Psst.. hey.. Itachi and Kisame left, and Gai took off on the pursuit! Unless he knew that Jiraiya was going to be there to encounter them, why would he go in pursuit of them without anbu members or other jounins?
Hrmm.. Hrrrrmmmmm..
His power is unparalleled.