[sky black swordman]

Originally Posted by XFire

The girls prefer it this way. They nearly bit Ise's head off when he made her cry, and they were all pretty happy when they started going out. So if you're asking if they'll break up and someone else will go out with Ise, then no, it's not happening.

For more specific reasons,

1. Asia - She's the "I want everyone to be happy" kind of person. She'd probably mentally collapse if a member of her family was excluded.
2. Akeno - She gets turned on by the whole "illicit affair" thing, and she likes teasing Rias.
3. Xenovia - She doesn't care. As long as she's with Asia and Ise (and gets his kid, eventually) she's happy.
4. Koneko - She's actually seems like the one in second place at this point, what with the proposal and all. Since she has to wait anyway, she doesn't particularly mind if Rias goes first.
5. Irina - She's too busy trying to decide if she likes him in the first place. And if she does "fall", she'll probably end up like Akeno.
6. Ravel - It feels like she's after the whole "master-servant" thing. So wants to be part of his harem, but saw Rias as the first wife from the beginning.

Well I still think he was not all at fault.

True, but Akeno took a big step (IMO) in the extra life chapter in volume 13 when she said.

Spoiler for Just in case you have not read it:

First a boy, then having a girl might be ideal. When I was thinking like that, Akeno-san started smiling while patting her stomach
“If it is your child, then I will bear as many as you want.”