Relevant excerpt to on-going discussion from an audio drama from vol. 10, doesn't have any spoilers regarding the main story. It deals with a table top RPG that Ainz plays with his guardians:
Spoiler for LN vol. 10 Drama CD excerpt:
[...]
Albedo: Humans are not like ourselves. They were not born with the purpose of serving the Supreme One.
Albedo: And if they continue living like that
Albedo: They will end up leading an empty existence like those bandits.
Albedo: However, by pledging allegiance to Ainz-sama
Albedo: By harboring love in their hearts and fighting for Ainz-sama
Albedo: Even such insignificant humans
Albedo: Can bring forth a strength which exceeds their own.
Demiurge: In that case, even humans can have a use.
Demiurge: I trust that is what you wanted us to take away from this, Ainz-sama?
Aura: After all, if we didn’t play this game
Aura: We’d simply dismiss humans as unimportant and kill them off.
Mare: Anyone from any race can be a comrade of ours as long as they have the same purpose as we do.
Mare: Even human beings. Right, nee-chan?
Chair: Well, if anyone’s audacious enough to not swear loyalty to Ainz-sama
Chair: It doesn’t matter what happens to them. Is that right?
Ainz: Eh, ah? Ah, yes!
Ainz: Well done, all of you. I have to hand it to you for realizing that.
Everyone: Truly, we expected nothing less of the Supreme One, Ainz-sama!
[...]
With this it should be pretty clear that as long as humans are under Ainz's rule, the guardians will probably not move against them.