Yeah, he has this complex going on and some people flat out call him useless or at least lacking chivalry. He still better than run of the mill warrior due to knight-class equipment, limited magic skill, and terrain adaptability, but that's about it. When he's forced to duel against top unit (elite knight or hero) or surrounded by large number of mooks by himself, then it's over.
He's supposed to be a hero called to fight demon, but since the summoner is greatly inexperienced, she call wrong person, and thus calling him, an otaku (not even talented mage like Rebecca).... who is relatively clueless and a total chicken.
In a bit of deconstruction, he failed to accomplish his task, causing great devastation to the small kingdom until Yuki and Brioche came to the rescue, he then went on a self-exile rather than choosing to return to earth, due to sheer guilt. From here, the real story start... so I guess he's somewhat faction-less at first.