Well look at smoker ... the guy is really strong even though he has a devil fruits power. And Luffy too ... he's stretchy but still strong.
Example: Zoro had a boulder around his neck when he was training as a kid.
Kuro didn't have any devil fruit powers either but somehow he was quite fast.