On one hand, I think this is not so unexpected. these guys are trained to be warriors, an army. Here they’re being asked to act as a police force/guards, to react rather than act - a completely different set of skills. Plus, they don’t know the terrain of the city as the Sons of the Harpy do.
Put the Unsullied in an open field against an army and they’ll stand toe-to-toe with anyone. .