Yeah sadly a lot of the older troops have to get disbanded or get guard duty because against tougher opponents they just don't have the attack power to make a dent.
Which isn't necessarily a bad thing. Sometimes I get a bit of a scare when enemy units pop out of the FoW, then I see that they're going to attack a city with old, veteran units and I'm like, yeah good luck, have fun trying to take that city.