I agree - which is a huge sway in favor of the player.
Subjectively I can't stand the idea of an entire turn only going 1 tile (i.e. stuck in a swamp). I've played a single game without master scouts and doubt I will again after like 400 hrs.
I would be fine removing mounted additional movement from the game if EVERY unit had a base move of 4 - but that trivializes terrain for players that can deal with it.
With a move of 4 - you can usually end up in combat every turn or a quest or at least make significant progress towards your goal. With a move of 2, life is painfully slow.
Unfortunately, the AI is generally limited to a move of 2 - so that's a HUGE player advantage in clearing, leveling, exploring, free loot.
I think I'll create a spell - forced march, enchantment - 30 mana, 2 maintenance, +2 moves, -20% hitpoints. Then I can get my key units with me, but pay a price for it. Now all I have to do is figure out how to mod a spell...