There are a number of places where you can swap to abuse the game. One is moving leaders around between factions. There's a faction that gives you benefits at the galactic bazaar and there is zero reason to keep a leader there when you are not actively shopping.

I like the Civ VI mechanic of not being able to change policy cards unless there is some broader change like researching a civic, changing your government, the end of an era, or paying cash. That exact mechanic isn't exactly applicable here, but I'm sure there is something similar that could be achieved.

IDEA: How about once a year you can move your leaders, swap policy cards, change your tax rate, and maybe even spend ideology points? You could also spend control to unlock this, resetting the clock to zero. Then you don't get stuck when there is a crisis like your neighbor's psychotic leader deciding to invade you. I also hate getting stuck with a suboptimal governor and enraging my entire empire if I fire the person.

In general, I don't think it is good for gameplay to be able to tweak these things every turn. If the AI can do these things indiscriminately, then the player will want to do the same thing to keep up at higher difficulty levels. I remember constantly tweaking the tax rate in GC I/II. It's probably better for pacing to make this an occasional thing.