Once your gyno is reduced/cured completely you should be able to start the cycle as soon as you come off the SERMs/AI. You don't need to take time off from SERMs (when used for gyno reduction) because it wouldn't matter anyway
SERMs artificially boost testosterone production, and orals will shut your production down anyway. So, bottom line, you wouldn't really gain or lose anything by waiting a few weeks before starting the oral; either way test production will be in the shitter once the cycle gets going, and you'll have to PCT with a SERM again.
Ultimately it's your call to make, on some level it's good to give your body a break from ALL chemicals from time to time to maintain natural equilibrium as much as possible, but every situation is case-dependent since everybody has different circumstances and every physiological response is unique to the individual.
physiological=psychological+physical (body+mind); every snowflake is different
Feel it out and do what you think is best in your situation