During Upgrading or downgrading process of fusion, your virtual machines reamain untouched. Hence its safe to downgrade.
Before downgrading fusion, you must ensure to set compatibility to 4 .
To do that shut down (not suspend )windows virtual machine . Then Go to virtual machine >settings> compatibility and choose version 4 or higher.
Once set, you may go ahead and install fusion 4.