While I've never visualized it in quite that way, I have noticed occasional oddities in the Host/VM clock relationship.
I usually turn off the "Synchronize time" setting under "Advanced" in the Settings window. The clock doesn't stay synchronized between the two but that doesn't matter in my case. Not sure if it's important in your setup.
-Brian
