Moving a rotating Collision Block messed up its position.

I'm trying to create a level with a rotating collision block. I have both the collision block and a block with no collision rotating around a center object. Both of them have the same groups added to them. The whole system is also moving with the player and downwards. For some reason, the collision block seems to move differently from the other block and is somewhat offset. Enabling "Lock Object Rotation" doesn't help. Is there any way to fix this?

Before movement:

After movement:

(Slightly offset)