I’ll try to find it later but one indie dev is making exactly this, where you construct elaborate machines by recording movements and item interactions in VR.

Edit: The Last Clockwinder https://store.steampowered.com/app/1755100/The_Last_Clockwin...

Support indie devs making cool stuff like this!