GOAL: Investigate how the physicality of objects and different interaction techniques affect mixed reality interactions

Description: We conceptualized, designed, and evaluated whether users behave differently when interacting with physical and virtual objects. We also looked at how hand avatars and two different kinds of object manipulation techniques termed "pinch-to-grasp" and "stick-on-touch" affect these interactions. 

To investigate these factors, a custom peg board apparatus was built using birch sanded plywood, a bench drill press, and cylindrical wooden dowels that were spray painted.

Using Unity 3D, MRTK and the Hololens 2, we built a simulation and conducted a study to compare and understand how users' perceptions and interactions are affected when performing a peg transfer task where they transferred a ring from one peg to another.
No-Avatar, Physical pegs, Pinch-to-grasp interaction technique
No-Avatar, Physical pegs, Pinch-to-grasp interaction technique
Avatar, Virtual pegs, Stick-on-touch interaction technique
Avatar, Virtual pegs, Stick-on-touch interaction technique
Avatar-Gain, Virtual+Physical pegs, Pinch-to-grasp interaction technique
Avatar-Gain, Virtual+Physical pegs, Pinch-to-grasp interaction technique

You may also like

Back to Top