With extended reality(XR) headsets becoming increasingly popular and mobile devices with strong computing capabilities, XR developers have been on the mission to create techniques for visceral XR interactions. Early interactions in mobile XR expriences, used either a capacitive button on a cardboard VR headset or flat controls panel in the scene itself. When the HTC Vive and Oculus Rift first arrived, they came with their own haptic solutions. But as time past and more people began to see the impact of XR technology, more techniques for visceral XR interactions were formed.

Pantomime Everywhere

XR studio propelling visceral mobile XR interactions

The Pantomime Corporation has been at the forefront of the XR user-interface. Before the release of the pioneering XR headsets, Pantomime has been developing techniques to incorporate users devices to be used as an object that interacts with the scene. To put the device in the action. Essentially, “mobile user visit shared worlds, reach in and interact.”

Dr. David Levitt and Don Hopkins founded Pantomime in 2014, quickly achieving the Silicon Valley Launch Cup for Digital Media and Mobile. Dr. Levitt holds a MIT doctorate in AI, a B.S. from Yale and have patents for next-level XR environment interactions. If you ever played The Sims, then you have experienced the work of the founder and Chief Software Architect Core developer of the recognized game franchise, Don Hopkins. Eric Hedman is the Key Content Developer for the Sim’s franchise and its expansion packs, who is now the Content Lead for Pantomime. There is also a expert group of advisors assisting in Pantomime’s endeavors. A testament to their dedication for advancing XR tech.

Pantomime’s Creatures- Real-Time Augmented Reality

Pantomime has a fun way of showcasing visceral mobile XR interactions

They have XR games that showcases visceral XR interactions. Pantomime Creatues AR is one experience where people can feed, capture, scoop up and play with dinosaurs, right on their tabletop or a flat surface. The game incorporates shared gameplay through a shared Wi-Fi network. Players can see each other’s movements within the game. The actually framework of the game is practically flawless, making for seamless real-time virtual interactions. The dinosaurs can be scooped up, pushed and paddled with the smart-device itself. And they are quite alive, chasing food, flying and making noises.

When playing Creatures AR, players tilt, turn and swing their devices for in-game motions. If want to paddle a dinosaur, then simply paddle them with the tablet of smartphone rather than pressing button on screen to initiate the maneuver. Though there is a flat UI that provides players additional options for gameplay. Using either 1, 2 or 3 fingers, players can tap the screen, sending either food or snowballs at the dinos. The same combination of fingers can be used to navigate within the scene through swipe gestures. The combination of a flat UI and in-game smart-device makes for seamless intuitive gameplay. This implementation of the smart device enables players deeper interactions within the XR scene.

Lenovo Y50 in Pantomime’s Virtual Worlds

Continuing to optimize augmented reality features

Pantomime’s device-tracking tech can replicate the shape and size of the users device in the game. As stated by them, people “can accurately reach into first person 3D worlds with most any mobile device, join other people in them, and see into them through… flawless screens that increasingly surround us.” And indeed they’ve accomplished this objective. With their propelling effort for more visceral XR interactions, they are undoubtedly pushing what’s possible for immersive mobile experiences. It true, they are showing us all what’s possible from Around Your Screen.

Thank you for reading!

P.S.- Possibly Legacy Studio