Header Banner
Next Reality Logo
Next Reality
Augmented & Mixed Reality News, Rumors & Dev Guides
nextreality.mark.png
Apple Snap AR Business Google Instagram | Facebook NFT HoloLens Magic Leap Hands-On Smartphone AR The Future of AR Next Reality 30 AR Glossary ARKit Dev 101 What Is AR? Mixed Reality HoloLens Dev 101 Augmented Reality Hololens How-Tos HoloLens v. Magic Leap v. Meta 2 VR v. AR v. MR

Apple AR: Move the AR World with Your Gestures in New Demo

Aug 22, 2017 03:20 PM
Aug 22, 2017 03:29 PM
Hands interacting with a laptop displaying a 3D cube and projection lines.

The future is here with a new demo made with Apple's ARKit and LeapMotion.

Typically, since ARKit works through your iPhone, in order to move augmented reality objects that are appearing on your screen, you have to drag them with your finger. However, developer Arthur Schiller is now playing around with how you can move augmented reality objects on your phone with gesture recognition, rather than by touching.

He stresses in his tweet that right now, this demo is just a proof of concept that he hopes will develop into a way to use gesture recognition for ARKit without using a VR/AR headset. The video shows an iPhone 7 connected to a MacBook that's using LeapMotion. An AR box appears when Schiller opens ARKit on his phone and with the MacBook doing the processing and streaming the motion data to the iPhone, Schiller is able to manipulate the box with his hand gestures. Though the gestures have to be basic as of now, he is able to flip, move and rotate the box.

This concept is incredibly promising for the world of mobile AR. Even though right now you can only use gesture recognition technology with ARKit using your MacBook, Schiller's demo opens up the possibility that one day we'll be able to manipulate the mobile AR world using gestures and without a headset.

Cover image via Arthur Schiller/YouTube

The next big software update for iPhone is coming sometime in April and will include a Food section in Apple News+, an easy-to-miss new Ambient Music app, Priority Notifications thanks to Apple Intelligence, and updates to apps like Mail, Photos, Podcasts, and Safari. See what else is coming to your iPhone with the iOS 18.4 update.

Related Articles

Comments

No Comments Exist

Be the first, drop a comment!