Header Banner
Next Reality Logo
Next Reality
Augmented & Mixed Reality News, Rumors & Dev Guides
nextreality.mark.png
Apple Snap AR Business Google Instagram | Facebook NFT HoloLens Magic Leap Hands-On Smartphone AR The Future of AR Next Reality 30 AR Glossary ARKit Dev 101 What Is AR? Mixed Reality HoloLens Dev 101 Augmented Reality Hololens How-Tos HoloLens v. Magic Leap v. Meta 2 VR v. AR v. MR

Dev Report: A Breakdown of the What Apple's New ARKit Can Do for iPhones & iPads

Jun 7, 2017 05:50 PM
Jun 7, 2017 09:50 PM
Hand holding a smartphone displaying a digital billboard with the text "Next Reality."

At Apple's yearly event, the World Wide Developers Conference, the tech giant finally announced their decision to enter the augmented reality space. Through adding basic AR functionality to the beta release of Xcode 9, the development environment for Mac computers, as well as their line of iOS devices, the company has said they understand the importance of the tech.

Rumors have spread for some time about Apple, hiring lots of new engineers to boost their AR game. Even recently hiring Jeff Norris, pulling him not only away from NASA, but also taking him away from working on some amazing projects for the Microsoft HoloLens. So with all of these rumors and great expectations, the announcement of some new AR functionality added to the iOS SDK was a little underwhelming.

So What Exactly Does the New ARKit Add to iOS?

Well, let's unpack that.

Using only the RGB cameras and other sensors built into iPhones, along with a technique called visual-inertial odometry, or combining information from the device's motion-sensing hardware and computer vision through the device's camera, Apple has added a version of world tracking and virtual object anchoring that is comparable to some of the depth sensors that exist. Considering the lack of additional hardware the tracking is really impressive.

Jason Odom/Next Reality

In addition, through the use of hit-testing, world tracking can understand the scene it sees. At least, on a basic level. Using plane detection the iPhone can find flat surfaces in the camera view which will allow the user to place a virtual object on a table for example.

ARKit also does ambient light estimation, which allows the application to more accurately match its virtual lighting to the lighting in the area. This will provide a more seamless and immersive AR experience for the user.

Along with all of these new additions to their SDK, they have added in Unity and Unreal support. Unity has a bitbucket repository up with a plugin to enable all of the added ARKit functionality to Unity applications for iOS.

So while the revelations presented at WWDC may not be the new AR wearable some of us were hoping for, and a few expected, they have in a single move created the world's largest AR platform.

In a recent conversation, when asked about his thoughts on the rumors of the upcoming Apple reveal, the president and general manager of Vuforia, Jay Wright, let me know that this was what he expected, saying, "Somethings going on, we've seen signs long enough — enough's gone in, something ought to come out. I think we should expect further validation of AR going to mainstream."

For a developer, what this move means, is that finding real use-cases that have some value, whether for instruction and training, education, or entertainment, on a hardware platform with "hundred of millions of iPhones and iPads" leads to getting that power bill paid and clothes on the children. This move by Apple further confirms that AR is becoming a much larger part of the zeitgeist.

Will you be developing AR apps for iOS? Let us know in the comments below.

Cover image by Jason Odom/Next Reality

You already know how to use your phone. With Gadget Hacks' newsletter, we'll show you how to master it. Each week, we explore features, hidden tools, and advanced settings that give you more control over iOS and Android than most users even know exists.

Sign up for Gadget Hacks Weekly and start unlocking your phone's full potential.

Related Articles

Comments

No Comments Exist

Be the first, drop a comment!