Apple AR: Apple Adds Much-Needed Vertical Surface Recognition in ARKit Update

Apple Adds Much-Needed Vertical Surface Recognition in ARKit Update

When Apple unboxes the next major update to its mobile operating system this spring, iPhones and iPads will gain some significant new features for augmented reality experiences: verticality.

In a preview of iOS 11.3 released on Wednesday, Apple unveiled details for iterative improvements in ARKit version 1.5, chief among them the ability to recognize vertical surfaces. The initial release of ARKit was limited recognizing to horizontal surfaces, which was enough to anchor AR content to floors and tabletops, but provided a challenge to developers looking to account for walls and doors in their AR experiences.

Room-scanning features, such as those in Pottery Barn's app, will improve with ARKit 1.5. Image by Pottery Barn/YouTube

For example, a room scanning app like Pottery Barn 3D Room Design, after discovering the floor of a room, requires users to tap at the base of the walls in order to estimate their location. Similarly, first-person shooter ARZombi asks players to mark the location of doors and windows, but the tracking is hardly accurate.

In addition to vertical surfaces, ARKit will also be able to map irregularly-shaped surfaces, such as round furniture.

ARKit's vertical surface capabilities will help games like ARZombi improve accuracy of door and window placement. Image by Tommy Palladino/Next Reality

Another welcome addition for developers is 2D image recognition. Some developers have already experimented with the CoreML computer vision APIs for AR experiences, so the integration of the capability with ARKit should make it easier to create image-based effects. Based on the update announcement, Apple imagines that some of the uses cases of this feature for developers might include bringing posters and paintings to life with ARKit.

ARKit 1.5 will also bring some overall quality of experience improvements with it. Apple promises a 50% increase in image resolution along with auto-focus to give AR content more realism. The sum of these added capabilities should result in more accurate room mapping (and fewer shortcuts) and better visual content.

Apple's iOS 11.3 update will be available to all users this spring, but a preview version is available today for anyone enrolled in the company's developer program, and the public beta preview version will follow shortly thereafter.

What are you looking forward to seeing with the next crop of ARKit apps and updates? Developers, how will these new capabilities improve your apps? Let us know in the comments below.

Just updated your iPhone to iOS 18? You'll find a ton of hot new features for some of your most-used Apple apps. Dive in and see for yourself:

Cover image via Apple

Be the First to Comment

Share Your Thoughts

  • Hot
  • Latest