News: FaceTime for iOS 13 Uses ARKit to Help Callers Pretend They Are Maintaining Eye Contact

FaceTime for iOS 13 Uses ARKit to Help Callers Pretend They Are Maintaining Eye Contact

You may soon add feigning eye contact to the list of ways that augmented reality is improving our lives.

In beta versions of iOS 13, FaceTime contained a new feature called "Attention Correction," which corrects the user's eye gaze to appear as though they are maintaining eye contact with parties on the other end of the video call. However, in the stable release of iOS 13, as well as subsequent iOS 13 updates, the new FaceTime feature was missing. Apple finally brought it back in the stable iOS 14 version.

Evidently, the secret sauce to the magic trick was none other than Apple's native augmented reality toolkit, ARKit. According to Dave Schukin, co-founder of Observant AI, the new Attention Correction feature used ARKit's face-tracking abilities and the iPhone's TrueDepth camera depth-sensing powers to virtually modify the user's eye position.

Images by Dave Schukin/Twitter (1, 2)

Schukin, whose company develops technology that tracks a driver's eye gaze, shared the discovery on Twitter during iOS 13's beta phase. By passing an object in front of his face, warping around the eyes reveals that FaceTime is using a virtual mask to create the illusion of undivided attention.

In response to another Twitter user, Schukin confirmed that the effect was like a Snapchat filter, but a more accurate one thanks to the TrueDepth camera on the iPhone X, XS, and 11 series.

If we have room for another analogy, it's kind of like a high-tech version of drawing eyes on your eyelids so your teacher doesn't think you're sleeping in class. Moreover, it is a very clever application of augmented reality in general, where the ultimate benefit is not the technology itself, but the outcome it generates.

In other words, while face filters are fun, give me something truly useful, like Attention Correction! We're not sure if Apple plans on adding the feature back into iOS in a future update, but why not, especially since it had an off switch in FaceTime's settings.

It’s Cyber Monday on WonderHowTo! Don’t miss out on all the big sales in the Gadget Hacks shop and Null Byte shop. Use code CMSAVE20 to save on everything, and use CMSAVE40 for all things apps and software. For online courses, apply code CMSAVE70 for the biggest discounts.

Check out all of Gadget Hacks' CM 2020 deals >

Check out all of Null Byte's CM 2020 deals >

Cover image via Apple/YouTube

Join our AR community

Get the latest in AR — delivered straight to your inbox.

Be the First to Comment

Share Your Thoughts

  • Hot
  • Latest