Header Banner
Next Reality Logo
Next Reality
Mobile AR News
nextreality.mark.png
Apple Snap AR Business Google Instagram | Facebook NFT HoloLens Magic Leap Hands-On Smartphone AR The Future of AR Next Reality 30 AR Glossary ARKit Dev 101 What Is AR? Mixed Reality HoloLens Dev 101 Augmented Reality Hololens How-Tos HoloLens v. Magic Leap v. Meta 2 VR v. AR v. MR

Apple Continues Assembling AR Arsenal with Acquisition of Spektral's Background Removal Tech, Report Says

Oct 12, 2018 12:00 PM
Woman with glasses using a smartphone in a cozy indoor setting.

Adding another arrow to its quiver of augmented reality acquisitions, Apple has reportedly acquired Spektral, a computer vision company with technology for real-time compositing (otherwise know as the "green screen" technique in broadcast TV and film).

According to Danish newspaper Børsen (subscription required), Apple actually bought the company, founded as CloudCutout by Toke Jansen and Henrik Paltoft, late last year for $30 million. Jansen's LinkedIn profile shows that he has served as manager of computational imaging for the company since Dec. 2017.

Spektral's technology applies machine learning and spectral graph theory (the study of connections on a graph) to remove backgrounds from images and videos in real time.

With an equation that represents the layers in an image, the technology solves for unknown values in each pixel. This results in 16.8 million unknown values in each frame, and Spektral solves for these unknowns 60 times every second. Spektral is capable of compensating for fine details and fast motion with the same approach.

"The human visual system is extraordinary at recognition, segmentation, and compositing, simply through thought. Researchers have for decades been intrigued by these remarkable skills, and have therefore tried to build computer systems with similar properties," the company's website states. "This is notoriously a very challenging problem, but recently, computers are able to reach human precision in certain recognition tasks. With no doubt this trend is bound to continue, bridging the gap between human cognition and artificial intelligence. The implications of these advances pave the way for new business models, as tasks that previously required human intervention can now be solved automatically by algorithms."

Apple actually introduced a similar background-removing feature in its Clips app, though the feature requires the TrueDepth camera on the iPhone X. Google has also developed a method for changing video backgrounds using neural networks, while Facebook and Snapchat offer background segmentation.

Nonetheless, Spektral joins a formidable stockpile of Apple's augmented reality talent and tools, including AR display maker Akonia, headset maker Vrvana, and Flyby Media (which developed the code behind ARKit).

Cover image via Apple/YouTube

You already know how to use your phone. With Gadget Hacks' newsletter, we'll show you how to master it. Each week, we explore features, hidden tools, and advanced settings that give you more control over iOS and Android than most users even know exists.

Sign up for Gadget Hacks Weekly and start unlocking your phone's full potential.

Related Articles

Comments

No Comments Exist

Be the first, drop a comment!