Apple Patents Expression Tracking System for Mixed Reality Headset

Apple has been reportedly working on its own AR/MR headset for a while now. There still isn’t any concrete information as to when the company plans on revealing its AR/MR headset to the world, but recent reports suggested a potential 2020 release.

And that could turn out to be very accurate, especially according to a new patent. Variety reported on Tuesday about a new patent from Apple, first filled in March of this year, and published last week. The patent, titled “Display System Having Sensors“, outlines a system that will allow a head-mounted display to capture gestures and expressions of a user.

Apple has pretty much mastered facial expression tracking on the iPhone with the latest iPhones’ facial tracking sensors, but it’s obviously harder to implement that on a headset that’s mounted on the user’s actual face. You can’t use external cameras unless Apple used external camera units like some of the early VR headsets, and that’d obviously not be very Apple-like. And so, the new patent outlines a system that would allow the head-mounted display to use a range of sensors on the headset itself that gather user’s facial expression data like jaw tracking and eyebrow tracking which could be combined together for a full facial expression tracking system.

The same system could even be used for biometric authentication on the headset, according to the patent.

The patent also confirms recent rumors of how Apple’s mixed-reality headset will work. The patent talks about a system that uses cameras to capture the user’s real-world, layering virtual elements over the captured world, and then displaying the completed image to the user via actual displays. That actually sounds kind of smart, especially considering the fact that other augmented reality headsets like the Microsoft HoloLens do that very differently. The same system could give Apple’s headset the opportunity to produce a better quality image than we have seen on the HoloLens, and that will be a clear edge for Cupertino.

Tagged with

Share post

Please check our Community Guidelines before commenting

Conversation 5 comments

  • dontbe evil

    23 July, 2019 - 6:53 am

    <p>hassan cannot wait to give all his money to apple for the FIRST INVENTED, REVOLUTIONARY MR headset</p>

    • bellbm

      23 July, 2019 - 12:15 pm

      <blockquote><em><a href="#444441">In reply to dontbe_evil:</a></em></blockquote><p><br></p><p>Why are you so nasty?</p>

      • dontbe evil

        23 July, 2019 - 2:23 pm

        <blockquote><em><a href="#444481">In reply to bellbm:</a></em></blockquote><p>when he'll start to write objective articles, and not apple fan boy clickbait title, I'll change my clickbait comments </p>

        • bellbm

          23 July, 2019 - 3:11 pm

          <blockquote><em><a href="#444495">In reply to dontbe_evil:</a></em></blockquote><p><br></p><p>How can you read the title and content of this article and think of it as anything other than straightforward and matter-of-fact?</p><p><br></p><p><br></p>

          • dontbe evil

            24 July, 2019 - 3:28 am

            <blockquote><em><a href="#444500">In reply to bellbm:</a></em></blockquote><p>it's not this article, it's ll of his article, just check how the title and article changes if something is about apple or someone else, they're facts </p>


Stay up to date with the latest tech news from!

"*" indicates required fields

This field is for validation purposes and should be left unchanged.

Thurrott © 2023 BWW Media Group