Microsoft Pix for iOS Update with More AI Smarts

Posted on September 14, 2017 by Paul Thurrott in iOS, Mobile, Music + Videos with 7 Comments

Microsoft Pix for iOS Update with More AI Smarts

Microsoft’s Pix camera app for iOS has been updated to automatically detect whiteboards, documents, and business cards in real time.

“Microsoft Pix is pushing the boundaries of image understanding, using AI to take better pictures of everything from a snapshot of your kid in new sneakers to the whiteboard in your morning meeting,” Microsoft’s Josh Weisberg said. “The intelligent camera app now automatically detects whiteboards, documents, and business cards in real time and intelligently adjusts camera settings for these types of photos.”

In a related post to the Microsoft AI Blog, Microsoft’s John Roach explains how the firm has improved the app, which has used AI since its inception to take better photos. (The app also received a major update this past June that added fun painting effects.)

“We all use our cameras to take photos of more than just people and places,” Roach writes. “Now, you can use the smartphone camera app to take better pictures of documents, whiteboards and business cards, too.”

The update to Pix addresses what Microsoft says was a key customer request. When you focus on an object it recognizes—again, whiteboards, documents, and business cards—it uses AI to improve the resulting image by cropping edges, boosting color and tone, sharpening focus, and tweaking the angle to render the image in a straight-on perspective.

Many will note that this is similar to how Office Lens works as well. But Microsoft says that the two apps are complementary.

“Office Lens remains the best tool to easily integrate productivity images across the suite of Office products, while Microsoft Pix is out front pushing the boundaries of using AI to take better pictures of everything from a snapshot of your kid in new sneakers to the whiteboard in your morning meeting,” Mr. Roach notes. “The research thrust behind Microsoft Pix informs innovation across apps, including Office Lens.”

Microsoft Pix is available for free from the Apple Apps Store.

 

Tagged with

Join the discussion!

BECOME A THURROTT MEMBER:

Don't have a login but want to join the conversation? Become a Thurrott Premium or Basic User to participate

Register
Comments (7)

7 responses to “Microsoft Pix for iOS Update with More AI Smarts”

  1. Avatar

    markbyrn

    gee, where's the Android version?

  2. Avatar

    lvthunder

    What? So what's the difference between Pix and Office Lens again?

  3. Avatar

    Delmont

    This app is pretty cool. I just wish more people knew about. Besides Microsoft employees, I haven't come across one tech/I.T. person that has ever heard of this app.

  4. Avatar

    Ryan Dennis

    I was waiting for the update. Glad its finally happening more info

  5. Avatar

    arikan

    Thanks for the update man. I would like to know more about XModGames on iOS after latest iOS update.

  6. Avatar

    Maxpayne

    I am truly amazed by the results of this camera application. I wonder why haven’t they released an android version of the same yet? I believe that there will be more users than iOS users who will be so thrilled to use this application.

    river ranch resort 55 rv parks texas

  7. Avatar

    nbplopes

    Just downloaded it. Put a paper on top of my couch. Camera parallel to the couch, nothing. Only cought the paper in a slant. Guess the AI needed something a little more challenging before it decided to use its "brains" :(

Leave a Reply