Google Lens Will Bring Vision-Based Object Identification to Your Phone

Google Lens Will Bring Vision-Based Object Identification to Your Phone

Google this week introduced a new set of Google Lens technologies that can visually identify objects in the real world.

Google CEO Sundar Pichai explained during this week’s I/O keynote how the firm has made major strides in computer vision technology, and that these advances would impact a variety of its products and services. Google Photos is an obvious example, and this app will soon be able to remove unwanted elements in photos in a way that requires experience with powerful tools like Photoshop.

Windows Intelligence In Your Inbox

Sign up for our new free newsletter to get three time-saving tips each Friday — and get free copies of Paul Thurrott's Windows 11 and Windows 10 Field Guides (normally $9.99) as a special welcome gift!

"*" indicates required fields

This field is for validation purposes and should be left unchanged.

But as impressive, Google has also announced a new “initiative” called Google Lens. Yes, I know this sounds like Office Lens at first, both because of the name and its vision-based functionality. But Google Lens is actually a lot more like Samsung’s Bixby Vision, and provides general purpose visual recognition. (It’s also sort of a successor to Google Goggles.)

“Google Lens is a set of vision-based computing capabilities that can understand what you’re looking at and help you take action based on that information,” Pichai explained. “We’ll ship it first in Google Assistant and Photos, and it will come to other products.”

In a demo, Pichai showed how Lens might work: You point your phone’s camera at an object, and Google Lens will tell you what it is. In the demo, he used a flower, and Google Assistant explained what kind of flower it was. But another demo got an even bigger cheer: You can point the camera at the sign-in information on the back of a wireless router and Google Assistant will recognize the SSID and password and then actually sign the device into the network.

More impressive to me is Google Lens’s ability to identify locations like stores out in the world: You will be able to point your phone at a store or other location and a Google Maps card for that location will pop-up, letting you learn more instantly.

Google Lens capabilities will be added to Assistant and Home “in the coming months,” Google says.

Tagged with

Share post

Please check our Community Guidelines before commenting

Conversation 15 comments

  • Waethorn

    18 May, 2017 - 8:51 am

    <p>This sounds an awful lot like a rebrand of Google Goggles.</p>

    • DavidCKWalker

      18 May, 2017 - 9:38 am

      <blockquote><a href="#117689"><em>In reply to Waethorn:</em></a></blockquote><p>Goggles involved no ML and only used structured data </p>

      • skane2600

        19 May, 2017 - 11:12 am

        <blockquote><a href="#117705"><em>In reply to DavidCKWalker:</em></a></blockquote><p>If by ML you mean Machine Learning, it's worth keeping in mind that as a practical matter only a very tiny subset of real-world object "examples" can be trained for. </p>

  • Demileto

    18 May, 2017 - 8:53 am

    <p>"Google Googles"? LOL, they seriously named that one of their products? ?</p>

  • George Rae

    18 May, 2017 - 9:28 am

    <p>Not hot dog.</p>

  • gregsedwards

    Premium Member
    18 May, 2017 - 9:39 am
    • Elindalyne

      Premium Member
      18 May, 2017 - 11:23 am

      <blockquote><a href="#117706"><em>In reply to gregsedwards:</em></a></blockquote><p>Apparently that's an actual app…</p>

  • SvenJ

    18 May, 2017 - 10:29 am

    <p>Anyone remember Bing Vision? Early implementation of the same thing. I could point my phone camera at a book, DVD, assorted other stuff and Bing would recognize it and provide option of what to do, look up more info, buy it from Amazon, etc. As usual, MS was out ahead, and stopped to take a break while everyone else ran by. There should still be a little Bing Vision eye next to the music recognition note when you open Bing. </p>

    • BoItmanLives

      18 May, 2017 - 3:41 pm

      <blockquote><a href="#117713"><em>In reply to SvenJ:</em></a></blockquote><p>Bing vision? I don't even remember Bing.</p><p>That said, Google goggles existed before everything. Google Vision is just that idea more fully realized and properly implemented.</p>

    • Bats

      18 May, 2017 - 4:13 pm

      <blockquote><a href="#117713"><em>In reply to SvenJ:</em></a></blockquote><p>Bing Vision copied Google Goggles.</p>

  • Chris Lindloff

    18 May, 2017 - 11:24 am

    <p>Things like this, Google Home, Google Assistant, Cortona, Siri and Alexa are years from being really useful and used by many. All of them are just two slow and not intuitive. I can type my questions faster in most cases.</p><p><br></p><p>This is not to say they are bad or not fun/cool new tech. However I just don't use them after playing with them. The only one I regularly use is my echo for Music as I have Amazon Music Unlimited.</p>

    • BoItmanLives

      18 May, 2017 - 3:42 pm

      <blockquote><a href="#117724"><em>In reply to Chris Lindloff:</em></a></blockquote><p>"I don't use them therefore why does anyone else"? That it? </p><p>Theyre extremely useful, and for anything they lack, well it all has to start somewhere. Walk before run.</p>

  • chrisrut

    Premium Member
    18 May, 2017 - 12:31 pm

    <p>OK, well then, wow.</p>

  • skane2600

    19 May, 2017 - 11:07 am

    <p>Hasn't Google had object identification for a number of years? As I recall it was quite hit and miss. </p>

  • Athena Azuraea

    19 May, 2017 - 2:47 pm

    <p>"<span style="color: rgb(0, 0, 0);">But another demo got an even bigger cheer: You can point the camera at the sign-in information on the back of a wireless router and Google Assistant will recognize the SSID and password and then actually sign the device into the network."</span></p><p><br></p><p><span style="color: rgb(0, 0, 0);">If that works, then you've got a problem. Lesson nr 1 when purchasing a router: Change the default password.</span></p>

Windows Intelligence In Your Inbox

Sign up for our new free newsletter to get three time-saving tips each Friday

"*" indicates required fields

This field is for validation purposes and should be left unchanged.

Thurrott © 2024 Thurrott LLC