Microsoft’s Bing Chatbot Adds Visual Search Support

Microsoft’s Bing chatbot is one of the highlights of the company’s Inspire partner conference that kicked off this morning. The software giant has just announced Bing Chat Enterprise, which is rolling out in preview for Microsoft 365 E3, E5, Business Standard and Business Premium customers. For consumers, Microsoft also announced that its Bing chatbot is getting support for visual search.

With Visual Search, Bing users can now upload images to the chatbot and prompt it to search the web for related content or create new content based on that image. Visual Search is leveraging OpenAI’s GPT-4 model under the hood, and this is pretty much a brand-new way to use the chatbot.

In the video below, you can see an example of using Bing Chat to create HTML code based on a project management sketch.

“Bing can understand the context of an image, interpret it, and answer questions about it. Whether you’re traveling to a new city on vacation and asking about the architecture of a particular building or at home trying to come up with lunch ideas based on the contents of your fridge, upload the image into Bing Chat and use it to harness the web’s knowledge to get you answers,” the company explained today.

Visual Search in Bing Chat is just starting to roll out on desktop and the Bing mobile app. Microsoft is planning to make it available on Bing Chat for Enterprise in the future.