Brave Improves Leo AI Performance with Mixtral

Brave announced today that it has integrated the Mixtral 8x7B large language model (LLM) with the Leo AI assistant in its desktop web browser. Released a month ago by Mistral AI, Mixtral 8x7B is open source and is now the default LLM in Brave Leo.

“Since its release, Brave Leo has been adopted by tens of thousands of free tier users and paid subscribers, and we expect even greater adoption as we expand our availability of LLMs to include Mixtral,” Brave co-founder and CTO Brian Bondy said. “Our aim is to create novel and convenient use cases in the context of users’ browsing sessions, and to help our users interact with the Web in groundbreaking ways.”

Brave announced Leo in August 2023, and it released the native AI assistant in Brave 1.6 in November. As you might expect, Leo can be used to summarize or provide answers about web pages, but it can also be used to create new content, translate content into other languages, and transcribe audio and video, and it can engage in conversations. It’s available for free in the desktop versions of Brave, but there’s also a Premium version for $15 per month that provides higher usage limits, access to better LLMs, and higher quality conversations.

As the default LLM in Brave Leo, Mixtral 8x7B is available to all users, free and Premium, and compared to the previous default LLM, it can handle larger contexts, interact in English, French, German, Italian, and Spanish, and can generate software code. And on that note, it now powers the recently released CodeLLM developer query service.

Mixtral 8x7B outperforms ChatGPT 3.5, Claude Instant, Llama 2, and many other LLLMs, and it offers reduced hallucinations and biases, according to the BBQ benchmark. But thanks to the open Leo architecture, users can also opt-in to Claude Instant from Anthropic or Meta’s Llama 2 13B. Or, they can go back to the Llama 2 LLM that was the previous default. And because this is Brave, Leo is private, anonymous, and secure. It doesn’t record chats, or use them for model training, and it doesn’t require an account or sign-in.

To access Leo, just type in the Brave address bar and click “Ask Leo” at the bottom of the search suggestions pop-down.

And here’s some good news: Leo is coming to the mobile versions of Brave on Android, iPhone, and iPad soon. As noted in the Leo roadmap, the goal is feature parity with the desktop versions of the browser.