Google Chrome Introduces AI-Powered Search with Google Lens

Google Chrome Introduces AI-Powered Search with Google Lens: Visual Search, Product Comparison, and Conversational History

Google is introducing new AI features into its Chrome browser, improving the browsing experience across multiple platforms, including ChromeOS, Windows, macOS, and for the first time, Linux. Here’s a comprehensive look at these upcoming features:

Search with Google Lens

Google is rebranding its “Circle to Search” feature as “Search with Google Lens” and expanding its availability. Initially launched on Samsung’s Galaxy S24 smartphones, this feature is now coming to the Chrome browser and ChromeOS. For now, it is available in beta versions of ChromeOS 127 and Chrome 128 for Windows and macOS, with a wider rollout expected soon.

How it Works on Windows and macOS: Users can access “Search with Google Lens” through the three-dot menu. This allows them to select an area on their screen, effectively circling it, to trigger an instant search. The results are displayed in a side panel, enabling users to continue browsing while viewing the new information.

How it Works on ChromeOS: Users can use the Google Lens icon in the address bar to perform the same functionality. Google’s release notes for Chrome 128 beta describe it as a tool that makes it easy to search anything visible on the screen, whether it’s a video, a slide in a livestream, or an image on a webpage. Google Lens will provide answers directly in the tab, enhancing the browsing experience with quick, relevant information.

Enhanced Visual Search

Google Lens, built-in into the Chrome desktop browser, allows users to search for visual content directly from their screen using a simple motion. This feature lets users highlight any part of a webpage, be it text or images, to find visually similar results. Searches can be refined based on color, brand, and various other specifics, with the option to ask follow-up questions for a more detailed exploration of a topic.

Product Comparison with Tab Compare

Another exciting addition is the “Tab Compare” feature, designed to simplify the online shopping experience.

  • Functionality: This feature uses AI to generate comparison tables for products across multiple open tabs. Users often switch between tabs to read reviews and compare prices. Tab Compare combines key details such as product specifications, features, prices, and ratings into a single view, eliminating the need for constant tab switching. This allows users to easily compare options and make informed purchasing decisions.
  • User Experience: As users browse different product pages and reviews, Chrome will offer to generate a comparison table, pulling out essential data and presenting it in one combined view. This feature is expected to be particularly beneficial for those who do extensive online shopping.

Natural Language Search for Browsing History

Google is also improving Chrome’s search history capabilities with AI, allowing users to find previously visited websites using natural language queries.

  • How it Works: Users can access their history and type a query like, “What was that ice cream shop I looked at last week?” Chrome will then show relevant pages from the browsing history. This feature is optional and can be easily turned on or off in the settings. Importantly, it will not include any data from incognito mode.
  • Potential Use Cases: This natural language search interface aims to be smart enough to understand the context of the user’s queries. For instance, if a user read several reviews about a specific movie, watched its trailer on YouTube, and checked various shopping links, they could ask Chrome specific questions about their history, like “What was the cheapest price I saw for that 1980s film last week?” This feature promises to saves a lot of time by pulling up similar matches from the user’s browsing history based on conversational phrases rather than just keywords.

Rollout and Availability

These new AI-Powered tools are rolling out in stages, starting with the U.S. and expanding to other regions soon after. Currently, only the improved visual search feature (Google Lens) is available in Chrome 127 for users in the UK, with the Tab Compare and natural language history search features to follow in the coming weeks.

Additional Context

Google’s integration of AI into Chrome takes the advantage of the latest advancements in Google AI and Gemini models. These updates aim to make web browsing more intuitive, efficient, and user-friendly, showing Google’s ongoing commitment to improving its products with powerful technology.

In the meantime, Google is also preparing to introduce its flagship smartphone series, the Pixel 9, on August 13, highlighting the company’s broader strategy to integrate AI seamlessly across its ecosystem of devices and services.