Notebookcheck Logo
, , , , , ,
search relation.
, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,
 

AI features accelerated by Google Tensor that make Pixel 6 and Pixel 6 Pro smarter than any Android listed

Features like Magic Eraser are made possible due to the AI prowess of the Tensor SoC. (Image Source: Google)
Features like Magic Eraser are made possible due to the AI prowess of the Tensor SoC. (Image Source: Google)
The Google Tensor SoC enables the Pixel 6 and Pixel 6 Pro to leverage several advanced AI and ML capabilities to enhance various aspects of smartphone usage such as photos, videos, transcription, and translation. The Tensor SoC accelerates these AI-driven features while ensuring privacy and also being economical on the battery.

Google has been traditionally using Qualcomm SoCs for its Pixel lineup, but all that changes with today's announcement of the Pixel 6 and Pixel 6 Pro. Google is now aiming for more real-world benefits using AI and machine learning (ML) with its custom-built SoC called Tensor. According to Google, Tensor is designed to cater to not only today's AI models but also future ones as well.

Improved speech and transcription

Google said that Tensor was built in collaboration with Google Research for accelerating speech, language, imaging, and video capabilities. Tensor enables capabilities such as highly accurate Automatic Speech Recognition (ASR) and Live Translate without greatly impacting battery life. Third-party messaging apps such as WhatsApp can leverage Live Translation without users having to copy-paste to and from Google Translate.

Tensor's ML abilities also allow Google Assistant to answer incoming calls via Google Call Screen. Google Assistant can now play the waiting part while contacting customer support and allow selecting tree menus more intuitively. It listens whenever the operator places the call on hold and alerts when a human responds on the line. 

Google Assistant can now also perform contextual voice typing and identify the correct spelling for similar sounding names on-device. There's also an Interpreter Mode that lets users converse in their own language while the phone does the job of an interpreter and plays back the translation instantly on the speaker. The Pixel 6 phones can also translate and provide live captioning of media in real-time and on-device.

Motion Mode

Tensor also enables new computational photography features such as Motion Mode. Motion Mode is comprised of two feature subsets viz. Action Pan that focuses on a moving object and Creative Blur that intelligently blurs the background. Also available is a Long Exposure option that enables users to easily take light trails at night or smooth waterfalls without having to use a complicated camera setup.

Magic Eraser

Magic Eraser in Google Photos is another feature that makes good use of Tensor's AI abilities. Magic Eraser allows easy removal of "photobombs" or stray objects or people in photos after they have been taken. Users can mark which objects to remove manually or let Google Photos offer its own suggestions. 

Face Unblur

Another interesting feature that benefits from Tensor's AI prowess is Face Unblur that can recognize and correct blurry photos of subject faces, particularly those of kids. Data from four machine models is used together to achieve the end result. Google said that it unfortunately does not work on pets for now, though it does work on video, which has traditionally been highly resource-intensive process.

Face Unblur works by tapping into a Google Research AI model called FaceSSD that detects a face in the scene even before taking the photo. If it finds the the face blurry, it fires up the ultrawide to take a fast exposure shot.

The algorithm works by combining images from the normal exposure, low noise primary camera and the fast exposure, high noise ultrawide to give the best of both scenarios. Any remaining blur is further analyzed and removed by the AI as well.

Real Tone

Back when the Pixel 6 series was first announced in August, Google also highlighted that it was working on using computational photography to offer a more equitable representation of diverse skin tones. Tensor uses new HDR algorithms to natively offer Real Tone skin color representation from the get go.

HDRnet

For video, Google has developed the HDRnet algorithm parts of which are embedded directly into the Tensor ISP. HDRnet works with all video formats and allows the Pixel 6 Series to capture 4K60 video with accurate tone mapping and vivid colors. 

Check out the Pixel 6 launch video below for a demonstration of the above features and more.

Buy the Spigen Ultra Hybrid case for the Google Pixel 6 Pro on Amazon

static version load dynamic
Loading Comments
Comment on this article
Vaidyanathan Subramaniam
Vaidyanathan Subramaniam - Managing Editor - 1603 articles published on Notebookcheck since 2012
Though a cell and molecular biologist by training, I have been drawn towards computers from a very young age ever since I got my first PC in 1998. My passion for technology grew quite exponentially with the times, and it has been an incredible experience from being a much solicited source for tech advice and troubleshooting among family and friends to joining Notebookcheck in 2017 as a professional tech journalist. Now, I am a Lead Editor at Notebookcheck covering news and reviews encompassing a wide gamut of the technology landscape for Indian and global audiences. When I am not hunting for the next big story or taking complex measurements for reviews, you can find me unwinding to a nice read, listening to some soulful music, or trying out a new game.
contact me via: @Geeky_Vaidy
Please share our article, every link counts!
> Notebook / Laptop Reviews and News > News > News Archive > Newsarchive 2021 10 > Here are all the AI features accelerated by Google Tensor that make Pixel 6 and Pixel 6 Pro smarter than any Android on the market
Vaidyanathan Subramaniam, 2021-10-20 (Update: 2021-10-22)