Google Gave the Pixel 8 Cameras a Major Upgrade. Here’s How They Did It

With its Pixel 8 and Pixel 8 Pro smartphones, Google is bringing its big guns to the battle for smartphone photo and video leadership. Among more than a dozen notable improvements coming to the Android phones is a tool called Video Boost that uses AI processing on Google’s server-packed data centers to dramatically increase image quality.

When you first shoot a video on the Pixel 8 Pro, you’ll have just a 1080p preview version. But during a couple hours or so for uploading and processing, Google uses new artificial intelligence models too big for a smartphone to improve shadow detail, reduce pesky noise speckles and stabilize the video. That means Google’s Night Sight technology, which in 2018 set a new standard for smartphone photos taken in dim and dark conditions, has now come to video, too. Or at least it will when Video Boost ships later this winter.

“Night Sight means something very big to us,” said Isaac Reynolds, the lead product manager in charge of the Pixel cameras. “It is the best low-light smartphone video in the market, including any phones that might have recently come out,” he said in an unsubtle dig at Apple’s iPhone 15 models. But Video Boost improves daytime videos, too, with better detail and smoother panning.

Instead, the dual conversion gain technology is able to simultaneously capture details from both low-light and bright areas of a scene pixel by pixel, then blend the best of both. The result: “Whether it’s a high-contrast scene or a low-light scene, you’re going to see dramatically better performance versus the Pixel 7 and Pixel 7 Pro,” Reynolds said. “You don’t have to give up the dynamic range. That means less underexposure, which means less shadow noise.”

 The technology is on both the Pixel 8 and 8 Pro, but only the 8 Pro gets Video Boost.

Next is the new Tensor G3 processor, the third generation of Google’s Pixel phone processors. The G3 has more built-in Google circuitry for AI and image processing than last year’s G2, and Google uses it to produce two videos. One is the 1080p preview version you can watch or share immediately.

The other is the Video Boost version that’s uploaded to Google for more editing. The G3 preprocesses that video and, for each frame, adds up to 400 metadata elements that characterize the scene, Reynolds said.

The last Video Boost step takes place in Google’s data centers, where servers use newly developed algorithms for noise reduction, stabilization and sharpening with low-light imagery. That processed video then replaces the preview video on your phone, including a 4K version, if that’s the resolution you originally shot at.

Reynolds defends the video’s data center detour as worthwhile.

“The results are incredible,” he said. Besides, people like to reminisce, revisiting a moment through photos and videos hours later, not just months or years later. “I don’t think there’s any downside at all to waiting a couple of hours,” he said.

See the Pixel 8 and Pixel 8 Pro Up Close and Personal

+9 more
See all photos

It may be worth the wait, but the wait also might be longer than just a couple hours to pump gigabytes of video to Google. If you’re away from home Wi-Fi, you might be worried about blowing through your plan’s mobile data cap. And when you’re at home, you might be among the millions of people whose broadband doesn’t actually offer fast upload speeds.

If you’re nervous about sending your videos to Google’s cloud, Video Boost largely follows the same privacy policies Google already used. “If you delete the backed-up version after processing but keep it on-device, Google will not retain any copy,” Google said.  The difference is with intermediate versions of the video the company creates during Video Boost processing. Those are discarded once the new video is done.

More megapixels on Pixel 8 cameras

If you’re taking photos, the sensor doesn’t use the image sensor’s dual conversion gain technology — at least yet, though Google says it’s excited about the technology’s potential.

But there are other big improvements: Like Samsung and Apple, Google is now advancing beyond the 12-megapixel smartphone photo resolution we’ve had for years.

When Apple introduced its iPhone 14 Pro in 2022, it let photographers shoot 48-megapixel photos with the main camera. Samsung goes even further with a 200-megapixel sensor, though the results aren’t generally impressive beyond 50 megapixels. In comparison, even though the Pixel 7 and 7 Pro had 50-megapixel main cameras, Google offered photos at only 12-megapixel resolution. (Though it did offer 2x and 10x modes that took advantage of the full resolution of its sensors.)

This year, Google is leapfrogging Apple when it comes to pixel count on the Pixel 8 Pro. Not only can you take photos at the main camera’s full 50-megapixel resolution, you can also take 48-megapixel ultrawide (like this year’s OnePlus 11) and 48-megapixel 5x telephoto shots. (The Pixel 8 only can take 12-megapixel ultrawide shots.)

Like all flagship phone makers, Google has employed a technology called pixel binning that offers photographers a choice between full-resolution shots and lower resolutions that work better in low-light situations. But this year, it’ll let you shoot full-res shots even in low light if you prefer. That’s unlike Apple, which switches to pixel binning and low resolution automatically when it’s dark.

“You will always get more detail by enabling 50 megapixels [than when shooting at 12 megapixels], even in very low light, although you may suffer some noise penalty,” Reynolds said.

You can also use Night Sight for lower noise. It works at 50-megapixel resolution.

Apple changed its main camera’s default photo resolution from 12 megapixels to 24 megapixels with the iPhone 15 models, released last month. It also uses the HEIF image format, which stores files more compactly than the older JPEG. If you’re a Pixel photographer, you can choose the full resolution or 12 megapixels, but nothing intermediate. And there’s no HEIF support, because Google prefers JPEG’s universal compatibility.

We won’t know until testing whether Google’s high-resolution shots are worth it. Small pixels are worse when it comes to image noise and dynamic range. But Google has invested in better hardware, including wider aperture lenses that gather more light.

Pixel 8 camera hardware upgrades

Both the Pixel 8 and Pixel 8 Pro get the new higher-end main camera with dual conversion gain, and that gathers 21% more light than on the Pixel 7 generation.

Both phones get a new selfie camera, but it autofocuses only on the Pixel 8 Pro. Better image processing possible with the G3 helps improve color and reduce noise on both phones, Google said.

And as with the 2022 phones, only the Pro model gets a 5x telephoto camera. It uses the same sensor as the Pixel 7 Pro, but this year, the Pixel 8 Pro gets a wider f2.8 aperture lens to gather 56% more light. That’s the same aperture as on the iPhone 15 Pro Max’s 5x telephoto.

“We’re going hard on low light,” Reynolds said. A secondary benefit: Switching to the 5x camera is faster because the phone can lock focus more swiftly than with the Pixel 7 Pro’s f3.5 lens.