Can Google replace photographers with an algorithm?

Like all mediocre photographers, Google's Clips camera occasionally lucks into some good pictures.The new $249...

Posted: Apr 1, 2018 12:30 AM
Updated: Apr 1, 2018 12:30 AM

Like all mediocre photographers, Google's Clips camera occasionally lucks into some good pictures.

The new $249 gadget, released in February, automates much of the job of a certain kind of photographer. You place the 2-inch high white square on a surface, preferably someplace frequented by children or pets. It automatically captures any "candid" scenes it determines are worthwhile with its wide-angle lens.

I spent a week with the camera, planting it on countertops, floors and shelves. Unfortunately my cat and bunny both passed away last year, so Clips only had children to work with. Luckily, my children are extremely good looking.

Even so, the resulting photos and videos had a common, soulless look to them. The wide-angle meant they were busy, with too much in focus and no appealing composition.

Essentially, Clips combines the hands-off approach of a surveillance camera with the visual style of a surveillance camera.

And yet, for a camera that silently watches you, Clips doesn't feel creepy. Google has been careful to avoid raising any privacy red flags. It stores all images and videos on the device. You preview photos using the Clips Android or iOS app over a one-to-one WiFI connection, and manually choose which ones to save to your smartphone.

While it might not succeed as a camera, it does raise interesting questions about what makes a photograph "good," and if you can ever program an algorithm to make art.

"The act of photography is the act of expression," said photographer Ben Long, author of "The Complete Digital Photography." "The [Clips] algorithm would just be the expression of the photographic ideas of whoever wrote that algorithm, minus the knowledge of what makes the scene around them interesting."

To come up with its special sauce, the Clips team asked professional photographers working at the company what they believe makes a good photo.

The software looks for children, animals, and faces, preferably within three-to-eight feet of the lens. Clips likes movement, but tries to avoid blurry photos and can tell when something is blocking the lens, like the hand of a curious child. It learns the faces of the people you save the most and takes more pictures of them. It is programmed to have a preference for happy, smiling faces.

Related: Google unveils new Pixel phones, speakers, futuristic headphones

Even when Clips follows the rules, the resulting photographs are mostly un-Instagrammable. Current trends favor highly stylized, painstakingly staged shots for social media. While cameras have gotten better at capturing reality, people have grown sophisticated enough to appreciate more abstraction in photography.

But the problem with Clips isn't just the execution or quality of photos. It's the underlying assumption that you can program a device to replicate the decisions that go into making a good picture.

"You can try to come up with all the rules you want for photography, and you can try to follow them perfectly and still come up with some very crappy photos," said Long after reviewing my test shots.

Rules can't predict the many small decisions a photographer makes in the moment, like where to stand, what moment to press the shutter button, or what part of an image to expose or keep in shadows. The mere presence of a photographer also has an influence on the picture. Taking pictures is an inherently social experience, says Long. The subject is always reacting to the photographer in some way.

Clips might not take off, but it is a sign of what could be next for photography. Companies are forging ahead with technologies that will automate and change the field. They're driven in part by the desire to improve smartphone photography without having to make giant phones. For example, cameras like the newer Pixel and iPhones use software to convincingly fake a shallow depth-of-field effects. The Light L16 camera uses 16 separate cameras to create one detailed image file that can be edited after the fact.

Related: Google wants you to experiment with its new photo apps

Clips builds on years of Google's own work by automating parts of photography. Google Photos has an "Assistant" option that handles some of the duller parts of managing a massive amount of photos, like choosing and editing the best shots, and making movies from videos.

Google doesn't see Clips as a replacement for photographers, but as another tool they can use.

"We see the importance of a human being in this," said Google's Juston Payne, the Clips product lead. "It can't move itself or compose a shot or get a good angle. The person is still exerting creative control, AI is just pressing the shutter button ... We think of it as a collaboration between people and AI and they are both completely necessary."

Indiana Coronavirus Cases

Data is updated nightly.

Cases: 306538

Reported Deaths: 5435
CountyCasesDeaths
Marion41953849
Lake26872453
Allen17621295
Elkhart16905219
St. Joseph16524223
Hamilton12696167
Vanderburgh9552115
Tippecanoe844927
Porter813785
Johnson6231165
Vigo597979
Hendricks5944156
Monroe530349
Clark504077
Madison4858121
Delaware4820103
LaPorte457194
Kosciusko455739
Howard334975
Warrick319572
Floyd311477
Bartholomew308462
Wayne301367
Cass295831
Marshall293744
Grant262949
Noble249846
Hancock246551
Boone240254
Henry240237
Dubois234631
Dearborn215730
Jackson212633
Morgan204443
Gibson181725
Knox181419
Shelby178254
Clinton177821
Lawrence174047
DeKalb172829
Adams166422
Wabash158020
Miami157814
Daviess154643
Fayette147733
Steuben143513
Jasper142111
Harrison141824
LaGrange140129
Montgomery139027
Whitley133412
Ripley128114
Decatur124643
Huntington123510
Putnam123027
Randolph120719
Wells120428
White120321
Clay119822
Posey119616
Jefferson116216
Scott103219
Greene101353
Jay96413
Starke90621
Sullivan88916
Fulton83518
Jennings83214
Spencer8198
Perry81521
Fountain7738
Washington7417
Franklin68626
Carroll67913
Orange66628
Vermillion5993
Owen5987
Parke5606
Newton55312
Tipton55226
Rush5317
Blackford51912
Pike50318
Pulaski37710
Martin3515
Benton3362
Brown3353
Crawford2881
Union2671
Switzerland2555
Warren2382
Ohio2307
Unassigned0266

Ohio Coronavirus Cases

Data is updated nightly.

Cases: 371840

Reported Deaths: 6100
CountyCasesDeaths
Franklin50231667
Cuyahoga36047741
Hamilton29931372
Montgomery20065228
Butler14769146
Lucas14317414
Summit13388316
Stark8792197
Warren819175
Mahoning7276299
Lake682666
Lorain643499
Clermont577248
Delaware556436
Licking549276
Fairfield538464
Trumbull5305147
Greene522364
Clark511464
Allen465485
Marion465251
Wood4491107
Medina447756
Miami425867
Pickaway399348
Columbiana347297
Portage344872
Tuscarawas328658
Wayne318793
Richland316638
Mercer289945
Hancock241337
Ross240759
Muskingum240210
Auglaize231031
Putnam224749
Erie224266
Darke223559
Ashtabula223253
Geauga203351
Scioto195915
Union19118
Shelby190615
Lawrence189438
Athens18864
Seneca180018
Belmont164929
Madison158918
Sandusky154229
Preble152621
Huron152318
Defiance139522
Holmes139139
Logan127816
Knox126318
Fulton124525
Washington121927
Crawford121516
Ottawa121130
Clinton106714
Williams10579
Ashland105222
Highland101317
Jefferson10124
Henry100023
Brown9925
Champaign9475
Jackson93112
Hardin91019
Fayette90317
Van Wert8976
Morrow8882
Guernsey83914
Coshocton82613
Perry78712
Adams78313
Pike7451
Gallia73513
Wyandot71216
Paulding64611
Hocking62616
Noble60223
Carroll45710
Meigs39012
Monroe31821
Morgan2575
Vinton2195
Harrison2023
Unassigned00
Fort Wayne
Broken Clouds
48° wxIcon
Hi: 51° Lo: 45°
Feels Like: 46°
Angola
45° wxIcon
Hi: 47° Lo: 43°
Feels Like: 40°
Huntington
Overcast
49° wxIcon
Hi: 52° Lo: 44°
Feels Like: 47°
Decatur
Overcast
50° wxIcon
Hi: 52° Lo: 46°
Feels Like: 50°
Van Wert
Overcast
50° wxIcon
Hi: 52° Lo: 46°
Feels Like: 50°
Rain Continues Wednesday
WFFT Radar
WFFT Temperatures
WFFT National

Community Events