SEVERE WX : Severe Thunderstorm Watch - Severe Thunderstorm Warning View Alerts

A new program can animate old photos. But there's nothing human about artificial intelligence

Online genelogy company MyHeritage unveils a new tool called Deep Nostalgia that uses artificial intelligence to give old photos life-like movement.

Posted: Mar 11, 2021 4:50 AM
Updated: Mar 11, 2021 4:50 AM

It's hard to explain the mix of emotions that spark upon seeing a photo of Frederick Douglass come alive with the click of a button. And yet, there he is, blinking and nodding as if he were just alive yesterday, as if he hadn't died in 1895, years before film recording became commonplace.

His animated image and others like it -- at the same time unsettling, emotional, and a bit fantastical, are made possible by Deep Nostalgia, an artificial intelligence program from the genealogy platform MyHeritage.

As far as AI-animated images go, the technology behind these Harry Potter-esque photos isn't particularly complex.

Users are invited to supply old photos of their loved ones, and the program uses deep learning to apply predetermined movements to their facial features. It also makes up for little moments that aren't in the original photo, like the reveal of teeth or the side of a head. Together it creates, if not an entirely natural effect, than a deeply arresting one.

Responses to the Deep Nostalgia images -- tears at seeing a grandmother's smile, an eerie feeling of connection to a long-dead historical icon -- knock on a mysterious emotional wall between us and this type of rapidly-evolving technology.

We rely on perception and emotion

"The draw here is that visual imagery is visceral and compelling and we respond to it," says Hany Farid, associate dean and head of the School of Information at UC Berkeley. "We are visual beings. When you see your grandmother or Mark Twain come alive, there's something fascinating about it."

Fascinating -- and yes, a little frightening.

Our brains, as sophisticated as they are, have a prehistoric response to things that are almost human, but not quite. This is commonly called the uncanny valley, and a lot of deepfakes and AI-driven image manipulations set off this ancient alarm bell. Even MyHeritage addresses this reaction in their explanation of the program.

"Indeed, the results can be controversial and it's hard to stay indifferent to this technology," their FAQ page reads.

When it's a beloved relative occupying that almost-but-not-quite space in reality, the parts of our brain that love and fear are pitted against each other, even if we know full well that what we're looking at isn't real.

"The way our brain processes images of people is different than inanimate objects. It taps into neural circuitry," Farid says. "For years we have been able to synthesize inanimate objects, and that completely fools the visual system because we don't have preconceived notions of how they move. But when it comes to humans, it is lagging. Part of that is the subtle way we move and recognize these movements."

"My sense of wonder might be tinged with a sense of terror" said La Marr Jurelle Bruce, a professor at the University of Maryland who shared the animated image of Frederick Douglass, capturing the attention of hundreds of thousands of people online.

AI relies on data and rules

Deepfakes, which are a sophisticated melding of synthetic audio and images, have been a point of contention for digital ethicists for years, especially when it comes to issues like altered pornography and fake videos that could threaten national and financial institutions.

For a more positive application, companies have been turning to the technology more and more to create widely customizable ad campaigns. The payoff, experts say, is that the consumer can feel more attached to a brand or a product by seeing the specific way it would fit into their life -- on a model with similar proportions, in their own language, or in a micro-targeted ad that speaks to their interests.

Those kinds of applications are courting a similar kind of human connection as Deep Nostalgia. But the fact is, there's nothing human about artificial intelligence.

Farid is careful to point out that machine learning, which is what drives more widely available animation technologies like Deep Nostalgia, is a field within the greater world of artificial intelligence. Machine learning pores over data and finds patterns. While a program may get better with more input, there isn't any intelligence or analysis involved in the way it applies these patterns.

There are many applications that benefit greatly from this type of data.

"When you're predicting the stock market, you want patterns," Farid offers as an example. "Or doing cancer diagnoses. I don't need to understand at the moment why cancer shows up, I just want to know if it does."

When applied to more human pursuits, the lack of, well, intelligence shows through.

The smiling faces of our ancestors, though touching, naturally don't hold up once we drop our suspension of disbelief.

AI-generated renderings of human faces, another threat to the security of our online environs, often contain hilarious glitches where a program, not quite sure what to do with irregular things like ears or glasses, spits out little monstrosities hidden in otherwise convincing visages.

Even extremely sophisticated, true deepfakes like the elaborate ones of Tom Cruise currently being passed around often have small inconsistencies that make us second guess our own sense of reality.

Those inconsistencies, however, will lessen as the technology develops, and Farid says the time has come for companies to look critically at the ethical implications of using them.

"The tech sector has done things because they can and not because they should," he says. "We need to stop building things because they're cool and start asking these hard questions before it's too late."

Before, say, the technology gets so good that our emotions are able to override our keen senses of perception.

When using Deep Nostalgia, MyHeritage cautions users against uploading photos of living people without their consent, and says the company did not add audio options in the interest of user safety.

In the future, perhaps another program will be able to fill in those gaps, and we'll be able to see, hear and converse with those long lost to us. Such technology will present stunning challenges to our security and our sense of reality as we know it.

But when it's smiling at us through the comforting faces of our dearest loved ones, it will be that much harder to resist.

Indiana Coronavirus Cases

Data is updated nightly.

Cases: 751242

Reported Deaths: 13795
CountyCasesDeaths
Marion1032931788
Lake556911009
Allen41692692
St. Joseph36990565
Hamilton36588417
Elkhart29398461
Tippecanoe22901226
Vanderburgh22556400
Porter19356325
Johnson18471389
Hendricks17682317
Clark13226195
Madison13149344
Vigo12614253
LaPorte12419221
Monroe12207176
Delaware10966198
Howard10321225
Kosciusko9630121
Hancock8576146
Bartholomew8169157
Warrick7860156
Floyd7811180
Grant7242179
Wayne7162201
Boone6966103
Morgan6761141
Dubois6218118
Marshall6209116
Cass6016110
Henry5900110
Dearborn589878
Noble581488
Jackson509076
Shelby501496
Lawrence4742122
Gibson444894
Clinton442355
Harrison441875
DeKalb439885
Montgomery438090
Whitley406543
Huntington402681
Steuben400159
Miami395269
Jasper388054
Knox375991
Putnam372960
Wabash361983
Ripley347170
Adams345555
Jefferson335886
White331953
Daviess3033100
Wells295281
Decatur289992
Greene286885
Fayette284864
Posey273835
LaGrange273072
Scott270156
Clay267148
Washington246036
Randolph244783
Jennings235349
Spencer234531
Starke228058
Fountain220948
Sullivan214643
Owen211858
Fulton202942
Jay200932
Carroll193620
Orange188255
Perry187237
Rush175926
Vermillion174844
Franklin170335
Tipton166246
Parke149416
Pike138234
Blackford136232
Pulaski120647
Newton113936
Brown104243
Crawford102516
Benton101714
Martin91715
Warren84015
Switzerland8148
Union72810
Ohio57911
Unassigned0420

Ohio Coronavirus Cases

Data is updated nightly.

Cases: 1108736

Reported Deaths: 20166
CountyCasesDeaths
Franklin1287201467
Cuyahoga1157922211
Hamilton813971250
Montgomery525481043
Summit484271001
Lucas43353820
Butler39013606
Stark33332929
Lorain25672505
Warren24591303
Mahoning22370603
Lake21207388
Clermont20117253
Delaware18852136
Licking16662222
Fairfield16574204
Trumbull16548482
Medina15610271
Greene15281248
Clark14237306
Wood13292200
Portage13251215
Allen11913239
Richland11605211
Miami10849225
Wayne9141223
Columbiana9032230
Muskingum8906135
Pickaway8663122
Tuscarawas8649250
Marion8642138
Erie8056165
Ashtabula7160179
Hancock6998132
Ross6944161
Geauga6838151
Scioto6534106
Belmont6157174
Union584549
Lawrence5731102
Jefferson5678158
Huron5546122
Sandusky5442126
Darke5420129
Seneca5348128
Washington5319109
Athens523960
Auglaize502187
Mercer487385
Shelby476895
Knox4571112
Madison444266
Ashland435797
Putnam4336103
Defiance432399
Fulton432074
Crawford4037110
Brown402461
Logan387677
Preble3855105
Clinton379166
Ottawa373681
Highland359665
Williams348278
Champaign344759
Guernsey324953
Jackson318254
Perry297350
Morrow291840
Fayette285450
Hardin275265
Henry273467
Holmes2701101
Coshocton269060
Van Wert247264
Adams243256
Pike242835
Gallia240650
Wyandot234556
Hocking220563
Carroll197348
Paulding176542
Meigs148440
Monroe136344
Noble136239
Harrison114138
Morgan109624
Vinton85517
Unassigned03
Fort Wayne
Cloudy
67° wxIcon
Hi: 73° Lo: 70°
Feels Like: 67°
Angola
Cloudy
° wxIcon
Hi: 70° Lo: 66°
Feels Like: °
Huntington
Cloudy
67° wxIcon
Hi: 73° Lo: 70°
Feels Like: 67°
Decatur
Mostly Cloudy
67° wxIcon
Hi: 74° Lo: 71°
Feels Like: 67°
Van Wert
Mostly Cloudy
77° wxIcon
Hi: 74° Lo: 70°
Feels Like: 79°
Strong to severe storms move through Sunday evening to early Monday morning. Showers and a few storms are likely on Monday.
WFFT Radar
WFFT Temperatures
WFFT National

Community Events