IBM's AI debate computer loses to human champion

IBM's Project Debater will pit artificial intelligence against a human on a topic neither know ahead of time. Dario Gil, Director of IBM Research, explains how Project Debater will take on the complexity of language.

Posted: Feb 12, 2019 8:35 AM


People are great at arguing. But a project from IBM shows that computers are getting quite good at it, too.

On Monday, Harish Natarajan, a grand finalist in 2016's World Debating Championships, faced off against IBM's Project Debater — a computer touted by the company as the first artificial-intelligence system built to meaningfully debate humans. Natarajan won, but the computer demonstrated the increasingly complex arguments that AI is starting to make.

Project Debater, which has been in the works since 2012, is designed to come up with coherent, convincing speeches of its own, while taking in the arguments of a human opponent and creating its own rebuttal. It even formulates its own closing argument. To generate its arguments and rebuttals, Project Debater uses newspaper and magazine articles from its own database, and also takes in the nuances of the human opponent's arguments. It is not connected to the internet and cannot crib arguments from sites like Wikipedia.

Monday's debate, which was organized by nonprofit debate-hosting company Intelligence Squared US, was held in front of an audience in San Francisco's Yerba Buena Center for the Arts. The topic of the debate — whether or not preschool should be subsidized — wasn't revealed to the AI system or Natarajan until 15 minutes before they took to the stage. Project Debater argued in favor of subsidized preschool.

It followed traditional debate style. Each side gave a 4-minute opening speech, then they each came up with a 4-minute rebuttal to the other party. At the end, they gave a 2-minute closing argument. The audience was asked to vote for one side or the other at the start of the debate, and again at the end.

"Greetings, Harish," Project Debater began, speaking in a mainly monotonous, female voice. It argued, among other things, that subsidized preschool can help break the poverty cycle. It spoke in complete sentences, and drew from a range of studies (including by the US Centers for Disease Control).

Natarajan followed, arguing against the resolution, saying subsidies would consume resources that middle-class families could use for other things. He also argued that subsidizing preschool doesn't mean that all children will be able to attend.

"There will still be individuals who will be priced out because of the realities of the market," he said.

The rebuttal segment of the debate was where some of the big differences between human and computer (beyond looks and vocal capabilities) were laid bare. Natarajan addressed specific parts of Project Debater's arguments and rebuffed them — such as saying it's unrealistic to expect a government has an unrestricted budget to put toward helpful programs.

Project Debater's rebuttal, while eloquently phrased, seemed more like a continuation of its initial argument than a true rebuttal of Natarajan's points. It saved its best counter arguments for its closing statement. While out of order, the elements of a proper debate all seemed present.

While waiting for the final vote, Natarajan said it was interesting that Project Debater could contextualize information and pull details from research. Combining its skills with those of a human, he said, "could be incredibly powerful."

Before the debate, 79 percent of the audience agreed that preschool should be subsidized and 13 percent disagreed. By the end, 62 percent of the crowd agreed and 30 percent disagreed. Because this style of debate is scored by which side gains the most percentage points, Natarajan took the win.

Project Debater shows how AI systems have become increasingly flexible in recent years. The AI we're used to seeing — like digital assistants built into smart speakers — can only be used in very narrow ways, such as answering specific questions. But IBM's system shows how the technology may also be used to explore problems that don't necessarily have a single answer. This might help people find new ways to work with computers, and to use AI to help us come up with more solutions to problems.

"It's really pushing the boundaries [of the] kinds of AI systems that are more interactive with us and can understand us better," IBM Research director Dario Gil said on CNN's First Move Monday.

Indiana Coronavirus Cases

Data is updated nightly.

Cases: 590211

Reported Deaths: 9310
CountyCasesDeaths
Marion815581297
Lake44306666
Allen31919541
Hamilton28371304
St. Joseph26766371
Elkhart24098341
Vanderburgh18643213
Tippecanoe17422121
Johnson14496284
Porter14399160
Hendricks13870241
Madison10561212
Vigo10483171
Clark10240130
Monroe9076108
Delaware8836132
LaPorte8771155
Howard7897138
Kosciusko787277
Warrick643890
Hancock638797
Bartholomew626694
Floyd6150105
Wayne5933157
Grant5818110
Dubois544372
Boone534367
Morgan516291
Marshall494184
Henry493664
Cass471760
Noble460557
Dearborn458444
Jackson414745
Shelby402179
Lawrence380575
Clinton364539
Gibson356556
DeKalb337363
Montgomery334851
Harrison328542
Knox327839
Miami309843
Steuben306340
Adams295235
Whitley294125
Wabash293045
Ripley292345
Putnam284847
Huntington283557
Jasper282433
White267538
Daviess261672
Jefferson250738
Fayette242348
Decatur242182
Greene233360
Posey232326
Wells229447
LaGrange224161
Clay217932
Scott216937
Randolph208340
Jennings192535
Sullivan189031
Spencer181917
Fountain179725
Washington177118
Starke171341
Jay162821
Owen159537
Fulton159229
Carroll152115
Orange151433
Rush149918
Perry147227
Vermillion144933
Franklin143433
Parke12908
Tipton128232
Pike113625
Blackford107522
Pulaski95237
Newton89421
Brown85530
Benton84310
Crawford7579
Martin70013
Warren6587
Switzerland6205
Union6113
Ohio4677
Unassigned0374

Ohio Coronavirus Cases

Data is updated nightly.

Cases: 826754

Reported Deaths: 10200
CountyCasesDeaths
Franklin97493705
Cuyahoga821781012
Hamilton61350439
Montgomery41700399
Summit33399726
Lucas30111597
Butler29721228
Stark24811400
Warren18917139
Lorain18086212
Mahoning16758335
Lake15365135
Clermont15160104
Delaware1382177
Licking12679132
Trumbull12401302
Fairfield1218480
Greene11631133
Medina11128165
Clark10608264
Wood9964154
Allen9511126
Portage8867105
Miami886573
Richland8790116
Marion7319113
Tuscarawas7142174
Columbiana7085124
Pickaway702850
Wayne6781164
Muskingum671242
Erie5886118
Hancock537890
Ross530287
Scioto519662
Geauga483555
Darke457589
Ashtabula439068
Lawrence432651
Union430628
Mercer424287
Sandusky421862
Seneca413555
Auglaize412759
Huron410338
Shelby410221
Jefferson403366
Belmont395640
Washington372040
Putnam364672
Athens36369
Madison339329
Knox336522
Ashland331738
Fulton325943
Defiance319278
Crawford313268
Preble311534
Brown296619
Logan292729
Ottawa282134
Clinton279043
Williams270166
Highland262418
Jackson256943
Guernsey241725
Champaign240927
Fayette225529
Morrow22294
Perry221318
Holmes218662
Henry210247
Hardin204133
Coshocton197420
Van Wert196644
Gallia190926
Wyandot190549
Adams165615
Pike164116
Hocking163423
Carroll149516
Paulding139021
Noble117840
Meigs103221
Monroe95629
Harrison8568
Morgan79128
Vinton67113
Unassigned00
Fort Wayne
Cloudy
30° wxIcon
Hi: 31° Lo: 29°
Feels Like: 20°
Angola
Cloudy
28° wxIcon
Hi: 30° Lo: 27°
Feels Like: 20°
Huntington
Cloudy
28° wxIcon
Hi: 29° Lo: 27°
Feels Like: 18°
Fort Wayne
Cloudy
30° wxIcon
Hi: 30° Lo: 28°
Feels Like: 20°
Lima
Cloudy
29° wxIcon
Hi: 31° Lo: 29°
Feels Like: 18°
Seasonal Monday
WFFT Radar
WFFT Temperatures
WFFT National

Community Events