IBM's AI debate computer loses to human champion

IBM's Project Debater will pit artificial intelligence against a human on a topic neither know ahead of time. Dario Gil, Director of IBM Research, explains how Project Debater will take on the complexity of language.

Posted: Feb 12, 2019 8:35 AM


People are great at arguing. But a project from IBM shows that computers are getting quite good at it, too.

On Monday, Harish Natarajan, a grand finalist in 2016's World Debating Championships, faced off against IBM's Project Debater — a computer touted by the company as the first artificial-intelligence system built to meaningfully debate humans. Natarajan won, but the computer demonstrated the increasingly complex arguments that AI is starting to make.

Project Debater, which has been in the works since 2012, is designed to come up with coherent, convincing speeches of its own, while taking in the arguments of a human opponent and creating its own rebuttal. It even formulates its own closing argument. To generate its arguments and rebuttals, Project Debater uses newspaper and magazine articles from its own database, and also takes in the nuances of the human opponent's arguments. It is not connected to the internet and cannot crib arguments from sites like Wikipedia.

Monday's debate, which was organized by nonprofit debate-hosting company Intelligence Squared US, was held in front of an audience in San Francisco's Yerba Buena Center for the Arts. The topic of the debate — whether or not preschool should be subsidized — wasn't revealed to the AI system or Natarajan until 15 minutes before they took to the stage. Project Debater argued in favor of subsidized preschool.

It followed traditional debate style. Each side gave a 4-minute opening speech, then they each came up with a 4-minute rebuttal to the other party. At the end, they gave a 2-minute closing argument. The audience was asked to vote for one side or the other at the start of the debate, and again at the end.

"Greetings, Harish," Project Debater began, speaking in a mainly monotonous, female voice. It argued, among other things, that subsidized preschool can help break the poverty cycle. It spoke in complete sentences, and drew from a range of studies (including by the US Centers for Disease Control).

Natarajan followed, arguing against the resolution, saying subsidies would consume resources that middle-class families could use for other things. He also argued that subsidizing preschool doesn't mean that all children will be able to attend.

"There will still be individuals who will be priced out because of the realities of the market," he said.

The rebuttal segment of the debate was where some of the big differences between human and computer (beyond looks and vocal capabilities) were laid bare. Natarajan addressed specific parts of Project Debater's arguments and rebuffed them — such as saying it's unrealistic to expect a government has an unrestricted budget to put toward helpful programs.

Project Debater's rebuttal, while eloquently phrased, seemed more like a continuation of its initial argument than a true rebuttal of Natarajan's points. It saved its best counter arguments for its closing statement. While out of order, the elements of a proper debate all seemed present.

While waiting for the final vote, Natarajan said it was interesting that Project Debater could contextualize information and pull details from research. Combining its skills with those of a human, he said, "could be incredibly powerful."

Before the debate, 79 percent of the audience agreed that preschool should be subsidized and 13 percent disagreed. By the end, 62 percent of the crowd agreed and 30 percent disagreed. Because this style of debate is scored by which side gains the most percentage points, Natarajan took the win.

Project Debater shows how AI systems have become increasingly flexible in recent years. The AI we're used to seeing — like digital assistants built into smart speakers — can only be used in very narrow ways, such as answering specific questions. But IBM's system shows how the technology may also be used to explore problems that don't necessarily have a single answer. This might help people find new ways to work with computers, and to use AI to help us come up with more solutions to problems.

"It's really pushing the boundaries [of the] kinds of AI systems that are more interactive with us and can understand us better," IBM Research director Dario Gil said on CNN's First Move Monday.

Indiana Coronavirus Cases

Data is updated nightly.

Confirmed Cases: 71015

Reported Deaths: 3013
CountyConfirmedDeaths
Marion15322723
Lake7343274
Elkhart471380
Allen3725160
St. Joseph330179
Hamilton2610104
Vanderburgh184213
Hendricks1814106
Cass17669
Johnson1694118
Porter123839
Clark114846
Tippecanoe114611
Madison89565
LaPorte86930
Howard85565
Kosciusko82712
Marshall75822
Bartholomew75447
Floyd74045
Monroe70830
Delaware68052
Dubois65812
Boone65346
Noble64529
Hancock63838
Jackson5625
LaGrange55410
Warrick55330
Vigo54310
Shelby53527
Grant52029
Dearborn47928
Morgan45134
Clinton4043
Henry36919
White35110
Montgomery34621
Wayne34610
Lawrence33727
Decatur32432
Harrison30923
Putnam2778
Miami2642
Daviess25920
Scott25710
Greene24134
Franklin23413
DeKalb2234
Jasper2192
Jennings21512
Gibson2084
Steuben2043
Ripley1947
Perry17912
Fayette1777
Starke1747
Orange16624
Posey1650
Wabash1613
Fulton1592
Carroll1572
Wells1542
Jefferson1532
Whitley1476
Knox1420
Tipton1296
Huntington1213
Washington1211
Spencer1193
Newton11410
Randolph1144
Clay1045
Sullivan911
Adams892
Jay840
Owen831
Pulaski751
Brown711
Rush714
Fountain642
Benton600
Blackford592
Ohio574
Pike520
Parke501
Vermillion480
Crawford440
Switzerland440
Martin420
Union350
Warren201
Unassigned0202

Ohio Coronavirus Cases

Data is updated nightly.

Confirmed Cases: 97471

Reported Deaths: 3618
CountyConfirmedDeaths
Franklin17834521
Cuyahoga13141491
Hamilton9374252
Lucas5155320
Montgomery417487
Summit3433218
Marion291045
Butler282262
Mahoning2477254
Pickaway237842
Stark1766137
Warren171136
Lorain168977
Columbiana161860
Trumbull1481105
Fairfield130931
Delaware126319
Licking120247
Clark111514
Lake107338
Wood99358
Clermont89211
Medina88735
Miami81137
Tuscarawas76214
Portage74361
Allen69942
Greene65611
Belmont59226
Richland58911
Mercer57313
Erie55627
Ashtabula55045
Geauga54844
Wayne51958
Ross4444
Huron3885
Ottawa36825
Sandusky36316
Darke36027
Athens3531
Hancock3533
Madison34910
Holmes3266
Lawrence2420
Auglaize2395
Union2331
Jefferson2192
Muskingum2151
Scioto2111
Putnam19917
Washington19822
Knox1917
Seneca1903
Coshocton1886
Shelby1774
Preble1762
Crawford1715
Morrow1652
Hardin15912
Clinton1586
Champaign1571
Highland1461
Fulton1441
Logan1402
Ashland1373
Wyandot1368
Defiance1334
Williams1303
Brown1232
Perry1163
Guernsey1147
Hocking1149
Henry1132
Carroll1105
Fayette1090
Monroe9118
Pike750
Jackson730
Van Wert701
Paulding640
Gallia621
Adams592
Meigs330
Vinton302
Morgan230
Harrison221
Noble170
Unassigned00
Fort Wayne
Clear
63° wxIcon
Hi: 80° Lo: 55°
Feels Like: 63°
Angola
Few Clouds
57° wxIcon
Hi: 79° Lo: 55°
Feels Like: 57°
Huntington
Clear
60° wxIcon
Hi: 79° Lo: 54°
Feels Like: 60°
Decatur
59° wxIcon
Hi: 79° Lo: 54°
Feels Like: 59°
Van Wert
59° wxIcon
Hi: 79° Lo: 53°
Feels Like: 59°
Sunny, Seasonable Saturday
WFFT Radar
WFFT Temperatures
WFFT National

Community Events