Search the KHIT Blog

Friday, June 2, 2023

"The Battle For Your Brain," and your Vote. A Creative Commons cross-post

How AI could take over elections–and undermine democracy

An AI-driven political campaign could be all things to all people.
Eric Smalley, TCUS; Biodiversity Heritage Library/Flickr; Taymaz Valley/Flickr, CC BY-ND

Could organizations use artificial intelligence language models such as ChatGPT to induce voters to behave in specific ways?

Sen. Josh Hawley asked OpenAI CEO Sam Altman this question in a May 16, 2023, U.S. Senate hearing on artificial intelligence. Altman replied that he was indeed concerned that some people might use language models to manipulate, persuade and engage in one-on-one interactions with voters.

Altman did not elaborate, but he might have had something like this scenario in mind. Imagine that soon, political technologists develop a machine called Clogger – a political campaign in a black box. Clogger relentlessly pursues just one objective: to maximize the chances that its candidate – the campaign that buys the services of Clogger Inc. – prevails in an election.

While platforms like Facebook, Twitter and YouTube use forms of AI to get users to spend more time on their sites, Clogger’s AI would have a different objective: to change people’s voting behavior.

How Clogger would work

As a political scientist and a legal scholar who study the intersection of technology and democracy, we believe that something like Clogger could use automation to dramatically increase the scale and potentially the effectiveness of behavior manipulation and microtargeting techniques that political campaigns have used since the early 2000s. Just as advertisers use your browsing and social media history to individually target commercial and political ads now, Clogger would pay attention to you – and hundreds of millions of other voters – individually.

It would offer three advances over the current state-of-the-art algorithmic behavior manipulation. First, its language model would generate messages — texts, social media and email, perhaps including images and videos — tailored to you personally. Whereas advertisers strategically place a relatively small number of ads, language models such as ChatGPT can generate countless unique messages for you personally – and millions for others – over the course of a campaign.

Second, Clogger would use a technique called reinforcement learning to generate a succession of messages that become increasingly more likely to change your vote. Reinforcement learning is a machine-learning, trial-and-error approach in which the computer takes actions and gets feedback about which work better in order to learn how to accomplish an objective. Machines that can play Go, Chess and many video games better than any human have used reinforcement learning.

How reinforcement learning works.

Third, over the course of a campaign, Clogger’s messages could evolve in order to take into account your responses to the machine’s prior dispatches and what it has learned about changing others’ minds. Clogger would be able to carry on dynamic “conversations” with you – and millions of other people – over time. Clogger’s messages would be similar to ads that follow you across different websites and social media.

The nature of AI

Three more features – or bugs – are worth noting.

First, the messages that Clogger sends may or may not be political in content. The machine’s only goal is to maximize vote share, and it would likely devise strategies for achieving this goal that no human campaigner would have thought of.

One possibility is sending likely opponent voters information about nonpolitical passions that they have in sports or entertainment to bury the political messaging they receive. Another possibility is sending off-putting messages – for example incontinence advertisements – timed to coincide with opponents’ messaging. And another is manipulating voters’ social media friend groups to give the sense that their social circles support its candidate.

Second, Clogger has no regard for truth. Indeed, it has no way of knowing what is true or false. Language model “hallucinations” are not a problem for this machine because its objective is to change your vote, not to provide accurate information.

Third, because it is a black box type of artificial intelligence, people would have no way to know what strategies it uses.

The field of explainable AI aims to open the black box of many machine-learning models so people can understand how they work.


If the Republican presidential campaign were to deploy Clogger in 2024, the Democratic campaign would likely be compelled to respond in kind, perhaps with a similar machine. Call it Dogger. If the campaign managers thought that these machines were effective, the presidential contest might well come down to Clogger vs. Dogger, and the winner would be the client of the more effective machine.

Political scientists and pundits would have much to say about why one or the other AI prevailed, but likely no one would really know. The president will have been elected not because his or her policy proposals or political ideas persuaded more Americans, but because he or she had the more effective AI. The content that won the day would have come from an AI focused solely on victory, with no political ideas of its own, rather than from candidates or parties.

In this very important sense, a machine would have won the election rather than a person. The election would no longer be democratic, even though all of the ordinary activities of democracy – the speeches, the ads, the messages, the voting and the counting of votes – will have occurred.

The AI-elected president could then go one of two ways. He or she could use the mantle of election to pursue Republican or Democratic party policies. But because the party ideas may have had little to do with why people voted the way that they did – Clogger and Dogger don’t care about policy views – the president’s actions would not necessarily reflect the will of the voters. Voters would have been manipulated by the AI rather than freely choosing their political leaders and policies.

Another path is for the president to pursue the messages, behaviors and policies that the machine predicts will maximize the chances of reelection. On this path, the president would have no particular platform or agenda beyond maintaining power. The president’s actions, guided by Clogger, would be those most likely to manipulate voters rather than serve their genuine interests or even the president’s own ideology.

Avoiding Clogocracy

It would be possible to avoid AI election manipulation if candidates, campaigns and consultants all forswore the use of such political AI. We believe that is unlikely. If politically effective black boxes were developed, the temptation to use them would be almost irresistible. Indeed, political consultants might well see using these tools as required by their professional responsibility to help their candidates win. And once one candidate uses such an effective tool, the opponents could hardly be expected to resist by disarming unilaterally.

Enhanced privacy protection would help. Clogger would depend on access to vast amounts of personal data in order to target individuals, craft messages tailored to persuade or manipulate them, and track and retarget them over the course of a campaign. Every bit of that information that companies or policymakers deny the machine would make it less effective.

Strong data privacy laws could help steer AI away from being manipulative.

Another solution lies with elections commissions. They could try to ban or severely regulate these machines. There’s a fierce debate about whether such “replicant” speech, even if it’s political in nature, can be regulated. The U.S.’s extreme free speech tradition leads many leading academics to say it cannot.

But there is no reason to automatically extend the First Amendment’s protection to the product of these machines. The nation might well choose to give machines rights, but that should be a decision grounded in the challenges of today, not the misplaced assumption that James Madison’s views in 1789 were intended to apply to AI.

European Union regulators are moving in this direction. Policymakers revised the European Parliament’s draft of its Artificial Intelligence Act to designate “AI systems to influence voters in campaigns” as “high risk” and subject to regulatory scrutiny.

One constitutionally safer, if smaller, step, already adopted in part by European internet regulators and in California, is to prohibit bots from passing themselves off as people. For example, regulation might require that campaign messages come with disclaimers when the content they contain is generated by machines rather than humans.

This would be like the advertising disclaimer requirements – “Paid for by the Sam Jones for Congress Committee” – but modified to reflect its AI origin: “This AI-generated ad was paid for by the Sam Jones for Congress Committee.” A stronger version could require: “This AI-generated message is being sent to you by the Sam Jones for Congress Committee because Clogger has predicted that doing so will increase your chances of voting for Sam Jones by 0.0002%.” At the very least, we believe voters deserve to know when it is a bot speaking to them, and they should know why, as well.

The possibility of a system like Clogger shows that the path toward human collective disempowerment may not require some superhuman artificial general intelligence. It might just require overeager campaigners and consultants who have powerful new tools that can effectively push millions of people’s many buttons.

Learn what you need to know about artificial intelligence by signing up for our newsletter series of four emails delivered over the course of a week. You can read all our stories on generative AI at Conversation

Archon Fung, Professor of Citizenship and Self-Government, Harvard Kennedy School and Lawrence Lessig, Professor of Law and Leadership, Harvard University

This article is republished from The Conversation under a Creative Commons license. Read the original article.
Hmmm... looking back nearly a decade (11/16/2013 on this blog):

NYeC 2013 Digital Health Conference Day Two

Day two, final day, actually. Wish they could do a 3-day conference. I think there's certainly enough material.

In the Grand Ballroom, A/V actually managed to fire up some overhead fresnel floods, though the above-stage banks of pars remained dark. Lighting was marginally better. Marginally.

NYeC Executive Director David Whitlinger kicks things off, introducing the day's Keynote Speaker, Obama 2012 Re-election Campaign ("OFA") Director Jim Messina.

The air was thick with anticipation: would he address the obvious question surely on all minds -- what about the rollout fiasco? We know you're hear to regale us regarding the brilliant Obama 2012 tech smackdown of the hapless Romney-Ryan presidential bid, but how can essentially the same people screw up the PPACA launch so miserably?

He dispensed with it jokingly right up front. He had nothing to do with He would go on to later point out the major problem that is federal procurement. There was no was to simply hand off PPACA HIX to the OFA techies.

Yeah. We know that. But, still, federal procurement is a venerable beast, a long-known quantity. To get blindsided by its upshot remains rather inexcusable.

But, not his gig. Not his purpose here.

He did, in fact dazzle us with power of adroitly captured, analyzed, and managed data, and OFA's adept, central use of social media.

Romney-Ryan never knew what hit them. In fact, reports have it that they'd not even prepared concession speeches, so hubristically certain were they of victory on Election Eve. Pride indeed Goeth Before a Fall.

Above, the money shot graph. While Gallup and the other mainstream political media polls showed wildly variable swings in relative Ups/Downs, internal OFA analytics had the President consistently way up. Messina said he told the President, as election day drew nigh, that he was sure that Mr. Obama would be re-elected in an Electoral College blowout, that their finely-tuned Big Data analytics could not be wrong. They could drill right down to the front-door level, precinct by precinct, and capture every available vote. They could ID every Facebook friend and Twitter follower of every Undecided and leverage them for "personal validation" (i.e., you are most amenable to persuasion by your circle of friends).

OFA nailed it. It is a compelling tale. Once NYeC posts the video of Mr. Messina's keynote, I exhort everyone to view it.

What he didn't say, but what had to have been a factor, was a slick Rope-A-Dope element. To mix my metaphors, Romney was playing checkers against a pool shark. The pool parlor hustler always seems to be lucky and just one ball better than you, as he patiently cleans out your wallet (this once happened to me, long ago). OFA was content to work this principle against the poignant Mr. Romney. Fine, let Mrs. Romney measure the White House drapes. Stroke those conceits, actually. Send her the catalogs, gratis… 
Well, a decade later our data-analytic capabilities are exponentially greater, but the political goals remain the same—win at all costs.
A bit over 4 years ago I called attention to this:

A "Science of Deliberation"?

As regular readers know, I am firmly on the side of science--specifically the "scientific method(s)," warts and all. But, what about "political discourse," which seems more than ever overpopulated with noisy, demagogic fact-averse partisans and ad hominem rhetorical bomb-tossers? After all, the phrase "political science" is unhappily viewed by many as a contradiction in terms.

Interesting piece in Science Magazine (paywalled):

Are we making material progress? Sometimes, I have to wonder.

More to come...

No comments:

Post a Comment