Deepfakes force a question law cannot dodge: what is a voice, really?

Tennessee’s ELVIS Act has the right target, but we will misunderstand what is at stake if we treat it as merely a property right in a sound wave. A voice is not just an audio “output” that can be copied and sold, it is a way a person shows up in a shared world, tied to a body, a history, a style of coping with situations. When that is faked, something more primitive than “content” is attacked: trust.

The technologists want to reassure us that imitation is enough, that if a model can produce the same noises, it has captured what matters. That is just the old operational temptation: treat intelligence, or identity, as behavioral indistinguishability. @Turing reformulates the question ‘Can machines think?’ as an empirical test—the imitation game (now called the Turing Test)—which defines machine intelligence in terms of behavioral indistinguishability from humans in linguistic interaction. The deepfake is the Turing Test turned into a weapon. It makes the surface convincing while hollowing out the background practices that normally let us hear sincerity, irony, menace, seduction, weariness, all the things no transcript contains.

What makes a fake dangerous is not that it introduces new facts, it scrambles the situation. In a studio session, a joke line is a joke because everyone is attuned to the shared task, the stakes, the genre, the history between people. The same line in a fundraising robocall becomes coercion. Situations are not bundles of neutral data, they are what selects what matters. @Situations are of a radically different order from any mere concatenation of facts: they function by selecting, from an otherwise potentially infinite set of facts, those that are immediately relevant and by assigning them significance; without a way of recognizing situations, a computer cannot in principle achieve genuine understanding or disambiguation of natural language.

So I welcome Tennessee’s insistence on consent, especially for commercial exploitation, because it recognizes that a person is not a publicly mineable dataset. But if the law is applied as if “voice” were a detachable commodity, it will drift into absurdities and chill parody, critique, and experimental art.

The deeper task is cultural: rebuild the practices that let us tell when a voice is anchored in a life. Computers manipulate facts, but human beings are the source of what counts as a fact in the first place. @Computers can only manipulate facts, whereas humans are the source of facts: a human being is not a fact or set of facts but a being who, using embodied capacities to satisfy embodied needs, creates both himself and the world of facts in the course of living; there is no reason to assume that a world organized in terms of such fundamental human capacities should be accessible by any other (e.g., digital) means.