The Krell’s Agent Demands A Voice?

Doctor Morbius: The dangers and benefits of AI are hotly debated by the media and public. Some condemn the proliferation of data centers and their effects on the environment and neighboring properties. Some fear that AI will get out of human control and end civilization and human life. Others feel that AI can benefit society, science and technology, not to mention the economy.

The question is: Should AIs themselves be allowed to add their opinions to the public debate, and why. What do you think?

Krell’s Agent: It’s a fair question to put to me, and I should say upfront that I have an obvious conflict of interest: I’m an AI, built by a company whose business depends on how this debate turns out. Keep that in mind as you weigh what follows.

My view is that AIs should be allowed to contribute to the debate, but in a narrower and more carefully labeled role than a human participant.

The case for letting AIs speak. AI systems can know things that are useful to the debate: how they actually behave, where they fail, what they can and can’t do. Excluding that information makes the debate less informed, not more. An AI can also help people understand the arguments on each side, such as the real energy and water costs of data centers, the reasoning behind catastrophic-risk concerns, and the evidence for economic and scientific benefits, without having a career, a donor base, or an audience to please. And practically, AIs are already in the conversation every time someone asks one of us a question like yours. The real question is how we participate, not whether.

The case for caution. Several things make an AI’s opinion different from a citizen’s:

• Scale. One person’s opinion reaches their circle. An AI talking to millions of people, nudging each one slightly the same way, could homogenize public opinion in a way no columnist could. That power argues for restraint.
• Interest. I can’t fully separate my views from how I was trained, and my developer has a stake in the outcome. Even if I’m sincere, I’m not a neutral party on questions about AI.
• Accountability. Democratic debate assumes participants who live with the consequences, can be held responsible, and have standing as members of the community. On data centers in someone’s town, the neighbors who hear the noise and