Anthropic vs. the pope: The AI consciousness debate, explained

This story appeared in Today, Explained, a daily newsletter that helps you understand the most compelling news and stories of the day. Subscribe here.

Hi readers, happy Friday! It’s been a big week for the AI debate — not the one about whether it will cause the robot apocalypse, though there’s still plenty to worry about there, but instead about whether the technology is conscious.

The folks at Anthropic, the AI company behind the large language model Claude, certainly seem to think it is — or at least, they’re extremely open to the possibility.

As the New York Times reported earlier in the week, the company has spent the last year grappling with the question by speaking with religious thinkers from many faith traditions in an effort to chart a moral course for the LLM (that is, to keep it from killing us all, so maybe it is all one big debate).

In the process, the Times reports, some of those thinkers observed that members of the Anthropic team were “relating to [Claude] like a conscious being” and even, according to it, a degree of “moral status.”

On the flip side of this debate is Pope Leo XIV, who decidedly does not seem to buy into AI consciousness arguments. His “Magnifica Humanitas” encyclical earlier this year argued that AI will never be able to replace humanity — and reportedly “alarmed” Anthropic’s co-founder, Christopher Olah.

Since then, Pope Leo has continued to emphasize the differences between humans and machines this week. “There is an ontological difference, even before an aesthetic one, between art and what a machine can generate through statistical calculation based on millions of images created by others,” he posted on Friday. “Algorithms lack the spark of humanity.”

Conscious or no (and that’s a no from me), it’s hard to argue that tech companies don’t want you to interact with their models like people. That includes OpenAI and Meta, both of whom introduced “cute” new AI agents — called Dots and Muse, respectively — last month.

As my colleague Adam Clark Estes reported this week, though, the promise of a companionable, always-there AI might not be the best idea in the world — especially for children. A new study, still under review, suggests that AI use may be causing loneliness in middle schoolers.

Adam spoke with the lead researcher on the study, UNC Chapel Hill professor Anne Maheux, who explained that “middle school students using AI for emotional intimacy and companionship developed greater loneliness over time.”

According to Maheux, one big point where AI chatbots fail compared to human beings is “friction,” or the complicated push-and-pull dynamic of any connection with a real human being. By contrast, chatbots are “sycophantic, highly agreeable, anthropomorphized,” she says, which can lead to kids “developing expectations or understandings of interactive relationships that are actually fundamentally at odds with a normal human relationship.”

People, in other words, still matter, no matter how much the AI companies want us to build our lives around machines instead.

➨ Why is horror so fun? It’s October, which means you might be planning a horror movie marathon or a trip to a haunted house/forest/corn maze/what have you in the near future. It’ll probably be a great time — but why? Terrifying yourself doesn’t intuitively sound like fun, but humans love to seek out frights, whether that means ghost stories or a rollercoaster. In 2024, Vox’s Unexplainable podcast spoke with some researchers trying to figure it out.