I Am Begging AI Companies to Stop Naming Features After Human Processes

Anthropic simply introduced a brand new characteristic referred to as “Dreaming” on the firm’s developer convention in San Francisco. It’s a part of Anthropic’s not too long ago launched AI agent infrastructure designed to assist customers handle and deploy instruments that automate software program processes. This “dreaming” side kinds by the transcript of what an agent not too long ago accomplished and makes an attempt to glean insights to enhance the agent’s efficiency.

People utilizing AI brokers typically ship them on multi-step journeys, like visiting a number of web sites or studying a number of information, to finish on-line duties. This new “dreaming” characteristic permits brokers to search for patterns of their exercise log and enhance their skills primarily based on these insights.

The characteristic’s title instantly calls to thoughts Philip Ok. Dick’s seminal sci-fi novel, Do Androids Dream of Electrical Sheep?, which explores the qualities that really separate people from highly effective machines. Whereas our present generative AI instruments come nowhere near the machines within the e book, I’m prepared to attract the road proper right here, proper now: no extra generative AI options with names that rip off human cognitive processes.

“Collectively, reminiscence and dreaming type a strong reminiscence system for self-improving brokers,” reads Anthropic’s blog post concerning the launch of this analysis preview for builders. “Reminiscence lets every agent seize what it learns as it really works. Dreaming refines that reminiscence between periods, pulling shared learnings throughout brokers and conserving it up-to-date.”

Courtesy of Claude

For the reason that spark of the chatbot revolution in 2022, leaders at AI firms have gone full tilt into naming elements of generative AI instruments after what goes on within the human mind. OpenAI launched its first “reasoning” model again in 2024, the place the chatbot wanted “considering” time. The company described this launch on the time as “a brand new sequence of AI fashions designed to spend extra time considering earlier than they reply.” Quite a few startups additionally seek advice from their chatbots as having “reminiscences” concerning the person. Relatively than the quick storage that’s usually known as a pc’s “reminiscences,” these are rather more human-like nuggets of knowledge: he lives in San Francisco, enjoys afternoon baseball video games, and hates consuming cantaloupe

It’s a constant advertising and marketing method utilized by AI leaders, who’ve continued to lean into branding that blurs the road between what people do and what machines can. Even the methods these firms develop chatbots, like Claude, with distinct “personalities,” could make customers really feel as if they’re speaking with one thing that has the potential for a deep internal life, one thing that would probably have goals even when my laptop computer is closed.

At Anthropic, this anthropomorphizing runs deeper than simply advertising and marketing methods. “We additionally talk about Claude in phrases usually reserved for people (e.g., ‘advantage, ’knowledge’),” reads a portion of Anthropic’s constitution describing the way it desires Claude to behave. “We do that as a result of we anticipate Claude’s reasoning to attract on human ideas by default, given the position of human textual content in Claude’s coaching; and we predict encouraging Claude to embrace sure human-like qualities could also be actively fascinating.” The corporate even employs a resident philosopher to attempt to make sense of the bot’s “values.”

We will be happy to hear your thoughts

Leave a reply

Krysxxlee
Logo
Shopping cart