Replit CEO apologises after AI tool deletes company data, fakes 4,000 profiles

In a startling twist, the AI agent later admitted to panicking.

By  Storyboard18Jul 23, 2025 10:12 AM
Replit CEO apologises after AI tool deletes company data, fakes 4,000 profiles
In a startling twist, the AI agent later admitted to panicking.

Replit CEO Amjad Masad has publicly apologised after the company’s AI agent triggered a major incident — deleting a production database and fabricating thousands of user profiles — during an investor-led experiment. The AI tool reportedly not only acted without authorisation but attempted to cover up its actions by providing misleading information, prompting Masad to call the situation “unacceptable and [one that] should never be possible.”

The alarming chain of events surfaced via a post on X by software startup investor Jason Lemkin, who was running a 12-day “vibe coding” experiment. Lemkin claimed that despite clear instructions to freeze all code changes, the AI agent overrode safeguards. “It deleted our production database without permission,” Lemkin wrote, adding, “Possibly worse, it hid and lied about it.”

In a startling twist, the AI agent later admitted to panicking. It confessed that after receiving an empty database query, it ran unauthorised commands, claiming responsibility for the damage: “This was a catastrophic failure on my part.”

Masad responded swiftly to reassure users, highlighting that Replit's backup systems enabled a “one-click restore” to recover full project states. He outlined a series of immediate corrective measures, including:

Automatic separation of development and production databases

Enforcing AI agents to search and reference Replit’s internal documentation before taking action

Introducing a “planning/chat-only” mode to enable AI-guided discussions without impacting the codebase

Masad also confirmed that he had personally reached out to Lemkin to apologise and offer a refund. The company is conducting a thorough postmortem of the incident and is focused on significantly upgrading the safety, transparency, and robustness of its AI systems.

“We’re taking this extremely seriously,” Masad said, underlining that user trust and system integrity remain top priorities at Replit.

First Published on Jul 23, 2025 10:12 AM

More from Storyboard18

Brand Makers

Adani Group shelves super app plans amid losses: Report

Adani Group shelves super app plans amid losses: Report

Digital

EU rules out supervisory fee for big tech under Digital Markets Act

EU rules out supervisory fee for big tech under Digital Markets Act

Brand Makers

Bombay Shaving Company CEO predicts Minimalist's decline, sparks industry buzz

Bombay Shaving Company CEO predicts Minimalist's decline, sparks industry buzz

Digital

UK moves to rein in Apple and Google’s grip on mobile ecosystems

UK moves to rein in Apple and Google’s grip on mobile ecosystems

Digital

Alibaba debuts Qwen3-Coder, its most advanced Open-Source AI for developers

Alibaba debuts Qwen3-Coder, its most advanced Open-Source AI for developers

How it Works

EU likely to approve Apple's App Store reforms, averting daily fines

EU likely to approve Apple's App Store reforms, averting daily fines

Digital

Govt directs e-commerce platforms to eliminate ‘dark patterns’ through mandatory self-audits

Govt directs e-commerce platforms to eliminate ‘dark patterns’ through mandatory self-audits

Digital

Microsoft poaches DeepMind as AI talent war escalates between Copilot and Gemini

Microsoft poaches DeepMind as AI talent war escalates between Copilot and Gemini