Meta has pulled a controversial feature from its new Muse Image model after widespread backlash. The feature let users create AI-generated images of other people by @-mentioning their public Instagram accounts. No consent was needed, just a username. The feature was enabled by default, and anyone who did not want their photos used had to manually opt out through Instagram's settings.
Meta acknowledged the problem and shut down the feature just days after announcing it. The company said it had wanted to offer "a useful creative tool and to give people control over whether their public content could be referenced in this way." In Europe, the feature likely would not have survived anyway due to stricter data protection rules.
A feature borrowed from OpenAI?
Meta may have taken inspiration from OpenAI's now-discontinued Sora app. That app let users create "cameos" of themselves and, with permission, allow others to use those in their videos. The feature was a viral hit at launch, but interest faded quickly.
Privacy concerns and backlash
The Muse Image feature raised serious privacy concerns. Critics argued that allowing anyone to generate AI images of another person without their explicit consent was a dangerous step. The fact that it was on by default made it even more problematic. Users had to dig into Instagram's settings to opt out, a process that many found confusing or difficult.
Meta's admission that the feature "missed the mark" was a rare concession from the company. It is unclear if the feature will return in a modified form or if Meta will abandon the idea entirely.
Stay updated
Get the day's AI and automation news in your inbox. No spam, unsubscribe anytime.
What is Muse Image?
Muse Image is Meta's latest AI image generation tools model. It is designed to create images from text prompts. The controversial feature was an extension of that capability, allowing users to reference real Instagram accounts in their prompts. The feature was meant to make the tool more social and interactive, but it backfired.
The broader context
This is not the first time a tech company has faced backlash over AI features that use people's images without consent. Similar controversies have surrounded other AI tools, including those from OpenAI and Google. The incident highlights the ongoing tension between innovation and privacy in the AI industry.
Meta's decision to remove the feature quickly suggests the company is sensitive to privacy concerns, at least in this instance. However, critics say the feature should never have been launched in its current form. The episode serves as a reminder that AI tools can have unintended consequences when they interact with real people's data.