Apple tightened its developer guidelines over the weekend to ban apps that use AI to create offensive content, as well as those that masquerade as regular apps to pass the App Store review process and then turn into nudify apps, or surface those features prominently.
The company updated its guidelines with strong language around AI and user-generated content, and how app developers should include enough preventative measures to moderate objectionable or offensive content.
“Apps that host user-generated content are required to filter objectionable material, give users a way to report offensive content, and let users block abusive accounts. Apps containing hidden or undocumented features are also prohibited on the App Store, including apps that misrepresent their purpose during review and only reveal harmful capabilities — such as “nudification” — after approval, a tactic commonly known as bait-and-switch,” the company said in a blog post.
Apple said that it will remove apps that add features not present in the version submitted for App Store review.
The iPhone maker has also updated the language in its legal section to reinforce that it will bar apps promoting human trafficking and exploitation of children.
Apple said last year its review process blocked over 150,000 apps from reaching users, and removed 193,000 developer accounts on account of fraud and abuse.
In July, San Francisco ordered both Apple and Google to clean up and delete nudification apps from their app stores. City Attorney David Chiu accused the companies of profiting from these apps through store fees. And in April, a Tech Transparency Project report indicated that both tech giants’ stores hosted multiple nudify apps , some of which were rated as suitable for minors.
When you purchase through links in our articles, we may earn a small commission . This doesn’t affect our editorial independence.
Ivan covers global consumer tech developments at TechCrunch. He is based out of India and has previously worked at publications including Huffington Post and The Next Web.
You can contact or verify outreach from Ivan by emailing [email protected] or via encrypted message at ivan.42 on Signal.
Get 50% off a second pass Cover more ground at TechCrunch’s ultimate founder bootcamp of the year by bringing your co-founder or partner. Save 50% off a second pass. Meet scaling and investment leaders, ask questions, find solutions, and more. Last day to save Oct. 16
Anthropic says its workforce has become less junior and is spending more time in meetings Anthony Ha
Replit makes OpenAI its default over Anthropic, CEO says Kirsten Korosec Lucas Ropek Rebecca Bellan
Mark Wahlberg wants to take on the longevity-startup crowd with an affordable gym concept Connie Loizos
Tesla reveals SpaceX-powered Roadster that flies and falls with style Sean O'Kane
FBI arrests OpenAI employee accused of planting hidden recording device in conference room Zack Whittaker
Bumble agrees to a $1.3B acquisition deal as online dating faces a reset Lauren Forristal
Just 5 years in, interactive chatbot platform Character.AI files for bankruptcy Ivan Mehta