Deepfake Apps Turn App Stores into Infrastructure for Sexual Abuse
Deepfake app removal refers to efforts by regulators, platforms, and civil society to force the deletion of AI-powered face swap and nudify tools from app stores and social media ecosystems when those tools are widely used to create nonconsensual deepfakes, including sexually explicit images of people without their knowledge or consent. That framing matters, because it puts responsibility not only on individual abusers but on the companies that make abuse cheap, scalable, and one click away. At this point, the scandal is not simply that such apps exist; it is that Apple and Google continue to distribute them while profit-sharing on in‑app purchases. Their app store moderation has failed to treat nonconsensual intimate imagery as a red‑line harm, instead relegating it to the same category as ordinary adult content. When deepfake pornography is largely a violence problem, that stance is indefensible.
Cease-and-Desist Letters Expose Holes in App Store Moderation
San Francisco’s city attorney David Chiu has moved from criticism to confrontation, sending cease-and-desist letters to Apple and Google targeting 13 face-swap apps that generate AI nonconsensual intimate images. His message is blunt: by hosting and billing for these tools, the companies are "aiding and abetting" the sale of explicit deepfake images and violating laws that prohibit supporting services that create deepfake pornography. This is a direct indictment of current app store moderation. Both firms have policies that ban pornography, abuse, and harassment, and Google says it has already suspended "hundreds" of violating apps and restricted search terms like "nudify" on its store. Yet Chiu’s action shows those rules are reactive and porous. Researchers and journalists keep finding new abuse-enabling face swap apps in the stores, some rated as suitable for children. When enforcement only follows public shaming, moderation has failed.
YouTube and X as Gateways to Nudify Services
App stores are not the only weak link. Social platforms, meant to block nonconsensual intimate images, have become traffic funnels for nudify services. According to the Institute for Strategic Dialogue, mainstream social networks sent more than 5.7 million visits to nudify sites between December 2025 and March 2026, with YouTube alone driving 1.82 million visits and X more than 1.3 million. Videos and posts surfaced through searches for terms like "undress app" and "nudify app," promoting specific services, sharing promo codes, and linking directly to sites that charge as little as USD 1 (approx. ₱60) per generated image. This is not a marginal phenomenon hiding in fringe forums; it is embedded in the discovery systems of the largest platforms. When YouTube policies explicitly ban sexually explicit content and links to such sites, yet violative material remains easy to find, the claim that the platform is taking nonconsensual deepfakes seriously rings hollow.
The Gendered Reality of Face Swap Apps Abuse
Behind the debates over app store moderation and deepfake app removal is a stark pattern: the overwhelming targets of face swap apps abuse are women and girls. Reporting shows that people, mostly men, use nudify and face-swap tools to upload reference photos and generate images that digitally undress women or place them in graphic sexual scenarios, often within seconds. Previous investigations have documented deepfake sexual abuse images of minors in at least 90 schools, and the ISD study describes targets ranging from current and ex‑girlfriends to relatives like sisters and cousins. Motivations are not limited to sexual gratification; some users openly seek to get women fired or to wreck their lives and livelihoods. In this light, nudification tech is better understood as a scalable harassment weapon than as adult entertainment. Every time an app store waves such tools through review, it is effectively approving a new instrument of gendered abuse.
Regulators Want Structural Enforcement, Not One-Off Takedowns
The key question is not whether Apple, Google, YouTube, or X can remove some offending apps or channels when pressured; they clearly can. The question is whether they will redesign app store moderation and platform policies to treat nonconsensual deepfakes as a systemic abuse risk that must be screened out before distribution. Chiu’s letters demand that the companies "sever" business relationships with developers of nudify and explicit deepfake tools, and stop profiting from in-app payments that monetize sexual abuse. That is a call for structural changes: better pre‑approval review, ongoing audits of AI image apps, and real penalties for repeat offenders. Social platforms, meanwhile, must close referral loopholes that let creators openly advertise nudify services against their own rules. Until those enforcement actions become default practice rather than emergency measures, app stores and social networks will remain core infrastructure for nonconsensual deepfakes.
