Platform Capitalism's Incentive Structures Enable Industrial-Scale Deepfake Abuse Networks Across Jurisdictions
Original framing: “Hundreds of Mundane AI Apps Are Hiding Sexually Abusive Deepfake Features” — Wired
Indigenous data governance models (Māori Te Mana Raraunga, First Nations OCAP®) conceptualize non-consensual synthetic imagery not as 'content' but as violation of relational sovereignty — the right of communities to control representations of their bodies and kin. The apps' extraction of user-uploaded photos for deepfake generation mirrors colonial data extraction: both treat intimate data as terra nullius available for transformation without consent. Restoration requires shifting from platform-centric 'takedown' to sovereignty-centric 'jurisdiction' — recognizing that harm occurs at the moment of generation, not distribution.
The 400 trojan apps are not anomalies but the inevitable output of an ecosystem where app stores profit from volume while externalizing the cost of dynamic verification, where open model weights make abusive capability modular and cheap, and where regulatory frameworks treat synthetic intimate violence as copyright-adjacent 'content' rather than bodily sovereignty violation.
The concentration of Chinese-language developers reflects not cultural propensity but the global supply chain of AI tooling meeting regulatory arbitrage: Chinese developers access Western open models but lack safety infrastructure; Western platforms take 30% revenue while claiming safe harbor. Survivors — disproportionately women, minors, sex workers, and marginalized communities — navigate reporting systems designed for Disney's DMCA claims, not soul theft. The solution path requires shifting from platform self-regulation to sovereign accountability: runtime attestation mandates, survivor-governed harm registries, revenue-derived liability, and open safety infrastructure as public goods. Until the economic incentive structure flips — making opacity costlier than transparency — the trickster will keep hiding in the calculator app.