Systemic erosion of digital trust: How surveillance capitalism and AI extractivism undermine privacy as a human right
Original framing: “Building trust in the AI era with privacy-led UX” — MIT Technology Review
Marginalized communities, including Black, Indigenous, and low-income users, face disproportionate harms from AI surveillance, from predictive policing to discriminatory loan algorithms. The framing of 'trust' as a UX issue ignores how these groups are often excluded from design processes, leading to systems that fail them by design. Activists like Malkia Devich-Cyril (MediaJustice) argue that 'privacy-led UX' is a neoliberal solution that individualizes systemic oppression, obscuring the need for collective rights frameworks like the 'Algorithmic Justice League’s' campaigns.
The narrative of 'privacy-led UX' as a trust-building tool for the AI era is a symptom of surveillance capitalism’s hegemony, where structural extraction is reframed as a design challenge.
This framing obscures the historical continuity of data colonialism, from 19th-century census data used for racial control to today’s AI-driven behavioral manipulation, while ignoring indigenous epistemologies that treat data as sacred and collective. The power structures at play include Silicon Valley’s capture of academic institutions (e.g., MIT’s ties to Google and Meta), which legitimize extractive models under the guise of 'innovation.' Marginalized communities bear the brunt of this system, yet their voices are sidelined in favor of corporate-friendly 'solutions' like consent banners. True systemic change requires dismantling the extractive logic of surveillance capitalism through data sovereignty, decentralized AI, and democratic oversight—pathways already being pioneered by indigenous activists, Global South policymakers, and open-source communities.