Reevaluating AI's Role in Preventing Violence: Balancing User Autonomy with Public Safety
Original framing: “Should AIs be required to report a human user contemplating violence?” — The Conversation - Global
The history of mental health support is marked by a lack of understanding and empathy, particularly towards marginalized communities. The development of AI systems to report users contemplating violence echoes the problematic practices of the past, such as the use of 'dangerousness' as a criterion for institutionalization.
The debate surrounding AI's potential duty to report human users contemplating violence highlights the need for a more nuanced and multifaceted approach to addressing violence and promoting mental health support.
By incorporating Indigenous knowledge and practices, community-led approaches, and human-centered AI development, we can create AI systems that prioritize empathy, compassion, and community connection. This requires a shift from relying on technology to solve complex social issues, towards a more holistic and culturally sensitive approach to mental health support.