AIだけではソーシャルメディアコミュニティをAIから守れないAI isn’t enough to protect social media communities from AI

Protecting Social Media Communities

AI-generated low-value material and hateful content can threaten the safety and value of social media platforms. Although AI-driven moderation is becoming widespread, relying on AI alone may make these problems worse rather than adequately protecting communities from AI-generated harm.

The central issue is not simply whether AI can identify or remove content. It is whether platforms can preserve the authenticity and human participation that make social communities valuable while responding to harmful or low-quality material.

Authentic, Valuable Content

At its best, social media gives people a place to share experiences and knowledge. It comes closest to that ideal when users contribute authentic and valuable material, such as a uniquely thoughtful blog post or a helpful video explaining how to build a PC.

Primarily assigning the preservation of that authenticity to AI tools overlooks the people behind the content. If the value of a community comes from what its users know, experience, and choose to share, moderation cannot be treated only as an automated content-processing task.

Adding more AI to address AI slop also follows a “fight fire with fire” approach that may intensify the underlying problem. The use of AI as a moderation tool does not by itself ensure that a platform will retain the qualities that made its community worthwhile.

Human Oversight Remains Essential

Experts argue that human oversight continues to be essential as AI-driven moderation spreads across social platforms. AI alone cannot adequately defend communities against harms produced by AI, particularly when moderation is also meant to maintain authentic and useful participation.

Human moderation therefore remains important alongside automated systems. The activity surrounding moderators is reflected in the r/AskHistorians Reddit community, whose moderators had a Slack channel that was usually busy in April.

The broader limitation is clear: protecting a social media community involves more than applying AI to unwanted content. It also requires attention to the human contributions, judgment, and oversight at the center of the community itself.