Meta is rolling out a new generation of artificial intelligence systems to strengthen how it enforces content rules across its platforms, while simultaneously reducing its dependence on third-party moderation vendors.
The move marks a significant shift in how the company handles trust and safety, with AI now taking on a larger share of the workload previously handled by human reviewers and external contractors. Meta said the new systems are designed to improve accuracy, speed, and consistency in detecting harmful or rule-breaking content.
According to a press statement by the company, the AI tools can identify more violations than traditional moderation systems while also reducing mistakes. Early testing shows that the systems are capable of detecting significantly more cases of harmful content, including sensitive categories, while cutting error rates by over 60 per cent.
Meta added that the technology is particularly effective in areas where bad actors constantly evolve their tactics, such as scams, impersonation, and illicit online activities. The systems can also respond more quickly to real-world events, enabling faster removal of harmful posts as situations unfold.
One of the more notable improvements is in scam detection. Meta says its AI tools can identify and block thousands of scam attempts daily, including schemes designed to trick users into revealing login credentials. The systems can also detect suspicious account behaviour, such as logins from unfamiliar locations or sudden profile changes, helping prevent account takeovers.
Despite the shift toward automation, Meta emphasised that human moderators will not be completely removed from the process. Instead, AI will take over repetitive and high-volume tasks, such as reviewing graphic content or identifying patterns in large datasets, allowing human reviewers to focus on more complex and nuanced decisions.
The transition also reflects a broader strategic goal: bringing more of its moderation infrastructure in-house. By reducing reliance on external vendors, Meta aims to have greater control over its systems, improve efficiency, and address long-standing criticism about the quality and consistency of outsourced moderation.
The rollout comes at a time when the company faces increasing scrutiny over how it handles harmful content across platforms like Facebook and Instagram. Regulators and advocacy groups have raised concerns about issues ranging from online scams to harmful and misleading content, pushing tech companies to invest more heavily in safety technologies.
Meta’s investment in AI-driven moderation highlights a wider trend across the tech industry, where companies are turning to advanced machine learning tools to manage the growing scale and complexity of online content. As digital platforms expand, manual moderation alone has become increasingly difficult to sustain.
While the company remains optimistic about the new systems, the shift also raises questions about transparency and accountability, particularly as automated tools take on a more central role in deciding what content stays online.
Get the latest news and insights that are shaping the world. Subscribe to Impact Newswire to stay informed and be part of the global conversation.
Got a story to share? Pitch it to us at info@impactnews-wire.com and reach the right audience worldwide
Discover more from Impact AI News
Subscribe to get the latest posts sent to your email.
