Meta Serves 7,600 Ads For China App With Deepfake Content

Meta's Facebook and Instagram have been found to have served approximately 7,600 advertisements for AI-powered apps that can transpose women's faces onto sexually explicit content, according to a report by the Tech Transparency Project (TTP). The ads were delivered through GatherOne, a Beijing-based company that connects Chinese firms with Meta's platforms for advertising purposes.

The report highlights a significant failure by Meta to enforce its own advertising policies, which prohibit sexually suggestive ads or those promoting apps designed to digitally strip individuals depicted in images. Despite these policies, the ads were still able to reach users on Facebook and Instagram.

Katie Paul, director of TTP, stated that Meta appears to be giving a 'free pass' to GatherOne, suggesting that the company prioritizes advertising revenue over user safety. Meta's Head of Women's Safety Policy, Cindy Southworth, responded by saying that the company does not allow non-consensual intimate imagery or nudify apps on its platforms and takes steps to combat them.

GatherOne has also responded, stating that it complies with Meta's advertising policies and maintains a zero-tolerance stance on deceptive practices, adult content, non-consensual explicit AI-generated material, and child exploitation. The company has announced that it will be suspending new advertising accounts for AI nudifying and face-swap services and undertaking a compliance upgrade.

The report provides insight into how Meta generates revenue from China, where its own platforms are blocked, through intermediaries like GatherOne. In 2024, Meta reported $18.4 billion in China sales, accounting for 11 percent of its global revenue. This is more than double what it made in the country in 2022.

The findings also included an Android app that was flagged for allegedly containing illegal content involving minors, despite being listed as suitable for all ages. The app was subsequently removed from Google Play.

The incident raises concerns about the spread of deepfake content and the ability of companies like Meta to enforce their own policies. It also highlights the challenges of regulating online content and the need for greater transparency and accountability in the advertising industry.

In the context of the broader digital landscape, the report underscores the importance of prioritizing user safety and enforcing policies to prevent the spread of harmful content. As technology continues to evolve, it is crucial for companies like Meta to stay ahead of the curve and ensure that their platforms are not used to facilitate harmful activities.

The report's findings have significant implications for Meta and the wider advertising industry, highlighting the need for greater scrutiny and regulation of online content. As the use of AI-powered apps continues to grow, it is essential that companies prioritize user safety and take steps to prevent the spread of harmful content.

In conclusion, the report's findings are a cause for concern, highlighting the need for greater transparency and accountability in the advertising industry. Meta's failure to enforce its own policies has allowed harmful content to reach users, and it is essential that the company takes steps to address this issue and prioritize user safety.

The incident also raises questions about the role of intermediaries like GatherOne in facilitating the spread of harmful content. As the advertising industry continues to evolve, it is crucial that companies like Meta take steps to ensure that their platforms are not used to facilitate harmful activities.

Ultimately, the report's findings highlight the need for greater scrutiny and regulation of online content. As technology continues to evolve, it is essential that companies prioritize user safety and take steps to prevent the spread of harmful content.