In its latest quarterly report on adverse threats, Meta, the parent company of Facebook, highlights China as an emerging source of coordinated inauthentic behavior (CIB) campaigns. The report emphasizes that China, along with Russia and Iran, ranks high in engaging in activities like fake user accounts and manipulating public discourse for strategic objectives. Meta acknowledges disrupting three CIB networks in the third quarter, including two from China and one from Russia. This development raises concerns about the potential escalation of covert influence efforts, especially with the advancements in generative artificial intelligence (AI).
Coordinated Inauthentic Behavior (CIB) by China
Meta’s report underscores that China is becoming a notable player in CIB campaigns, characterized by activities such as the creation of fake accounts and manipulation of public discussions. The company reveals its efforts to counter three CIB networks, with one major operation requiring the removal of 4,780 Facebook accounts associated with a Chinese network. The individuals behind this activity impersonated Americans by using basic fake accounts with profile pictures and names copied from the internet. Such campaigns aim to influence debates across different platforms.
Disinformation Challenges and Trends
Disinformation campaigns, often linked to foreign actors, have been a longstanding challenge for Facebook, particularly highlighted after the 2016 US elections. The report acknowledges that China has been the subject of Meta’s earlier disinformation removals, with thousands of accounts removed in previous actions. Meta anticipates a potential pivot to China-based influence operations in upcoming election cycles worldwide, particularly if China becomes a political talking point.
Evolving Tactics and Use of Online Platforms
Meta notes a trend in CIB campaigns wherein bad actors are diversifying their platforms, moving away from concentrating activities on a single large platform. The report attributes this shift to increased scrutiny on major platforms, leading threat actors to utilize smaller sites like Medium, Reddit, and Quora. This diversification poses challenges for tracking and countering these campaigns effectively.
Challenges Posed by Generative AI
As generative AI technology advances, Meta acknowledges the challenges it presents in the context of spreading disinformation. While the company has not observed evidence of generative AI being used for disinformation, it emphasizes the need for vigilance and preparedness as tactics evolve. Meta, being a major investor in AI, employs the technology to identify content that may violate its policies.
Readiness for Synthetic Material in Society
Looking ahead to upcoming elections, Meta warns that the protective community needs to be prepared for large amounts of synthetic material in society. The report emphasizes the importance of defenses evolving to address adverse practices on a larger scale, especially concerning AI-generated content.
Conclusion
Meta’s report sheds light on the increasing prominence of China in engaging in coordinated inauthentic behavior and disinformation campaigns. As the landscape of online influence operations evolves, Meta emphasizes the need for adaptive defense mechanisms, particularly in the face of advancements in generative AI. The company’s commitment to remaining vigilant and countering emerging threats reflects the ongoing challenges in maintaining the integrity of online discourse and mitigating the impact of covert influence efforts.
