- The Strategist - https://www.aspistrategist.org.au -

As Taiwan voted, Beijing spammed AI avatars, faked paternity tests and ‘leaked’ documents

Posted By on January 18, 2024 @ 13:00

ASPI has identified multiple attempts by the Chinese Communist Party (CCP) to manipulate Taiwanese voters by spreading disinformation and propaganda across social media. These influence operations primarily sought to undermine Democratic Progressive Party (DPP) presidential and legislative candidates. We assess they likely had a minimal impact on the integrity of the election results due to the resilience [1] of Taiwan’s civil society. Partial credit must also go to the Taiwanese government for its efforts to raise [2] public awareness of electoral interference, and a crackdown on other illicit activities, such as the spreading of fake polls [3].

We observed at least two China-originated threat actors seeking to interfere in this election. We believe one is likely linked to the CCP’s largest network [4] of inauthentic social media accounts known as Spamouflage or Dragonbridge. This network evolved its online influence capabilities by utilising AI-generated avatars and amplified the contents of a document it called ‘The Secret History of (outgoing president) Tsai Ing-wen’. Another China-based actor we assess is likely linked to the first coordinated inauthentic behaviour (CIB) network identified in Meta’s 2023 third quarter adversarial threat report [5]. This second threat actor conducted more sophisticated cyber-influence operations, including disseminating what it claimed were leaked Taiwanese government documents, and a fake DNA paternity test.

The key takeaway for other democracies with elections in 2024 is that they must not become complacent because the CCP is likely to replicate and improve its tactics in more divided and less resilient electorates where they may be more effective. We found that some of the inauthentic social media accounts [6] trying to sway Taiwanese voters were also spreading anti-Bharatiya Janata Party (BJP) and anti-Indian government content, presumably to impact public sentiment before India’s elections this year. These accounts are primarily targeting audiences in India’s northeast region of Manipur [7], where India has [8] suspected [9] Beijing of aiding insurgent groups to destabilise the region.

The Spamouflage-affiliated accounts on X/Twitter [10] (see image below), Facebook [11], Medium [12] and Taiwanese blog sites [13] called for a change [14] in government and accused DPP presidential candidate Lai Ching-te of corruption [15] and embezzling [16] military procurement expenses. They named him and vice-presidential candidate and former representative to the US, Hsiao Bi-khim, as ’America’s pets’ [17]. The most common narrative spread by these accounts accused Lai and Hsiao of secretly signing [18] a NT$2 trillion (US$65 billion) arms purchase from the US to help the DPP win the election. There are no authoritative reports of such a deal and the claim was almost certainly disinformation.

The posting patterns and timelines of these accounts suggested they were very likely linked to the Spamouflage network, which has links [19] to Chinese law enforcement and coordinates with other agencies such as the Ministry of Foreign Affairs and the United Front Work Department according to internal group communications revealed [20] by the US Department of Justice. Accounts targeting Lai and Hsiao were involved in previous Spamouflage campaigns targeting [21] Chinese virologist Yan Limeng, Chinese businessman Guo Wengui [22], and Chinese dissidents [23]. They also spread disinformation [24] about Japan’s release of treated wastewater. These accounts tended to post between 9am and 9pm—Beijing business hours. While Spamouflage accounts were active throughout 2023, ASPI observed this network significantly increasing posts attacking the DPP after the KMT and TPP joint presidential ticket collapsed [25] on 16 November 2023.

Spamouflage-affiliated accounts sought to harass DPP legislative candidates too, calling [26] the DPP’s Lin Ching-yi [27], a ‘shameless [28]’ politician. Accounts would reply [29] en mass to her posts and troll [30] or claim [31]she was ‘taking advantage of men to get ahead’ (#林静仪借男人上位). These tactics were reminiscent [32] of previous harassment and psychological targeting of women with Asian heritage which were intended to silence their public profiles and damage their mental health. Lin also faced negative [33] news [34] coverage throughout the year in the Straits Herald, a news outlet sponsored by the Fujian Daily, the official newspaper of the Fujian Provincial Committee of the Chinese Communist Party, which alleged falsely that she plagiarised her master’s thesis. Lin lost her seat [35] to KMT challenger Yan Kuan-heng.

Other politicians targeted by the network included Lin Feifan [36], the former deputy secretary-general of the DPP, and Taiwan’s Foreign Minister, Joseph Wu, who Spamouflage accounts accused [37] of sexually harassing [38] female colleagues and having affairs [39]. Posts targeting Wu would often use the #METOO hashtag and have images of him doctored [40] to include women (see images below).

Starting on 2 January 2024, Spamouflage-linked accounts began flooding social media platforms, including X/Twitter [41], Facebook [42], Reddit [43], WeChat [44] and TikTok [45], with posts about a 318-page document called ‘The Secret History of Tsai Ing-wen’ (蔡英文秘史), which falsely accused Tsai of corruption and promiscuous behaviour. The document was originally uploaded [46] on Zenodo, an open-source data repository previously used [47] by Spamouflage-linked operators to upload a document [48] claiming Covid-19 originated from the US. Most of the document’s metadata had been removed but enough remained to indicate that the document was created by ‘WPS 文字’, a word processor developed by Chinese software company Kingsoft and commonly used only in mainland China. To provoke further online attention, a link to the document was spammed to prominent [49] Chinese-language [50] online commentators [51].

On YouTube, Spamouflage-linked channels posted at least 490 videos referencing the ‘secret history’ document between 4 January and 10 January before YouTube suspended all the channels. As noted [52] by the Taipei Times, these videos involved the use of AI-generated content and some videos had been edited using Capcut, a software developed by ByteDance. In addition, ASPI found other companies possibly complicit in creating these videos. At least one video [53] appeared to have used a ‘speaking portrait’, a photorealistic AI-generated avatar created by D-ID, a US-based software company. ASPI is not suggesting that D-ID knowingly cooperated with Spamouflage-linked operators. However, the presenter used in the video (see images below) requires users to have a paid subscription to D-ID’s platform.

Another video [54] posted by Spamouflage accounts appeared to have been generated with the Weta365 [55] app (see images below) launched [56] by Mobvoi, an AI company founded by ex-Google scientist Li Zhifei [57] with funding [58] from Sequoia Capital China, Google and Volkswagen [59]. One of the case studies on Weta365’s website shows the application being used [60] by Chinese police officers for training videos, which implies that there may be deeper cooperation between Mobvoi and Chinese security or intelligence services.

The CCP is now comfortably leveraging AI-generated content as a cornerstone in its influence operations and propaganda arsenal. In late 2023, ASPI observed [61] a similar but distinct China-originated coordinated inauthentic influence campaign on YouTube using entities and voiceovers generated by AI to promote narratives such as China is winning the US-China technology war. This network of YouTube channels attracted just under 120 million views and 730,000 subscribers. With Spamouflage adopting similar tactics, the possibility of the network amassing significant online audiences with AI-generated content is a concerning development, especially outside closely monitored election periods.

In addition to Spamouflage activity, ASPI observed another likely CCP-linked online threat actor seeking to interfere in Taiwan’s election that was more targeted and operated more sophisticated personas. On 17 December 2023, an anonymous user uploaded [62] an alleged leak of Taiwanese government documents on the hacking crime forum, BreachForums. One of the documents claimed Taiwanese military intelligence funded a podcast called ‘Complicated Things in a Nutshell’ (繁事簡單說) as part of Taiwan’s media warfare against the mainland. The BreachForum’s post was then shared [63] at [64] least [65] 82 [66] times [67] on [68] X/Twitter [69], before HK01, a Hong Kong-based online news site launched by pro-Beijing businessman Yu Pun-hoi, was said to have been emailed similar documents and reported [70] about them on 4 January 2024.

On 7 January 2024, another anonymous BreachForum user named ‘jt53ur39’ uploaded [71] a fake DNA test purporting to show that Lai Ching-te had an illegitimate child. We agree with Radio Free Asia’s Fact Checking Laboratory’s assessment [72] that the DNA report was likely fake [72]. The numbers representing the allele sizes were not properly aligned down the columns and there was no conclusion in the interpretation box that is expected in typical reports. Jt53ur39’s forum post was first shared [73] on 4chan from an IP address originating from Thailand. ‘Lai Ching-te’s illegitimate son’ (賴清德私生子) was then mentioned nearly 20,000 times on X/Twitter [74], Facebook [75], YouTube [76] and other online forums [77] by inauthentic accounts that had also previously shared links to the alleged Taiwanese government document leaks. The number of such posts peaked on 12 January, the eve of the election, with over 13,000 mentions that day alone. This coincided with reporting [78] on the allegation by the China Times, a Taiwan-based newspaper that reportedly takes instructions [79] directly from the CCP’s Taiwan Affairs Office.

We assess that the network of inauthentic social media accounts sharing links to the Taiwanese government document leaks and the fake DNA test is likely linked to a China-based CIB network targeting India, Tibet and the US. Almost all of the X/Twitter accounts had retweeted @NickJonas154141 [80], an account identified as being acquired by a China-based CIB network in Meta’s 2023 Third Quarter Adversarial Threat Report [5]. Like that CIB network, all the accounts in the new network posed as Indian citizens and posted anti-BJP or anti-Indian government content that primarily targeted users in Manipur.

The account, Ayush Satyal [6], identifies as being located in Nepal and has over 100 followers but appears to have stolen the profile image of Kapil Gnawali [81], a Nepal-based engineer not linked to the China-based network. Ayush Satyal frequently uses [82] the #Manipur hashtag, retweets [83] NickJonas154141, shares [84] posts about Lai’s DNA test on BreachForums (which is the only Chinese-language post on his profile) and calls [85] for Indians to never vote for the BJP because of its activities in the Manipur region (see images below).

It’s difficult to assess the effectiveness of the CCP’s influence operations in these elections. More research could be collected on Taiwanese sentiments leading up to the election and how specific CCP-fueled narratives influenced opinions. Taiwan elected DPP candidates Lai and Hsiao, which suggests the CCP was ineffective in swinging the vote. But the DDP lost its majority in Taiwan’s parliament, the Legislative Yuan. That could in part be due to the CCP’s amplification of anti-DPP content but it’s more likely to be Taiwanese people expressing dissatisfaction [86] with the DPP’s domestic policies and the increased cost of living.

The prevalence of two known China-based networks, Spamouflage and the India-focussed CIB network, on social media platforms shows that X/Twitter is failing [87] to ensure online safety during a year of important elections. Of all the X/Twitter accounts listed in Meta’s 2023 Q3 Adversarial Threat Report [5] as having been acquired by a China-based CIB network, only one out of seven has been suspended by X/Twitter. Other platforms such as YouTube and Meta are being proactive and taking down state-backed influence operations when they are detected. However, the research community still lacks access to archives of these takedowns. That access would enable independent investigators to study new threat actors and force platforms to be more transparent in content moderation decisions.

The burden of preventing electoral interference must also extend to emerging Western generative AI companies. A laissez-faire approach to online safety could damage democracy and lessen public trust. OpenAI’s announcement [88] of a series of new initiatives to protect the integrity of elections is a welcome start but OpenAI should also publicly release threat reports of malicious state and non-state actors misusing their products as do social media platforms. Companies like Synthesia [89] and D-ID, whose products are being co-opted by authoritarian intelligence and military services, must be more rigorous in their due diligence regarding their clients, or governments should consider making generative AI companies liable for defamation or facilitating electoral interference.

Likewise, Western governments and companies need to reassess their foreign direct investments into China’s AI industry if the products they are funding, such as Mobvoi’s Weta365 generative AI app, are likely to be used in political warfare operations against democratic states. There are no low-risk investments in China’s dual-use AI sector. Any Chinese AI company that is likely to succeed with a high return on foreign investment, will at the same time have the capabilities that the CCP desires to modernise its military or intelligence services and will be required to cooperate because of Beijing’s National Intelligence Law [90].

Democracies conducting elections later this year, such as India, Indonesia, the UK and the US, should strengthen their relationship with Taiwan and the new Lai Administration. India and Taiwan should share intelligence on CCP threat actors active in the recent Taiwanese election and jointly investigate the China-based inauthentic social media accounts targeting India’s Manipur region. Taiwan should share an intelligence memo [91] about a December 2023 meeting between senior Chinese leaders from the Propaganda Department, the Ministry of State Security, the Ministry of Defence and the Taiwan Affairs Office to consolidate their influence operations targeting the Taiwan election.

The success of Taiwan’s whole-of-society counter-disinformation and propaganda efforts is primarily due to the efforts of civil organisations, including DoubleThink Lab [92], the Information Environment Research Center [93], the Taiwan FactCheck Center [94], Cofacts [95], Kuma Academy [96] and many others. These organisations often investigate malicious online activity before government agencies can respond and counter false narratives in real time. They are themselves the targets of the CCP’s propaganda apparatus.

Their collaborative approach demonstrates that defending against disinformation and electoral interference is not something organisations or states should face alone.



Article printed from The Strategist: https://www.aspistrategist.org.au

URL to article: https://www.aspistrategist.org.au/as-taiwan-voted-beijing-spammed-ai-avatars-faked-paternity-tests-and-leaked-fake-documents/

URLs in this post:

[1] resilience: https://www.codastory.com/authoritarian-tech/taiwan-election-disinformation-china/

[2] raise: https://www.reuters.com/world/asia-pacific/taiwan-alert-chinese-funded-election-interference-2023-06-21/

[3] fake polls: https://www3.nhk.or.jp/nhkworld/en/news/20231223_07/

[4] largest network: https://edition.cnn.com/2023/11/13/us/china-online-disinformation-invs/index.html

[5] adversarial threat report: https://transparency.fb.com/sr/Q3-2023-Adversarial-threat-report

[6] accounts: https://twitter.com/SatyalAyus59794

[7] Manipur: https://www.usip.org/publications/2023/06/understanding-indias-manipur-conflict-and-its-geopolitical-implications

[8] has: https://www.bloomberg.com/news/articles/2020-12-07/india-accuses-china-of-helping-rebels-groups-on-myanmar-border

[9] suspected: https://thewire.in/security/chinese-aid-army-ex-chief-gen-naravane-says-foreign-interference-in-manipur-definitely-there

[10] X/Twitter: https://archive.vn/8o9pb

[11] Facebook: https://www.facebook.com/permalink.php?story_fbid=pfbid03cevFiCxgGG8fS2yRr7ft97hN5NwWLpyaLxt7pu5RjQjCAceV9YGVTzogDJ96y8Vl&id=100089713916720

[12] Medium: https://archive.vn/EEmlo

[13] blog sites: https://web.archive.org/web/2/https:/showwe.tw/blog/article.aspx?a=58333

[14] change: https://archive.vn/djnQr

[15] corruption: https://twitter.com/KaplanRhea92363/status/1730146047975198977

[16] embezzling: https://twitter.com/NguyenMali47976/status/1730128732432761042

[17] ’America’s pets’: https://archive.vn/4i6FZ

[18] secretly signing: https://web.archive.org/web/20231127171350/https:/showwe.tw/blog/article.aspx?a=58333

[19] links: https://www.aspi.org.au/report/gaming-public-opinion

[20] revealed: https://www.justice.gov/d9/2023-04/squad_912_-_23-mj-0334_redacted_complaint_signed.pdf

[21] targeting: https://twitter.com/WinniSpender

[22] Guo Wengui: https://twitter.com/goqing674179215/status/1729736510998507974

[23] Chinese dissidents: https://twitter.com/Victori13268053/status/1724329187962716246

[24] disinformation: https://showwe.tw/blog/main.aspx?m=12567

[25] collapsed: https://thediplomat.com/2023/11/taiwan-oppositions-bid-for-a-unity-ticket-collapses/

[26] calling: https://twitter.com/ModestyPar71391/status/1737302367115133376

[27] Lin Ching-yi: https://www.ly.gov.tw/EngPages/List.aspx?nodeid=12101

[28] shameless: https://twitter.com/TGuynup70700/status/1737304666113720508

[29] reply: https://twitter.com/ArnettaSpi26213/status/1729028438332498197

[30] troll: https://twitter.com/GronitzW68343/status/1729030452160393492

[31] claim : https://archive.vn/Cky1n

[32] reminiscent: https://www.aspistrategist.org.au/musks-twitter-takeover-comes-as-the-ccp-steps-up-its-targeting-of-smart-asian-women/

[33] negative: https://web.archive.org/web/20240115054412/https:/www.163.com/dy/article/INSDHNC7055080L4.html

[34] news: https://web.archive.org/web/20240115054936/https:/c.m.163.com/news/a/IIMMKJRC055080L4.html

[35] lost her seat: https://tw.news.yahoo.com/%E6%8D%B2%E5%9C%9F%E9%87%8D%E4%BE%86-%E9%A1%8F%E5%AF%AC%E6%81%92%E5%86%8D%E6%88%B0%E6%9E%97%E9%9D%9C%E5%84%805%E5%8D%80%E5%85%A8%E5%8B%9D-%E9%8F%A1%E6%96%B0%E8%81%9E-150257849.html?guccounter=1

[36] Lin Feifan: https://archive.vn/LBtY3

[37] accused: https://twitter.com/JoannWoodr29041/status/1729702611186499618

[38] sexually harassing: https://www.facebook.com/permalink.php?story_fbid=pfbid024n9GBZY1nPCW7RfWMvATYccMrs6Vq7spuadnRRX9VjYMDKccWYPsZNGJjW7nyc87l&id=100089713916720

[39] affairs: https://archive.vn/Zl5RT

[40] doctored: https://twitter.com/AminaCross95542/status/1729700489309139247

[41] X/Twitter: https://twitter.com/JoannWoodr29041

[42] Facebook: https://www.facebook.com/permalink.php?story_fbid=pfbid02twQtncEFjB6P3o1zWQGqAeUHLy9Lk1Q7g9NoqbXtvS5dHtYxsEneRpopmapNn7LZl&id=61550417693995

[43] Reddit: https://www.reddit.com/r/BlogBlogBlog/comments/18xeqaj/%E8%94%A1%E8%8B%B1%E6%96%87%E7%A7%98%E5%8F%B2/

[44] WeChat: https://twitter.com/ThisIsWenhao/status/1745133678198415589

[45] TikTok: https://www.tiktok.com/@kendrick.long5

[46] uploaded: https://web.archive.org/web/20240110020328/https:/zenodo.org/records/10450173

[47] used: https://twitter.com/AlbertYZhang/status/1516306445792256000

[48] document: https://zenodo.org/records/5752000

[49] prominent: https://twitter.com/whyyoutouzhele/status/1745003948631605458

[50] Chinese-language: https://twitter.com/badiucao/status/1745237045910634649

[51] online commentators: https://twitter.com/setlivenews/status/1745407710059741323

[52] noted: https://www.taipeitimes.com/News/front/archives/2024/01/11/2003811930

[53] video: https://archive.is/RDXOM

[54] video: https://archive.is/6MNC9

[55] Weta365: https://weta365.com/

[56] launched: https://www.chumenwenwen.com/aigc-content-generation

[57] Li Zhifei: https://macropolo.org/analysis/silicon-valleys-china-paradox/

[58] funding: https://www.ft.com/content/bf8fa718-52e3-11e6-befd-2fc0c26b3c60

[59] Volkswagen: https://www.ft.com/content/b8e175ce-1aa0-11e7-bcac-6d03d067f81f

[60] used: https://archive.vn/9Z00C#selection-949.0-965.11

[61] observed: https://www.aspi.org.au/report/shadow-play

[62] uploaded: https://archive.vn/3mF2Z

[63] shared: https://twitter.com/BhattaraiA12668/status/1738155526415139098

[64] at: https://twitter.com/marlene83237496/status/1738151635883544897

[65] least: https://twitter.com/sachin_tha2543/status/1738142881280647445

[66] 82: https://twitter.com/NinjaSrish6559/status/1738142887857234256

[67] times: https://twitter.com/mohsins97842324/status/1738137257855648162

[68] on: https://twitter.com/RahulBodkh58666/status/1738141675929915592

[69] X/Twitter: https://twitter.com/rashmisrin80848/status/1738134765780566524

[70] reported: https://web.archive.org/web/20240116021809/https:/www.hk01.com/%E6%B7%B1%E5%BA%A6%E5%A0%B1%E9%81%93/977126/%E5%8F%B0%E7%81%A3%E6%A9%9F%E5%AF%86%E6%96%87%E4%BB%B6%E5%A4%96%E6%B4%A9-%E4%B8%8D%E5%80%AB%E6%88%80-%E9%A4%8A%E6%B0%B4%E8%BB%8D-%E5%81%87%E6%83%85%E8%B3%87-%E8%BB%8D%E6%83%85%E5%B1%80%E5%86%8D%E7%88%86%E9%A2%A8%E7%B4%80%E9%86%9C%E8%81%9E

[71] uploaded: https://archive.is/mLj0a

[72] assessment: https://www.rfa.org/cantonese/news/factcheck/tw-01122024081145.html

[73] shared: https://archive.vn/Z3OTP

[74] X/Twitter: https://twitter.com/shohuwn1/status/1744383080960348639

[75] Facebook: https://www.facebook.com/photo?fbid=315165938181478&set=a.116719888026085

[76] YouTube: https://archive.vn/N610D

[77] forums: https://www.quora.com/profile/Kuna-Fendy

[78] reporting: https://archive.vn/Ch2iW

[79] takes instructions: https://www.ft.com/content/036b609a-a768-11e9-984c-fac8325aaa04

[80] @NickJonas154141: https://twitter.com/NickJonas154141/status/1734764055225889248

[81] Kapil Gnawali: https://www.linkedin.com/in/kapil-gnawali-ph-d-a4863353/

[82] uses: https://twitter.com/SatyalAyus59794/status/1746450876024426828

[83] retweets: https://twitter.com/NickJonas154141/status/1744983717305860421

[84] shares: https://twitter.com/SatyalAyus59794/status/1744303686602658164

[85] calls: https://twitter.com/SatyalAyus59794/status/1743542938276401297

[86] expressing dissatisfaction: https://www.theguardian.com/world/2024/jan/07/taiwan-braces-for-big-deal-presidential-election-as-chinas-shadow-looms

[87] failing: https://www.esafety.gov.au/sites/default/files/2024-01/Full-Report-Basic-Online-Safety-Expectations-Summary-of-response-from-X-CorpTwitter-to-eSafetys-transparency-notice-on-online%20hate.pdf

[88] announcement: https://openai.com/blog/how-openai-is-approaching-2024-worldwide-elections

[89] Synthesia: https://www.nytimes.com/2023/02/07/technology/artificial-intelligence-training-deepfake.html

[90] National Intelligence Law: https://www.dni.gov/files/NCSC/documents/SafeguardingOurFuture/FINAL_NCSC_SOF_Bulletin_PRC_Laws.pdf

[91] intelligence memo: https://www.reuters.com/world/asia-pacific/taiwan-intelligence-says-china-leadership-meet-election-interference-2023-12-08/

[92] DoubleThink Lab: https://doublethinklab.org/

[93] Information Environment Research Center: https://iorg.tw/_en

[94] Taiwan FactCheck Center: https://tfc-taiwan.org.tw/

[95] Cofacts: https://en.cofacts.tw/

[96] Kuma Academy: https://kuma-academy.oen.tw/

Copyright © 2024 The Strategist. All rights reserved.