China bans deepfakes created without permission or for evil
'Deep synthesis service providers' otherwise free to create AI-generated humans in line with socialist values
China's Cyberspace Administration has issued guidelines on how to do deepfakes the right way.
Deepfakes use artificial intelligence to create realistic depictions – usually videos – of humans saying and/or doing things they didn't say and/or do. They're controversial outside China for their potential to mislead audiences and create trouble for the people depicted.
Beijing clearly also has worries about the technique as the Cyberspace Administration (CAC) has issued regulations that prohibit their creation without the subject's permission, or to depict or utter anything that could be considered as counter to the national interest. Anything counter to socialist values falls under that description, as does any form of "Illegal and harmful information" or using AI-generated humans in an attempt to deceive or slander.
But the rules also suggest China expects synthetic humans will be widely used. For instance, they allow use of deepfakes in applications such as chatbots. In such scenarios, deepfakes must be flagged as digital creations.
The document also envisages that deepfakes will be used by online publishers, which must take into account China's myriad other rules about acceptable online content.
Including the one that censpored images of Winnie the Pooh online, as the beloved bear - as depicted by illustrator E. H. Shepard - was felt to resemble, and mock, China's president-for-probably-life Xi Jinping.
The Register therefore suggests it will be a very, very, brave Chinese developer that creates a photorealistic ursine chatbot or avatar.
- Chinese AI censors live-streamed Alpacas – beasts with a very NSFW and political back story
- Phishing works so well crims won't bother with deepfakes, says Sophos chap
- China's internet regulator details algorithms used by local Big Tech players
- This rumor needs to Die Hard: Bruce Willis denies selling face to deepfake biz
- China orders web operators to spring clean its entire internet
The regulations also spell out how the creators of deepfakes – who are termed "deep synthesis service providers" – must take care that their AI/ML models and algorithms are accurate and regularly revised, and ensure the security of data they collect.
The rules also include a requirement for registration of users – including their real names. Because allowing an unknown person to mess with deepfakes would not do.
The rules are pitched as ensuring that synthesis tech avoids the downsides and delivers benefits to China. Or, as Beijing puts it (albeit in translation), deepfakes must "Promote the healthy development of internet information services and maintain a good ecology of cyberspace."
The regulations come into force on January 10, 2023. ®