Recently, Chen Lan (pseudonym), an Internet celebrity female anchor with more than 6.7 million followers, posted a video saying that she encountered malicious Ps and AI face swapping, and the photos were made into pornographic photos and videos and sold publicly online.
Chen Lan said that she wanted to collect relevant evidence and find out the root cause, but did not want to be too public, but as more and more people in the comment area "spread rumors", she planned to call the police.
Face-swapping videos
Being openly sold
In addition to the female anchor Chen Lan, Du Yue (pseudonym), an Internet celebrity female anchor with more than 4 million fans, also encountered a similar situation. Du Yue said, "I found that someone registered an account with a fraudulent identity on an overseas social platform, and then 'transported' it to a domestic video platform to post it, and when the account had a certain number of fans, they began to sell pornographic videos after changing faces." ”
A price list provided by Du Yue shows that hundreds of Internet celebrities are involved, and it is also divided according to the size of fans, from less than 500,000 fans to more than 10 million fans, and the corresponding face-changing videos are priced at 30 yuan to 50 yuan.
According to the clues provided by Du Yue, the reporter added a QQ friend of a seller, and the other party directly sent a screenshot with dozens of female celebrity pictures pasted on the picture.
The seller said he had more than 80 celebrities and more than 15,000 pictures. If you buy them all, it will only cost 60 yuan, and 23 videos will be given away, and you can enjoy a free update after that.
"AI drawing software" only costs 16.66 yuan
Monthly sales exceeded 200
The reporter searched for the keyword "AI face change" on multiple e-commerce platforms, but it could not be displayed. However, reporters searching for keywords such as "intelligent synthesis, star" and "clothing removal AI" can still search for goods on sale.
The product page of an "AI drawing software" clearly states that "the software can realize the function of converting real people to cartoons, changing heads and changing clothes". The price of this software is only 16.66 yuan, and the monthly sales volume reaches more than 200.
Someone asked if it was possible to produce pornographic images, and someone replied, "Just buy the software to enter the buyer communication group, and there are all kinds of functions." ”
After the reporter entered the "buyer exchange group", in just two days, the group members quickly grew from 40 to 150 people, most of whom exchanged how to use the software in the group and shared their "works" from time to time.
Some members asked in the group if anyone was willing to take orders and make "custom diagrams". "Isn't this thing illegal?" Some people asked rhetorically in the group, and the other party said "wealth is in danger".
In addition to selling drawing software, there are also merchants to provide "real model training", some merchants say, only need to provide 20 to 30 photos, try to focus on face close-up, more than 2 hours to complete the training, to achieve the effect of face replacement.
The legislature is being established
Relevant legal regimes
Zhang Qihuai, director of Beijing Lanpeng Law Firm, has represented a number of "AI face change" related cases. In his opinion, "AI face change" should have been to help advertising, film, art, etc. to properly repair, which is a good technology, but now many people are beginning to use this technology for illegal profit.
Zhang Qihuai said that using other people's portraits to change faces is suspected of infringing on the parties' portrait rights, reputation rights, honor rights and personality rights. If a person's face is made into a pornographic video and sold, it may constitute a criminal offence.
In order to curb the chaos of "AI face changing", on November 25, 2022, the Cyberspace Administration of China, the Ministry of Industry and Information Technology, and the Ministry of Public Security jointly issued Article 17 of the Provisions on the Administration of Deep Synthesis of Internet Information Services, which requires that where deep synthesis service providers provide deep synthesis services such as intelligent dialogue, synthetic human voice, face generation, and face replacement, which may cause confusion or misidentification among the public, they shall be conspicuously marked in the reasonable location and area of the information content generated or edited. Inform the public about deep compositing.
In the face of unlawful infringement, victims should abandon their sense of shame and self-doubt, immediately take screenshots and store evidence, and provide the police with evidence and clues they have retained. In addition to the victims' toughness, laws and systems must put "reins" on the chaos of "AI for face" and severely punish those who are lucky.
The chatterbox is integrated from the Central Broadcasting Network
Editor: Li Yanhao
Responsible editor: Yan Ping