Recently, fraud cases caused by AI face changing technology have attracted people's attention. With the development of AI large models, the application of "face changing" technology is becoming more and more extensive, and the breakthrough of technology also makes the facial expressions and action details of the characters after face change more realistic, which may bring serious harm once used by criminals. The reporter's investigation found that on the Internet, the acquisition of AI face changing software is very easy, where is the legal boundary of using AI face changing software? How to do a good job of pre-supervision?
Paid AI face changing software appears on the Internet
Package prices range from 499 RMB to 2888 RMB
At present, relying on the breakthrough of large models and algorithms, AI face changing is realizing a wider range of applications, causing more worry. On the Internet, tutorials that demonstrate the use and effects of face changing software abound. Different from a large number of free software that gives ordinary people a "taste", the reporter found that there are many high-priced paid AI face changing software on the Internet, what is the difference between these paid software and free software?
The reporter searched for "AI face changing software" and contacted a developer, who provided the reporter with a demonstration video of using his software to achieve face change - the left side of the double window page is the original video before the face change, and the right side is the video after the face change.
△The amateur face changing effect displayed by the seller (S is the original video, D is after replacement)
On its sales website, the software developer also showed how to stitch the eyes and mouths of two well-known actresses together to create a video of a new "digital human."
△ Local facial features replacement displayed by the seller
This paid software is available in different versions from Beginner (LV1) to Super (LV4) to Full (LV5). For the beginner package, 499 yuan provides software interface, video guidance, face changing model, etc., if you spend 2888 yuan, you can get a full set (LV5) level video face changing model.
△ Provide a variety of different levels of face changing software products on the network "You can change any face you want", AI large model can integrate a variety of functions to create a "digital human"
When you open the site, there is no text at the bottom that says it has been filed. The seller is also very cautious and only communicates with text throughout the process. He said that compared with the primary (LV1) to super (LV4) package, the full (LV5) version has more iterations and stronger capabilities, which can also be understood as a more realistic face changing effect, and at the same time, it can not only realize video face change, but also support live face change.
The reporter further asked, can you change your face according to your own needs? The software developer said: "You can change what kind of face you want to take material training."
△ Screenshot of the software developer's chat with reporters
One technician working on AI development said that means there could be more risks that are difficult to control. "AI face changing technology similar to deepfake is open source, the recent AI large model is on fire, its algorithm has been updated, you can integrate Wensheng diagram, Wensheng text, Wensheng audio, Wensheng video, face change, such functions combined, you can create a completely new 'digital human' or 'AI person', the cost and difficulty of supervision is orders of magnitude higher."
△User feedback displayed by sellers
Expert: Effective identification regulatory system
It can clarify the blurred boundaries brought by AI face changes in advance
Zhao Zhanzhan, a lawyer and IT law expert at Beijing Jiawei Law Firm, said that from the perspective of post-crackdown, there are provisions on fraud in the criminal law; The Civil Code clearly states that citizens enjoy corresponding civil rights such as portrait rights, name rights, reputation rights, etc. In other words, if there is a case related to using the portrait of another person to commit fraud, the wrongdoer can be legally restrained and punished afterwards. However, with the rapid development of artificial intelligence technology, we should also explore how to achieve effective precautions.
For example, the "Provisions on the Administration of Deep Synthesis of Internet Information Services" requires that where deep synthesis services may cause confusion or misidentification among the public, the deep synthesis service provider shall conspicuously mark the information content generated or edited in a reasonable location or area.
The Measures for the Administration of Generative Artificial Intelligence Services (Draft for Comments) requires that before using generative AI products to provide services to the public, security assessments shall be reported to the state internet information department in accordance with relevant provisions; To respect the legitimate interests of others; Product providers shall be responsible for the pre-training data of generative AI products and the legality of optimizing training data sources.
△Source: Visual China
Pan Helin, co-director of the Digital Economy and Financial Innovation Research Center of Zhejiang University's International Business School, believes that at present, if the requirements of labeling can be effectively implemented and an effective regulatory system can be formed, the blurred boundaries caused by AI face change can be clarified to a large extent in advance.
Pan and Lin: At present, the identification supervision system of AI face change has not yet been formed, and it is necessary to identify the content that is not marked by technical means, and there must be specific punishment measures, standards and systems for individuals or units and organizations that do not label.
Zhao Zhanzhan believes that in the long run, regulatory and punitive measures still need to be "iterated" with the development of technology to form a three-dimensional and effective governance plan.
Source: Voice of China of the Central Radio and Television Corporation