laitimes

AI face swapping scam, 4.3 million scammed in 10 minutes, where is the boundary of the use of artificial intelligence?

author:Cold knowledge Ian

In recent years, the misuse of generative AI technology has raised concerns worldwide. People are not only concerned about its "creative ability" and "destructiveness" beyond ordinary technology, but also note the rapid development of this technology. At present, countries are in the exploratory stage to try to anticipate and prevent the risks of this technology, and the legal system needs to be further improved.

Recently, a case of telecom fraud using artificial intelligence technology attracted the attention of the society, and in just 10 minutes, the victim was defrauded of 4.3 million yuan. The emergence of these AI technologies for fraud has led to food for thought, and the false information generated by AI may potentially carry huge social risks.

AI face swapping scam, 4.3 million scammed in 10 minutes, where is the boundary of the use of artificial intelligence?

People need to be wary of the misuse of generative AI technology. British media outlet The Daily Mail reported on the use of AI voice imitation software for telecom fraud in March 2019. The criminals changed their voice to that of the owner of a local energy company, defrauding an executive of 220,000 euros (about 1.7 million yuan) on the grounds of "helping the company avoid defaulting fines." This is considered the world's first AI scam.

AI face swapping scam, 4.3 million scammed in 10 minutes, where is the boundary of the use of artificial intelligence?

In fact, imitating a person's voice or even appearance is nothing new for AI. Previously, the AI-generated video "AI Sun Yanzi" became popular on online platforms, and one of the cover songs "Hair Like Snow" has been played more than 2 million times. Recently, some media have also reported an online paid AI face changing software, which can be used to perform highly realistic face changing with almost no flaws.

The emergence of these generative artificial intelligence technologies is mainly due to the rapid development of deep synthesis and machine learning. AI scammers use these advanced technologies to train AI that can simulate human speech and expressions.

The misuse of generative AI technology requires vigilance. In a reminder issued on May 24, the Internet Society of China pointed out that with the openness and open-source of deep synthesis technology, there are more and more illegal acts of fake audio and video, including the use of "AI face change" and "AI voice change" and other technologies for fraud and defamation. In the face of this new type of scam, the public needs to raise their police

Strengthen precautions. Industry insiders believe that the abuse of AI face changing technology has sounded the alarm and put forward higher requirements for the identification and application of technology.

The misuse of generative AI technology raises concerns that it goes beyond the "destructiveness" of general technology. Governments are accelerating the development of AI regulatory laws. The UK's Competition and Markets Authority is reviewing the impact of AI on consumers, businesses and the economy to consider whether new regulatory measures are needed. France's privacy regulator is investigating complaints related to generative AI. The Australian Government is consulting with the Scientific Advisory Body to consider next regulatory steps. The European Data Protection Commission has established a Task Force on Generative AI, and EU consumer organisations have called on EU consumer protection authorities to investigate generative AI technologies and their potential harm to consumers.

AI face swapping scam, 4.3 million scammed in 10 minutes, where is the boundary of the use of artificial intelligence?
AI face swapping scam, 4.3 million scammed in 10 minutes, where is the boundary of the use of artificial intelligence?

Concerns about generative AI technologies exist globally, and the "disruption" beyond general technology raises concerns. Countries are currently exploring how to anticipate and prevent the risks of this technology, and legal systems need to be further improved.

Here are three recommendations for science fiction about artificial intelligence:

1. A Brief History of Mankind - by Yuval Harari. This best-selling book explores the evolution of human history, including the possible impact of AI on future societies.

2. "The Rise of the Robots" - by Isaac Asimov. This is a classic collection of science fiction about the impact of robots on humans and the issue of robot ethics.

3. "Snow Crash" - by Neil Stephenson. This is an imaginative science fiction novel that explores the role and impact of virtual reality and artificial intelligence in the future society.

These books will take readers into the future world of artificial intelligence and think deeply about the impact of technological development on human society and individuals.

Read on