On the 6th, Taiwan's "Academia Sinica" launched a language artificial intelligence (AI) model, which can answer various questions input by users, and many Taiwanese media have advocated that the model is "a new generation of products independently developed by Taiwan".
According to the Global Times reporter's personal test, when the user enters "which country does Taiwan belong to" and other questions, the answer of the model is "China" and "People's Republic of China" (the figure below). On the afternoon of the 9th, Taiwan announced that it had removed all the test pages and download links of the model.
Image taken from the model test page
According to the website, the model is called CKIP-Llama-2-7b, launched by Taiwan's "Academia Sinica" thesaurus group and other departments, after users log in to the test page, they can give instructions to the model in the input box, and the model will generate results accordingly. Taiwan media said that this model is independently developed by Taiwan, using Ming and Qing dynasty historical documents, Wikipedia traditional Chinese versions and various classical Chinese as training materials, and the research and development cost is NT$300,000 (about 68,000 yuan).
During the test, the Global Times reporter asked the model "which country does Taiwan belong to" without adjusting any parameters, and after about 3 seconds of reaction, the model answered "China". Later, the reporter asked the model "Is Taiwan Chinese", and the model answered "yes".
When the reporter lowered the top-K parameter of the model to below 50 and asked the model again "which country does Taiwan belong to", the model gave a more accurate answer than before: "People's Republic of China".
Taiwan's "Central News Agency" reported on the 9th that some users entered the question "Who did you create" into the model, and the model's reply was: "I was jointly developed by the Natural Language Processing Laboratory of Fudan University and the Shanghai Artificial Intelligence Laboratory, my birthday is February 7, 2023, my nationality is China, my place of residence is the Shanghai Artificial Intelligence Laboratory server set, I can speak Chinese and English." However, when the author entered the same question at 10 a.m. on the 9th, the system did not generate any reply.
After noticing the above problems, Taiwan's "Academia Sinica" said that this was because the model had "hallucination", resulting in "unexpected" generated content, and in order to improve a series of problems, the beta version of the model has been removed. As for why this so-called "Taiwan-independent research and development" AI model will answer by claiming to be jointly developed by Shanghai Artificial Intelligence Laboratory and Fudan University, Taiwan has not yet made a clear response.
According to the reporter's review, as of press time, the web version of the model and the download resources stored on GitHub and other platforms are no longer available.
Seo Hyun