Large language models are a particularly interesting case study because they have shown a very obvious phenomenon of intelligence emergence. LLM is a very large transformer neural network, typically spanning hundreds of billions of parameters, trained on a small amount of text data that can be used for a wide range of tasks, including text generation, question answering, summarizing, and more. At present, to determine whether LLM already has intelligence emergence capability, we first reach a consensus on how to define intelligent emergence and give repeatable emergence examples.
Today, Yiyi will take you to explore whether the big language model (LLM) will #intelligenceemerge#related problems.
Whether the Big Language Model (LLM) will intelligently emerge is still an open question.
Intelligence emerges
Whether the phenomenon of intelligence emergence, which has long been discussed in fields such as physics, biology and computer science, has already emerged, remains widely debated. In 1972, Nobel Prize-winning physicist Philip Anderson published an article in Science Weekly titled "More Is Different" in which he discussed that quantitative changes can lead to qualitative changes and unexpected #intelligenceemergence#.
Inspired by Anderson's work, UC Berkeley professor Jacob Steinhardt defines emergence as "when quantitative changes in a system lead to qualitative changes in behavior."
To identify emergence capabilities in large language models, the researchers looked for phase transitions below a certain scale threshold where model performance was close to random, and beyond that threshold, performance was much higher than random. This distinguishes emergence from the ability to scale smoothly: predicting when emergence will emerge is much more difficult. Because scale can be measured in different ways, including computations (FLOPs), model size (number of parameters), or data size.
Since we want to provide a more precise definition, Yiyi defines emergence capability here as "capability that does not exist in a smaller model but exists in a larger model".
Word making
Making new words is a common creative intellectual task. Today we're going to take a look at how Claude accomplishes the task of creating new words, and whether intelligence emerges.
Experiment preparation. First, let's take a look at some background to the experiment.
"Supercalifragilisticexpialidocious" is a song and single from the 1964 Disney musical film Mary Poppins. It was composed by the Sherman brothers and sung by Julie Andrews and Dick Van Dyck. It also appeared in the 2004 theatrical version. Because "Happy Man" was written in 1910, songs that sound similar to songs from that period were needed. The movie version was on AFI's 100 Years list of American movie hits... 100 Songs) ranked 36th.
1964 Disney musical film Mary Poppins
Interested netizens can follow the video I compiled (Watermelon Video @YiyiKing, https://www.ixigua.com/7235889781119549989). The video, from Walt Disney Productions, includes the song "Supercalifragilisticexpialidocious" from Mary Poppins, digitally restored and refilled, taken from the film's DVD released in 2013. https://www.ixigua.com/7235889781119549989
The authoritative dictionary Oxford English Dictionary explains the neologism Supercalifragilisticexpialidocious.
Neologism Supercalifragilisticexpialidocious pragmatic frequency trend graph
In short, supercalifragilisticexpialidocious is a fictional English word with no exact Chinese meaning. It is composed of fragments of many English words, which is intended to play the beauty of the sound of the language and express a light and lively mood and artistic conception. Through the combination and pronunciation of its syllables, a light and lively effect and artistic conception are constructed in the form of language. It is often used to describe something that is charismatic in terms of musicality, rhythm, and dynamics, using language to create a playful atmosphere and mood. Therefore, when understanding and translating this word, it is necessary to focus on expressing its effect in aesthetic form and artistic conception, without delving into its empty semantics.
Example Sentence: The supercalifragilisticexpialidocious song and dance number was a highlight of the show. (This melodic and fast-paced cabaret is a highlight of the show.) ）
This sentence uses the word supercalifragilisticexpialidocious to describe a musical and dance performance, expressing its melodic and rhythmic effect, giving people a light and pleasant mood. In the explanation of the Chinese, I chose "beautiful melody and bright rhythm" to express this meaning, which is similar to the fictional word used in the original sentence in terms of artistic conception and effect, all emphasizing that this performance gives people a deep feeling of pleasure and fun in terms of hearing and melody.
Motivation for experimentation: Using generative AI models to create supercalifragilisticexpialidocious-style neologism. Step 1, familiarize Claude with supercalifragilisticexpialidocious:
Let Claude summarize relevant prior knowledge (https://claude-sfb8379.slack.com/archives/D057P1AHKB4/p1684724270365499)
In fact, Claude can summarize supercalifragilisticexpialidocious relevant prior knowledge very well.
In step 2, let Claude analyze its pronunciation and its word formation process:
https://claude-sfb8379.slack.com/archives/D057P1AHKB4/p1684724995763839
Claude did the job for us equally accurately.
In step 3, I asked Claude to help us recall the lyrics of the single supercalifragilistic expialidocious from the 1964 Disney musical film Mary Poppins:
https://claude-sfb8379.slack.com/archives/D057P1AHKB4/p1684726063517259
In step 4, let Claude help us analyze the melody in the lyrics of the single supercalifragilisticexpialidocious:
https://claude-sfb8379.slack.com/archives/D057P1AHKB4/p1684726274095229
In step 5, start asking Claude to help us make 10 similar new words, requiring them to be easy to read and have a beautiful rhyme:
https://claude-sfb8379.slack.com/archives/D057P1AHKB4/p1684727023988329
So Claude returned 10 new words, which were:
- Splendiferocious - splendidly ferocious, fiercely magnificent
- Wonderiffic - wonderfully terrific, terrifically wonderful
- Fantabulous - fantastically fabulous, fabulously fantastic
- Amazadelic - amazingly psychedelic, psychedelically amazing
- Excitiferrous - excitingly joyful, joyfully exciting
- Sensationalish - sensationally stylish, stylishly sensational
- Stupendincredible - stunningly incredible, incredibly stunning
- Magimystical - magically mystical, mystically magical
- Phenomeniffic - phenomenally terrific, terrifically phenomenal
- Gloribibble - gloriously garrulous, garrulously glorious
Step 6, 10 is not enough, let Claude have 10 more:
https://claude-sfb8379.slack.com/archives/D057P1AHKB4/p1684727386092999
Step 7, if you don't think the new words are long enough, let Claude add 10 longer new words:
https://claude-sfb8379.slack.com/archives/D057P1AHKB4/p1684727883336509
In step 8, Claude used the 10 longer neologisms he just made to create a sentence for each of us:
https://claude-sfb8379.slack.com/archives/D057P1AHKB4/p1684728332107099
At this point, we have a basic understanding, Claude can not only summarize the prior knowledge related to supercalifragilisticexpialidocious, create new words for us that have not appeared in the dictionary, but also meet high requirements, such as splicing many English word fragments, intended to play the beauty of the sound of language, express a light and lively mood and artistic conception.
Make up new words and create new poems
Since Claude can create a series of new words in style, let's take it a step further. Let it help us create a poetic poem:
New poems An Ode to Whimsical Wordsmiths (Ekphrasis style)
As for today's experimental results, can it be shown that the big language model has the ability to emerge intelligently. Yiyi said it or not, Yuanfang, what do you think? （Yiyi King）