[Sogou founder Wang Xiaochuan creates a 13 billion parameter 10 billion universal language model] AI Singularity Network reported on July 11丨Sogou founder Wang Xiaochuan is currently focusing on the research and development of artificial intelligence large models. On July 10, Baichuan Intelligent released Baichuan-13B-Base, an open-source general-purpose large-language model with 13 billion parameters, and derived a chatbot large model and two smaller vertical quantization models on this basis.
This is Baichuan Intelligence's second release of a general large language model after June this year, after the company created a 7 billion parameter Chinese and English language model Baichuan-7B. According to the disclosed parameter amount information, the parameter amount of Baichuan large model exceeds that of another open source large model, LLaMA-13B, by as much as 40%, which is the largest model under the current open source 13 billion level parameter quantity.
It is reported that the new version of the large model has improved coding technology, can handle the context throughput in a longer dialogue window, and can accurately infer the length of the context beyond the training amount, so as to obtain the amount of body information more accurately and make more accurate content prediction and generation.
