Have followed Ernie as an assistant style chatbot for some time, and saw chatbot style approaches like 'Ernie' in a visit to China. Previously mentioned here. Unclear yet how ERNIE compares to ChatGPT in abilities. Here just a short overview.
China’s Baidu reveals generative AI chatbot based on language model bigger than GPT-3 in TheRegister, Tue 7 Feb 2023
Probably bilingual bot will be called ERNIE outside China, Wenxin Yiyan within
Chinese web giant Baidu, which has “AI” in its name and has made AI the focus of its hyperscale cloud, has revealed it will launch a generative AI chatbot later this year.
Chinese media reported the launch and Baidu confirmed it to The Register.
“The company plans to complete internal testing in March before making the chatbot available to the public,” a Baidu spokesperson wrote.
The bot will be named “Wenxin Yiyan文心一言” or "ERNIE Bot" in English.
The spokesperson added that the bots are based on the Enhanced Representation through Knowledge Integration (Ernie) model first proposed in 2019. We were told Ernie “expands into a series of advanced big models that can perform a wide range of tasks, including language understanding, language generation (ERNIE 3.0 Titan), and text-to-image generation (ERNIE-ViLG).”
“What sets ERNIE apart from other language models is its ability to integrate extensive knowledge with massive data, resulting in exceptional understanding and generation capabilities,” the spokesperson added.
Just what the bot will be capable of is not known, but Baidu has over the years described its ambitions for something that sounds an awful lot like ChatGPT. As we noted yesterday, Baidu has discussed "proposed a controllable learning algorithm and a credible learning algorithm to ensure the model can formulate reasonable and coherent texts". It’s done the hard work to deliver such a system, having in 2021 detailed “ERNIE 3.0 Titan” – a pre-training language model with 260 billion parameters.
ChatGPT uses the 175-billion parameter GPT3 model. ... '
No comments:
Post a Comment