ChatGPT Outdoes Other Chatbots When Writing Chinese College Entrance Exam Essays
Lv Qian
DATE:  Jun 08 2023
/ SOURCE:  Yicai
ChatGPT Outdoes Other Chatbots When Writing Chinese College Entrance Exam Essays ChatGPT Outdoes Other Chatbots When Writing Chinese College Entrance Exam Essays

(Yicai Global) June 8 -- US artificial intelligence firm OpenAI’s chatbot ChatGPT performed the best out of a number of large language models which were asked to write essays on topics that were part of the Chinese college entrance examinations which started yesterday.

ChatGPT, Baidu’s Ernie Bot, iFlytek’s Spark and Qihoo 360’s Zhinao could all write good essays but they needed a few attempts in order to better understand the format, Yicai Global noticed when putting them through their paces.

For example, on the first attempt ChatGPT organized the key points it needed to discuss separately. But after several rounds of training it was able to write a complete essay.

Although there were still some grammatical errors, as the number of users increased, the chatbots were able to change and improve their prose, Yicai Global noticed.

ChatGPT was the only large language model to explore the relationship between technology and time when asked to write an essay revolving around the key words ‘people, technology and time.’ Other chatbots gradually deviated from the topic, did not mention technology and only talked about how to grasp the relationship between people and time.

“GPT-4 performs better than Spark and Ernie Bot in terms of cognitive distance,” said Duan Yucong, head of the AGI-AIGC-GPT Test and Evaluation DIKWP Lab and a professor at Hainan University.

GPT-4 can collect the background data behind the question and analyse the concept and meaning in order to provide an in-depth analysis, Duan said. It identifies key words and topics in a question and structures its answers around those elements.

By contrast, Spark and Ernie Bot rely too much on data that they bring directly into their answers and they lack in-depth analysis and data synthesis. This can lead to limited and incomplete answers.

It should be noted that the large language models available to the public are still at the demonstration stage, and they have yet to be applied in specific scenarios.

Editor: Kim Taylor

Follow Yicai Global on
Keywords:   ChatGPT,Gaokao,college entrance exam