How good is ChatGPT at climate science?

CMCC President Antonio Navarra reflects on our interview with ChatGPT and how good it is at answering questions related to climate science. "ChatGPT doesn't actually 'understand' anything [but] the technology’s potential is enormous and the next versions will be able to do much more than this interview shows."

The interview with ChatGPT, conducted on Climate Foresight, is interesting because it shows in some sense the real nature of Chat GPT, which in a way represents a collective wisdom of the Internet and the average shared consensus knowledge that emerges from the analysis of everything that is on the net. 

The answers that ChatGPT gives on the issue of climate change are basically sound, and they express the basic foundational understanding of the climate change problem and the issues around it which allows us to either understand or tackle the issue. 

It is remarkable that the information is by and large sound and correct and therefore captures the basics, a climate change common sense which has been harvested very efficiently from the Web. Therefore, Chat-GPT works well when used as an integrator of the common planetary knowledge. It is the collective sentiment that emerges from the amount of information that is available on the web without many of the incoherences and contradictions. 

However, the interview also reveals how it is much less effective when used to obtain specific information. For example, when specific sources and references were demanded of it. The results were hallucinated answers and/or mistakes. 

The tendency to provide an answer regardless of whether it is accurate or not seems to win over the restraint of providing correct information. It may be that some parameters need to be tuned or it could be because ChatGPT still doesn’t have access to enough content to be able to comment in an informed way on detailed issues. 

This probably demonstrates that ChatGPT doesn’t actually “understand” anything, although it’s important to say that this technology’s potential is enormous and that ChatGPT’s next versions will be able to do much more than this interview shows. It looks like the next few years are going to be very interesting.

Share

Landscape with mountains. Ramallah, Palestine
Article

Land and climate change: a close connection

Land is a critical resource. It is under pressure from human activities and climate change, but it is also part of the solution. According to the IPCC, keeping global warming below 2°C can be possible only by reducing greenhouse gas emissions from all sectors, including land and food. The way we use land impacts climate change and, in turn, climate change deeply affects our land.

ice
Article

Ice’s perpetual change through the lens of photography, semiotics and science

The climate and environmental history of our planet are archived in ice. Glaciers are an invaluable resource for understanding how our climatic system operated in the past and how it operates now; witnesses of the changes that our planet is undergoing. Carlo Barbante, Director of the CNR Institute of Polar Science, Fabiano Ventura, photographer and president of the non-profit organisation Macromicro, and Valeria Burgio, postdoctoral researcher at Ca’ Foscari University in Venice, engage in dialogue on the role of glaciers as archives and sentinels of climate change.

Seeds

Digital twin

By connecting the real and virtual worlds digital twins help create, test and deploy the disruptive technologies and ideas needed to respond to the climate crisis at an unprecedented pace. A look at how experts such as Peter Bauer, Director of Destination Earth at the European Center for Medium-Range Weather Forecasts, are using digital twins to help plan and define the future.