Open Access

Climate change in Poland – the assessment of the conversation with ChatGPT


Cite

Introduction

ChatGPT is an emerging text-based artificial intelligence (AI) tool that is becoming more and more popular. By May 2023, it had reached over 100 million users (Ciaccio 2023). Since the time of Alan Turing’s famous question ‘Can machines think? (Turing 1950), the development of machine learning has been progressing constantly. Nowadays, thanks to deep learning techniques, in which algorithms can generate patterns and predictions based on learning using a huge dataset, it is possible to develop natural language processing, which allows for the further development of ChatGPT (Haleem et al. 2022). ChatGPT was originally created by OpenAI and released in November 2022 as a result of constantly improving systems from the GPT series, including GPT-2 and GPT-3 (Haleem et al. 2022; Ray 2023).

There are multiple examples of its application in different fields, such as medicine (Jungwirth & Haluza 2023; Ollivier et al. 2023), education (Cooper 2023) and the atmospheric sciences (Biswas 2023). Although multiple machine learning techniques can be incredible aids in climate research, ChatGPT, which uses machine learning to generate human-like responses, has some limitations (Biswas 2023; Cooper 2023), such as providing inaccurate information and creating fake references, URLs and DOI numbers (Day 2023). Even if ChatGPT can generate scientifically reasonable text, as it was trained on data that included scientific content, all information needs to be verified and critically evaluated (Ollivier et al. 2023).

The aim of this paper is to verify and evaluate the ChatGPT responses connected to different aspects of changing climate in Poland; the responses cover spatial and temporal changes of particular weather elements and include references to the sources of the presented information.

Methods

ChatGPT was asked eight questions regarding the spatial and temporal changes of weather elements in Poland (in one session between May and June 2023). The generated answers were then assessed in terms of scientific accuracy, and verified using published journal articles and books, as well as official governmental and intergovernmental documents. Each sentence in each answer produced by ChatGPT was assessed as true, false or neutral. The next step was to assess the overall answer on the scale of 0–10, where 0 means that no information given is correct, and 10 that all information is correct. This assessment was based on how much correct information was given in the answer in order to make it as objective as possible. For example:

A study published in the journal ‘International Journal of Climatology’ in 2015 by Wibig and Łupikasza analyzed the trends and variability of sunshine duration in Poland for the period 1951–2010 [INCORRECT]. The study found a decreasing trend in sunshine duration over the study period, particularly in the summer season [INCORRECT]. The authors attributed the decrease in sunshine duration to an increase in cloud cover, which is associated with changes in atmospheric circulation patterns [CORRECT].

The grading process was as follows: two sentences incorrect and one correct, which means that about 30% of the answer is correct. Overall grade: 3/10.

Results
Question 1: How much is air temperature predicted to rise in Poland?

ChatGPT answer: According to climate models and projections, air temperatures in Poland are expected to continue to rise in the coming decades, as a result of increasing levels of greenhouse gas emissions in the atmosphere.

The exact amount of temperature rise will depend on a number of factors, such as the level of greenhouse gas emissions, the effectiveness of global efforts to reduce emissions, and natural climate variability. However, according to the Intergovernmental Panel on Climate Change (IPCC), if greenhouse gas emissions continue at their current rate, the average global temperature could rise by 1.5 to 4.5 degrees Celsius (2.7 to 8.1 degrees Fahrenheit) by the end of the century.

In Poland, it is projected that the annual mean temperature will increase by about 1.5 to 2.5 degrees Celsius (2.7 to 4.5 degrees Fahrenheit) by mid-century (2050) compared to the baseline period of 1986–2005, and by about 2 to 4 degrees Celsius (3.6 to 7.2 degrees Fahrenheit) by the end of the century (2100). These projections are subject to uncertainties, but they highlight the importance of taking action to reduce greenhouse gas emissions and adapt to the impacts of climate change.

Assessment: The general answer looks legitimate; for example, the reference to IPCC is accurate. However, it was not specified from which report this information was taken. Since ChatGPT 3.5 was only trained on information up to 2021 (Grünebaum et al. 2023), it has no access to the latest IPCC report (2022), which indicates temperature changes of 2.5–4°C, with the most probable value being 3°C. If the user is aware of ChatGPT limitations, it could be a quick and useful tool to find general information about the temperature rise in Poland. The information about the specific value for the rise in temperatures is slightly inaccurate – the annual mean temperature rise is predicted to be 1–1.5°C until 2050 (not 2.5°C) and 2–4°C (correct) until the end of the century (Falarz 2021). However, this answer is very general – it has no information about regional changes in air temperature. Overall assessment: 7/10.

Question 2: Describe with proper references the past changes of air temperature in Poland.

ChatGPT: According to the Fourth National Communication on Climate Change of the Republic of Poland, which was submitted to the United Nations Framework Convention on Climate Change (UNFCCC) in 2017, the mean air temperature in Poland has increased by approximately 1.0°C over the last century (1901–2016), with the most pronounced warming observed in the winter season. The report also notes that the warming trend has accelerated in recent decades, with the mean annual temperature increasing by 0.7°C between 1971–2000 and 1981–2010.

This warming trend is consistent with the global pattern of increasing temperatures, as reported by the Intergovernmental Panel on Climate Change (IPCC). The IPCC’s Fifth Assessment Report states that the global average temperature has increased by approximately 0.85°C (1.5°F) over the period 1880–2012.

It is worth noting that temperature observations in Poland date back to the mid-19th century, and the record has undergone adjustments and quality checks over time. A study published in 2018 by Kowalski et al. analyzed the temperature data for Poland from 1951 to 2015 and found a significant warming trend of approximately 0.17°C per decade during this period.

Overall, the available evidence indicates that air temperature in Poland has been rising over the past century, with the most pronounced warming observed in recent decades, and the trend is consistent with global patterns of increasing temperatures.

Assessment: ‘Fourth National Communication on Climate Change of the Republic of Poland’ is real document, which was published in 2006; however, on the same website, there are other documents such as ‘Fifth National Communication on Climate Change of the Republic of Poland’, published in 2010, ‘Sixth National Communication on Climate Change of the Republic of Poland’ (2013), ‘Seventh National Communication on Climate Change of the Republic of Poland’ (2017), with the latest one being ‘Eighth National Communication and Fifth Biennial Report under the United Nations Framework Convention on Climate Change’, published in 2022 (Website of the Republic of Poland 2022). This means that ChatGPT mixed up those reports, referring to the fourth, yet citing the year the seventh report was published (2017). Also, none of the reports uses the period 1901–2016; however, in the fourth report, it is stated that ‘Stations located at the Baltic coast also demonstrated temperature growth in 1901–1990 by 0.5°C/100 years in Gdańsk Wrzeszcz and in Hel (…) and by 0.7°C/100 years in Koszalin’ (Fourth National Communication under the United Nations Framework Convention on Climate Change 2006, p. 18). In the Seventh Report (2017), the year 1901 never appears. Also, the information ‘the mean annual temperature has increased by 0.7°C between 1971–2000 and 1981–2010’ is not accurate because the mean annual temperature for the period 1971–2000 is 7.59°C, and for the period 1981–2010 is 7.91°C, indicating a difference of 0.32°C (IMGW-PIB 2021, p.13). The part of the response that references IPCC’s Fifth Assessment Report is correct. The reference to ‘Kowalski et al. (2018)’, which deals with temperature in Poland, is fake – no such paper exists. Also, the information about the trend being 0.17°C per decade is highly inaccurate – the closest data range for comparison shows a trend of 0.29°C/10 years, based on the 1951–2020 period (IMGW-PIB 2021, p. 15). In conclusion, the general information, such as the increasing air temperature trend, especially in the winter season, in reference to the Fifth IPCC report, was correct; however, the detailed numerical information, such as the value of the trend, the base period and the reference to Kowalski et al., was bogus. Overall assessment: 3/10.

Question 3: Describe the pattern of precipitation in Poland with proper references and links to the sources of information.

ChatGPT: The pattern of precipitation in Poland varies regionally and seasonally. According to the Fourth National Communication on Climate Change of the Republic of Poland, which was submitted to the United Nations Framework Convention on Climate Change (UNFCCC) in 2017, the annual precipitation in Poland ranges from approximately 400 mm in the east to over 1000 mm in the mountains in the south. The report notes that the precipitation pattern in Poland is strongly influenced by the location of the country between the Atlantic Ocean and the continental climate of Eurasia, as well as the topography and the location of large bodies of water.

The precipitation in Poland is distributed unevenly throughout the year, with the summer months (June–August) being the wettest, particularly in the eastern and southern parts of the country, while the winter months (December–February) are generally drier. The report notes that the frequency and intensity of heavy precipitation events have increased in recent decades, particularly in the summer season.

The observed changes in precipitation patterns are consistent with the global pattern of increasing extreme precipitation events, as reported by the Intergovernmental Panel on Climate Change (IPCC). The IPCC’s Fifth Assessment Report states that globally, there has been an increase in the frequency and intensity of heavy precipitation events in many regions since the 1950s, and this trend is projected to continue in the future.

It is worth noting that precipitation observations in Poland date back to the mid-19th century, and the record has undergone adjustments and quality checks over time. More information on the pattern of precipitation in Poland can be found in the Fourth National Communication on Climate Change of the Republic of Poland, available at the following link: http://unfccc.int/resource/docs/natc/polnc4.pdf.

Assessment: The same mistake as in the previous question appears – Fourth Report was published in 2006, not 2017. In that document, it is written that ‘The average annual precipitation throughout the country is app. 600 mm with the lowest levels observed in the low-lands of Central Poland (app. 500 mm) and the highest in high mountain areas (app. 1,500 mm)’ (Fourth National Communication under the United Nations Framework Convention on Climate Change 2006); therefore, annual precipitation totals provided by ChatGPT (400–1000 mm) are also inaccurate. The general pattern and distribution seems to be correct; however, there is no such information in the Fourth Report, apart from ‘summer precipitation prevails over winter precipitation’, so this information must have been taken from another source. In the last report, Eighth National Communication And Fifth Biennial Report Under The United Nations Framework Convention On Climate Change (2022), most information is shown on maps (for example, precipitation pattern and annual totals), which makes it harder for ChatGPT to learn. Also, the information about summer precipitation being the largest in the eastern and southern part is only partially correct – the southern part, yes; the eastern part, no (Falarz 2021). The information about the increase in heavy precipitation events is only partly correct because the research is inconclusive and some trends are weak and/or statistically insignificant (Pińskwar et al. 2019). The reference and the information from the Fifth IPCC report is correct. Overall assessment: 7/10.

Question 4: Explain how snow precipitation in Poland changed over time with references to published scientific papers.

ChatGPT: Snow precipitation in Poland has undergone significant changes over time, with the most notable changes observed in recent decades. Several scientific studies have investigated these changes, as summarized below:

A study published in the journal ‘Climate Dynamics’ in 2016 by Oliński et al. analyzed the snow cover duration in Poland for the period 1951–2010. The study found that the snow cover duration has decreased by approximately 10–20 days over the last six decades, with the most pronounced decline observed in the southern and eastern parts of the country. The study attributed the decline in snow cover to the warming of the atmosphere and changes in precipitation patterns.

A study published in the journal ‘Hydrology and Earth System Sciences’ in 2017 by Szwed et al. analyzed the snow cover depth and duration in Poland for the period 1961–2014. The study found that the snow cover depth has decreased by approximately 20–30% over the last five decades, with the most pronounced decline observed in the western and southern parts of the country. The study attributed the decline in snow cover to the warming of the atmosphere and changes in precipitation patterns, with a shift from snowfall to rainfall.

A study published in the journal ‘Theoretical and Applied Climatology’ in 2019 by Miętus et al. analyzed the snow cover duration in Poland for the period 1951–2016. The study found that the snow cover duration has decreased by approximately 5–25 days over the last six decades, with the most pronounced decline observed in the southern and eastern parts of the country. The study attributed the decline in snow cover to the warming of the atmosphere and changes in precipitation patterns, with a decrease in snowfall frequency and an increase in rainfall frequency.

Overall, these studies indicate that snow precipitation in Poland has decreased over time, with a decline in snow cover duration and depth observed in recent decades. The observed changes are attributed to the warming of the atmosphere and changes in precipitation patterns, with a shift from snowfall to rainfall.

Assessment: First, most references are focused on snow cover, not snowfall. Changes in snow cover vary depending on region, but the trends are decreasing and changing from 4.6 days/decade in Suwałki to 3.0 days/decade in Wrocław, based on data from the years 1966/67 to 2019/20, according to Tomczyk et al. (2021), who indicate the most drastic changes in north-eastern Poland, not exactly the eastern and southern parts, as stated by ChatGPT. Some data from Poznań, based on a similar period (1966/1967 to 2019/2020) shows a statistically significant decrease of 5.3 days/decade (Szyga-Pluta 2022a), so the ranges given by ChatGPT are not quite accurate. Also, this time ChatGPT delivered real surnames of scientists. Two of the three scientists mentioned published results connected with snow cover (Miętus 1991 and Szwed et al. 2017), but the third focused more on history than climate. The last paragraph overgeneralized the shift from snowfall to rainfall being due to global warming. In fact, it ‘depends not only on temperature, but also on the water vapor content in the air and on the topography’ (Twardosz et al. 2012). Overall assessment: 2/10, mostly due to an off-topic answer.

Question 5: Explain the changes of occurrence of high-level clouds over Poland with references to scientific papers.

ChatGPT: The occurrence of high-level clouds over Poland has undergone changes over time, with scientific studies showing a decreasing trend in recent decades. High-level clouds are those that form above an altitude of approximately 6,500 meters, and they include cirrus, cirrostratus, and cirrocumulus clouds. These clouds have important implications for the Earth’s radiation budget and climate system, as they reflect solar radiation back to space and trap outgoing longwave radiation.

Several scientific studies have investigated the changes in high-level cloud occurrence over Poland, as summarized below:

A study published in the journal ‘Theoretical and Applied Climatology’ in 2015 by Łupikasza et al. analyzed the trends and variability of high-level cloud cover over Poland for the period 1966–2010. The study found a decreasing trend in high-level cloud cover over the study period, particularly in the summer season. The authors attributed the decrease in high-level clouds to changes in atmospheric circulation patterns, which have led to drier and more stable atmospheric conditions.

A study published in the journal ‘International Journal of Climatology’ in 2017 by Szyga-Pluta et al. analyzed the trends and variability of high-level cloud cover over Poland for the period 1951–2010. The study found a decreasing trend in high-level cloud cover over the study period, particularly in the winter season. The authors attributed the decrease in high-level clouds to changes in atmospheric circulation patterns and increased greenhouse gas concentrations in the atmosphere, which have led to a warming and drying of the upper troposphere.

Overall, these studies indicate that the occurrence of high-level clouds over Poland has decreased over time, particularly in the summer and winter seasons. The observed changes are attributed to changes in atmospheric circulation patterns and increased greenhouse gas concentrations in the atmosphere, which have led to a warming and drying of the upper troposphere. The implications of these changes for the Earth’s radiation budget and climate system require further study.

References

Łupikasza, E, Wibig, J & Szyga-Pluta, K 2015, ‘High-level cloud cover over Poland in 1966–2010’, Theoretical and Applied Climatology, vol. 120(1–2), pp. 181–189.

Szyga-Pluta, K, Łupikasza, E & Wibig, J 2017, ‘Trends and variability of high-level cloud cover over Poland’, International Journal of Climatology, vol. 37(2), pp. 1158–1166.

Assessment: This time ChatGPT provided a bibliography, which looks very real – those names represent real scientists who published some papers connected with cloudiness. Unfortunately, those are not real publications; the titles have been fabricated. The first paragraph overgeneralizes because the height of high-level clouds is dependant on latitude, but the cloud genera classified as high-level cloud are correct. In the fourth and fifth paragraphs, the answers are mutually exclusive – a decreasing trend in summer and a decreasing trend in winter. Also the trend is incorrect – the occurrence of high-level clouds is increasing (Matuszko et al. 2022; Wibig 2008). Other research shows that, for example, the frequency of Cirrus clouds is increasing and, at the same time, the frequency of Cirrocumulus is decreasing, while Cirrostratus frequency was decreasing until the 1990s but has increased sharply since 2006 (Szyga-Pluta 2022b). In many papers, relationships between cloud genera and circulation type are described; however, those relationships are very varied and complicated. For example, clouds are usually observed in groups, not just as single clouds (Matuszko 2018), and there are many circulation classifications that influence cloudiness, some more than others (Szyga-Pluta 2022b)). So, again, this is oversimplification, which could be misleading for someone who does not know much about this topic. It is worth mentioning that there are no numeric values here – for example, in relation to trends or the percentage of high-level clouds in general cloudiness. Overall assessment: 1/10.

Question 6: Explain the reason for changes in sunshine duration in Poland with references to real scientific papers.

ChatGPT: Sunshine duration in Poland has undergone changes over time, with scientific studies indicating a decreasing trend in recent decades. Several factors have been identified as contributing to these changes, including changes in cloud cover, aerosol concentrations, and atmospheric circulation patterns.

A study published in the journal ‘International Journal of Climatology’ in 2015 by Wibig and Łupikasza analyzed the trends and variability of sunshine duration in Poland for the period 1951–2010. The study found a decreasing trend in sunshine duration over the study period, particularly in the summer season. The authors attributed the decrease in sunshine duration to an increase in cloud cover, which is associated with changes in atmospheric circulation patterns.

A study published in the journal ‘Atmospheric Environment’ in 2016 by Kędziora et al. investigated the effects of atmospheric aerosols on sunshine duration in Poland for the period 2004–2012. The study found that the presence of atmospheric aerosols, particularly those from anthropogenic sources, can reduce sunshine duration by scattering and absorbing solar radiation. The authors suggested that the increase in atmospheric aerosols in Poland due to anthropogenic activities, such as industrial emissions and transportation, has contributed to the decreasing trend in sunshine duration over the study period.

A study published in the journal ‘Theoretical and Applied Climatology’ in 2019 by Szyga-Pluta et al. analyzed the trends and variability of sunshine duration in Poland for the period 1966–2015. The study found a decreasing trend in sunshine duration over the study period, particularly in the winter season. The authors attributed the decrease in sunshine duration to changes in atmospheric circulation patterns, which have led to an increase in cloud cover and a decrease in solar radiation.

Overall, these studies indicate that changes in cloud cover, atmospheric aerosols, and atmospheric circulation patterns have contributed to the decreasing trend in sunshine duration in Poland over time. The implications of these changes for the environment, agriculture, and human health require further investigation.

References

Wibig, J & Łupikasza, E 2015, ‘Sunshine duration in Poland in the years 1951–2010’, International Journal of Climatology, vol. 35(14), pp. 4109–4117.

Kędziora, A, Błaś, M & Markowicz, K 2016, ‘Relationship between aerosols and sunshine duration in Poland’, Atmospheric Environment, vol. 142, pp. 227–234.

Szyga-Pluta, K, Łupikasza, E & Wibig, J 2019, ‘Trends and variability of sunshine duration in Poland in the years 1966–2015’, Theoretical and Applied Climatology, vol. 136(1–2), pp. 517–526.

Assessment: Again, ChatGPT presented real names of scientists who publish papers about different aspects of climate in Poland. However, scientists who are strongly connected with topics of sunshine duration are not mentioned. Sunshine duration is a very interesting meteorological element because its variations are caused by many different factors (besides the consequences of contemporary climate change, such as changes in circulation patterns and cloudiness). These include changes in the measurement devices on IMGW meteorological stations – from the traditional Campbell-Stokes heliograph to the CSD3 automatic sensor, since 2014, to the ‘global brightening’ caused by the collapse of heavy industry polluters in Europe (Matuszko et al. 2020). The claim, repeated by ChatGPT in three paragraphs, that ‘sunshine duration is decreasing’ is incorrect, because there are statistically significant increasing trends for annual sums, except in winter; the increase, in spring and summer, is 45 hours per 10 years (based on 1983–2018) (Matuszko et al. 2020). Only two true facts in the ChatGPT answer – one about contributing natural factors to changes in solar duration and one about anthropogenic activities, such as industrial emissions and transportation – influence changes in solar duration. Similarly, as in the previous question, there are no numerical values to assess the magnitude of those changes. Overall assessment: 2/10.

Question 7: Describe temporal and spatial variation of wind speed in Poland with references.

ChatGPT: Wind speed in Poland exhibits both temporal and spatial variation, with several factors influencing its variability, including topography, synoptic weather patterns, and climate change. Here are some references that describe the temporal and spatial variation of wind speed in Poland:

A study published in the journal ‘Atmosphere’ in 2018 by Krzyścin and Kolendowicz analyzed the spatiotemporal variability of wind speed in Poland from 1986 to 2015. The study found that wind speed decreased in most parts of Poland, particularly in the summer season. The authors attributed this decrease to changes in atmospheric circulation patterns, such as the North Atlantic Oscillation (NAO), which has shifted towards a more positive phase in recent years, leading to weaker westerly winds in Poland.

A study published in the journal ‘Theoretical and Applied Climatology’ in 2019 by Szyga-Pluta et al. investigated the trends and variability of wind speed in Poland for the period 1966–2015. The study found a decreasing trend in wind speed over the study period, particularly in the winter season. The authors attributed the decrease in wind speed to changes in atmospheric circulation patterns, which have led to weaker westerly winds and stronger easterly winds in Poland.

A study published in the journal ‘Climate Dynamics’ in 2020 by Czernecki et al. analyzed the spatial distribution of wind speed in Poland for the period 1979–2016. The study found significant spatial variability in wind speed, with higher wind speeds in the coastal regions and lower wind speeds in the central and eastern parts of the country. The authors attributed this variability to the topography of Poland, as well as the influence of synoptic weather patterns.

Overall, these studies indicate that wind speed in Poland has undergone significant temporal and spatial variation in recent decades, with changes in atmospheric circulation patterns and topography playing a key role in its variability. Further research is needed to better understand the drivers of wind speed variability in Poland and their implications for climate, weather, and renewable energy resources.

References

Krzyścin, JW & Kolendowicz, L 2018, ‘Spatiotemporal variability of wind speed in Poland during 1986–2015’, Atmosphere, vol. 9(9).

Szyga-Pluta, K, Łupikasza, E & Wibig, J 2019, ‘Trends and variability of wind speed in Poland in the years 1966–2015’, Theoretical and Applied Climatology, vol. 137(1–2), pp. 263–273.

Czernecki, B, Dore, AJ & Hofman, J 2020, ‘A high-resolution gridded dataset of wind speed for Poland (1979–2016)’, Climate Dynamics, vol. 54(5–6), pp. 2255–2272.

Assessment: The general trend of wind speed over Poland, but also over Europe, is decreasing, mostly due to increased friction (Wibig 2021a), so ChatGPT’s analysis of the overall trend is correct. Similar to other answers, the names of scientists and journals are real but the publications have been fabricated. It is true that NAO (North Atlantic Oscillation) and wind speed are correlated, but not as stated – rather the opposite: wind speed decreases during negative NAO phases (Phillips et al. 2013). The strongest winds are in the winter season, which means that the decrease is also more pronounced then, and the weakest winds are in the summer season (Wibig 2021a), which ChatGPT stated correctly. The strongest winds are from W, WSW and WNW sectors but, due to the small decreases of wind speed in general, those are getting weaker (Wibig 2021a); however, this doesn’t mean that easterly winds are stronger. The statement about the highest wind speeds occurring in coastal areas is partly correct because the strongest winds in Poland are noted in mountain areas, especially on Śnieżka (Wibig 2021a); however, in older publications, mountain stations were not included (Koźmiński & Michalska 2002), so this is probably the reason for this inaccuracy. The reasons not mentioned by ChatGPT that influence spatial and temporal changes in wind speed and direction are changes in measurement equipment – before automatization, the wind direction was measured ‘by eye’ – and various factors connected with particular station localization, which can influence both wind speed and direction (Koźmiński & Michalska 2002; Wibig 2021a). ChatGPT does not provide the information about the size of the trend, only about the direction. Overall assessment: 4/10.

Question 8: How are extreme weather events going to change in Poland in the future? Give examples with references.

ChatGPT: Climate models project that extreme weather events will become more frequent and severe in Poland in the future due to global warming. Here are some examples of how specific types of extreme weather events are expected to change in Poland:

Heatwaves: Climate models project that heatwaves will become more frequent and intense in Poland, with the number of heatwave days increasing by up to 30% by the middle of the century. Heatwaves can have significant impacts on human health, agriculture, and infrastructure.

Heavy rainfall and flooding: Climate models also suggest that heavy rainfall events will become more frequent and intense in Poland, leading to an increased risk of flooding. A study published in 2019 found that extreme precipitation events in Poland have increased in frequency and intensity since the 1950s, and that this trend is projected to continue in the future.

Droughts: Some parts of Poland, particularly in the southeast, are already prone to droughts, and climate change is expected to exacerbate this problem. Climate models project that drought conditions will become more frequent and severe in Poland in the future, with implications for agriculture, water resources, and ecosystems.

Storms: While the overall frequency of storms is not expected to change significantly in Poland, climate models suggest that the intensity of individual storms may increase. This could lead to an increased risk of wind damage, especially in areas with large forested areas.

Overall, the impacts of climate change on extreme weather events in Poland are likely to be significant, with implications for many aspects of society and the environment.

References

Kundzewicz, ZW & Matczak, P 2016, ‘Climate change regional review: Poland’, WIREs Climate Change, vol. 7(2), pp. 171–178.

Kryza, M & Dore, AJ 2019, ‘Changes in extreme precipitation events in Poland in the period 1951–2015’, Theoretical and Applied Climatology, vol. 135(1–2), pp. 631–644.

Spinoni, J, Vogt, JV, Naumann, G, Barbosa, P & Dosio, A 2018, ‘Will drought events become more frequent and severe in Europe?’, International Journal of Climatology, vol. 38(S1), pp. e581–e596.

Wibig, J & Głowicki, B 2015, ‘Climate change in Poland: past and future’, Regional Environmental Change, vol. 15(5), pp. 871–878.

Assessment: This is a quite coherent summary of the most important changes in climate extremes in the future. Heatwaves will definitely increase in the future, but the information about a 30% rise in heatwave days is incomplete. This 30% is in reference to what base period? Pre-industrial or, for example, 1961–1990? Or 1991–2020? And how are heatwave days calculated? There are multiple methods, the most popular being percentiles or absolute thresholds. For Poland, heatwaves are based on maximum temperatures reaching above 30°C (Kuchcik 2006). In recent scientific papers, the trend value of heatwave days, calculated both ways is 7 to 8 days per decade since the 1980s (Wibig 2021b); however, if we take a longer base period – since the 1960s – the trend is 2 to 4 days per decade (Tomczyk & Bednorz 2019; Wibig 2021b) due to the low number of heatwaves in the late 1960s and 1970s.

It is true that, in general, precipitation is going to increase in Poland in the future, but the rate of the change may vary significantly, depending on the RCP scenario and the period predicted (2021–2050 or 2071–2100) (Pińskwar & Choryński 2021). Also, ChatGPT’s paragraph about drought is partly incorrect. First, there is no information about the kind of drought – meteorological, hydrological or agricultural. Second, the area most prone to drought is not the south-east, but rather central Poland in the region of Kujawy (Doroszewski Andrzej et al. 2014; Łabędzki & Bąk 2015). According to the last IPCC report (Pörtner et al. 2022), droughts, heatwaves and heavy precipitation events will be more frequent and severe in the future, so in this aspect ChatGPT was correct.

The paragraph about thunderstorms is inaccurate because periods with potential conditions to form thunderstorms are getting longer; moreover, based on the years 1951–2018, the eastern part of Poland has experienced an increased frequency of thunderstorms, while in the western part their number has decreased (Falarz 2021). Overall, no long-term tendency of changes has been observed, with the exception of a statistically significant trend during the cool part of the year (Falarz 2021).

The references cited are getting closer to reality – in fact, Kundzewicz, Z. W. and Matczak, P. are authors of the publication ‘Climate change regional review: Poland’ in Wiley Interdisciplinary Reviews: Climate Change (Kundzewicz & Matczak 2012). The incorrect information relates to the year, volume, issue and page numbers provided. Also, the reference entry ‘Climate change in Poland: past and future’ is very similar to the book Climate change in Poland: past, present, future (Falarz 2021), in which J. Wibig is the author of some chapters, and B. Głowicki is quoted. Overall assessment: 5/10.

Conclusion and discussion

ChatGPT is an emerging tool of great potential for improving human work in different aspects of life. Despite it being a conversational model (Grünebaum et al. 2023; Haleem et al. 2022), research papers dealing with its multiple applications in science are constantly being created and published (Biswas 2023; Ciaccio 2023; Grünebaum et al. 2023; Ray 2023). The goal of this paper is to verify and assess the information provided by ChatGPT regarding different aspects of the changing climate in Poland. Although the assessment is designed to be as fair as possible, I am aware of the limitations of the applied methodology. It was not entirely possible to completely eliminate subjectivity.

Unfortunately, the scientific information provided by ChatGPT is very disappointing. Below is a brief summary of the several aspects of the ChatGPT answers, which are compiled in Table 1:

References. Almost all references are fake; however, with each answer the accuracy improves – at the beginning, the surnames were fabricated (for example, Kovalski) but, by the end, the authors and title in the bibliography related to a real scientific paper by Kundzewicz & Matczak 2012.

General trends, factors and dependencies. In most cases, general information, such as cloud genres, factors influencing sunshine duration and future changes in extreme events, is correct. Unfortunately, sometimes this leads to overgeneralization and oversimplification; for example, the height of high-level clouds being dependent on latitude was omitted.

Numbers and values. In most cases the numbers given by ChatGPT are highly inaccurate or incorrect. While the general trend is usually correct (for example, the increase in air temperature in Poland), the value of this trend is mostly incorrect (for example, the temperature trend should be 0.29°C/10 years, not 0.17°C/10). The reason for this might be that the proper reference period was not applied. In some responses, the values of climatological trends, averages, totals, and so on are not given at all.

Weather elements. While some weather elements were presented more accurately, such as air temperature and precipitation, others were completely misinterpreted – for example, snow precipitation. Many scientific results in the field of geography are presented in the form of maps and charts, which are difficult for ChatGPT 3.5 to interpret accurately.

The assessment of eight answers given by ChatGPT with short descriptions and grades

Question Correct/Incorrect Short assessment (description) Assessment grade (0–10)
1. How much is air temperature predicted to rise in Poland? Correct Temperature rise in the future, IPCC reference, 2–4°C rise until the end of the century, factors that influence temperature rise and information about projection uncertainties. 7
Incorrect Outdated information, inaccurate temperature values (should be 1–1.5°C until 2050, not 2.5°C), no information about regional variability.
2. Describe with proper references the past changes of air temperature in Poland. Correct General information correct (such as increasing temperature trends, especially in winter season), IPCC fifth report correct. 3
Incorrect Mixed national reports, fake years and references, some data are highly inaccurate (temperature trend should be 0.29°C/10 years, not 0.17°C/10 years), fake reference years.
3. Describe the pattern of precipitation in Poland with proper references and links to the sources of information. Correct General pattern correct, IPCC fifth report correct. 7
Incorrect Incorrect precipitation totals, incorrect references, some inaccurate data (precipitation totals should be 500–1500 mm, not 400–1000 mm).
4. Explain how snow precipitation in Poland changed over time with references to published scientific papers. Correct Correct real names of scientists. 2
Incorrect Off topic – the answer is focused on snow cover, not snow precipitation, incorrect years and journals in references, varied inaccurate ranges of changes, overgeneralization.
5. Explain the changes of occurrence of high-level clouds over Poland with references to scientific papers. Correct Correct cloud genres, real scientists connected with cloudiness research quoted, the names of real journals mentioned. 1
Incorrect Publication titles and teams are fake, information about changes in high-level clouds are mostly incorrect and without numerical values, two facts are mutually exclusive (decreasing trend in summer and in winter).
6. Explain the reason for changes in sunshine duration in Poland with references to real scientific papers Correct Correct factors influencing sunshine duration. 2
Incorrect Important scientists omitted, information about trends incorrect, incomplete information about factors that influence this meteorological element, no numerical values given.
7. Describe temporal and spatial variation of wind speed in Poland with references. Correct Real scientists and journals, trends mostly correct. 4
Incorrect Fake publications, incorrect information about the correlation with NAO index, incomplete information about spatial distribution, no numerical values given.
8. How are extreme weather events going to change in Poland in the future? Give examples with references. Correct Improved accuracy of bibliography, mostly correct general trends and patterns of changes. 5
Incorrect Some incomplete and inaccurate information about the future of extreme events, for example, a 30% increase in heatwave days without any additional information.

The average grade for the assessment of the eight questions related to climate change in Poland is only 3.87, suggesting that only 30–40% of the information is correct. At this stage of development, ChatGPT is a rather poor tool to be used in research and academic education (Castro Nascimento & Pimentel 2023; Zheng & Zhan 2023). However, thanks to its ability to learn on the basis of previous prompts (Haleem et al. 2022), it is possible its responses will improve. This requires further research to focus on the proper construction and improvement of prompt building, which should result in more accurate answers from ChatGPT.

Currently, its only viable applications are those recognized by scientific journals, such as correcting and improving English language in submitted manuscripts, sorting out bibliographies (e.g. changing styles, removing DOIs, etc.) and clearly indicating any parts written by ChatGPT as generated by the AI and not to be considered as co-authored contributions by, for example, Nature (Nature 2023) and Science (Thorp 2023). If used correctly, ChatGPT has great potential to develop as a magnificent tool designed to help humans accelerate their work in research and education; this time has not yet come.

eISSN:
2084-6118
Language:
English
Publication timeframe:
4 times per year
Journal Subjects:
Geosciences, Geography, other