Evaluating ChatGPT-4's Historical Accuracy: A Case Study on the Origins of SWOT Provisionally Accepted

Richard W. Puyt^1* Dag Øivind Madsen^2*

• ¹University of Twente, Netherlands
• ²University of South-Eastern Norway (USN), Norway

In this study we test ChatGPT-4's ability to provide accurate information about the origins and evolution of SWOT analysis, perhaps the most widely used strategy tool in practice worldwide.ChatGPT-4 is tested for historical accuracy and hallucinations. Our findings present a nuanced view of ChatGPT-4's capabilities. We observe that while ChatGPT-4 demonstrates a high level of proficiency in describing and outlining the general concept of SWOT analysis, there are notable discrepancies when it comes to detailing its origins and evolution. These inaccuracies range from minor factual errors to more serious hallucinations that deviate from evidence in scholarly publications. However, we also find that ChatGPT-4 comes up with spontaneous historically accurate facts. Our interpretation of the result is that ChatGPT is largely trained on easily available websites and to a very limited extent has been trained on scholarly publications on SWOT analysis, especially when these are behind a paywall. We conclude with four propositions for future research.