Authors: Christian Terwiesch

Abstract

OpenAI’s Chat GPT has shown a remarkableability to automate some of the skills of highly compensated knowledge workers in general and specifically the knowledge workers in the jobs held by MBA graduates including analysts, managers, and consultants. Chat GPT has demonstrated the capability of performing professional tasks such as writing software code and preparing legal documents. The purpose of this paper is to document how Chat GPT performed on the final exam ofa typical MBA core course, Operations Management. Exam questions were uploaded as used in a finalexam setting and then graded. The “academic performance” of Chat GPT can be summarized as follows. First, it does an amazing job at basic operations management and process analysis questions including those thatare based on case studies. Not only are the answers correct, but the explanations are excellent. Second, Chat GPT at times makes surprising mistakes in relatively simple calculations at the level of 6th grade Math. These mistakes can be massive in magnitude. Third, the present version of Chat GPT is not capable of handling more advanced process analysis questions, even when they are based on fairly standard templates. This includes process flows with multiple products and problems with stochastic effects such as demand variability. Finally, Chat GPT is remarkably good at modifying its answers in response to human hints. In other words, in the instances where it initially failed to match the problem with the right solution method, Chat GPT was able to correct itself after receiving an appropriate hint from a human expert. Considering this performance, Chat GPT would have received a B to B- grade on the exam. This has important implications for business schooleducation, including the need for exam policies, curriculum design focusing on collaboration between human and AI, opportunities to simulate real world decision making processes, the need to teach creative problem solving, improved teaching productivity, and more.