Tianyi Zhang is an assistant professor in the College of Science’s Department of Computer Science at Purdue University. In a recent study, Zhang and other researchers asked ChatGPT 517 questions from Stack Overflow, a popular question-and-answer website for computer programmers. They discovered that ChatGPT gave answers with incorrect information 52% of the time.
Zhang says that ChatGPT is a useful tool but should be used with caution. AI can be used to generate answers that are common knowledge, but it is unable to fully understand and present information that requires deeper expertise or human creativity. Zhang sees ChatGPT as an automation tool that can help programmers complete mundane and repetitive tasks. He does not believe that current AI will replace programmers or any job that requires complex thought or creativity.
About Purdue University
Purdue University is a public research institution with excellence at scale. Ranked among top 10 public universities and with two colleges in the top four in the United States, Purdue discovers and disseminates knowledge with a quality and at a scale second to none. More than 105,000 students study at Purdue across modalities and locations, with 50,000 in person on the West Lafayette campus. Committed to affordability and accessibility, Purdue’s main campus has frozen tuition 13 years in a row.