Leveraging GPT-3 as a question generator in Swedish for High School teachers

Abstract: The purpose of this study was to improve education by leveraging GPT-3 as a teacher tool. To achieve this, a prototype website was created that uses GPT-3 for generating questions based on teacher input. The tool is meant for High School teachers and produces questions in Swedish. To assess GPT-3’ capability as a question generator, and what value this would provide as a teacher tool, expert interviews were conducted. The experts consisted of teachers and teacher students. The interviews resulted in quantitative and qualitative data. The quantitative data was used to assess the quality of the generated questions in terms of truthfulness, linguistic ability, relevance & pedagogical ability. The qualitative data was used to identify strengths and weaknesses of the prototype. Furthermore, a SWOT-analysis was made including these strengths and weaknesses, as well as opportunities and threats of implementing such a tool into education. The study concluded that GPT-3 can be used to generate high quality questions. Although the quality of the questions was not as good as teacher-created questions, it was sufficient for teachers as they would have used 85% of the generated questions. The SWOT-analysis concluded that the strengths outweigh the weaknesses, which makes the prototype valuable for teachers with its current performance. There are opportunities to implement tools like the prototype into education, but also opportunities to make these tools better with new technology. The identified threats are regulation by law, cost sensitivity of High Schools, and inadequate socio-technical integration.