Concerns Raised Over Use of AI Chatbot for School Reports
The integration of artificial intelligence (AI) chatbots into various aspects of our lives is becoming increasingly common, but concerns have been raised over their use in generating school reports for students. Tauranga Boys’ College in New Zealand has implemented an AI chatbot called ChatGPT to assist in generating report comments. While the use of this technology aims to improve accuracy and efficiency, some individuals have expressed reservations.
The chatbot, which is integrated into the school’s student management system, generates comments based on students’ academic achievements, learning behaviors, and attendance data. Teachers have the option to utilize the comments provided by ChatGPT, but they are still required to peer-review and cross-check them for accuracy and suitability. The school states that the chatbot is intended to create an initial outline comment, but it does not replace the personal feedback provided by teachers.
Despite the potential benefits of using AI to synthesize large amounts of data, concerns have been raised regarding the reliability and personalization of the comments generated by ChatGPT. Some argue that students and parents would benefit from more personalized and detailed feedback, rather than relying solely on AI-generated comments. There is also concern about the privacy implications of the chatbot collecting data.
Principal Andrew Turner emphasizes that the use of ChatGPT is strictly confidential to the school. Only staff, students, and parents with login/password access can access the information stored in the student management system. Turner clarifies that the chatbot does not collect any identifying information such as students’ names or genders, thereby adding a layer of privacy.
While the school has trialed the use of ChatGPT, the feedback from teachers has been mixed. The school remains open to exploring tools that will enhance accuracy and efficiency in reporting without compromising the teachers’ ability to provide their own voice.
KAMAR, the company behind the student management system, provides interfaces for schools to integrate with third-party tools such as ChatGPT. However, they do not collect information on which schools have enabled the chatbot feature. The Ministry of Education advises schools to have robust policies and procedures around privacy, digital technology use, and data information security.
The Office of the Privacy Commissioner suggests that schools give parents the opportunity to discuss the potential benefits and concerns of using AI chatbots for report comments. If parents remain uncomfortable with their children’s reports being generated by AI, they should have the option to opt-out. The office also recommends privacy impact assessments to mitigate potential privacy risks.
In conclusion, while the use of AI chatbots like ChatGPT can improve efficiency in generating school reports, concerns remain about their reliability, personalization, and privacy implications. Schools are urged to consider the risks and benefits carefully, ensuring that appropriate policies and safeguards are in place. Ultimately, the goal should be to strike a balance between leveraging technology and providing students with meaningful feedback from their teachers.
