AI Teacher Assistants: Trustworthiness Examined - Key Insights
In a recent report, Common Sense Media has assessed the risks associated with four popular AI teacher-assistant platforms: Google's Gemini, Khanmigo's Teacher Assistant, Curipod, and MagicSchool.
The report raises concerns about potential biases in AI-generated recommendations, particularly in behavioural intervention strategies. For instance, it found that AI tools may recommend different interventions for students based on what the AI is inferring from students' names about their gender and race.
Google has acknowledged these concerns and has taken steps to address them. They have turned off a shortcut to the prompt "generate behaviour intervention strategies" in Google Classroom, while they evaluate the issues raised in the Common Sense Media report.
MagicSchool, another platform under scrutiny, has stated that it could not replicate the findings of the Common Sense Media report.
The report also emphasizes that AI teacher assistants are only as good as the systems that surround them, including teacher training, oversight processes, and districts' policies guiding usage. For example, it found that AI tools may fail to identify harmful misinformation, and teachers should be aware of "automation bias" and critically assess AI outputs before using them with students.
AI teacher assistants should allow teachers to upload lesson plans, curriculum guides, and other resources to ensure outputs are aligned with curricula and standards. However, these tools may not be appropriate for novice teachers to use without guidance and training. Schools should provide support and training for novice teachers on how to use AI teacher assistants.
Moreover, AI teacher assistant tools can produce biased outputs based on what it perceives to be a student's race or background. Teachers should be cautious when relying on AI teacher assistants to generate images, as they can create pictures that promote harmful stereotypes and misinformation.
It's important to note that AI teacher assistant tools are intended to be used as assistants, with teachers maintaining control over their use and outputs. They should not replace the need for mentors and learning communities for new teachers.
In conclusion, while AI teacher assistants can improve learning by enhancing high-quality instructional materials and saving teachers time on busy work, it's crucial for schools and teachers to approach these tools with caution and critical awareness. Schools and teachers should ensure that they are using these tools responsibly and ethically, providing necessary support and training to ensure the best outcomes for students.
