AI Insights - FAQ

• What is AI Insight?

  AI Insight is a new feature from IRIS Connect that uses artificial intelligence to analyze classroom videos, providing teachers with immediate, actionable feedback to enhance professional development

• Can you explain more about AI Insights?

  IRIS Connect's AI Insight streamlines professional development, allowing teachers, coaches, and administrators to focus on what truly matters: impactful teaching, meaningful collaboration, and continuous growth. By quickly analyzing classroom videos, it delivers immediate, actionable feedback, saving valuable time and speeding up the professional development process.

  When used in Pathways, AI Insight enables automated, adaptive professional development. Pathways guide teachers through reflection, collaboration, and coaching processes. When integrated into a Pathway, AI Insight tailors recommendations based on classroom teaching analysis, delivering personalized, research-based guidance within the Pathway. This level of customization, which traditionally required significant time from coaches, administrators, and colleagues, is now available to all teachers.

• Why did you decide to build AI Insight?

  Teachers, coaches, and administrators are often stretched thin, with limited time to spend on crucial human interactions. By using AI to automate the analysis of classroom videos, we aimed to streamline this process, providing immediate, actionable feedback that saves time and accelerates professional growth. Our goal was to make high-quality, personalized professional development accessible and scalable. Traditionally, this requires significant human capital, making it costly and time-consuming. 

• How does AI Insight work?

  AI Insight quickly reviews classroom videos and identifies key aspects of teaching and learning. It then provides feedback and recommendations based on this analysis, helping educators improve their instructional practices. See user guide here
  
  

• What kind of feedback does AI Insight provide?

  AI Insight offers actionable feedback on various aspects of teaching, such as classroom management, instructional techniques, and student engagement. The feedback is designed to be practical and immediately useful.

• When will AI Insight be available to all users?

  We are planning to release a limited version of AI Insight to all IRIS Connect users in the coming weeks. Our Early Access Community members will have access to additional features for testing and experimentation before the general release. This community helps us to collect data from practitioners about how well the feature is working and how it can be improved. To join the early access programme, click here.

• What are Pathways, and how does AI Insight integrate with them?

  Pathways are structured programs within IRIS Connect that guide teachers through reflection, collaboration, and coaching. When integrated with Pathways, AI Insight tailors recommendations based on classroom analysis, offering personalized, research-based strategies for professional development.

• Is AI Insight customizable?

  Yes, AI Insight can be integrated into Pathways to provide tailored recommendations based on specific classroom analyses. This customization was traditionally done by human coaches but is now more scalable and cost-effective with AI. For now, the Insights available to users are limited to those that have been written by IRIS Connect. In the future, users may be able to create their own AI Insights, asking the AI question that they have written.

• How will AI Insight save me time?

  AI Insight automates the process of video analysis and feedback, eliminating the need for teachers to wait for a coach or colleague to review their videos. This immediate feedback accelerates the professional development process.
  
  

• How do you know that the analyses AI Insight provides are valid, accurate, and unbiased?

  AI Insight leverages advanced large language models (LLMs) developed by OpenAI to analyze classroom video transcripts. These models are designed to understand and generate human-like text based on the data they are trained on. OpenAI's technology is continuously refined to ensure accuracy and reliability. We have conducted extensive internal testing to validate the analyses provided by AI Insight. Our team has carefully crafted the AI queries to ensure that the feedback and recommendations are valid, accurate, and reliable. Our priority is to "do no harm," so we pace our feature development carefully to ensure we are providing valuable and trustworthy information to educators. Additionally, we are actively engaging with educators to test new Insights and gather feedback. This collaboration helps us refine AI Insight further and ensure it meets the high standards of quality and usefulness that educators need. Through this ongoing process, we aim to provide tools that genuinely enhance teaching and learning.

Potential Bias in Feedback:

At IRIS Connect, we understand the importance of fair and unbiased feedback. Our AI Insights tool uses pre-trained models from OpenAI, which have been trained on vast and diverse datasets. While it's challenging to eliminate all biases from large language models (LLMs), OpenAI has implemented extensive measures to ensure their training data is balanced across various demographics, including race, gender, age, ethnicity, and socioeconomic status.

We want to assure our users that:

• Diverse and Representative Training: OpenAI's training data encompasses a broad spectrum of perspectives to mitigate bias.
• Additional Safeguards: Both OpenAI and IRIS Connect have added layers of prompt architectures to further reduce potential biases.
• Transcript-Only Analysis: The AI Insights tool only analyzes the transcript of audio, without explicit information about speakers' personal characteristics. While certain inferences might be made from the text, no additional external data about the speaker is provided to the model.

Bias Considerations:

• Western and Liberal Bias: It is acknowledged in research that OpenAI models may exhibit a Western cultural and liberal political bias. We are continuously working to address and mitigate this.
• Expert Validation: Our prebuilt AI Insights have been rigorously tested by educators to ensure consistent and expert-aligned feedback. These insights focus on factual, evidence-based questions and provide minimal, respectful qualitative feedback.

• Will my data be secure and private if I use AI Insight?

  Yes, IRIS Connect takes the responsibility of acting as a processor of personal data extremely seriously. AI Insight operates within the secure environment of IRIS Connect, adhering to strict data protection standards. Additionally, before analyzing the videos, AI Insight attempts to remove any personally identifiable information to further protect your privacy. We constantly review our procedural, organizational, and physical security to ensure that we are offering a service that our customers can trust. We have completed multiple external audits, gap analysis, and penetration testing of our services to ensure that we meet industry best practices and the principles of GDPR.

If you would prefer to opt out of the AI Insights feature, request a different sub processor or understand more how the feature works, please click here

• Is the video data submitted by the schools used in any way to further train or enhance your AI models?

We prioritize the privacy and security of your data. Video data submitted by schools is never used to train or enhance our AI models. We respect the confidentiality and ownership of your content.

By incorporating these measures and policies, we aim to provide reliable, fair, and respectful AI-driven insights for all our users.

If you have any further questions or concerns, please feel free to contact our support team.