AI in Education
Artificial intelligence (AI) tools are increasingly being used in educational settings for everything from lesson planning to evaluating student work. While these tools offer convenience and innovation, they also present unique privacy and security challenges that educators must consider carefully before use.
Why Evaluate AI Tools?
Unlike traditional classroom tools, AI technologies rely heavily on data—data that is often collected, stored, and sometimes used to train AI models. When this data includes sensitive or personal information, such as student names or grades, it introduces risks that can compromise student privacy or even violate Canadian privacy laws like PIPEDA or FIPPA.
Check out the Full Checklist
With this checklist you are taking a step toward fostering a safe, secure, and innovative learning environment for your students.
Privacy and Security Questions
These questions apply to all tools and should be the first criteria evaluated.
Criteria | Consider Using | Needs Clarification | Not Recommended |
Privacy policy clearly states what data is collected and stored. | Yes | Needs more information | No privacy policy |
Inputted data is not used to train AI models. | Confirmed | Unclear or ambiguous | Explicitly used to train models |
Data is encrypted during transmission (e.g., end-to-end). | Confirmed | Requires confirmation | No encryption |
Minimal or no personal data required for use. | Yes | Requires limited data | Requires significant personal data |
Vendor specifies data storage location (e.g., Canada). | Clearly stated | Not specified | Unknown or problematic location |
Complies with Canadian privacy laws (PIPEDA, FIPPA, etc.). | Confirmed | Requires review | Likely non-compliant |
Does the tool collect data about the user (e.g., IP address, usage patterns, user behaviour)? | No sensitive data collected | Unclear in policy | Data collection is extensive or intrusive |
Is there transparency about how user data is used and stored? | Yes | Needs further clarification | No transparency |
Use-Case Scenarios
For AI tools in education, understanding and managing these risks is crucial. Teachers should ensure that any AI tool or chatbot used in the classroom adheres to privacy laws and collects only the minimum data necessary for its intended purpose. Check these use-case scenarios down below!
A. Using AI Tools with Students
Consider Using | Needs Clarification | Not Recommended | |
Can be used without requiring student accounts or personal info. | Yes | Some personal data required | Full accounts or sensitive info required |
Offers age- appropriate, inclusive, and unbiased content. | Yes | Requires content review | Inappropriate or biased content |
Usage can be monitored to prevent misuse. | Yes | Partial monitoring options | No monitoring tools |
B. Lesson Planning
Consider Using | Needs Clarification | Not Recommended | |
Generates accurate and relevant content. | Yes | Verify output quality | Produces inaccurate or irrelevant material |
Provides citations for generated content. | Yes | Inconsistent citations | No citations provided |
Can be used without uploading sensitive personal data. | Yes | Limited sensitive data required | Significant sensitive data required |
C. Writing Report Cards or Using Student Data
Consider Using | Needs Clarification | Not Recommended | |
Complies with privacy laws (PIPEDA, FIPPA). | Confirmed | Requires view | Likely non-compliant |
Accepts anonymized or pseudonymized student data. | Yes | Limited anonymization | No anonymization option |
Provides secure options to delete data after use. | Confirmed | Requires manual deletion | No deletion tools |
D. Evaluating Student Homework
Consider Using | Needs Clarification | Not Recommended | |
Can analyze homework without storing identifiable info. | Confirmed | Unclear storage policy | Stores identifiable data |
Provides fair, accurate, and constructive feedback. | Yes | Needs manual verification | Biased or inaccurate feedback |
Aligns with grading standards and practices. | Confirmed | Requires adjustments | Misaligned outputs |
E. Creating Classroom Materials
Consider Using | Needs Clarification | Not Recommended | |
Generates age- appropriate and accurate materials. | Yes | Requires verification | Inappropriate material |
Content is customizable and editable for classroom use. | Fully customizable | Limited customization | Rigid content outputs |
Avoids copyright or intellectual property concerns. | Confirmed | Unclear licenses | Copyright violations |
F. Ethical and Inclusive Use
Evaluating AI tools in education also requires a focus on ethical considerations and inclusivity. These tools should align with established educational values and promote equity for all students and teachers.
Consider Using | Needs Clarification | Not Recommended | |
Does the tool address potential biases in its design and outputs? | Confirmed | Unclear or not reviewed | Evidence of bias or discrimination |
Is the tool culturally sensitive and inclusive of diverse perspectives? | Yes | Requires review | Excludes or marginalizes groups |
Does the tool support equity in access and usability for all students, including those with disabilities | Yes | Limited accessibility | Not accessible |
G. Accessibility and Usability
AI tools should be designed with accessibility and usability in mind, ensuring they are equitable for students with diverse needs, including disabilities or language barriers. Teachers should evaluate the following criteria.
Consider Using | Needs Clarification | Not Recommended | |
Does the tool include accessibility features such as screen readers or adjustable font sizes? | Yes | Limited features | Not accessible |
Is the tool compatible with assistive technologies already in use? | Fully compatible | Partial compatibility | Not compatible |
Does the tool offer multilingual support for students and families? | Yes | Limited languages | No multilingual support |
H. Continuous Improvement and Feedback
AI tools should be regularly reviewed to ensure they remain effective and aligned with educational goals. Teachers, students, and administrators should have mechanisms to provide feedback and contribute to the ongoing evaluation of these tools.
Consider Using | Needs Clarification | Not Recommended | |
Does the school or district have a plan to evaluate the tool’s long-term impact? | Yes | Limited feedback options | No feedback mechanism |
Is there a process for regular updates and improvements to the tool? | Yes | Requires review | No update process |
Does the tool provide a mechanism for user feedback? | Yes | Requires development | No evaluation plan |
Key Reminders for Teachers
Every Input is Data
Understand that any data you or your students input into an AI tool becomes part of that tool’s database. Even seemingly harmless inputs, such as text for lesson planning, could be collected and stored.
Stay Vigilant
If a tool’s privacy policy or data practices are unclear, avoid using it until clarification is obtained.
Collaborate with IT/Admin
You are not alone in evaluating these tools. School district IT teams and administrators are valuable resources for assessing privacy, security, and compliance.