K-12 Teachers

AI in Education

Artificial intelligence (AI) tools are increasingly being used in educational settings for everything from lesson planning to evaluating student work. While these tools offer convenience and innovation, they also present unique privacy and security challenges that educators must consider carefully before use.

Why Evaluate AI Tools?

Unlike traditional classroom tools, AI technologies rely heavily on data—data that is often collected, stored, and sometimes used to train AI models. When this data includes sensitive or personal information, such as student names or grades, it introduces risks that can compromise student privacy or even violate Canadian privacy laws like PIPEDA or FIPPA.

knowledgeflow-tipsheet-ai-tool-evaluation-checklist

Check out the Full Checklist

With this checklist you are taking a step toward fostering a safe, secure, and innovative learning environment for your students.

Privacy and Security Questions

These questions apply to all tools and should be the first criteria evaluated.

CriteriaConsider UsingNeeds ClarificationNot Recommended
Privacy policy
clearly states what
data is collected and
stored.
YesNeeds more informationNo privacy policy
Inputted data is not used to train AI models.ConfirmedUnclear or
ambiguous
Explicitly used to
train models
Data is encrypted
during transmission
(e.g., end-to-end).
ConfirmedRequires
confirmation
No encryption
Minimal or no personal data required for use.YesRequires limited dataRequires significant personal data
Vendor specifies data storage location (e.g., Canada).Clearly statedNot specifiedUnknown or problematic location
Complies with Canadian privacy laws (PIPEDA, FIPPA, etc.).ConfirmedRequires reviewLikely non-compliant
Does the tool collect data about the user (e.g., IP address, usage patterns, user behaviour)?No sensitive data collectedUnclear in policyData collection is extensive or intrusive
Is there transparency about how user data is used and stored?YesNeeds further clarificationNo transparency

Use-Case Scenarios

For AI tools in education, understanding and managing these risks is crucial. Teachers should ensure that any AI tool or chatbot used in the classroom adheres to privacy laws and collects only the minimum data necessary for its intended purpose. Check these use-case scenarios down below!

A. Using AI Tools with Students

Consider UsingNeeds ClarificationNot Recommended
Can be used without requiring student accounts or personal info.YesSome personal
data required
Full accounts or sensitive info required
Offers age- appropriate, inclusive, and unbiased content.YesRequires content reviewInappropriate or biased content
Usage can be monitored to prevent misuse.YesPartial monitoring optionsNo monitoring tools

B. Lesson Planning

Consider UsingNeeds ClarificationNot Recommended
Generates accurate and relevant content.YesVerify output qualityProduces inaccurate or irrelevant material
Provides citations for generated content.YesInconsistent citationsNo citations provided
Can be used without uploading sensitive personal data.YesLimited sensitive data requiredSignificant sensitive data required

C. Writing Report Cards or Using Student Data

Consider UsingNeeds ClarificationNot Recommended
Complies with privacy laws (PIPEDA, FIPPA).ConfirmedRequires viewLikely non-compliant
Accepts anonymized or pseudonymized student data.YesLimited anonymizationNo anonymization option
Provides secure options to delete data after use.ConfirmedRequires manual deletionNo deletion tools

D. Evaluating Student Homework

Consider UsingNeeds ClarificationNot Recommended
Can analyze homework without
storing identifiable
info.
ConfirmedUnclear storage policyStores identifiable data
Provides fair, accurate, and constructive feedback.YesNeeds manual verificationBiased or inaccurate feedback
Aligns with grading standards and practices.ConfirmedRequires adjustmentsMisaligned outputs

E. Creating Classroom Materials

Consider UsingNeeds ClarificationNot Recommended
Generates age- appropriate and accurate materials.YesRequires verificationInappropriate material
Content is customizable and editable for classroom use.Fully customizableLimited customizationRigid content outputs
Avoids copyright or intellectual property concerns.ConfirmedUnclear licensesCopyright violations

F. Ethical and Inclusive Use

Evaluating AI tools in education also requires a focus on ethical considerations and inclusivity. These tools should align with established educational values and promote equity for all students and teachers.

Consider UsingNeeds ClarificationNot Recommended
Does the tool address potential biases in its design and outputs?ConfirmedUnclear or not reviewedEvidence of bias or discrimination
Is the tool culturally sensitive and inclusive of diverse perspectives?YesRequires reviewExcludes or marginalizes groups
Does the tool support equity in access and usability for all students, including those with disabilitiesYesLimited accessibilityNot accessible

G. Accessibility and Usability

AI tools should be designed with accessibility and usability in mind, ensuring they are equitable for students with diverse needs, including disabilities or language barriers. Teachers should evaluate the following criteria.

Consider UsingNeeds ClarificationNot Recommended
Does the tool include accessibility features such as screen readers or adjustable font sizes?YesLimited featuresNot accessible
Is the tool compatible with assistive technologies already in use?Fully compatiblePartial compatibilityNot compatible
Does the tool offer multilingual support for students and families?YesLimited languagesNo multilingual support

H. Continuous Improvement and Feedback

AI tools should be regularly reviewed to ensure they remain effective and aligned with educational goals. Teachers, students, and administrators should have mechanisms to provide feedback and contribute to the ongoing evaluation of these tools.

Consider UsingNeeds ClarificationNot Recommended
Does the school or district have a plan to evaluate the tool’s long-term impact?YesLimited
feedback options
No feedback mechanism
Is there a process for regular updates and improvements to the tool?YesRequires reviewNo update process
Does the tool provide a mechanism for user feedback?YesRequires developmentNo evaluation plan

Key Reminders for Teachers

Every Input is Data

Understand that any data you or your students input into an AI tool becomes part of that tool’s database. Even seemingly harmless inputs, such as text for lesson planning, could be collected and stored.

Stay Vigilant

If a tool’s privacy policy or data practices are unclear, avoid using it until clarification is obtained.

Collaborate with IT/Admin

You are not alone in evaluating these tools. School district IT teams and administrators are valuable resources for assessing privacy, security, and compliance.

Additional Resource

Learn more about how to integrate our resources into your classroom