Essential recommendations for schools on privacy and accessibility

This article ai-products-essential-recommendations-for-schools-on-privacy-and-accessibility/” target=”_blank” rel=”noreferrer noopener”>originally appeared on the CoSN blog and is republished here with permission.

Key points:

In recent years, school districts have shown increasing interest in the potential of generative ai (GenAI) to revolutionize education. GenAI offers the promise of enhancing personalized learning, simplifying administrative tasks, and providing innovative educational resources. However, as districts rush to adopt these cutting-edge technologies, they must carefully select the right ai tools to meet their unique needs. This rapid adoption comes with significant risks, especially when it comes to data privacy and accessibility.

Ensuring that ai tools protect student data and meet accessibility standards is crucial to creating an inclusive and safe educational environment. This blog post will explore expert recommendations for selecting GenAI tools, helping districts address these challenges effectively.

Data Privacy Considerations and Recommendations for GenAI Adoption in Schools

Linnette Attai, project director of the CoSN Student Data Privacy Initiative and president of compliance consulting firm PlayWell, LLC, shares insights on the data privacy risks associated with adopting GenAI tools and offers guidance for a responsible implementation.

While security breaches are a common concern, Linnette emphasizes that protecting student privacy and data involves more than simply preventing breaches. There is a broader responsibility to safeguard students' emotional well-being and personal information or, as she calls it, a “responsibility of care.” Key privacy considerations include:

Ownership and control of data:

District leaders should be careful when using large language models that are not specifically designed for educational purposes. These models could use student data to further train the ai, raising concerns about commercial use of personal information and potential exposure of sensitive data. Additionally, in some districts, any type of commercial use of personal information is illegal.

Linnette advises districts to adhere to core practices when adopting new tools:

1. Have a clear objective: Despite the growing popularity of GenAI tools, districts should identify a specific reason for their use. This approach ensures that the tool aligns with the district's needs and maximizes its impact on student outcomes.
2. Find out before you take the test: Districts should thoroughly understand the tool, including its privacy practices, security measures, and contractual terms, before making a commitment. Especially, districts must ensure that the tool is used for educational purposes only.
3. Start with the staff: Testing ai tools with staff, rather than students, helps avoid premature exposure of student data. Some companies offer beta testing or sandbox environments for staff to simulate student experiences, which can be a valuable way to evaluate the effectiveness of the tool.

A Practical Example: Hinsdale Township High School District 86

Keith Bockwoldt, chief information officer for Hinsdale Township High School District 86 in Illinois, shares his district's thoughtful approach to GenAI. Keith's 'Reimagining Learning through Innovation' program allows teachers to try out new tools funded by the district's IT budget. Teachers submit proposals for evaluation, which evaluate compliance with data privacy policies prior to pilot implementation. Teachers must then provide evidence of the tool's impact by the end of the year, and the department reviews whether the tool should be adopted more widely.

Keith highlights two critical considerations:

1. Supplier Compliance: Ensures vendors are aware of and comply with data privacy policies, such as the Student Online Personal Protection Act (SOPPA). Discusses data protection measures, including data storage and deletion practices.
2. Ongoing commitment to suppliers: Ongoing communication with vendors is crucial to maintaining compliance with data privacy standards.

Ensure accessibility

Jordan Mroziak, ai and education project manager at InnovateEDU, emphasizes the need for a deliberate approach to the adoption of new technologies. Warns against the educational arms race of adopting unproven or potentially unsafe ai products. Instead, districts should focus on meeting the needs of all students, particularly those who are underserved or disadvantaged. As a helpful resource, Jordan shared his and his colleagues' work with the EdSAFE ai Industry Council, which aims to provide trusted guidance and standards for districts exploring GenAI tools. Companies join this alliance by demonstrating how their products adhere to the SAFE framework for ai, which focuses on safety, responsibility, fairness, equity and effectiveness. This collective effort ensures that ai tools are developed with these critical principles in mind, promoting responsible and effective use.

Additionally, the recent update to Title II of the ADA requires that accessibility be prioritized from the beginning. Districts should choose ai tools that meet ADA standards and ensure equitable access for all students. This process includes evaluating tools to meet accessibility guidelines, engaging diverse stakeholders in testing, and making adjustments to meet various learning needs. By proactively addressing these requirements, districts can ensure their ai tools are inclusive, effective, and compliant with the law, thereby maximizing the benefits of the technology for each student.

For more recommendations on accessible GenAI implementation, read Blog 5 in this series: ai-in-education/”>Adaptation to Title II of the ADA: Effective strategies for accessible ai in education.

Integrating generative ai tools into education offers significant opportunities to improve learning and efficiency. However, it also poses challenges related to data privacy and accessibility. Careful implementation and ongoing evaluation are essential to maximize the benefits of these tools while ensuring the protection and support of all students.