The Keenan Blog

Blog

AI in Education: What California Schools and Colleges Should Know

Artificial intelligence is changing how students learn, communicate, and engage with information. Across California, this shift is extending beyond academic use and into student safety, conduct, and compliance.

For K-12 districts and community colleges, the focus is not only on how AI supports learning. It is also on how new uses, including AI-generated content, introduce risks that schools must be prepared to address.

How AI is showing up in California classrooms

Students are already using AI in routine academic tasks. These include drafting written work, summarizing materials, and receiving tutoring support.

At the same time, newer uses are emerging that raise important concerns. One of the most significant is the use of AI to create realistic but false images, audio, or video, commonly referred to as deepfakes.

California policymakers are beginning to respond. Proposed legislation would establish a confidential reporting hotline and portal specifically for AI-generated deepfake harassment involving K-12 students (California P&C Legislative Summary: 2026 Start of Session).

This reflects a broader recognition that AI tools can affect both learning and student safety.

Understanding deepfake harassment in schools

Deepfake technology allows users to create highly realistic images or videos that appear to show a person saying or doing something they did not actually do.

In a school setting, this technology can be used in ways that are harmful. Examples reported nationally and reflected in policy discussions include:

• Altering student images to create inappropriate or misleading content
• Impersonating classmates or staff through generated audio or video
• Spreading false content quickly through social media or messaging platforms

These incidents often mirror traditional bullying, but with important differences. AI-generated content can be more convincing, more widely distributed, and more difficult to remove once shared.

For schools, this creates new challenges in both prevention and response.

Why deepfake misuse is a growing concern

Deepfake harassment introduces several risks that align with existing student safety responsibilities.

Emotional and reputational harm

Students impacted by altered or fabricated content may experience embarrassment, anxiety, or social isolation. Schools are often the first place these impacts are observed.

Rapid escalation through digital platforms

AI-generated content can spread quickly across student networks. This increases the potential reach and impact of a single incident.

Overlap with existing compliance frameworks

In some cases, deepfake content may intersect with harassment or discrimination concerns addressed under policies such as Title IX or local student conduct codes. Schools are required to respond promptly to such concerns (Title IX “Final Rule” Struck Down by The Courts).

Increased reporting and liability exposure

As with other forms of student harm, failure to respond appropriately can increase institutional risk. Schools already face growing expectations around reporting and intervention in student safety matters.

These risks highlight why AI is now part of broader safety and risk management discussions.

Key trends shaping AI and student safety

Several trends are becoming more visible across California education systems:

AI-related safety concerns are expanding

New forms of digital harm, including deepfake harassment, are being treated as part of overall student safety planning.

Policy responses are emerging at the state level

Proposed legislation focused on reporting AI-based harassment shows that governance is evolving alongside technology (California P&C Legislative Summary: 2026 Start of Session).

Schools are integrating AI into existing frameworks

Rather than creating entirely new systems, many institutions are incorporating AI considerations into established policies for bullying, harassment, and student conduct.

Awareness is still developing

Students may not fully understand the impact or consequences of creating and sharing AI-generated content. Education and guidance remain critical.

Considerations for K-12 districts

K-12 leaders are beginning to address both instructional and safety dimensions of AI.

Define acceptable use clearly

Policies should address not only academic use, but also the creation and sharing of AI-generated content involving others.

Integrate AI into bullying prevention efforts

Deepfake incidents can align with cyberbullying. Existing prevention programs may need to be updated to reflect new technologies.

Strengthen reporting pathways

Students and staff need clear, accessible ways to report concerns, particularly when content spreads quickly.

Train staff to recognize emerging risks

Educators and administrators may not immediately recognize AI-generated content. Training can help support early identification and response.

Considerations for community colleges

Community colleges face similar concerns, along with added complexity tied to adult learners and campus environments.

Address AI within conduct and harassment policies

Clear guidance helps ensure consistent expectations across programs and campuses.

Support digital literacy

Students benefit from understanding both how AI tools work and the ethical considerations associated with their use.

Coordinate with student services

Impacts of harassment may involve counseling, academic accommodations, or campus safety responses.

Practical best practices for institutions

Across education settings, several steps can help address deepfake-related risks in a balanced way:

• Include AI-generated content in student conduct and acceptable use policies
• Establish clear reporting procedures for digital harassment
• Provide training on identifying and responding to AI-generated content
• Reinforce expectations around respect, privacy, and responsible technology use
• Review incident response protocols to ensure timely and consistent action
• Monitor legislative and regulatory updates specific to AI and student safety

These actions build on existing safety frameworks while addressing new forms of risk.

Moving forward with clarity

AI will continue to shape how students learn and interact. It will also continue to influence how schools think about safety, accountability, and student support.

Deepfake harassment is one example of how quickly new risks can emerge. California's policy activity signals that this is an area of active attention for schools and colleges.

With clear expectations, consistent policies, and a focus on student well-being, educational institutions can respond to these challenges in a measured and effective way.

Keenan works with public agencies and educational institutions to provide guidance on emerging risks, helping organizations align policies with evolving expectations while maintaining safe learning environments.