Many products that use generative AI and the platforms that distribute them lack clear, reliable ways for users to report serious safety concerns, especially those involving potential or actual harm to children. In most cases, only general feedback forms are provided, which fail to distinguish between minor issues and urgent risks, offer no tracking or confirmation, and are rarely monitored in real time. As a result, severe safety threats can go unacknowledged and unresolved, leaving children exposed to ongoing harm.
Example
A user encounters harmful AI-generated content directed at a child within a product. When they attempt to report it, both the product and the platform it was obtained from offer only generic contact forms with no option to mark the issue as urgent. After submitting a report, no confirmation or follow-up is received, and the content remains accessible.
Why It Matters
When a child’s safety is at risk, there must be a clear, rapid, and accountable way to report and resolve the issue. Currently, there are many cases both products and the platforms that host them lack reliable mechanisms for urgent safety reporting, leaving serious concerns to vanish into untracked inboxes. Unlike security vulnerabilities or malware, which typically trigger immediate and traceable responses, child safety incidents involving generative AI are often treated as subjective or low priority. This gap erodes public trust and fails to uphold basic standards of child protection and corporate accountability in the digital environment.
What We Are Calling For
The AISF is calling for products that use generative AI to:
Implement a clearly visible “Report Urgent Child Safety Concern” channel designed specifically for high-risk issues involving children.
Ensure this system is easy to locate across all access points and allows tracked submissions with confirmation and progress updates.
Include escalation options for time-sensitive reports and provide clear communication about how and when the issue will be resolved.
Work toward standardising and making these mechanisms transparent across the industry so the public has a dependable way to ensure that urgent child safety risks are seen, tracked, and acted upon.
