
YouTube
Recommendation Algorithm Built a Catalog of Children's Videos for Pedophiles
A June 3, 2019 New York Times investigation, corroborated by researchers at Harvard's Berkman Klein Center for Internet and Society, found that YouTube's recommendation algorithm was systematically grouping and surfacing innocuous home videos of partially clothed children to viewers who had…
- 01TRIGGERA June 3, 2019 New York Times investigation, corroborated by researchers at Harvard's Berkman Klein Center for…
- 02MACHINE ACTIONAutonomous actor
- 03MISSING GATERisk-based SME approval before execution
- 04IMPACTHuman welfare
The short version
A June 3, 2019 New York Times investigation, corroborated by researchers at Harvard's Berkman Klein Center for Internet and Society, found that YouTube's recommendation algorithm was systematically grouping and surfacing innocuous home videos of partially clothed children to viewers who had…
Case telemetry
- INCIDENT
- SS-IR-015
- DATE
- June 3, 2019
- SYSTEM
- YouTube
- LOCATION / SCOPE
- Global (research focused on Brazil)
- EVIDENCE
- Documented
- AI ROLE
- Autonomous actor
- HARM
- Human welfare
- SOURCES
- 3 cited records
The event
A June 3, 2019 New York Times investigation, corroborated by researchers at Harvard's Berkman Klein Center for Internet and Society, found that YouTube's recommendation algorithm was systematically grouping and surfacing innocuous home videos of partially clothed children to viewers who had watched sexually themed content. The Harvard team (led by Jonas Kaiser) discovered the pattern while studying YouTube's influence in Brazil: a server set to follow YouTube's recommendations thousands of times mapped a pathway in which the system steered users from adult erotic content toward videos of progressively younger subjects, eventually to videos of girls as young as 5 or 6. Researchers identified roughly 50 sexually suggestive channels stocked with these clips. The algorithm acted as a discovery and aggregation engine for an audience of predators: a Brazilian mother's ordinary video of her 10-year-old daughter playing in a backyard pool jumped to more than 400,000 views in a few days, driven almost entirely by automated recommendations, where similar innocent videos normally drew only around 100 views.
What the machine did
YouTube's recommendation system was fully autonomous, optimizing for watch-time and engagement signals with no human SME review of what cohorts of content it was assembling or who it was assembling them for. The algorithm did not understand it was building a curated catalog of children for pedophiles; it simply detected that viewers of one clip clicked on similar clips and amplified that correlation at planetary scale. There was no human-in-the-loop gate evaluating the emergent behavior of recommendation clusters before they went live, no child-safety SME validating that engagement-optimized groupings were safe, and no oversight check that flagged when ordinary family videos were being driven to hundreds of thousands of views by an audience the optimizer never vetted. The harm was an unsupervised side effect of an engagement objective running without governance.
Where the failure landed
The algorithm exposed countless real children, identifiable in their own homes and neighborhoods, to a predatory audience without the knowledge or consent of the families who posted the videos. Ordinary home videos were boosted to hundreds of thousands of views, with one example exceeding 400,000. The disclosure triggered demands for consequences from US lawmakers and broad public outcry. YouTube responded by disabling comments on many videos featuring minors (a step begun in February 2019 after a related comment-section scandal), ending the ability of children to livestream alone, and limiting how some videos of children were recommended, but the company declined to stop recommending children's videos entirely, drawing continued criticism that the underlying engagement-optimized system remained intact.
Documented
Supported by a first-party disclosure, technical research, or corroborated reporting cited below.
SOURCE RECORD UPDATED 2026-07-09
3 cited records
- 01
- 02
- 03
Risk-based SME approval before execution
The failure pattern in this case: High-stakes output had no accountable checkpoint.
The moment the path could change
The appropriate subject-matter expert reviews the evidence, exceptions, and affected people before the output becomes action.
Autonomy is a design choice.
See the operating model that keeps AI useful while preserving human authority at consequential moments.
Compare AgenticAI and AugmentedAI →