RatioLogo
Back

AI Identifies a Hidden Digital Pandemic

During the height of the COVID-19 lockdowns, as physical doors closed, a dangerous digital window swung wide open. For adolescents isolated from peers and tethered to unregulated social media, the screen became a primary source of influence—one increasingly filled with "Pro-ED" (pro-eating disorder) imagery that fuels body dissatisfaction and emotional distress.

While text-based filters have long patrolled the internet for harmful keywords, the visual landscape has remained a "wild west." New research now reveals that artificial intelligence can finally see what we’ve been missing. By deploying advanced computer vision, researchers have successfully identified Pro-ED content with a high degree of precision, offering a new shield for vulnerable young users.


The Vision Transformer Breakthrough

The study centered on the Vision Transformer (ViT), an AI architecture that uses "self-attention" to analyze an entire image at once.

Model Performance

This model proved remarkably effective, achieving an accuracy of 86.7% and an F1 Score of 0.877. It outperformed the more traditional ResNet-152, which managed an accuracy of 83.2%.

This discovery matters because it proves that AI can monitor harmful visual "movements" as effectively as it reads text. As the study’s author noted, the Vision Transformer reached accuracies comparable to language-based models, despite analyzing an entirely different medium.


Beyond just identifying images, the AI acted as a digital historian, uncovering troubling trends across a massive validation set of 56,445 images from the "#selfie" hashtag.

Key Temporal Findings

  • A Seasonal Pattern: The data confirmed a distinct "summer-pattern," with Pro-ED content reaching its maximum ubiquity in July and August.
  • The Pandemic Scar: Researchers noted a sharp "inflection point" in January 2020. Content levels surged that year, and regression analysis (R2=0.555R^2 = 0.555; p < 0.001) confirms that these levels have not regressed to pre-pandemic baselines. This suggests a permanent expansion of these harmful digital communities.

Current Hurdles & Future Directions

There are, however, hurdles to clear before this AI becomes a standard gatekeeper.

Challenges to Implementation

  • False Positives: The model currently has a propensity for false-positive classifications, meaning it might occasionally flag healthy content as harmful.
  • Platform & Data Limits: The study focused exclusively on Twitter, and the training relied on hashtags rather than manual expert labeling, which can introduce "noise" into the data.

While the tech provides a quantitative substrate for monitoring, the researchers concede that more covert or niche Pro-ED terminology still needs to be captured to ensure a truly robust safety net.


Based on: RevealED: Uncovering Pro-Eating Disorder Content on Twitter Using Deep Learning by Jonathan Feldman.