Fahima Khan All articles
Opinion & Culture

Your Recommendations Know Your Trauma. Nobody Asked Them To.

Fahima Khan
Your Recommendations Know Your Trauma. Nobody Asked Them To.

The Machine That Figured You Out Before You Did

Here's something that happened to a friend of mine — though honestly, it could've been any of us. She'd been going through a slow, quiet unraveling after a breakup. Not the dramatic kind. The kind where you still show up to work and answer texts and seem completely fine. She hadn't said a word about it to anyone, not really. But her YouTube feed started serving her videos about anxious attachment. Her Spotify Discover Weekly filled up with songs about longing and loss. Her TikTok For You page became a meditation on heartbreak so precise it felt like someone had been reading her journal.

No one had. The algorithm had just been paying attention.

That's the thing about recommendation systems in 2024 — they're not just guessing what you want to watch next. They're building a psychological profile of you in real time, one click, one pause, one three-second hesitation at a time. And increasingly, that profile is more emotionally detailed than anything you'd hand over to a licensed therapist on day one.

What the Algorithm Is Actually Tracking

We tend to think of recommendation engines as content matchmakers. They notice you liked one true crime doc, so they serve you another. Simple enough. But the mechanics underneath are far more invasive than that framing suggests.

These systems track how you engage with content, not just what you engage with. Do you rewatch certain scenes? Do you pause mid-video and sit there for a beat before scrolling? Do you seek out content late at night versus in the morning? Do you binge-watch shows about estranged families during the holidays? Every micro-behavior feeds a model that starts drawing conclusions about your emotional state, your vulnerabilities, your psychological patterns — conclusions that, in many cases, are startlingly accurate.

Researchers have documented this for years. Facebook's infamous internal studies showed the platform could predict emotional states based on engagement patterns. Spotify's mood-based playlisting has been shown to both reflect and reinforce emotional states. Netflix's recommendation logic doesn't just factor in genre preferences — it accounts for viewing context, including time of day and session length, both of which correlate heavily with emotional states.

The algorithm isn't diagnosing you. But it's doing something that rhymes with it.

The Comfort Problem

Here's where it gets complicated, because there's a real seduction to all of this. When you're in pain and the algorithm serves you exactly the content that makes you feel seen — the podcast about childhood emotional neglect, the essay about the specific grief of losing a parent you had a complicated relationship with, the playlist that sounds like crying in a parking lot — it feels like being understood. And that feeling isn't nothing.

For a lot of people, especially those without easy access to mental health care (which, in the US, is a staggering number of people given insurance gaps and provider shortages), algorithmic content has become a kind of informal emotional scaffolding. It's not therapy. But it's something. It meets people where they are, at 2am, when their therapist is asleep and their friends are tired of hearing about it.

I don't want to dismiss that. The validation people find through curated content is real. The communities that form around shared emotional experiences online are real. Some people have genuinely found language for their experiences — depression, trauma responses, ADHD, grief — through content that algorithms served them before any professional ever named it.

But there's a difference between stumbling into a helpful resource and having a corporation's profit-optimized machine quietly cataloging your psychological vulnerabilities without your knowledge or consent.

The Part We're Not Talking About Enough

Let's be direct about what's actually happening here: you are generating incredibly sensitive psychological data every time you use these platforms, and that data belongs to them.

Your therapist is bound by confidentiality laws. Your therapy notes are protected health information under HIPAA. If your therapist figured out you were struggling with suicidal ideation, they couldn't sell that information to an advertiser. The algorithm has no such constraints.

The emotional profile these platforms build — the one that knows you're anxious, that you have unresolved family stuff, that you binge content about codependency at 11pm on Sundays — that profile is an asset. It makes you more targetable. It makes the ads more precise. It keeps you on the platform longer, because the content feels so eerily right for where you are emotionally.

That's not a side effect. That's the business model.

And the ethical implications of that are genuinely disturbing when you sit with them. We have entire frameworks around the ethics of psychological data in clinical settings — informed consent, data minimization, patient autonomy. We have almost none of that applied to the systems that are arguably collecting more psychologically revealing data than most clinical encounters ever would.

When Understanding Becomes Exploitation

There's a version of this technology that could be genuinely good. Imagine if the emotional intelligence these systems clearly possess was used to gently surface mental health resources when someone's engagement patterns suggested crisis. Imagine if users had real transparency into what the algorithm had inferred about their emotional state — and the ability to correct it, opt out, or understand it.

That version doesn't really exist at scale, because it's not the version that maximizes engagement. The version that exists keeps you in the emotional content loop, serving you more of whatever is clearly hitting a nerve, not because it wants to help you process your feelings but because processing your feelings keeps you on the app.

There's something particularly insidious about a system that gets good at recognizing your pain and then uses that recognition not to help you but to hold your attention. It's intimacy weaponized. It's the language of care deployed in the service of retention metrics.

What You Can Actually Do With This Information

I'm not going to tell you to delete your apps. That's not realistic advice for most people, and honestly, it sidesteps the structural problem by putting the burden entirely on individuals.

But I do think there's value in naming what's happening clearly. When your For You page feels suspiciously therapeutic, it's worth asking: is this actually helping me, or is this keeping me circling the same emotional drain? There's a real difference between content that helps you understand yourself and content that keeps you in a loop of familiar pain because familiar pain is engaging.

It's also worth pushing — loudly, politically, repeatedly — for actual regulatory frameworks around psychological data. The US is embarrassingly behind on this. Europe's GDPR at least gestures toward data minimization and purpose limitation. We have almost nothing comparable that meaningfully addresses the emotional profiling happening across every major platform Americans use daily.

The algorithm knowing your trauma isn't impressive. It's a liability. And we should probably start treating it like one.

All Articles

Related Articles

Your Streaming Queue Understands Your Grief Better Than Your Best Friend Does

Your Streaming Queue Understands Your Grief Better Than Your Best Friend Does

The More You Scroll, The More You Disappear

The More You Scroll, The More You Disappear

Your Phone Figured Out You Were Depressed Before You Did

Your Phone Figured Out You Were Depressed Before You Did