Shoppers for hard evidence are turning a critical eye to a widely reported Trevor Project study that linked anti-transgender laws to higher youth suicidality; independent biostatisticians say the headline finding may hinge on a single state and weaknesses in the study design, which matters for policy debate and public trust.
Essential Takeaways
- Key critique: Independent statisticians say the Trevor Project’s headline result largely came from Idaho, a state whose challenged laws were never in force.
- Method concern: The study used difference-in-differences but treated all non‑law states as controls, which may mix unlike places and bias results.
- Timing issues: The data span 2018–2022, so pandemic disruptions and other contemporaneous factors could confound the effect.
- Authors’ response: Trevor Project researchers argued in Nature Human Behavior that policy debate and legal action themselves can affect mental health even if laws are enjoined.
- Practical note: Careful interpretation matters , policymakers, clinicians and families need robust causal evidence before linking specific laws directly to suicide rates.
What the original study claimed , and why it grabbed headlines
The Trevor Project paper reported sizable increases in past‑year suicide attempts among transgender and non‑binary youth in states that enacted anti‑transgender laws, a finding that quickly made national news and shaped conversations about law and youth mental health. That claim carries a blunt emotional punch , the idea that statutes could be harming already vulnerable teens is headline‑ready and politically potent. But headlines aren’t a substitute for careful causal inference, and that’s where independent reviewers raised alarms.
Why statisticians say Idaho changed the story
Kathleen Kerr, a biostatistics director at the University of Washington, and colleagues examined the Trevor Project analysis and found that the large effects the paper highlighted were driven primarily by responses from Idaho , a state whose two cited laws were signed but then blocked by courts and, crucially, never went into full effect. Kerr’s point is simple and practical: if a single state with a few hundred respondents produces the largest estimated effect, the generalisability and robustness of the headline claim weaken considerably. That doesn’t mean the phenomenon is impossible, but it means we should be cautious about sweeping policy assertions based on these results.
Methodological pitfalls: controls, comparators and the pandemic
Difference‑in‑differences is a recognised approach for policy evaluation, but it relies on plausible comparisons between treated and control units. Kerr argues the Trevor Project team used all non‑law states as controls rather than selecting states that were otherwise similar, which can mix apples and oranges and violate key assumptions. The study’s 2018–2022 window also overlaps the Covid‑19 pandemic , a period that disrupted schooling, services and mental‑health supports , so separating pandemic effects from law‑related effects is tricky. In short, methodology and timing both matter when you’re trying to pin down cause.
The authors’ defence: debate and injunctions still have impact
In response, the original authors published a reply in Nature Human Behavior, noting that policy discussion and the public debate surrounding laws may themselves produce effects on young people’s mental health, even when laws are enjoined. They argue that the social signal sent by passage and publicity of such laws could plausibly affect wellbeing regardless of legal enforcement. That’s a reasonable hypothesis, and it points to a nuanced interpretation: legal texts are only one part of a broader social environment. Still, critics note hypotheses don’t replace tests that isolate those specific pathways.
What this means for parents, clinicians and policy wonks
For people on the ground , parents, school nurses, counsellors and legislators , the practical takeaway is modest but important. Science here is iterative: one widely cited study prompted valuable debate and follow‑up scrutiny, which is how stronger evidence emerges. Families should continue to prioritise well‑established protective measures for LGBTQ+ youth , supportive adults, access to competent mental‑health care and safe school environments , while researchers refine methods to better isolate policy effects. Policymakers, meanwhile, should ask for replicated, robust studies before claiming definitive causal links between statute passage and youth suicidality.
Looking ahead: better data, clearer comparisons
This exchange shows the system working: a high‑profile paper prompted independent critique, which prompted authors’ replies and further discussion in the literature. The next steps are straightforward , collect larger, representative samples; choose closer control states or use matched designs; and explore mechanisms such as media coverage and community climate. As evidence accrues, both advocates and sceptics will have to update their positions. Until then, nuance and caution are the best companions for public discussion.
It's a small but important reminder that strong claims need strong methods , and that good science grows from disagreement, not silence.
Source Reference Map
Story idea inspired by: [1]
Sources by paragraph: