Full Methodology
Version 5.1 “Decompression” ยท July 2026
The framework is open; the calibration is not. This document describes every mechanism in the scoring architecture and the reasoning behind it. The tuned constants โ power-mean order, penalty coefficients, signal sensitivity, per-signal reference points and scales, validity-rule thresholds โ are calibrated against the validation battery and held as proprietary. Understanding how the index works does not require them; reproducing it does.
1. Purpose & Scope
Mental Health Radar is a real-time, population-level index of psychosocial stress. It produces a composite Mental Health Risk Score โ the Acute Stress Signal Index (ASSI) โ for regions worldwide, updated every six hours.
The tool answers a question that existing surveillance infrastructure does not answer in real time: where are conditions most acutely elevated right now, and across which life domains?
What the score is
The score reflects the degree to which current conditions elevate the risk of population-level mental health deterioration. It aggregates public data signals through a 12-domain wellbeing model, anchored against international standards. As the data signal stack grows, the score becomes progressively more precise โ but the scoring architecture and domain model remain stable.
What the score is not
The score is not a clinical diagnostic instrument. It does not diagnose individuals, predict individual outcomes, or constitute medical advice. It is a population surveillance tool for the social and structural determinants of mental health.
An elevated score means conditions known to predict mental health deterioration are present. Whether deterioration materialises depends on protective factors, resilience, and the timeliness of intervention. The score identifies where intervention is most likely to have impact โ it does not diagnose a population.
Audience
The primary audience is non-specialist: policymakers, public health practitioners, journalists, and engaged citizens who want to understand the mental health landscape of their region relative to others. Signal-level decomposition and domain breakdowns provide analytical depth for users who want to understand what is driving the score.
2. Scientific Foundation
The domain model, weighting decisions, and structural vulnerability components are grounded in a comprehensive literature review synthesising evidence across biological, psychological, social, occupational, environmental, lifestyle, and digital determinants of mental health. The evidence base spans every inhabited continent and is not specific to any single country or health system.
2.1 Risk Factor Evidence Base
The following table summarises the evidence strength for each major risk factor domain, rated on a 1โ10 scale based on effect size, replication, and meta-analytic support in the published literature.
| Risk Factor Domain | Evidence Weight | Key References |
|---|---|---|
| Adverse Childhood Experiences | 9/10 | Felitti et al. (1998); Varese et al. (2012); Norman et al. (2012) |
| Socioeconomic Deprivation | 9/10 | Lund et al. (2010); Patel et al. (2018); Reiss (2013) |
| Genetic Predisposition | 8/10 | Sullivan et al. (2012); Howard et al. (2019); Musliner et al. (2021) |
| Social Isolation / Loneliness | 8/10 | Holt-Lunstad et al. (2015); Cacioppo & Cacioppo (2018) |
| Attachment / Early Relational | 7/10 | Mikulincer & Shaver (2012); Main & Hesse (1990) |
| Discrimination / Marginalisation | 7/10 | Schmitt et al. (2014); Williams et al. (2019); Meyer (2003) |
| Relationship Quality / IPV | 7/10 | Ouellet-Morin et al. (2015); WHO (2021) |
| Work Stress / Burnout | 7/10 | Harvey et al. (2017); Bianchi et al. (2015) |
| Unemployment / Economic Insecurity | 7/10 | Paul & Moser (2009); Benach et al. (2014) |
| Substance Use | 7/10 | Kessler et al. (1996); Moore et al. (2007) |
| Neurobiological Factors | 6/10 | McEwen (2017); Miller & Raison (2016) |
| Physical Health Comorbidity | 6/10 | Katon et al. (2007); Liu et al. (2017) |
| Community Violence / Safety | 6/10 | Steel et al. (2009); Fowler et al. (2009) |
| Personality / Cognitive Style | 6/10 | Kotov et al. (2010); Nolen-Hoeksema et al. (2008) |
| Urban / Environmental Factors | 5/10 | Lederbogen et al. (2011); Mair et al. (2008) |
| Lifestyle (sleep, diet, exercise) | 5/10 | Baglioni et al. (2011); Schuch et al. (2018) |
| Digital / Social Media | 5/10 | Holt-Lunstad et al. (2015); Valkenburg et al. (2022) |
| Climate / Environmental Stress | 4/10 | Hickman et al. (2021); Cianconi et al. (2020) |
2.2 Syndemic Framing
Risk factors rarely operate in isolation. Socioeconomic deprivation, for instance, increases exposure to adverse childhood experiences, neighbourhood violence, job insecurity, social isolation, and barriers to care โ creating clustered, compounding risk profiles that are qualitatively different from and more harmful than the sum of individual factors (Bellis et al., 2017). This syndemic framing (Singer et al., 2017) underpins the SYNDEMIC detection system described in Section 6.
2.3 What the Literature Does Not Justify Including
Several factors that might seem intuitive are excluded from real-time scoring because the evidence does not support them as measurable population-level leading indicators:
Genetic predisposition (evidence weight 8/10) โ not measurable at the regional level in real time. Its effects are captured structurally in the BVI via childhood adversity indicators.
Social media use intensity โ effect sizes are moderate and heterogeneous (Valkenburg et al., 2022). Social media is included as a language signal (what people are saying) rather than a usage signal (how much they're using it).
Individual-level neurobiological factors โ not measurable at population level.
3. The 12-Domain Model
3.1 Design Principles
Three principles governed the domain design:
Signal-to-domain mapping must be explicit. Every weight in the contribution matrix is defensible. Each data source's contribution to each domain is documented with reasoning, preventing hidden assumptions.
Domain weights must reflect the literature, not the signal stack. The data sources available today are not the data sources we will have tomorrow. If we weighted domains in proportion to data availability, we would produce a biased composite that over-represents what we happen to have data for. The domain weights are set against the evidence base and remain stable as new signals are added.
Missing signals must not silently inflate surviving signals. The weighted average computation excludes absent signals from the denominator. A domain with only two of three signals present uses a normalised two-signal average, not a three-signal average with one term at zero.
3.2 Domains and Weights
| Domain | Weight | Rationale |
|---|---|---|
| Economic Security | 16% | Socioeconomic deprivation rated 9/10 in the evidence base. Strongest documented population-level risk pathway. |
| Direct Mental Health | 13% | The most proximate signal โ directly measured psychological distress indicators. |
| Social Connection | 11% | Loneliness rated 8/10. Holt-Lunstad et al. (2015) found perceived social isolation carries an independent 26% mortality risk increase. Higher than most surveillance tools weight it. |
| Family & Relationships | 10% | Relationship quality/IPV rated 7/10. Mechanistically distinct from social connection โ captures domestic and relational distress specifically. |
| Mental Healthcare Access | 10% | Healthcare access degradation is a buffer erosion factor. When access fails, all other risk factors are amplified because the primary intervention pathway is blocked. |
| Physical Health | 9% | Physical health comorbidity rated 6/10, but anchored by hard clinical outcome measures where available. |
| Geopolitical & Political | 8% | Media-transmitted political and geopolitical anxiety. Holman et al. (2020) demonstrated that media exposure predicts PTSD and depression independently of direct event exposure. |
| Personal Safety | 7% | Community violence rated 6/10. Captures both direct violence exposure and perceived safety threat. |
| Purpose & Meaning | 5% | The literature strongly supports purpose/meaning as a protective factor whose erosion predicts depression onset (Frankl, 1959; Kim et al., 2022). Currently the hardest domain to measure with available public data. |
| Collective Safety | 5% | Disaster and mass-threat exposure. Steel et al. (2009) found approximately 30% PTSD prevalence in severely affected populations. |
| General Healthcare Access | 3% | Distinct from mental healthcare access. Captures general healthcare system degradation. Weight will increase as better data sources become available globally. |
| Environment & Place | 3% | Environmental health signals including air quality, extreme weather, and disaster exposure. Weight will increase as climate and environmental data sources expand. |
3.3 Domain Contribution Matrix
Each domain's score is computed from a weighted combination of contributing data signals. The contribution matrix defines exactly which signals feed into each domain and at what proportion. Every row sums to 1.0.
The matrix is maintained separately for different region types to reflect the different data signals available in each geography. As new signals are added for a region, they are slotted into the appropriate matrix rows and the existing weights are re-normalised โ the domain model itself does not change.
For each domain and each region, the domain score is calculated as:
domain_score = weighted quadratic mean of the signal scores present
(a power mean of order 2, computed on the shifted scale)
Missing signals are excluded from the weighted average entirely โ they do not default to the baseline at this layer. This prevents a missing signal from pulling the domain score toward baseline when other signals are clearly elevated.
Why a quadratic mean rather than a plain average (v5.1). Under a plain arithmetic mean, one signal sitting at baseline can fully cancel another that is screaming. Within a single domain that is the wrong behaviour: if any credible measure of a domain is extreme, the domain is not "average". A quadratic mean is the mildest standard convex mean โ it lets the higher reading carry more of the result without letting it dominate outright. The same non-compensability principle governs the composite one level up (Section 4.4), applied more gently here because signal-level noise is larger than domain-level noise.
3.4 Per-Domain Design Rationale
Economic Security โ Unemployment and labour market signals are the primary inputs because they are the most direct, high-frequency measures of economic stress available. Community-level economic distress language and search behaviour provide leading indicators of economic anxiety before it manifests in official statistics. Housing stress signals (eviction, affordability) capture a dimension of economic precarity that employment data alone misses.
Direct Mental Health โ This domain captures the most proximate mental health signals available: community language in mental health forums, mental health search behaviour, and news coverage of mental health crises. It is the domain most directly measuring the construct the tool exists to track.
Social Connection โ The evidence weight of 8/10 for loneliness justifies the third-highest domain weight. Available proxies include social isolation language in online communities and searches for loneliness and connection. Economic signals are excluded from this domain because economic stress and social isolation are sufficiently distinct pathways that cross-contamination should be minimised.
Family & Relationships โ Relationship distress language in dedicated communities (divorce, abuse, relationship crisis forums) is the most direct available signal. Housing displacement signals contribute because eviction is a documented family disruption event.
Mental Healthcare Access โ Search behaviour for mental health services captures unmet care demand in real time. Drug shortage data directly measures medication access failure. Community discussions of treatment barriers provide qualitative confirmation.
Physical Health โ Where available, clinical outcome data (overdose mortality, substance-related deaths) serves as the hard anchor. Community health distress language and health-seeking search behaviour provide more responsive but softer signals.
Geopolitical & Political โ News tone analysis dominates because media coverage is the primary transmission mechanism between political events and population-level anxiety. Community political distress language and political search behaviour contribute as corroborating signals.
Personal Safety โ Where available, direct violence incident data is the lead indicator. Community safety language captures perceived threat at ground level. Conflict event data is critical in regions experiencing armed conflict. News coverage of crime and violence contributes as a secondary signal.
Purpose & Meaning โ The most difficult domain to measure with public data. Community language about meaninglessness and hopelessness, and searches related to purpose and meaning, are weak but defensible proxies. This domain will strengthen significantly as employment quality data and community participation metrics become available.
Collective Safety โ Disaster declarations and disaster event databases are the primary signals. News coverage of collective threat events and conflict data contribute in regions where these are relevant.
General Healthcare Access โ Distinct from mental healthcare access. Captures general healthcare system degradation (hospital closures, wait times, uninsured rates). Available signals are weak proxies in most regions; weight will increase as better data sources are integrated.
Environment & Place โ Air quality data provides genuine environmental health differentiation between regions. Disaster exposure data contributes. Climate signals (extreme heat, wildfire smoke) remain priority additions that would justify further weight increases.
4. Scoring Architecture
The scoring pipeline is a four-layer computation that applies identically to all regions worldwide.
Layer 1: Signal Ingestion โ raw values per region
โ
Layer 2: Global Z-Score Normalisation โ anchored [โ50, +100] scores
โ
Layer 3: Domain Contribution Matrix โ 12 domain scores
โ
Layer 4: Penalised Power Mean โ + breadth โ + BVI offset โ Final Score
4.1 Layer 1 โ Signal Ingestion
Signal fetchers run in sequence at each scoring cycle. Each returns a structured dataset of raw values per region. Errors are isolated โ a failed fetcher marks its signal as absent for the affected regions rather than blocking the pipeline, and an absent signal is excluded from aggregation rather than defaulted to a value. Geographic scope is declared per signal in a central registry; the pipeline discovers applicable signals for each region type at runtime.
As new data sources are added, they register into this layer without changes to the normalisation, domain model, or scoring formula downstream. The architecture is designed so that signal expansion is the primary path to improving score quality โ the analytical layers are stable.
4.2 Layer 2 โ Global Z-Score Normalisation
Every raw signal value is converted to a score on a common scale using globally-anchored Z-scores:
z = (value โ reference) / scale signal_score = soft_clip(z ร sensitivity) on the [โ50, +100] scale
0 is the global developed-nation baseline. The sensitivity factor sets how many score points one standard deviation of deviation from the global norm is worth. It is a calibrated constant (recalibrated upward in v5.1 โ see the note below), chosen so that the eight risk tiers are actually reachable across the real distribution of regions while Crisis stays a meaningful alarm level rather than a common occurrence. Its exact value is part of the proprietary calibration.
Soft clipping, not hard clipping. Extreme readings are compressed smoothly (a tanh compression above the upper and below the lower shoulders) rather than truncated at a hard ceiling. A catastrophic reading therefore remains distinguishable from a merely severe one โ two regions both "off the scale" on a raw signal still receive different, ordered scores. The final composite lives on a bipolar [โ50, +100] scale: negative is protective (better than the OECD baseline), positive is elevated risk, and the asymmetry is deliberate โ conditions travel much further from baseline in the risk direction than in the protective one.
Reference Constants
Each signal is anchored against a published international reference value drawn from WHO, OECD, ILO, or equivalent global benchmarks. The reference represents the developed-nation baseline for that measure; the scale represents one standard deviation in the global distribution.
For example: if the OECD average unemployment claims rate is 200 per 100,000 during non-recessionary periods and the scale is 100, then a region at 300/100k scores 15 โ one standard deviation above baseline, appropriately flagged as Watch/Concerning given the documented mental health impact. A region at 400/100k scores 30 โ two standard deviations, firmly in the Concerning band.
Dynamic Anchoring
Some signals โ particularly those derived from social media language and search behaviour โ cannot be meaningfully compared to a fixed clinical reference. For these signals, the normalisation uses the current scoring run's mean and standard deviation across all regions (with a minimum SD floor to prevent division by near-zero). This captures relative elevation: how much more distress signal is present in a given region versus the typical level across all regions in this run.
The globally-anchored signals (labour market data, clinical outcomes, disaster events, conflict data, etc.) do not shift with the batch, so the composite score is a mix of both anchoring approaches. Full global anchoring of all signals requires sufficient historical data to compute stable per-region baselines โ this is a planned evolution as scoring history accumulates.
4.3 Layer 3 โ Domain Contribution Matrix
See Section 3.3 for the matrix design and Section 3.4 for per-domain rationale.
4.4 Layer 4 โ Composite, Breadth, BVI, and Final Score
The twelve domain scores combine into the composite through a penalised power mean โ a composite-indicator method from the OECD handbook lineage (Greco & Ishizaka 2018; the Mazziotta–Pareto family). It replaced a plain weighted average because a weighted average lets strengths in some domains silently buy back extreme risk in others โ the wrong behaviour for a risk index. Three properties do the work:
composite = penalised_power_mean(domain scores, domain weights)
+ breadth term
+ BVI offset
- Non-compensability. A power mean of order greater than 1 lets the higher-risk domains dominate the result. Excellent healthcare cannot fully offset an active war โ a region's worst domains are weighted toward, not averaged away.
- Imbalance penalty. A coefficient-of-variation term discounts a profile whose apparent risk comes from a single spiking domain, so one noisy signal cannot by itself push a region up the scale. In v5.1 this penalty is risk-gated: it applies only to net-elevated profiles, correcting an earlier defect where imbalance could make a net-protective region look artificially safer.
- Syndemic sensitivity. When many domains are elevated at once โ the syndemic pattern of Singer et al. โ a breadth term adds risk that a simple average would miss. This is the composite-level companion to the SYNDEMIC badge of Section 6.
The structural BVI is then added as a bounded offset (Section 5), and the result is clipped to the [โ50, +100] scale. The precise power-mean order, penalty coefficients, and breadth and BVI bounds are part of the proprietary calibration.
Risk level classification: the composite maps onto eight tiers. The bands span different intervals, with 0 โ the global OECD baseline โ sitting inside the Baseline band; a region scoring 0 is classified as "at the OECD baseline," not elevated.
| Score | Risk Level | Colour |
|---|---|---|
| โค โ20 | Thriving | #2F8060 |
| โ20 to 0 | Resilient | #6FA88C |
| 0 to 15 | Baseline | #AEC07A |
| 15 to 30 | Watch | #E2C067 |
| 30 to 50 | Concerning | #D98E3E |
| 50 to 65 | Elevated | #CB6E3C |
| 65 to 80 | Severe | #BC4A3C |
| 80+ | Crisis | #97302A |
5. Behavioral Vulnerability Index (BVI)
5.1 Purpose
The BVI encodes structural mental health risk โ the pre-existing conditions that determine how much a given level of acute stress translates into actual mental health deterioration. Two regions with identical ASSI scores may have very different outcomes if one has substantially higher structural vulnerability.
The BVI is an offset, not a separate score. It is added to the composite within fixed bounds: a structurally vulnerable region receives a positive offset that raises its risk score; a structurally resilient region receives a negative one that lowers it. Because it is additive and bounded โ not a multiplier โ it shifts the composite by a limited, directly interpretable number of points rather than scaling it by a percentage (see ยง5.4 for why this matters).
5.2 Components
The BVI captures five dimensions of structural vulnerability, each supported by strong evidence as a moderating factor in population mental health outcomes:
| Component | Scientific Basis |
|---|---|
| Childhood Adversity Prevalence | Evidence weight 9/10; strongest modifiable risk pathway (Felitti et al., 1998; Norman et al., 2012) |
| Poverty Rate | Evidence weight 9/10; foundational structural determinant (Lund et al., 2010; Ridley et al., 2020) |
| Healthcare Shortage Density | Healthcare access as buffer erosion โ amplifies all other risk |
| Health Insurance Coverage | Insurance as protective buffer; particularly relevant for mental healthcare access |
| Income Inequality (Gini) | Independent mental health risk factor beyond absolute poverty (Wilkinson & Pickett, 2009) |
The specific data sources used to measure these components vary by region. Where national statistical agencies provide direct measures (census data, health surveys, administrative records), those are used. Where direct measures are unavailable, international equivalents are drawn from WHO, World Bank, UNICEF, and ILO datasets.
5.3 Computation
Each component is normalised and combined into a single structural index. Components where higher values indicate worse conditions (childhood adversity, poverty, healthcare shortage, inequality) push the offset positive; protective components (insurance coverage) are inverted. The index is then mapped to a bounded point offset that is added to the composite:
bvi_index = weighted_average(normalised_components) bvi_offset = a bounded number of score points (signed) composite = penalised_power_mean + breadth + bvi_offset
The bounds are asymmetric โ vulnerability can add more points than resilience can subtract โ mirroring the asymmetry of the underlying scale. The exact bounds are part of the proprietary calibration.
5.4 Why Additive, Not Multiplicative
An additive offset was chosen over a multiplier deliberately. A percentage multiplier applied to an already-elevated composite compounds โ it moves high scores by many points and low scores by few, so structural vulnerability would count for far more in a region that already looks bad than in one that looks fine. That is backwards: structural vulnerability is most decision-relevant precisely where the acute signal has not yet spiked. A bounded additive offset shifts every region by a limited, comparable, directly interpretable number of points regardless of where it sits on the scale.
5.5 Update Cadence
BVI components are based on annual surveys and administrative data, typically with a 1โ2 year publication lag. The BVI refreshes on a 30-day cycle โ more than sufficient given the annual cadence of the underlying data. A known limitation is that sudden structural changes (emergency policy shifts, post-disaster healthcare changes) may not be reflected for up to a year.
5.6 Global BVI Coverage
BVI availability varies by region. Where all five components can be sourced from national or international datasets, a full BVI is computed. Where component data is unavailable, the BVI defaults to a neutral offset (0.0) โ the composite passes through with no structural adjustment. BVI coverage is expanding as international data sources are integrated. The goal is full BVI coverage for all scored regions.
6. Syndemic Detection
6.1 Definition
A โก SYNDEMIC badge is displayed when five or more of the 12 domain scores are simultaneously โฅ 15 โ that is, when risk is broad-based across life domains rather than concentrated in one.
The threshold of 15 was chosen because it falls in the lower portion of the Watch band โ a domain score of 15 reflects a meaningful deviation from baseline that is not merely noise. The count of five (of twelve, โ42%) is deliberately aligned with the composite's breadth term (Section 4.4), which begins adding risk when more than 40% of domains are elevated: the badge and the score are triggered by the same underlying pattern, so the badge is an honest visual flag for a mechanism already in the composite rather than a separate heuristic.
6.2 Scientific Basis
Singer et al. (2017) in The Lancet define a syndemic as two or more epidemics interacting synergistically and contributing to excess burden of disease. The mental health application, supported by Bellis et al. (2017) and the ACE literature, is that co-occurring stressors produce compounding โ not merely additive โ effects on mental health outcomes.
A region with Economic Security score 70, Mental Healthcare Access score 72, and Social Connection score 68 is in a qualitatively different situation from a region with the same composite score driven by a single elevated signal. The composite score alone cannot encode this distinction; the badge does.
6.3 Badge vs. Score
The badge itself does not apply a separate adjustment on top of the composite โ it is a display flag. But breadth is not ignored by the score: the composite's breadth term (Section 4.4) already adds risk when the same broad-based pattern is present, and the badge triggers on a threshold deliberately aligned with it. So the situation the badge marks is reflected in the number, without the badge and the score double-counting the same pattern. This is a change from earlier versions of this document, which described breadth as display-only; the penalised power mean introduced in v5.1 incorporates it directly, calibrated against the validation battery in Section 10 rather than set by intuition.
7. Global Design
7.1 Architecture
The scoring formula, domain model, normalisation approach, BVI logic, and syndemic detection apply identically to all regions worldwide. There is no separate scoring pathway for different geographies. A unified pipeline handles all region types via a signal registry that declares which data sources apply to each geography.
7.2 Why the Architecture Is Geography-Agnostic
The system was designed for global deployment from the start:
- The globally-anchored Z-score uses WHO/OECD international standards, not any country-specific baselines.
- The 12-domain model reflects universal wellbeing constructs grounded in literature spanning every inhabited continent (Patel et al., 2018; Vos et al., 2020).
- Scores are cross-region comparable from day one. A score of 15 means the same thing regardless of where it is measured โ conditions one standard deviation above the developed-nation baseline.
Expanding coverage to new regions is primarily a data sourcing task, not a methodology change. New signals register into the existing pipeline and contribute to the domain model through the contribution matrix. The analytical architecture is stable.
7.3 The OECD Baseline in Global Context
The OECD-calibrated baseline (0 = developed-nation standard) is retained globally without modification. Regions in the Global South will structurally score above 0 on several signals โ this is the honest and correct representation. The tool measures deviation from a human development standard, not from a regional norm.
This enables direct cross-region comparison. Observing that a high-income country's physical health signal scores similarly to a middle-income country is a meaningful and actionable finding โ not a bug in the methodology.
7.4 Data Sufficiency Gating
Not all regions have identical signal coverage. The system handles this transparently, and a domain must earn its way into the composite rather than being defaulted:
- Graduated coverage. A domain with two or more independent signals reporting joins the composite at full weight; a domain with only one reporting signal joins at reduced weight rather than being either dropped outright or trusted fully. This keeps genuine single-signal crisis information (a lone screaming disaster or conflict signal) in the score while damping the amplification a single sparse signal can produce.
- Withheld, not guessed. A region with too little coverage to score is displayed in grey with an Insufficient Data state โ the score is withheld, never filled in with a baseline placeholder.
- Confidence is scored and shown. Every scored region carries a data-confidence level derived from how many domains and signals actually contributed and how current they are. Regions resting on thin coverage are flagged so a low-confidence score is never mistaken for a well-supported one.
Signal coverage is disclosed per region on the frontend โ a data confidence indicator shows which signals are active and which are absent.
7.5 Signal Coverage by Country Income Tier
| Country Tier | Expected Signal Coverage | Typical Domain Coverage |
|---|---|---|
| OECD High Income | Broadest signal stack; all domain types represented | All 12 domains |
| Upper-Middle Income | Most core signals available | 10 of 12 domains |
| Lower-Middle Income | Economic, conflict, disaster, and search signals | 8 of 12 domains |
| Low Income / Conflict-affected | Conflict and disaster signals are primary | 4โ6 domains |
| Data-sparse / closed | News coverage signals only | 3 domains; confidence marked LOW |
The signal stack is continuously expanding to close these coverage gaps. The goal is meaningful signal coverage across all 12 domains for every scored region.
8. Data Pipeline & Infrastructure
8.1 Pipeline Architecture
Scheduled Pipeline (every 6 hours)
โ
โโโ Run unified scoring function
โ โโโ Signal fetchers (sequential, error-isolated)
โ โโโ Normaliser (Z-score โ soft-clipped signal scores)
โ โโโ Domain model (contribution matrix โ 12 domain scores)
โ โโโ Composite (penalised power mean + breadth term)
โ โโโ BVI fetch + additive offset
โ โโโ SYNDEMIC detection + confidence scoring
โ
โโโ Write unified scores cache (all regions)
โโโ Write seed file (cold-start fallback)
โโโ Append to rolling history (7-day window)
โโโ Commit + deploy
API Backend
โ
โโโ Serves scores cache (auto-reloads on file change)
โโโ GET /scores โ all regions (filterable by type)
โโโ GET /scores/{region} โ single region detail
โโโ GET /history โ 7-day rolling history
โโโ GET /signals โ signal status and freshness
โโโ GET /metadata โ data freshness and distribution
Static Frontend
โ
โโโ Interactive choropleth maps
โโโ Region detail panel with 12 domain bars
โโโ Trend charts
โโโ Auto-refresh matching pipeline cadence
8.2 Unified Pipeline
All regions are scored in a single pipeline run. There are no separate pipelines for different geographies. The workflow discovers which signals apply to each region type via a central signal registry, runs all applicable fetchers, and produces a single unified output.
8.3 Graceful Degradation
If any fetcher fails (network error, API rate limit, malformed response), that signal is treated as absent for the affected regions โ it is excluded from aggregation, never defaulted to a value that would masquerade as a real reading. The pipeline always produces a complete output even if some signals are temporarily unavailable, and affected domains fall back to their remaining signals under the graduated-coverage rule (Section 7.4). Stale cached data is used if fresh data cannot be obtained โ a staleness flag is raised, and long-stale structural measurements have their contribution weight decayed rather than being trusted at full strength. This design keeps the tool available and its scores honest under imperfect data conditions.
8.4 Data Files
Unified scores cache โ The primary live output. Contains a timestamp and an array of region records, each with: composite score, risk level, colour, all 12 domain scores, BVI offset, syndemic badge status, data confidence level, and top contributing signals.
Rolling history โ Array of snapshots with per-region scores. Maximum 7-day (168-hour) rolling window. Used for trend charts and momentum analysis.
Seed file โ Cold-start fallback copy of the most recent full scoring run, ensuring the tool is never empty on first load.
Signal-specific caches are stored separately with their own time-to-live values appropriate to each source's update frequency.
8.5 Backend
The API backend reads the scores cache on startup and maintains an in-process cache. When the pipeline commits new data, the next request detects the file change and reloads automatically โ no restart or webhook required.
CORS is configured for the production domain, preview/staging URLs, and local development.
8.6 Frontend
The frontend is a static site served via CDN. Maps are rendered client-side. Regions are coloured by the pre-computed risk level colour from the API. Selecting a region renders a detail panel showing all 12 domain scores, SYNDEMIC badge status, and a trend sparkline from the history endpoint.
8.7 Auth Architecture (Planned)
The frontend sends an authentication header on every request from day one. For free-tier users the token is empty and ignored. When the paid tier launches, the backend stub becomes real authentication middleware โ zero frontend changes required.
9. Limitations & Caveats
9.1 Signal Coverage Inequalities
Signal quality varies by population size and data infrastructure maturity. Smaller regions and countries with less developed statistical systems have higher score variance and fewer active signals. Scores for these regions should be interpreted with greater caution, and the data confidence indicator should be checked.
9.2 Dynamic vs. Fixed Anchors
Signals derived from social media and search behaviour use batch-level anchoring (current run mean and SD). This captures relative elevation within the current batch, not absolute elevation against a global reference. A global batch in which every region is experiencing elevated distress will show no elevation for any individual region. The globally-anchored signals (labour market, clinical outcomes, disasters, conflict) partially correct for this. Full global anchoring of all signals requires sufficient historical data to compute stable per-region baselines.
9.3 Risk Conditions, Not Outcomes
An elevated score indicates conditions associated with risk. It does not mean deterioration has occurred or will necessarily occur. Protective factors โ social cohesion, strong healthcare infrastructure, community resilience, timely intervention โ can substantially buffer the effects even when risk conditions are present.
9.4 Structural Data Lag
BVI components and some clinical outcome signals are based on annual data with 1โ2 year publication lags. These signals anchor the score against hard structural and clinical measures, but they do not respond to acute changes. They are confirmation signals, not leading indicators.
9.5 Social Media Representativeness
Online community language and search behaviour signals skew toward younger, more educated, more internet-connected populations. Rural communities, older adults, non-English speakers, and populations with lower internet access are systematically underrepresented. The BVI and labour market signals partially compensate by capturing structural factors affecting these populations. Full representativeness is an ongoing challenge that improves as the signal stack diversifies.
9.6 National-Level Signal Uniformity
Some signals (e.g., drug shortage data) are available only at the national level. In these cases, all sub-national regions within a country receive the same score for that signal. This is a known limitation disclosed in the signal metadata. These signals are best understood as national-level modifiers rather than region-differentiating inputs.
10. Validation Strategy
The composite score and its domain components require ongoing validation against clinical outcomes to be scientifically defensible. The validation strategy operates at multiple levels and applies globally, adapting to the health surveillance infrastructure available in each region.
10.1 Validation Data Sources
Validation compares Mental Health Radar scores against independent ground-truth measures of mental health outcomes. The specific data sources vary by region, but the categories are universal:
Emergency psychiatric presentation volume โ Hospital emergency department data on mental health presentations, available with varying lag times depending on the national health reporting system. Useful for validating acute signal spikes.
Crisis helpline call volume โ National and regional crisis line data validates the crisis signal layer. Available in most countries with established crisis services (e.g., 988 in the US, 116 123 in the EU, Lifeline services across Asia-Pacific).
Substance-related mortality โ National drug and alcohol mortality surveillance validates Physical Health domain predictions. Typically available with 6โ12 month lag depending on the national vital statistics system.
Population mental health surveys โ Nationally representative surveys (BRFSS, Eurobarometer, WHO World Mental Health Survey, national health interview surveys) validate absolute burden scores against clinical prevalence estimates. Annual cadence.
Insurance and administrative claims data โ Where available, anonymised mental health service utilisation data validates Healthcare Access domain scores.
10.2 Validation Protocol
- Log every composite score and domain score with timestamp and geography.
- Match to ground-truth outcome measures at the appropriate lag (2 weeks for emergency data, 6โ12 months for mortality, annually for survey data).
- Compute correlation, sensitivity, and specificity metrics at each level (composite, domain, signal).
- Report accuracy metrics publicly in this methodology documentation.
- Use validation findings to recalibrate reference constants, domain weights, and signal contributions where the evidence warrants it.
10.3 Validation Coverage
Validation data availability varies by region. High-income countries with mature health surveillance systems will be validated first and most rigorously. The validation framework is designed to incorporate new ground-truth sources as they become available in each region, ensuring that the tool's accuracy claims are always proportionate to the evidence behind them.
11. Roadmap
Signal Expansion
The signal stack is the primary lever for improving score quality. Planned additions include: WHO Global Health Observatory metrics, UNODC substance use data, World Bank poverty and inequality indicators, international social media analysis, climate and extreme weather signals, and mass layoff leading indicators. Each new signal slots into the existing domain model without changing the scoring architecture.
Global Coverage
The goal is meaningful signal coverage across all 12 domains for 190+ countries, followed by sub-national scoring (province/state/region level) for major countries. Sub-national expansion follows a prioritised approach based on statistical infrastructure maturity, beginning with countries that have strong open-data APIs (EU Eurostat, UK ONS, Canada Statistics Canada, Australia ABS, and others).
Scoring Enhancements
Several enhancements once listed here have shipped and are now described in the sections above: recency-decayed weighting of stale structural data (ยง4, ยง8.3), graduated coverage gating (ยง7.4), and the breadth term that folds the syndemic pattern into the composite (ยง4.4, ยง6.3). Remaining planned work:
- Score-level forecasting: short-horizon projection of the composite with an explicit backtest gate before any forecast is published.
- Automated reference refresh: API-based updates to WHO/OECD/ILO reference constants as new international benchmark data is published.
- Clinical-outcome calibration: tightening the reference points and weights against ground-truth outcome data as validation coverage expands (ยง10).
Premium Features (Planned)
- Dual-axis display โ Absolute Burden ร Relative Momentum quadrant analysis
- Sub-national scoring (county, province, region level)
- BVI component detail view
- 30-day domain-level forecasts
- AI narrative summaries
- Downloadable data export
12. References
ACLED (Armed Conflict Location & Event Data). (2024). ACLED Methodology and Coding Decisions.
Alicandro, G., et al. (2022). Using Google search query surveillance to monitor depression trends. Journal of Affective Disorders, 296, 149โ155.
Ayers, J.W., et al. (2013). Seasonality in seeking mental health information on Google. American Journal of Preventive Medicine, 44(5), 520โ525.
Baglioni, C., et al. (2011). Insomnia as a predictor of depression: a meta-analytic evaluation. Journal of Affective Disorders, 135(1โ3), 10โ19.
Bellis, M.A., et al. (2017). Adverse childhood experiences and their impact on health-harming behaviours in the Welsh adult population. BMC Public Health, 17, 630.
Benach, J., et al. (2014). Precarious employment: understanding an emerging social determinant of health. Annual Review of Public Health, 35, 229โ253.
Bianchi, R., et al. (2015). Burnout and depression: Evidence about their convergence but also their distinctiveness. Psychological Reports, 117(3), 931โ947.
Cacioppo, J.T., & Cacioppo, S. (2018). The growing problem of loneliness. The Lancet, 391(10119), 426.
Cianconi, P., et al. (2020). The impact of climate change on mental health: A systematic descriptive review. Frontiers in Psychiatry, 11, 74.
Coppersmith, G., et al. (2014). Measuring post traumatic stress disorder in Twitter. ICWSM, 8(1), 579โ582.
Desmond, M. (2016). Evicted: Poverty and profit in the American city. Crown Publishers.
Felitti, V.J., et al. (1998). Relationship of childhood abuse and household dysfunction to many of the leading causes of death in adults. American Journal of Preventive Medicine, 14(4), 245โ258.
Fowler, P.J., et al. (2009). Community violence: A meta-analysis on the effect of exposure and mental health outcomes of children and adolescents. Development and Psychopathology, 21(1), 227โ259.
Frankl, V. (1959). Man's Search for Meaning. Beacon Press.
Graetz, N. (2021). Estimating the effect of eviction on housing instability and mental health. Housing Policy Debate, 31(3โ5), 710โ730.
Harvey, S.B., et al. (2017). Can work make you mentally ill? A systematic meta-review of work-related risk factors for common mental health problems. Occupational and Environmental Medicine, 74(4), 301โ310.
Hickman, C., et al. (2021). Climate anxiety in children and young people and their beliefs about government responses to climate change. The Lancet Planetary Health, 5(12), e863โe873.
Holman, E.A., et al. (2020). Media's role in broadcasting acute stress following the Boston Marathon bombings. PNAS, 111(1), 93โ98.
Holt-Lunstad, J., et al. (2015). Loneliness and social isolation as risk factors for mortality: A meta-analytic review. Perspectives on Psychological Science, 10(2), 227โ237.
Howard, D.M., et al. (2019). Genome-wide meta-analysis of depression identifies 102 independent variants. Nature Neuroscience, 22(3), 343โ352.
Jahoda, M. (1982). Employment and Unemployment: A Social-Psychological Analysis. Cambridge University Press.
Katon, W.J., et al. (2007). The pathways study: a randomized trial of collaborative care in patients with diabetes and depression. Archives of General Psychiatry, 61(10), 1042โ1049.
Kessler, R.C., et al. (1996). The epidemiology of co-occurring addictive and mental disorders. American Journal of Orthopsychiatry, 66(1), 17โ31.
Kim, E.S., et al. (2022). Purpose in life and reduced incidence of stroke in older adults. Journal of Psychosomatic Research, 74(5), 427โ432.
Kotov, R., et al. (2010). Linking "big" personality traits to anxiety, depressive, and substance use disorders: A meta-analysis. Psychological Bulletin, 136(5), 768โ821.
Lederbogen, F., et al. (2011). City living and urban upbringing affect neural social stress processing in humans. Nature, 474(7352), 498โ501.
Leetaru, K., & Schrodt, P.A. (2013). GDELT: Global data on events, location, and tone, 1979โ2012. ISA Annual Convention, 2(4).
Liu, N.H., et al. (2017). Excess mortality in persons with severe mental disorders. World Psychiatry, 16(1), 30โ40.
Lund, C., et al. (2010). Poverty and common mental disorders in low and middle income countries: A systematic review. Social Science & Medicine, 71(3), 517โ528.
Main, M., & Hesse, E. (1990). Parents' unresolved traumatic experiences are related to infant disorganized attachment status. In M.T. Greenberg et al. (Eds.), Attachment in the Preschool Years. University of Chicago Press.
Mair, C., et al. (2008). Is neighbourhood racial/ethnic composition associated with depressive symptoms? Social Science & Medicine, 67(11), 1657โ1665.
McEwen, B.S. (2017). Neurobiological and systemic effects of chronic stress. Chronic Stress, 1, 2470547017692328.
Meyer, I.H. (2003). Prejudice, social stress, and mental health in lesbian, gay, and bisexual populations. Psychological Bulletin, 129(5), 674โ697.
Mikulincer, M., & Shaver, P.R. (2012). Attachment theory expanded. In K. Deaux & M. Snyder (Eds.), The Oxford Handbook of Personality and Social Psychology. Oxford University Press.
Miller, A.H., & Raison, C.L. (2016). The role of inflammation in depression. Nature Reviews Immunology, 16(1), 22โ34.
Moore, T.H., et al. (2007). Cannabis use and risk of psychotic or affective mental health outcomes. The Lancet, 370(9584), 319โ328.
Musliner, K.L., et al. (2021). Polygenic liability and the developmental and familial risk for major depression. Psychological Medicine, 51(6), 980โ988.
Nolen-Hoeksema, S., et al. (2008). Rethinking rumination. Perspectives on Psychological Science, 3(5), 400โ424.
Norman, R.E., et al. (2012). The long-term health consequences of child physical abuse, emotional abuse, and neglect. PLOS Medicine, 9(11), e1001349.
OECD. (2023). Health Statistics. OECD Publishing, Paris.
OECD. (2023). Labour Force Statistics. OECD Publishing, Paris.
Ouellet-Morin, I., et al. (2015). Intimate partner violence and mental health disorders in adulthood. Psychological Medicine, 45(4), 661โ677.
Patel, V., et al. (2018). The Lancet Commission on global mental health and sustainable development. The Lancet, 392(10157), 1553โ1598.
Paul, K.I., & Moser, K. (2009). Unemployment impairs mental health: Meta-analyses. Journal of Vocational Behavior, 74(3), 264โ282.
Reiss, F. (2013). Socioeconomic inequalities and mental health problems in children and adolescents. Social Science & Medicine, 90, 24โ31.
Ridley, M., et al. (2020). Poverty, depression, and anxiety: Causal evidence and mechanisms. Science, 370(6522), eaay0214.
Schmitt, M.T., et al. (2014). The consequences of perceived discrimination for psychological well-being. Psychological Bulletin, 140(4), 921โ948.
Schuch, F.B., et al. (2018). Physical activity and incident depression: A meta-analysis. American Journal of Psychiatry, 175(7), 631โ648.
Singer, M., et al. (2017). Syndemics and the biosocial conception of health. The Lancet, 389(10072), 941โ950.
Steel, Z., et al. (2009). Association of torture and other potentially traumatic events with mental health outcomes. JAMA, 302(5), 537โ549.
Sullivan, P.F., et al. (2012). Genetic epidemiology of schizophrenia. Schizophrenia Bulletin, 38(5), 892โ941.
Valkenburg, P.M., et al. (2022). Social media use and its impact on adolescent mental health: An umbrella review. Current Opinion in Psychology, 44, 58โ68.
Varese, F., et al. (2012). Childhood adversities increase the risk of psychosis. Schizophrenia Bulletin, 38(4), 661โ671.
Vos, T., et al. (2020). Global burden of 369 diseases and injuries in 204 countries and territories, 1990โ2019. The Lancet, 396(10258), 1204โ1222.
Wilkinson, R., & Pickett, K. (2009). The Spirit Level: Why Equality is Better for Everyone. Allen Lane.
Williams, D.R., et al. (2019). Racism and health: evidence and needed research. Annual Review of Public Health, 40, 105โ125.
World Health Organization. (2021). Violence against women prevalence estimates, 2018. WHO.
World Health Organization. (2022). World Mental Health Atlas. WHO.
World Health Organization. Global Health Observatory (GHO) Data Repository. https://www.who.int/data/gho