Sleep-wake detection is reasonably good, with one systematic flaw. Sensitivity is consistently 0.91–0.99 and overall accuracy 0.85–0.90. But specificity — correctly calling wake 'wake' — is 0.18–0.54. Devices are biased toward calling everything sleep. Pooled total sleep time error across 24 studies (n=798) was −16.9 min.
Stage classification is substantially worse. Four-state Cohen's κ sits at 0.21–0.53 in healthy and mixed adults, and 0.06–0.31 with 35–53% raw epoch accuracy in clinical sleep-lab patients. Per-stage sensitivity for the two stages marketing sells hardest: deep 0.45–0.75, REM 0.33–0.87.
The trap. Night-total minute comparisons look excellent — one meta-analysis found light −4.3, deep +1.4 and REM −3.9 minutes, none significant — while epoch-level accuracy sits near 53%. Over- and under-calls cancel out in the nightly total. A device can report '90 minutes of deep sleep' correctly on average while placing it in the wrong 90 minutes.
Why reproducibility drifts. Group-level agreement masks large individual-level error, and the bias is proportional — so it cannot be calibrated away. The documented failure mode across three independent groups: wake, deep and REM all collapse into 'light', which is the algorithms' default under uncertainty.
Worth watching on independence. Scored aligned because strong independent PSG validations exist. But the most favourable staging numbers come from vendor-funded and vendor-authored work (specificity 73–75%) while independent studies report 29–54%.
- Funding/COI lines for two independent studies were truncated in the retrieved text.
- The one at-home (rather than sleep-lab) validation returned HTTP 403 — the biggest gap on this card, since it speaks directly to Setting drift.
- A published critical comment on the vendor-funded study exists; its substance was not read.
- Chinoy ED, et al. (2021). SLEEP 44(5):zsaa291 ↗
- Schyvens A-M, et al. (2025). SLEEP Advances 6(2):zpaf021 — 6 devices, n=62 ↗
- Herberger S, et al. (2025). Sci Rep — clinical sample, n=45 ↗
- Lee YJ, et al. (2025). J Clin Sleep Med — meta-analysis, n=798 ↗
- Haghayegh S, et al. (2019). J Med Internet Res 21(11):e16273 ↗
- v1 · 2026-07-26 · Initial grade.
SSMT. "Consumer wearables measure sleep stages (light/deep/REM) accurately." Claim SSMT-2026-0002 v1, graded 2026-07-26. https://sportssciencetech.com/c/SSMT-2026-0002