docs(labels): refresh stale observed-value statistics in survey_documentation - #114
docs(labels): refresh stale observed-value statistics in survey_documentation#114elleggert wants to merge 1 commit into
Conversation
…entation The per-variable pages under data/labels/survey_documentation/ carry an "Observed values" block generated on 2026-04-28 from a pre-release snapshot of the label files (last_labels.json md5 0f65e8fe…). That snapshot predates several label-preparation steps, so 18 pages published statistics that no longer describe the released data. Regenerated those 18 blocks from the released full-cohort label files (last_labels.json md5 521c157a…, context_labels.json md5 220f5946…). Only the observation counts, stat table, top-N table and provenance footer are rewritten; all prose, source references, git-history and notes sections are untouched. Representative corrections: Watch_BasalEnergyBurned min -4666 -> 500.3 (kcal, was negative) Watch_RespiratoryRate min -1, max 106 -> 5, 39 (breaths/min) Watch_HRVSDNN min 0.002341 -> 5.18 (ms) WeightKilograms min/max 30/300 -> 31.3/223.6 (slider clamps gone) BMI_values max 125 -> 58.04 age median 32 -> 39 (de-identified birthdates) TotalCholesterol median 9.49 -> 4.55 (mmol/L) Hdl / Ldl median 2.77 / 5.61 -> 1.32 / 2.61 (mmol/L) Also corrects the unit shown for TotalCholesterol in the cardiometabolic_labs summary table (mg/dL -> mmol/L), which the refreshed statistics contradict. No code, data or API behaviour changes. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
|
Short version of what this does and how it was checked. What we did. The How we checked it. Every number was re-derived a second time through an independent code path (numpy percentiles, Cross-checked against Also confirmed no label-name collisions between On the large count drops ( Scope: docs only. 19 markdown files, all under |
While working through reviewer comments on the paper I went to verify the cholesterol figures in
data/labels/survey_documentation/and found the numbers there don't match the released dataset. That docs snapshot predates several label-preparation steps, so 18 pages publish statistics that no longer describe the data we ship.This PR regenerates those blocks. Nothing else.
What changed
Regenerated from the released full-cohort label files —
last_labels.json(md5521c157a…) andcontext_labels.json(md5220f5946…), the same bytes served by the public bundle. Per page, only these are rewritten:**Total observations** / type-enforced / unique / raw typesline**Type-enforcement rejections**line| stat | value |table**Top N most frequent values**table_Generated …_provenance footerProse,
## Source,## Question,## Answer options,## Git historyand## Notesare byte-identical. The diff contains no line outside those five kinds.Representative corrections
Watch_BasalEnergyBurnedWatch_RespiratoryRateWatch_HeartRateVariabilitySDNNWeightKilogramsBMI_valuesageWatch_VO2MaxTotalCholesterolHdl/LdlFull list of touched pages:
BMI_values,WeightKilograms,Hdl,Ldl,SystolicBloodPressure,TotalCholesterol,framingham_risk,age,Watch_BasalEnergyBurned,Watch_HeartRateVariabilitySDNN,Watch_RespiratoryRate,Watch_RestingHeartRate,Watch_StandTime,Watch_VO2Max,Watch_WalkingHeartRateAverage,vigorous_act,sleep_time,happiness.One additional one-word change, called out explicitly:
cardiometabolic_labs/summary.mddescribed TotalCholesterol as(mg/dL), which the refreshed statistics in the same PR directly contradict. Changed to(mmol/L).Scope / non-goals
survey_documentation/. The bundle-side docs (data/labels/README.md,RELEASE_NOTES.md, which live in Google Drive and the Dataverse deposits) carry no per-variable statistics, so no dataset re-version is needed.