Data Update Playbook

​

Goal

​

Required output bundle

• yearly/<year>.json for every year in scope
• columnar/*.npy files
• columnar/metadata.json
• columnar/fips_order.json
• fips_lookup.json
• us_counties.geojson

​

Step 1: Regenerate processed files

cd /Users/columbus/Development/idopt/matlabtoPythonTask/TSAMWPScripts/data_server
python preprocess_data.py

​

Step 2: Copy into visualsApi

rsync -av --delete \
  /Users/columbus/Development/idopt/matlabtoPythonTask/TSAMWPScripts/data_server/processed/ \
  /Users/columbus/Development/idopt/visualsApi/public/data/

​

Step 3: Quick API checks

cd /Users/columbus/Development/idopt/visualsApi
npm run dev

curl -s http://127.0.0.1:8787/api/years
curl -s http://127.0.0.1:8787/api/metrics
curl -s http://127.0.0.1:8787/api/data/2020 | head -c 200

​

Step 4: Quick frontend check

cd /Users/columbus/Development/idopt/visualWeb
npm run dev

​

Step 5: Commit and push

• visualsApi for public/data/*
• visualWeb only if frontend logic changed

​

Step 6: Deploy API

cd /Users/columbus/Development/idopt/visualsApi
npm run deploy

​

Common gotchas

• Keep FIPS as zero-padded 5-character strings.
• Keep metadata.json years and metric names aligned with files that exist.
• If any metric key name changes, update frontend mappings (see New Metric Checklist).