↖ CPA Weather Lab

Data Analytics report

Pennsylvania PRISM Precipitation Product Comparison

Daily and monthly Pennsylvania PRISM comparison with resolution, reconciliation, radar-era, and station evidence.

A reproducible comparison of LT81m, AN M2/M3, D1/D2, resolution filtering, radar-era interpretation, and station residuals for a Pennsylvania daily reconstruction back to 1895.

Bottom line

  • Use M2 monthly constraints for 1895-1980 and M3/D2 for 1981 onward for the best-estimate reconstruction, while preserving explicit era flags and overlap adjustments.
  • Keep LT81m as a parallel homogeneous-climate baseline, not as a silent substitute for the best-estimate storm product.
  • 4 km filtering barely changes Pennsylvania-wide monthly volume, but daily convective sub-cell structure matters: the mean 5×5 sub-cell range is about 20.7% of the daily mean on days above 2 mm.
  • M3 equals ΣD2 to storage precision. ΣD1 can miss M2 badly: −12.96 mm (−15.92%) in July 2000, +0.49 mm in July 2005, and +5.07 mm in September 2011.
  • Independent daily placement error dominates. Measured-only D2 wet-day RMSE is 122-158% of the mean wet-day amount, and roughly 14-26% of stations prefer a one-day shift.
  • Radar alone is not identifiable here. Both D1 and D2 use radar in the central/eastern U.S. starting in 2002, so D2−D1 is not radar-on minus radar-off.

Max D2 closure MAE (mm)

0.01Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv

Largest pixel MAE between a complete D2 sum and M3; remaining difference is storage precision.

Largest pixel MAE between a complete D2 sum and M3; remaining difference is storage precision.Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv

Expose bounded executed CSV outputs for all report visuals and tables.

Max July mean bias (%)

0.18Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv

Statewide volume is nearly conserved, while local detail is smoothed.

Sep 2011 local MAE (mm) 3.92Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csvDaily within-cell variance (%) 0.67Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv
Statewide volume is nearly conserved, while local detail is smoothed.Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv

Expose bounded executed CSV outputs for all report visuals and tables.

Min gain (mm)

1.38Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv

Apparent ΣD2 MAE improvement over ΣD1 across the three complete measured-only samples.

Max gain (mm) 6.69Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv
Apparent ΣD2 MAE improvement over ΣD1 across the three complete measured-only samples.Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv

Expose bounded executed CSV outputs for all report visuals and tables.

Wet-day RMSE / mean, min (%)

121.73Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv

Measured-only independent station-days show that daily placement error dominates monthly-anchor uncertainty.

Wet-day RMSE / mean, max (%) 158.12Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csvOne-day shift preferred, max (%) 25.85Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv
Measured-only independent station-days show that daily placement error dominates monthly-anchor uncertainty.Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv

Recompute independent-station daily skill, event detection, and lag preference after excluding estimated station-day values.

What the PRISM documentation settles

M3 and D2 begin in 1981 and continue to the present. M2 and D1 end in June 2015. In the central/eastern U.S., M3 is forced to equal the sum of D2; D2 apportions non-PRISM-day and multi-day station totals and applies monthly completeness. D1 and M2 used different input rules and were not reconciled. Both daily versions use CAI plus radar from 2002. The radar source changes again in July 2020, when radar-only MRMS replaces ST2un in the weighting process. These are method boundaries, not mere filename trivia.

The daily series can change the monthly result in two distinct ways

For the three complete paired months, the arithmetic identity is:

M3 − M2 = (ΣD1 − M2) + (ΣD2 − ΣD1) − (ΣD2 − M3).

The last term is essentially zero. This separates the old D1/M2 inconsistency from the D2/D1 method change, but neither term is a pure radar effect.

Monthly M3−M2 decomposition
Monthly M3−M2 decomposition data
Sample monthDifferenceComponentRelative differencePixel MAE
2000-07-12.96mmΣD1 − M2-15.92%14.07mm
2000-079.99mmΣD2 − ΣD114.59%11.29mm
2000-07-2.97mmM3 − M2-3.65%7.19mm
2005-070.49mmΣD1 − M20.48%14.58mm
2005-075.7mmΣD2 − ΣD15.58%7.82mm
2005-076.19mmM3 − M26.09%15.67mm
2011-095.07mmΣD1 − M22.02%20.06mm
2011-092.89mmΣD2 − ΣD11.13%9.58mm
2011-097.97mmM3 − M23.17%20.74mm

D2-to-M3 monthly closure

Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv

Expose bounded executed CSV outputs for all report visuals and tables.

D2-to-M3 monthly closure
YearMonthComparisonState mean Δ (mm)Pixel MAE (mm)Max |pixel Δ| (mm)
2,000Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv7Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csvsum D2 minus M3-0Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv0Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv0.01Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv
2,005Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv7Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csvsum D2 minus M3+0Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv0Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv0.01Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv
2,011Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv9Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csvsum D2 minus M3+0Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv0Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv0.01Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv
2,011Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv9Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csvsum 800m D2 minus 800m M3-0Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv0Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv0Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv
2,011Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv9Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csvsum 4km D2 minus 4km M3+0Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv0Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv0.01Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv
2,020Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv7Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csvsum D2 minus M3+0.01Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv0.01Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv0.02Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv

D2−D1 is event-dependent, not a monthly scale factor

ΣD2 exceeds ΣD1 by 9.99 mm in July 2000, 5.70 mm in July 2005, and 2.89 mm in September 2011. Daily spatial MAE peaks at 2.18 mm on July 15, 2000, 2.22 mm on July 9, 2005, and 2.43 mm on September 7, 2011. Differences grow on wet/event days, so a single statewide correction multiplier would erase the very structure the newer method is trying to recover.

Daily D2−D1 spatial difference
Daily D2−D1 spatial difference data
Day of monthPixel MAESampleState mean D2−D1P95 |difference|
10mm2000-070mm0mm
20.01mm2000-070.01mm0mm
30.29mm2000-070.25mm1.84mm
40.85mm2000-070.49mm3.33mm
50.21mm2000-070.08mm1.12mm
60.05mm2000-070.05mm0mm
70.32mm2000-070.18mm1.19mm
80.04mm2000-070.04mm0mm
90.06mm2000-070.06mm0.47mm
100.92mm2000-070.46mm3.4mm
110.37mm2000-070.18mm1.9mm
120mm2000-070mm0mm
130mm2000-070mm0mm
140.48mm2000-070.44mm2.54mm
152.18mm2000-071.17mm7.4mm
161.25mm2000-070.69mm4.27mm
171.43mm2000-070.85mm5.6mm
180.04mm2000-070.03mm0.33mm
190.14mm2000-070.11mm0.92mm
200.64mm2000-070.49mm3.03mm
210.13mm2000-070.13mm0.95mm
220.61mm2000-070.17mm2.09mm
230.06mm2000-070.05mm0.1mm
240.06mm2000-070.04mm0.45mm
250.18mm2000-070.12mm0.87mm
260.45mm2000-070.39mm2.05mm
270.69mm2000-070.01mm3.39mm
280.45mm2000-070.45mm1.35mm
291.61mm2000-071.36mm6.81mm
300.91mm2000-070.74mm3.43mm
312.04mm2000-070.97mm7.05mm
10.29mm2005-070.08mm1.76mm
20.43mm2005-070.13mm2.04mm
30mm2005-070mm0mm
40mm2005-07-0mm0mm
50.57mm2005-07-0.15mm2.66mm
61.51mm2005-070.73mm5.25mm
70.28mm2005-070.09mm1.19mm
81.33mm2005-070.31mm5.3mm
92.22mm2005-070.78mm8.26mm
100.13mm2005-070.04mm0.69mm
110mm2005-070mm0mm
120mm2005-07-0mm0mm
130.19mm2005-070.02mm0.73mm
140.72mm2005-070.09mm3.34mm
150.45mm2005-070.07mm2.01mm
161.01mm2005-070.71mm4.59mm
171.36mm2005-070.41mm5.58mm
180.86mm2005-070.13mm3.2mm
190.41mm2005-070.18mm1.82mm

92 results · Showing first 50

What radar changed—and what these data cannot say

The pre-2002 samples establish that M3/D2 can differ materially from M2/D1 even without radar, because station-day apportionment, completeness, networks, QC, and reconciliation changed. Post-2002 contrasts add radar, but also all those other differences. July 2020 is itself a radar-input transition month. A radar-only number requires a matched CAI-only and CAI+radar rerun under identical station, QC, and reconciliation rules; these archives do not contain that counterfactual.

800 m-to-4 km loss is local smoothing, not missing state volume

Across supplied July fields from 1971 through 2020, state-mean bias is −0.185% to +0.092%, while local paired MAE is 1.09-3.79 mm. For the 36 daily 2011 fields, precipitation-weighted within-4 km variance is 0.67%, but the mean 5×5 sub-cell range is 20.7% of the daily mean on days above 2 mm and reaches 67-69% on scattered September days. Daily maxima fall 3.8% on average on those wetter days. Monthly aggregation hides much of this: for September, within-cell variance is 0.35%, local MAE is 3.92 mm, and the maximum falls from 643.47 to 637.45 mm. Treat the loss as regime-dependent sub-grid uncertainty, especially on scattered convection.

2011 daily 800 m-to-4 km smoothing
2011 daily 800 m-to-4 km smoothing data
DatePaired local MAESegment800 m state meanState mean biasWithin-cell varianceMean sub-cell range / meanDaily maximum change
2011-09-010.17mmSeptember full month2.72mm-0.18%0.61%24.45%-0.6mm
2011-09-020.34mmSeptember full month6.56mm0.07%0.64%21.8%-0.31mm
2011-09-030.02mmSeptember full month0.12mm0.92%4.45%81.67%-1mm
2011-09-040.17mmSeptember full month1.43mm-0.13%3.28%51.55%-4.47mm
2011-09-050.84mmSeptember full month20.75mm0.14%0.92%17.19%-4.93mm
2011-09-060.52mmSeptember full month22.77mm0.2%0.56%9.79%-2.4mm
2011-09-070.86mmSeptember full month45.72mm0.25%0.21%8.15%-2.44mm
2011-09-081.04mmSeptember full month38.67mm-0.03%0.16%11.38%-4.58mm
2011-09-090.41mmSeptember full month6.41mm0.06%1.46%27.07%-2.11mm
2011-09-100.73mmSeptember full month10.73mm0.36%1.01%28.28%-3.63mm
2011-09-110.32mmSeptember full month1.88mm0.57%3.6%69.35%-2.55mm
2011-09-120.57mmSeptember full month4.34mm-0.16%3.57%54.68%-3.8mm
2011-09-130.06mmSeptember full month0.19mm1.43%10.19%131.62%-6.56mm
2011-09-140.15mmSeptember full month1.99mm-0.14%0.85%30.54%-1.61mm
2011-09-150.33mmSeptember full month7.78mm-0.36%1.36%18.03%-2.46mm
2011-09-160.14mmSeptember full month4.38mm0.17%0.95%13.92%-0.56mm
2011-09-170mmSeptember full month0mm-4.27%19.44%186.4%-0.07mm
2011-09-180.01mmSeptember full month0.1mm-0.31%1.23%32.5%-0.31mm
2011-09-190mmSeptember full month0mm3.84%24.66%154.56%-0.1mm
2011-09-200.17mmSeptember full month7.07mm0.09%0.3%10.03%-0.26mm
2011-09-210.03mmSeptember full month0.3mm-0.16%3.25%44.32%-1.49mm
2011-09-220.34mmSeptember full month5.86mm0.06%1.34%24.84%-5.69mm
2011-09-230.26mmSeptember full month1.61mm0.23%5.23%67.29%-3.48mm
2011-09-240.71mmSeptember full month19.2mm0.13%0.43%15.91%-1.76mm
2011-09-250.02mmSeptember full month0.1mm0.22%4.53%86.75%-3.11mm
2011-09-260.01mmSeptember full month0.07mm0.02%2.88%68.72%-1.47mm
2011-09-270.41mmSeptember full month6.51mm0.37%0.79%26.83%-2.81mm
2011-09-280.95mmSeptember full month22.13mm0.17%0.65%18.18%-2.09mm
2011-09-290.7mmSeptember full month15.87mm0.19%0.73%18.69%-3.23mm
2011-09-300.23mmSeptember full month3.33mm0.34%1.78%29.93%-2.56mm
2011-08-260.53mmAugust 26-31 partial8.16mm-0.02%1.93%26.89%-1.65mm
2011-08-270.03mmAugust 26-31 partial0.13mm0.43%4.93%104.01%-1.2mm
2011-08-280.69mmAugust 26-31 partial36.53mm0.21%0.08%8.03%-2.3mm
2011-08-290.29mmAugust 26-31 partial5.82mm-0.25%0.63%21%-5.75mm
2011-08-300mmAugust 26-31 partial0mm-0.79%12.08%104.46%-0.02mm
2011-08-310mmAugust 26-31 partial0.01mm0.9%4.91%100.05%-0.16mm
July local difference after 800 m-to-4 km filtering
July local difference after 800 m-to-4 km filtering data
YearLocal MAE / state meanState mean biasPaired MAEMaximum change
1.97K1.01%0.09%1.09mm-3.03mm
1.98K1.72%0.05%1.96mm-3.08mm
1.99K1.98%0.02%1.72mm-3.97mm
2K2.24%-0.13%1.76mm-2.67mm
2.01K3.19%0.06%3.44mm-7.65mm
2.02K4.06%-0.18%3.79mm-13.22mm

Station evidence favors M3/D2 in aggregate, but holdout evidence is thin

For complete measured-only station months, ΣD2 MAE is lower than ΣD1 by 6.69 mm (2000), 1.38 mm (2005), and 1.42 mm (2011). However, most observations helped construct at least one PRISM product. Among stations not listed in either monthly input inventory, D1 and D2 are essentially tied in 2000 and 2005, while D1 is better in 2011; those subsets contain only 12-30 stations. The honest conclusion is that D2 fits the assimilated station field better, while clean out-of-sample superiority is not yet established.

Station-month MAE for the daily/monthly candidates
Station-month MAE for the daily/monthly candidates data
Sample monthStation MAEProduct LabelStationsBiasP95 absolute error
2000-0717.58mmΣD1193-13.14mm73.74mm
2000-0710.89mmΣD2 / M3193-3.25mm50.63mm
2000-0715.59mmM2193-0.84mm52.57mm
2005-0712.93mmΣD1181-4.79mm43.51mm
2005-0711.54mmΣD2 / M31810.05mm35.9mm
2005-0716.34mmM2181-6.52mm49.12mm
2011-0912.48mmΣD1149-5.06mm33.1mm
2011-0911.06mmΣD2 / M3149-1.22mm31.75mm
2011-0919.86mmM2149-10.1mm58.93mm

Paired D1/D2 station checks

Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv

Expose bounded executed CSV outputs for all report visuals and tables.

Paired D1/D2 station checks
MonthSubsetND1 MAE (mm)D2 MAE (mm)D2 improvement (mm)D2 wins (%)
2000-07All complete measured-only months193Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv17.58Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv10.89Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv+6.69Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv60.1Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv
2000-07Not listed in either monthly product30Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv25.08Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv25.07Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv+0.01Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv40Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv
2005-07All complete measured-only months181Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv12.93Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv11.54Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv+1.38Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv58.56Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv
2005-07Not listed in either monthly product14Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv19.91Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv19.68Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv+0.23Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv57.14Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv
2011-09All complete measured-only months149Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv12.48Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv11.06Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv+1.42Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv52.35Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv
2011-09Not listed in either monthly product12Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv13.02Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv19.87Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv-6.85Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv33.33Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv

Daily validation changes the priority order

The supplied station-day parquet contains 25,559 rows and daily assimilation flags; 10.3% of its precipitation values are marked estimated, so this report recomputes headline results using measured-only rows. At D2-independent station-days, wet-day RMSE is 122-158% of the mean wet-day total and correlation is 0.34-0.68. D2 skill relative to D1 at stations independent of both is +4.3% in July 2000, −3.2% in July 2005, and +1.8% in September 2011—no consistent post-radar daily advantage. At 25 mm/day, measured-only probability of detection is 0.17-0.59 and false-alarm ratio is 0.36-0.60. Monthly anchoring controls mass and homogeneity; day allocation and timing dominate daily uncertainty.

Independent-station daily wet-day error
Independent-station daily wet-day error data
Sample monthWet-day RMSE / observed meanIndependent station-daysWet-day RMSECorrelation
2000-07158.12%2.31K13.31mm0.51
2005-07121.73%1.76K13.53mm0.47
2011-09122.8%1.7K20.17mm0.68
2020-07156.59%1.21K15.17mm0.34

Measured-only independent daily validation

Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv

Recompute independent-station daily skill, event detection, and lag preference after excluding estimated station-day values.

Measured-only independent daily validation
MonthIndependent daysWet RMSE / mean (%)CorrelationStations preferring ±1 day (%)25 mm POD25 mm FAR
2000-072,305Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv158.12Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv0.51Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv13.62Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv0.17Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv0.37Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv
2005-071,756Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv121.73Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv0.47Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv20Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv0.35Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv0.56Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv
2011-091,701Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv122.8Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv0.68Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv19.25Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv0.59Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv0.36Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv
2020-071,212Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv156.59Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv0.34Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv25.85Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv0.39Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv0.6Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv

Daily D1 versus D2 at stations independent of both

Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv

Recompute independent-station daily skill, event detection, and lag preference after excluding estimated station-day values.

Daily D1 versus D2 at stations independent of both
MonthStation-daysD1 RMSE (mm)D2 RMSE (mm)D2 skill (%)D1 bias (mm)D2 bias (mm)
2000-071,602Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv8.74Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv8.36Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv+4.33Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv-0.74Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv-0.35Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv
2005-07503Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv10.44Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv10.76Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv-3.15Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv+0.38Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv+0.42Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv
2011-09245Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv18.99Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv18.66Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv+1.76Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv+2.5Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv+2.35Source: Supplied CL9 daily station-day validation, measured-only reanalysisTable: sources/analysis_outputs/cl9_daily_station_validation.csv

Observation-time alignment is a first-order daily error

After excluding estimated station values, 13.6-25.9% of D2 stations prefer a one-day-shifted observation series; with all reported values the range is 19.5-25.8%, matching the supplied analysis. The sign depends on whether the shift is described from the grid or gauge perspective, so the report treats it direction-agnostically. Multi-day totals can be accurate while individual days alternate between dry and wet errors. Validate reconstruction amplitude on multi-day/event windows or model each station's observation time before scoring single days.

Product construction dominates resolution uncertainty

Annual M3−M2 is −3.93 mm in 1981, −18.93 mm in 1991, −11.40 mm in 2000, +22.14 mm in 2005, and +36.16 mm in 2011. The sign changes by year and month, while local pixel MAE remains much larger than the state-mean difference. This is spatial redistribution plus network/method change—not a stable bias correction.

Current AN minus stable M2 by month
Current AN minus stable M2 by month data
MonthCurrent AN − M2Year LabelDifferencePixel MAE
Jan-0%1.97K-0mm0mm
Feb0%1.97K0mm0mm
Mar0%1.97K0mm0mm
Apr-0%1.97K-0mm0mm
May0%1.97K0mm0mm
Jun0%1.97K0mm0mm
Jul0%1.97K0mm0mm
Aug0%1.97K0mm0mm
Sep-0%1.97K-0mm0mm
Oct0%1.97K0mm0mm
Nov-0%1.97K-0mm0mm
Dec-0%1.97K-0mm0mm
Jan-5.58%1.98K-1.06mm1.6mm
Feb1.05%1.98K1.41mm5.94mm
Mar-2.34%1.98K-0.88mm2.37mm
Apr0.7%1.98K0.81mm4.48mm
May-1.25%1.98K-1.08mm5.23mm
Jun-0.02%1.98K-0.03mm6.68mm
Jul-0.39%1.98K-0.44mm7.29mm
Aug-1.97%1.98K-1.12mm5.3mm
Sep-0.89%1.98K-0.87mm5.95mm
Oct0.78%1.98K0.87mm4.06mm
Nov-0.51%1.98K-0.22mm2.43mm
Dec-1.95%1.98K-1.33mm2.9mm
Jan-2.73%1.99K-1.94mm3.59mm
Feb-1.87%1.99K-0.83mm2.12mm
Mar-1.31%1.99K-1.31mm4.77mm
Apr-1.36%1.99K-1.1mm3.24mm
May-3.81%1.99K-2.22mm5.38mm
Jun-4.67%1.99K-1.9mm4.72mm
Jul-2.54%1.99K-2.27mm6.92mm
Aug-3.19%1.99K-2.54mm6.68mm
Sep-1.59%1.99K-1.28mm6.54mm
Oct-3.36%1.99K-1.73mm3.49mm
Nov-1.24%1.99K-0.9mm3.45mm
Dec-0.99%1.99K-0.92mm3.73mm
Jan-0.72%2K-0.45mm3.06mm
Feb-1.33%2K-0.95mm3.1mm
Mar-1.94%2K-1.76mm4.18mm
Apr-0.42%2K-0.48mm5.16mm
May-0.07%2K-0.08mm6.02mm
Jun-0.51%2K-0.69mm8.23mm
Jul-3.65%2K-2.97mm7.19mm
Aug-1.41%2K-1.34mm7.31mm
Sep-2.43%2K-2.48mm7.12mm
Oct0.63%2K0.38mm4mm
Nov-1.53%2K-0.84mm2.73mm
Dec0.34%2K0.26mm3.93mm
Jan3%2.01K4.23mm8.08mm
Feb2.4%2.01K1.37mm3.78mm

73 results · Showing first 50

Annual current-AN versus M2 diagnostics

Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv

Expose bounded executed CSV outputs for all report visuals and tables.

Annual current-AN versus M2 diagnostics
YearComparisonState mean Δ (mm)State mean Δ (%)Pixel MAE (mm)P95 |pixel Δ| (mm)
1,971Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csvM2 precision control+0Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv+0Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv0.01Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv0.02Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv
1,981Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csvM3 − M2-3.93Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv-0.38Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv23.17Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv60.13Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv
1,991Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csvM3 − M2-18.93Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv-2.2Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv28.1Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv65.14Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv
2,000Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csvM3 − M2-11.4Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv-1.08Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv29.44Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv76.44Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv
2,005Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csvM3 − M2+22.14Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv+2.07Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv43.97Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv119.62Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv
2,011Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csvM3 − M2+36.16Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv+2.37Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv56.24Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv142.6Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv

Empirical structural uncertainty

The annual mean cellwise range among current AN, stable M2, and block-averaged LT grows from 14.0 mm in 1971 to 63.0 mm in 2005; the 2005 95th-percentile cell range is 136.9 mm. Use this product spread as a structural sensitivity layer, not a probabilistic confidence interval. Calibrate a separate stochastic error model from genuinely held-out gauges where possible.

Annual cellwise range among LT, M2, and current AN
Annual cellwise range among LT, M2, and current AN data
YearMean cellwise rangeLargest state-mean gapP95 cellwise range
1.97K14.03mm2.17mm36.68mm
1.98K26.71mm3.93mm61.93mm
1.99K31.7mm18.93mm66.9mm
2K34.25mm11.4mm79.69mm
2.01K62.99mm33.92mm136.88mm

The practical choice for a 1895-present daily reconstruction

No one of the three candidates exists with the same purpose and method across the full period. A defensible operational design therefore has two products: a best-estimate track that splices monthly anchors with an explicit transition model, and a homogeneous LT track for climate sensitivity. The switch and method flags belong in the data model, not in a footnote discovered years later by an irritated raccoon.

The three monthly-anchor choices

Source: Reproducible Pennsylvania PRISM grid and station analysisTable: sources/analysis_outputs/report_*.csv

Expose bounded executed CSV outputs for all report visuals and tables.

The three monthly-anchor choices
ChoiceCoveragePriorityProsConsRecommended role
AN81m M2, 4 km1895-June 2015Legacy monthly CAI frameworkOnly AN monthly bridge back to 1895; no daily-sum constraint.Ends June 2015; old method; ΣD1 may differ materially; 4 km local smoothing.Monthly constraint for 1895-1980, with overlap-based transition modeling.
AN81m M3 / D2, 4 km1981-presentBest estimate and exact daily/monthly closureAll networks; M3 equals ΣD2 in PA; radar-enhanced from 2002.Method breaks at 1981, 2002, 2015, and July 2020; radar alone is not isolated; 4 km smoothing.Best-estimate daily/monthly track from 1981 onward.
LT81m, 800 m1895-present; 800 m onlyTemporal homogeneity and climate stationsLong-term networks, fine terrain detail, stable climate-oriented target.Not D2-closed; omits many short-term networks and radar; not the best storm/month estimate.Parallel homogeneous baseline and sensitivity control.

Recommended reconstruction architecture

  1. 1895-1980: constrain temporally disaggregated daily estimates to M2 monthly totals. Use station days, weather regimes, and neighboring-day structure for timing; force exact monthly mass closure.
  2. 1981-present: use D2 daily totals where available and M3 monthly totals as the closure target. Preserve native 800 m values when local hydrology matters; otherwise attach a 4 km smoothing uncertainty layer.
  3. Parallel LT track: maintain LT81m as a homogeneous climate/station baseline for trend and breakpoint sensitivity.
  4. Era flags: record at least 1981 (M3/D2 start), 2002 (radar use), July 2015 (M2/D1 availability ends), July 2020 (MRMS radar-input transition), and 2021 (new normals/predictor regime).
  5. Transition model: estimate month × physiographic region × elevation × wetness adjustments over overlaps. Never use one statewide multiplier.
  6. Daily regimes: give scattered-convective days wider spatial uncertainty than organised storms; a 4 km probability distribution may be more honest than a single value.
  7. Observation time: infer per-station day offsets and score amplitude on multi-day windows before using single-day residuals.
  8. Uncertainty: keep gauge/measurement error, anchor/product spread, temporal disaggregation error, and 800 m-to-4 km sub-grid smoothing separate.
  9. Validation: exclude estimated gauge values for the primary score, use daily inventory flags for true withheld sets, and report sample size and assimilation status.

Scope and validation status

Share with caveats. The workflow validates complete daily coverage, exact 5:1 grid alignment, D2-to-M3 closure below 0.01 mm pixel MAE, and the decomposition identity above. Pennsylvania contains 180,464 native 800 m cell centers and 7,164 4 km centers in this mask; state means use cosine-latitude weights. All 25,559 supplied station-day points fall inside the Pennsylvania polygon; 2,625 estimated values are excluded from the primary daily validation. The archive labeled 1992 contains 1991 grids. The 1981 annual 800 m AN archive is truncated, so only its valid July resolution comparison is used. LT is reduced to 4 km with an area-conserving 5×5 mean for cross-product spread; that does not recreate PRISM's production Gaussian kernel. Remaining limitations are radar causal identification, only one transition-month sample for MRMS, daily inventory matching at 0.02 degrees, and small fully independent monthly-gauge subsets.

Sources

  1. Reproducible Pennsylvania PRISM grid and station analysissources/analyze_daily_prism.py · DuckDB

    Expose bounded executed CSV outputs for all report visuals and tables.

    SQL query
    SELECT * FROM read_csv_auto('sources/analysis_outputs/report_*.csv', union_by_name=true, filename=true);
  2. Supplied CL9 daily station-day validation, measured-only reanalysissources/validate_cl9_daily_station.py · DuckDB

    Recompute independent-station daily skill, event detection, and lag preference after excluding estimated station-day values.

    SQL query
    SELECT * FROM read_csv_auto('sources/analysis_outputs/report_cl9_daily_*.csv', union_by_name=true, filename=true);
  3. PRISM Spatial Datasets documentation
  4. Pennsylvania boundary (us-atlas FIPS 42)
← CPA Weather Lab · Learn