Combining seasonality and recent demand signals into an out-of-sample weekly forecasting system
Integrated model · provisionally validated
My Role
I developed and evaluated this component within the demand-forecasting project, including benchmark comparison and interpretation.
Business / Analytical Question
Can an interpretable adaptive seasonal model outperform simple benchmarks on genuinely unseen demand?
Evidence
Frozen adaptive model developed on 2023–2024; evaluated on untouched 2025. 2025 holdout MAE 1.97 vs. 2.43; RMSE 3.23 vs. 3.70, both vs. recent 4-week benchmark.
Decision / Finding
Use as a provisional weekly acquisition-demand benchmark; check exact 2026 alignment before stronger claims.
Outcome / Status
Flagship integration: seasonality, adaptive demand level, and local momentum form the final architecture. Weather and economic candidates were tested but not retained. The next layer translates forecasts into a Demand Score. Analytical validation; no operational deployment is claimed.
19.2%Lower 2025 holdout MAE vs. recent 4-week benchmark
12.7%Lower 2025 holdout RMSE vs. recent 4-week benchmark
Decision support
Marketing Applications & Decision Support
Seasonal Budget Pacing
Expected seasonal demand provides context for allocating advertising investment throughout the year. Use the baseline alongside acquisition efficiency, campaign objectives, and service capacity when deciding where to accelerate or temper spend.
Direct Mail Timing
Anticipated demand periods can inform mail-drop schedules and related promotions. Account for production and delivery lead times, then coordinate campaign timing with the expected seasonal ramp.
Acquisition Against the Baseline
Compare observed acquisition with forecasted demand to distinguish normal seasonal increases from unusually strong or weak performance. Investigate gaps alongside campaign activity, conversion, capacity, and tracking changes.
These are practical decision-support applications of a provisionally validated forecast. The 19.2% lower holdout MAE and 12.7% lower holdout RMSE measure predictive performance; they do not establish deployed budget-optimization outcomes, incremental marketing lift, or causal attribution. Forecast gaps alone cannot isolate a marketing effect.
01
Business Question
Can an interpretable adaptive seasonal model outperform simple benchmarks on genuinely unseen demand?
02
Why It Matters
Fixed seasonality misses annual level changes; flat recent averages miss seasonal direction. Integrating shape, relative level, and local momentum addresses both weaknesses.
03
Data / Method
2023–2024 development used chronological rolling-origin selection. The selected architecture and score scale were frozen before evaluation on the untouched 2025 holdout. The final model uses no weather or economic inputs.
04
Analysis
Recurring seasonal curve
Normalize completed demand: (New Customers + 1) ÷ S(w)
Estimate six-week current level and slope
Reapply seasonal curve
Expected weekly New Customers
Method detail
Forecastₜ = max(0, S(wₜ) × max(0.01, Lₜ) − 1)
S(w) is the retained two-harmonic seasonal factor. L is the documented six-week endpoint trend of completed normalized observations. Each forecast excludes the target week.
2023–2024 development
Rolling-origin model selection
Model and score scale frozen
Untouched 2025 holdout
2026 calendar-alignment sensitivity check
05
Results
19.2%Lower 2025 holdout MAE vs. recent 4-week benchmark
12.7%Lower 2025 holdout RMSE vs. recent 4-week benchmark
1.972025 holdout MAE · New Customers/week
Untouched 2025 holdout: absolute error
MAE · weekly New Customers · lower is better
Adaptive seasonal
1.97
Recent four-week mean
2.43
Recent six-week mean
2.89
Seasonal month mean
3.52
Untouched 2025 holdout: large-error sensitivity
RMSE · weekly New Customers · lower is better
Adaptive seasonal
3.23
Recent four-week mean
3.70
Method detail
2025 holdout supporting diagnostics: predictive R² = 0.778; actual–predicted correlation = 0.891. Forecast error relative to the recent four-week benchmark is the primary evaluation.
Improvements are the source-reported values calculated before rounding; displayed two-decimal errors do not reproduce those percentages exactly.
The supplied sources report holdout summaries but do not contain all 52 actual/predicted 2025 rows. A weekly holdout line chart cannot be reconstructed accurately from these summaries.
06
Interpretation
Provisionally validated: the model generalized usefully to one untouched annual holdout. The later 2026 check is a separate, approximate alignment-sensitivity analysis.
Same week number. Different days.
Frozen model W01Jan 1–7, 2026
Pivot W01Dec 29, 2025–Jan 4, 2026
Pivot W02Jan 5–11, 2026
4 days from pivot W01
3 days from pivot W02
Approximate frozen-model W01 = 4/7 × count A + 3/7 × count B
Assumes uniform within-week timing. Exact validation needs daily Customer Since dates or daily counts.
Calendar definitions are part of the model specification, not a formatting detail.
MAE · weekly New Customers · approximate calendar alignment
Adaptive
1.56
Recent four-week
1.62
The model’s advantage persisted under this additional alignment check, but the margin was smaller: approximately 1.56 versus 1.62 New Customers per week in MAE. This is not a repeat of the untouched 2025 holdout. The next checkpoint is exact daily re-bucketing of 2026 New Customers, followed by a frozen-model rerun without retraining.
07
Limitations & Considerations
One annual holdout supports provisional rather than full validation. The 2026 approximation assumes uniform timing within each pivot week; exact daily counts are required for a definitive comparison.
08
How this fits into the forecasting system
Flagship integration: seasonality, adaptive demand level, and local momentum form the final architecture. Weather and economic candidates were tested but not retained. The next layer translates forecasts into a Demand Score.
Model structure, calculated validation metrics, and limitations are documented in this series. Source workbooks and full methodology downloads containing underlying business observations are withheld.