Evaluation Discipline and Model Combination
Evaluate with rolling windows that reflect regime shifts. Report RMSE, MAE, and directional accuracy. Track stability across subperiods, and document when performance deteriorates after revisions or structural breaks.
Evaluation Discipline and Model Combination
Always score against what was knowable then, not today’s revised data. Archive vintages, automate retrieval, and publish a reproducible pipeline. Readers appreciate honesty more than perfection when stakes are high.