Does Your Wildfire Prediction Model Actually Work, or Just Score Well?
A wildfire model can earn a strong score and still fall short when the rules of evaluation change. Wildfire-FM brings weather, active-fire observations, terrain, and vegetation into a shared model, then asks what its predictions really tell us.
arXiv: 2605.18911
The same forecast, different scores
A small shift in where or when a fire is predicted can change whether it counts as a correct forecast. Matching rules make that distinction explicit.
Key findings
- The same forecast can receive different scores depending on how predicted and observed fires are matched.
- Ranking fires well does not guarantee reliable decisions at a chosen alert threshold.
- Keeping the data, tasks, and scoring rules fixed makes model comparisons more meaningful.