Journal article

Indices for for the evaluation of wildfire spread simulations using contemporaneous predictions and observations of burnt area

Thomas J Duff, Derek M Chong, Kevin G Tolhurst



Methods to objectively evaluate performance are critical for model development. In contrast to recent advances in wildfire simulation, there has been limited attention to evaluating fire model performance. Information to validate fire models is typically limited, commonly to a few perimeter observations at a small number of points in time. We review metrics for comparing two burnt areas at a point in time: observed and predicted. These are compared in an idealised landscape and with a case study evaluating the performance of simulations of an Australian wildfire. We assessed: Shape Deviation Index (SDI), Jaccard's coefficient, F1, Sørensen's Similarity and Area Difference Index (ADI). For de..

View full abstract


Funding Acknowledgements

Part of the work was undertaken as part of the project 'Fire impact and risk evaluation decision support tool' that was funded by Bushfire Cooperative Research Centre. The Victorian Department of Environment, Land, Water and Planning provided additional funding. Data were sourced from the archives of the Victorian Department of Environment Land, Water and Planning, and the Australian Bureau of Meteorology. We gratefully acknowledge our reviewers, whose contribution greatly improved this research.