Elmo, D 2023, 'The risk of confusing model calibration and model validation with model acceptance', in PM Dight (ed.), SSIM 2023: Third International Slope Stability in Mining Conference
, Australian Centre for Geomechanics, Perth, pp. 333-342, https://doi.org/10.36487/ACG_repo/2335_19
This paper examines the meaning of calibration and validation in rock engineering design, highlighting several challenges and limitations associated with these processes. There exist two fundamental limitations: i) the inability to rely on engineering judgement as a substitute for proper calibration and validation, and ii) the use of qualitative characterisation methods introduces subjectivity in the data subsequently used for calibration and validation. Furthermore, varying modelling conceptualisations result in a paradoxical situation whereby the same problem analysed using different numerical models requires a different set of parameters, which can all be claimed to be calibrated. The author acknowledges that some of the points raised in this paper may encounter objections. However, by ignoring the epistemic limits of calibration and validation, there is the risk of letting engineering faith become the excuse behind the tendency to replace model validation with model acceptance.
Keywords: model calibration, model validation, model acceptance
Elmo, D 2023, ‘The Bologna Interpretation of rock bridges’, Geosciences, vol. 13, no. 2,
Elmo, D, Mitelman, A, & Yang, B 2022, ‘An examination of rock engineering knowledge through a philosophical lens’, Geosciences, vol 12, 174. doi.org/10.3390/geosciences12040174
Elmo, D & Stead, D 2021, ‘The role of behavioural factors and cognitive biases in rock engineering’, Rock Mechanics and Rock Engineering, vol. 54, no. 1,
Elmo, D & Stead, D 2020, ‘Disrupting rock engineering concepts: is there such a thing as a rock mass digital twin and are machines capable of learning rock mechanics?’, in PM Dight (ed.), Slope Stability 2020: Proceedings of the 2020 International Symposium on Slope Stability in Open Pit Mining and Civil Engineering, Australian Centre for Geomechanics, Perth, pp. 565–576,
Harrison, JP 2017, ‘Rock engineering design and the evolution of Eurocode 7’, Proceedings of EG50 Engineering Geology and Geotechnics Conference.
Hoek, E 1994, ‘Strength of rock and rock masses’, International Society for Rock Mechanics News Journal, vol. 2, no. 2, pp. 4–16.
Kahneman, D 2011, Thinking, Fast and Slow, Farrar, Straus and Giroux, New York.
Kalenchuk, KS 2019, ‘Canadian geotechnical colloquium: mitigating a fatal flaw in modern geomechanics: understanding uncertainty, applying model calibration, and defying the hubris in numerical modelling’, Canadian Geotechnical Journal, vol. 59, no. 3, pp. 315–329,
Karimi, L, Elmo, D & Stead, D 2020, ‘An investigation of the factors controlling the mechanical behaviour of slender naturally fractured pillars’, Rock Mechanics and Rock Engineering, vol. 53, no. 11, pp. 5005–5027,
Ross, B 2017, Rise to the Occasion: Lessons From the Bingham Canyon Manefay Slide, Society for Mining, Metallurgy & Exploration, Littleton.
Read, J & Stacey, P 2009, Guidelines for Open Pit Slope Design, CSIRO Publishing, Melbourne.
Shapka-Fels, T, & Elmo, D 2022, ‘Numerical modelling challenges in rock engineering with special consideration of open pit to underground mine interaction’, Geosciences, vol. 12, no. 5,
Taleb, N 2010, The Black Swan: The Impact of the Highly Improbable, Random House, New York.
Yang, B & Elmo, D 2022, ‘Why engineers should not attempt to quantify GSI’, Geosciences, vol. 12, no. 11.
Yang, B, Mitelman, A, Elmo, D & Stead, D 2021, ‘Why the future of rock mass classification systems requires revisiting its empirical past’, Quarterly Journal of Engineering Geology and Hydrogeology, vol. 55,