Authors / CoAuthors
Li, J.
Abstract
Assessing the accuracy of predictive models is critical because predictive models have been increasingly used across various disciplines and predictive accuracy determines the quality of resultant predictions. Pearson product-moment correlation coefficient (r) and the coefficient of determination (r2) are among the most widely used measures for assessing predictive models for numerical data, although they are argued to be biased, insufficient and misleading. In this study, geometrical graphs were used to illustrate what were used in the calculation of r and r2 and simulations were used to demonstrate the behaviour of r and r2 and to compare three accuracy measures under various scenarios. Relevant confusions about r and r2, has been clarified. The calculation of r and r2 is not based on the differences between the predicted and observed values. The existing error measures suffer various limitations and are unable to tell the accuracy. Variance explained by predictive models based on cross-validation (VEcv) is free of these limitations and is a reliable accuracy measure. Legates and McCabe’s efficiency (E1) is also an alternative accuracy measure. The r and r2 do not measure the accuracy and are incorrect accuracy measures. The existing error measures suffer limitations. VEcv and E1 are recommended for assessing the accuracy. The applications of these accuracy measures would encourage accuracy-improved predictive models to be developed to generate predictions for evidence-informed decision-making. <b>Citation:</b> Li J (2017) Assessing the accuracy of predictive models for numerical data: Not r nor r2, why not? Then what? <o>PLoS ONE</i> 12(8): e0183250. https://doi.org/10.1371/journal.pone.0183250
Product Type
document
eCat Id
101500
Contact for the resource
Point of contact
Cnr Jerrabomberra Ave and Hindmarsh Dr GPO Box 378
Canberra
ACT
2601
Australia
Resource provider
Point of contact
- Contact instructions
- Place and Communities
Keywords
- theme.ANZRC Fields of Research.rdf
-
- EARTH SCIENCES
- ( Discipline )
-
- predictive models
- ( Data centre )
-
- predictive accuracy
-
- Published_External
Publication Date
2024-12-24T00:51:01
Creation Date
Security Constraints
Legal Constraints
Status
completed
Purpose
Manuscript for publication in PLoS ONE journal
Maintenance Information
asNeeded
Topic Category
geoscientificInformation
Series Information
Public Library of Science (PLoS ONE) Journal Volume 12(8): e0183250 1-16
Lineage
Manuscript for publication in Public Library of Science (PLoS ONE) journal
Parent Information
Extents
[-54.75, -9.2402, 112.92, 159.11]
Reference System
Spatial Resolution
Service Information
Associations
Source Information