pROC: an open-source package for R and S+ to analyze and compare ROC curves
Xavier Robin,Natacha Turck,Alexandre Hainard,Natalia Tiberti,Frédérique Lisacek,Jean-Charles Sanchez,Markus Müller +6 more
TLDR
pROC as mentioned in this paper is a package for R and S+ that contains a set of tools displaying, analyzing, smoothing and comparing ROC curves in a user-friendly, object-oriented and flexible interface.Abstract:
Receiver operating characteristic (ROC) curves are useful tools to evaluate classifiers in biomedical and bioinformatics applications. However, conclusions are often reached through inconsistent use or insufficient statistical analysis. To support researchers in their ROC curves analysis we developed pROC, a package for R and S+ that contains a set of tools displaying, analyzing, smoothing and comparing ROC curves in a user-friendly, object-oriented and flexible interface. With data previously imported into the R or S+ environment, the pROC package builds ROC curves and includes functions for computing confidence intervals, statistical tests for comparing total or partial area under the curve or the operating points of different classifiers, and methods for smoothing ROC curves. Intermediary and final results are visualised in user-friendly interfaces. A case study based on published clinical and biomarker data shows how to perform a typical ROC analysis with pROC. pROC is a package for R and S+ specifically dedicated to ROC analysis. It proposes multiple statistical tests to compare ROC curves, and in particular partial areas under the curve, allowing proper ROC interpretation. pROC is available in two versions: in the R programming language or with a graphical user interface in the S+ statistical software. It is accessible at http://expasy.org/tools/pROC/
under the GNU General Public License. It is also distributed through the CRAN and CSAN public repositories, facilitating its installation.read more
Citations
More filters
Modern Applied Statistics With S
TL;DR: The modern applied statistics with s is universally compatible with any devices to read, and is available in the digital library an online access to it is set as public so you can download it instantly.
Journal ArticleDOI
Inferring tumour purity and stromal and immune cell admixture from expression data
Kosuke Yoshihara,Maria Shahmoradgoli,Emmanuel Martinez,Rahulsimham Vegesna,Hoon Kim,Wandaliz Torres-Garcia,Victor Trevino,Hui Shen,Peter W. Laird,Douglas A. Levine,Scott L. Carter,Gad Getz,Katherine Stemke-Hale,Gordon B. Mills,Roel G.W. Verhaak +14 more
TL;DR: A method that uses gene expression signatures to infer the fraction of stromal and immune cells in tumour samples and prediction accuracy is corroborated using 3,809 transcriptional profiles available elsewhere in the public domain.
Book
Applied Predictive Modeling
Max Kuhn,Kjell Johnson +1 more
TL;DR: This research presents a novel and scalable approach called “Smartfitting” that automates the very labor-intensive and therefore time-heavy and therefore expensive and expensive process of designing and implementing statistical models for regression models.
Journal ArticleDOI
Genome-wide meta-analysis identifies new loci and functional pathways influencing Alzheimer's disease risk.
Iris E. Jansen,Jeanne E. Savage,Kyoko Watanabe,Julien Bryois,Dylan M. Williams,Stacy Steinberg,Julia Sealock,Ida K. Karlsson,Ida K. Karlsson,Sara Hägg,Lavinia Athanasiu,Lavinia Athanasiu,Nicola Voyle,Petroula Proitsi,Aree Witoelar,Sven Stringer,Dag Aarsland,Dag Aarsland,Ina S. Almdahl,Ina S. Almdahl,Ina S. Almdahl,Fred Andersen,Sverre Bergh,Francesco Bettella,Sigurbjorn Bjornsson,Anne Brækhus,Geir Bråthen,Christiaan de Leeuw,Rahul S. Desikan,Srdjan Djurovic,Srdjan Djurovic,Logan Dumitrescu,Tormod Fladby,Tormod Fladby,Timothy J. Hohman,Palmi V. Jonsson,Steven J. Kiddle,Arvid Rongve,Ingvild Saltvedt,Sigrid Botne Sando,Geir Selbæk,Maryam Shoai,Nathan G. Skene,Nathan G. Skene,Jon Snaedal,Eystein Stordal,Eystein Stordal,Ingun Ulstein,Yunpeng Wang,Linda R. White,John Hardy,Jens Hjerling-Leffler,Patrick F. Sullivan,Patrick F. Sullivan,Wiesje M. van der Flier,Richard Dobson,Lea K. Davis,Hreinn Stefansson,Kari Stefansson,Nancy L. Pedersen,Stephan Ripke,Stephan Ripke,Stephan Ripke,Ole A. Andreassen,Danielle Posthuma,Danielle Posthuma +65 more
TL;DR: A large genome-wide association study of clinically diagnosed AD and AD-by-proxy identifies new loci and functional pathways that contribute to AD risk and adds novel insights into the neurobiology of AD.
Journal ArticleDOI
Clinical-grade computational pathology using weakly supervised deep learning on whole slide images.
Gabriele Campanella,Gabriele Campanella,Matthew G. Hanna,Luke Geneslaw,Allen P. Miraflor,Vitor Werneck Krauss Silva,Klaus J. Busam,Edi Brogi,Victor E. Reuter,David S. Klimstra,Thomas J. Fuchs,Thomas J. Fuchs +11 more
TL;DR: A multiple instance learning-based deep learning system that uses only the reported diagnoses as labels for training, thereby avoiding expensive and time-consuming pixel-wise manual annotations, and has the ability to train accurate classification models at unprecedented scale.
References
More filters
Journal ArticleDOI
Advances in statistical methodology for the evaluation of diagnostic and laboratory tests
TL;DR: Two new simultaneous confidence regions associated with the ROC curve are presented, one based on Kolmogorov-Smirnov confidence bands for distribution functions and the other based on bootstrapping.
Journal ArticleDOI
A distribution-free procedure for comparing receiver operating characteristic curves from a paired experiment
E. S. Venkatraman,Colin B. Begg +1 more
TL;DR: In this article, a distribution-free permutation test procedure is proposed for comparing receiver operating characteristic curves based on continuous data from a paired design, which tests the hypothesis that the two curves are identical for all operating points, unlike previously proposed methods which test the equivalence of the areas under the curves.
Journal ArticleDOI
Comparison of Eight Computer Programs for Receiver-Operating Characteristic Analysis
TL;DR: Adequate ROC analysis and ROC plotting cannot be performed with a single program, and Analyse-It, AccuROC, and MedCalc can be recommended with certain limitations, but each program had different shortcomings.
Journal ArticleDOI
A permutation test to compare receiver operating characteristic curves.
TL;DR: A permutation test for continuous unpaired data is developed and studied through simulations to test the equality of receiver operating characteristic curves based on continuous paired data.
Journal ArticleDOI
A multiparameter panel method for outcome prediction following aneurysmal subarachnoid hemorrhage
Natacha Turck,Laszlo Vutskits,Paola Sanchez-Peña,Xavier Robin,Alexandre Hainard,Marianne Gex-Fabry,Catherine Fouda,Hadiji Bassem,Markus Mueller,Frédérique Lisacek,Louis Puybasset,Jean-Charles Sanchez +11 more
TL;DR: The use of this panel, including four brain injury-related proteins, one cardiac marker and a clinical score, could be a valuable tool to identify aSAH patients at risk of poor outcome.