Peter Hofmann

TL;DR: The Critical Assessment of Metagenome Interpretation (CAMI) challenge has engaged the global developer community to benchmark their programs on highly complex and realistic data sets, generated from ∼700 newly sequenced microorganisms and ∼600 novel viruses and plasmids and representing common experimental setups as discussed by the authors.

TL;DR: CAMISIM can simulate a wide variety of microbial communities and metagenome data sets together with standards of truth for method evaluation, and generated the benchmark data sets of the first CAMI challenge.

TL;DR: Assessment of Metagenome BinnERs (AMBER) is an evaluation package for the comparative assessment of genome reconstructions from metagenome benchmark datasets and calculates the performance metrics and comparative visualizations used in the first benchmarking challenge of the initiative for the Critical Assessment ofmetagenome Interpretation (CAMI).

TL;DR: Benchmark metagenomes were generated from ~700 newly sequenced microorganisms and ~600 novel viruses and plasmids, including genomes with varying degrees of relatedness to each other and to publicly available ones and representing common experimental setups.

TL;DR: AMBER, an evaluation package for the comparative assessment of genome reconstructions from metagenome benchmark data sets, is presented, which calculates the performance metrics and comparative visualizations used in the first benchmarking challenge of the Initiative for the Critical Assessment of Metagenome Interpretation (CAMI).