DETONATE (DE novo TranscriptOme rNa-seq Assembly with or without the Truth Evaluation) consists of two component packages, RSEM-EVAL and REF-EVAL. Both packages are mainly intended to be used to evaluate de novo transcriptome assemblies, although REF-EVAL can be used to compare sets of any kinds of genomic sequences.
RSEM-EVAL is a reference-free evaluation method based on a novel probabilistic model that depends only on an assembly and the RNA-Seq reads used for its construction. Unlike N50, RSEM-EVAL combines multiple factors, including the compactness of an assembly and the support of the assembly from the RNA-Seq data, into a single, statistically-principled evaluation score. This score can be used to select a best assembler, optimize an assembler's parameters, and guide new assembler design as an objective function. In addition, for each contig within an assembly, RSEM-EVAL provides a score that assesses how well that contig is supported by the RNA-Seq data and can be used to filter unnecessary contigs.
REF-EVAL is a toolkit of reference-based measures, including contig, nucleotide, and pair precision, recall, and F1 scores, a novel kmer compression score, and several scores that compare induced kmer distributions between the assembly and the reference. REF-EVAL also includes a program to estimate the “true” assembly of a set of RNA-Seq reads, relative to a collection of full-length reference transcripts. See here, or ref-eval/README in the distribution, for detailed information.
DETONATE is motivated and described in detail in the following paper:
Bo Li*, Nathanael Fillmore*, Yongsheng Bai, Mike Collins, James A. Thompson, Ron Stewart, Colin N. Dewey. Evaluation of de novo transcriptome assemblies from RNA-Seq data.
* = equal contributions
The current version of DETONATE, comprised of RSEM-EVAL 1.5 and REF-EVAL 20140108, is available here:
To build RSEM-EVAL and REF-EVAL, simply type “make” in the top-level detonate-20140108 directory, after you've upacked the tarball (tar xvf detonate-20140108.tar.gz). If you have trouble with any of this, please contact us via the mailing list (TODO@wisc.edu).
For information about using RSEM-EVAL, see here, or rsem-eval/README.md in the distribution.
For information about using REF-EVAL, see here, or ref-eval/README in the distribution.
For information about using REF-EVAL-BUILD-TRUE-ASSEMBLY, see here, or ref-eval/README.REF-EVAL-BUILD-TRUE-ASSEMBLY in the distribution.
RSEM-EVAL was coded by Bo Li, and REF-EVAL was coded by Nathanael Fillmore. Bo, Nate, and Colin Dewey jointly developed the RSEM-EVAL and REF-EVAL methodology, with feedback on the methodology from the other coauthors.
The RSEM-EVAL-guided Axolotl assembly described in the DETONATE paper (see above) is available here.