Skip to main content

AXIOME: automated exploration of microbial diversity

Abstract

Background

Although high-throughput sequencing of small subunit rRNA genes has revolutionized our understanding of microbial ecosystems, these technologies generate data at depths that benefit from automated analysis. Here we present AXIOME (Automation, eXtension, and Integration Of Microbial Ecology), a highly flexible and extensible management tool for popular microbial ecology analysis packages that promotes reproducibility and customization in microbial research.

Findings

AXIOME streamlines and manages analysis of small subunit (SSU) rRNA marker data in QIIME and mothur. AXIOME also implements features including the PAired-eND Assembler for Illumina sequences (PANDAseq), non-negative matrix factorization (NMF), multi-response permutation procedures (MRPP), exploring and recovering phylogenetic novelty (SSUnique) and indicator species analysis. AXIOME has a companion graphical user interface (GUI) and is designed to be easily extended to facilitate customized research workflows.

Conclusions

AXIOME is an actively developed, open source project written in Vala and available from GitHub (http://neufeld.github.com/axiome) and as a Debian package. Axiometic, a GUI companion tool is also freely available (http://neufeld.github.com/axiometic). Given that data analysis has become an important bottleneck for microbial ecology studies, the development of user-friendly computational tools remains a high priority. AXIOME represents an important step in this direction by automating multi-step bioinformatic analyses and enabling the customization of procedures to suit the diverse research needs of the microbial ecology community.

Peer Review reports

Findings

Rationale

Next-generation sequencing technologies have improved our ability to study complex microbial communities, but have also posed significant computational challenges associated with analyzing such large sequence datasets. The research community has developed multiple analysis platforms [1–4] to manage analysis of taxonomic high-throughput sequencing data, particularly for the study of microbial small subunit (SSU) rRNA sequence data. As implemented, these pipelines require extensive user intervention and are not particularly well suited to extension. To address these issues, we developed the Automation, eXtension, and Integration Of Microbial Ecology (AXIOME) package and the associated graphical user interface, Axiometic. AXIOME simplifies analyses common to native installs of multiple analysis platforms by using XML scripting and configuration. Generating AXIOME’s XML input using Axiometic, the companion GUI, simplifies scripting and further increases usability. AXIOME also extends functionality by offering several additional analytical plug-ins and easily enables the implementation of user-specific functionality for customized workflows.

Functionality

Automation and checkpointing and reproducible research

Analysis environments, such as QIIME and mothur, have provided open source and effective tools for the analysis of high-throughput marker sequencing data (e.g., SSU rRNA). These environments are not easily automated beyond shell scripting, which is available for essentially any software installed on a Unix/Linux-based operating system. While effective, shell scripting can present a significant barrier to researchers using the software. AXIOME avoids this difficulty by interpreting commands from an XML-based input file containing simplified instructions and analysis blocks. This XML-based configuration file can be created manually, from workflow templates, or using the simple and interactive GUI tool, Axiometic.

Analysis pipelines for high-throughput marker data can consume many CPU hours due to dataset size and analysis complexity. Workflows can be interrupted for a myriad of reasons, including power failure and software error. Furthermore, analytical parameters can be modified or analyses added based on preliminary results. Built into AXIOME, using the make software package, is the ability to automatically restart a workflow from the last valid position, which does not unnecessarily reproduce previous valid results. This behavior can significantly reduce computational load and errors caused by excessive user intervention.

Efforts such as metadata standardization [5] and bioinformatic tools stressing reproducibility [6, 7] represent attempts to make bioinformatic workflows documented and reproducible, thus facilitating collaboration. The use of XML-based instructions defining an entire AXIOME workflow has the added benefit of contributing to these reproducible research initiatives. This is a useful addition to both individual researchers and to the collaboration of different investigators, and can be packaged with research publications.

Extension

AXIOME manages QIIME [2] analyses and supports sequence processing and α-diversity in mothur [1]. In addition to offering common α- and β-diversity measures, there are several functions specific to AXIOME v.1.6. AXIOME enables the assembly and de-multiplexing of Illumina paired-end reads through the use of PAired-eND Assembler for Illumina sequences (PANDAseq [8]). Post-assembly analysis techniques unique to AXIOME include (i) non-negative matrix factorization [9], a technique that identifies overlapping patterns between samples, generating a concordance model, that can then be used for a non-negative factorization of the sample matrix (used to visualize the importance of specific taxa within a sample or a cluster of samples), (ii) multi-response permutation procedures (MRPP [10]), which tests for significant differences between sampling groups and the degree of within-group sample clustering, (iii) recovering and exploring phylogenetic novelty (SSUnique [11]) and (iv) indicator species analysis [12], a method for identifying operational taxonomic units (OTUs) that are significantly associated with user-defined sample treatment groups. Future releases of AXIOME will continue to incorporate analysis techniques reflecting advances in the analysis of marker data in ecology.

One advantage of the AXIOME package is the ability to quickly extend functionality to include new protocols, easily customizing research workflows. This also provides the opportunity to test alternative approaches to sequence analysis before implementing them in standard distributions of software environments, such as QIIME or mothur. In AXIOME, individual analyses are managed through the corresponding XML tag within the configuration file, and custom XML tags that invoke novel analyses can be built into the source to extend AXIOME. Full instructions and templates for extension are provided with the source and documentation. By facilitating extension of analysis pipelines, the implementation of previously existing ecological methods and the development of novel techniques can progress at a faster rate than through standard release schedules. This will foster experimentation and increase community involvement in these efforts.

AXIOME workflow

All user-defined workflow analyses and parameters are outlined in a single XML configuration file, which is processed by AXIOME, generating a Makefile that controls and manages analyses. By leveraging these tools, an entire run of QIIME and all requested extensions requires only three steps (Figure 1). Additionally, any interruption in processing can be circumvented by re-running the make command, which will act as a checkpoint by restarting from the last valid position. Furthermore, a companion GUI, Axiometic (Figure 2), allows users to easily construct this XML configuration file. Even though AXIOME is designed to work within a Linux environment, the XML configuration file can be generated on any system and transferred to the analysis environment. Axiometic is based on a platform-independent toolkit, further facilitating XML script generation.

Figure 1
figure 1

Schematic representation of the AXIOME workflow and its relation to existing QIIME analyses.

Figure 2
figure 2

Axiometic, a multi-platform companion GUI for AXIOME with four steps defining: metadata associated with samples, the data source files, expressions for sorting samples within source file and the analyses for the AXIOME pipeline to run. The resulting XML control file is interpreted by AXIOME to run analyses. Axiometic is available for Linux, Windows and is in development for Mac OS X.

Distributed with the source is a sample analysis, including instructions, XML workflow script, data files and expected output. The workflow management of AXIOME fosters reproducible, predictable and automated analyses, which are challenging goals given the large sequence datasets now being generated. AXIOME adds to the expanding computational toolbox supporting the next generation of research efforts in microbial ecology.

Comparison to related work

The Galaxy project [7, 13, 14] is a web-based analysis management and distribution system for biomedical research. Currently, analysis of SSU rRNA marker data within Galaxy can be accomplished through a mothur v.1.27.0 [1] implementation. Additionally, a QIIME [2] wrapper (QIIME-Galaxy) is under development for Galaxy. Within Galaxy, these implementations are intended to provide a managed workflow, either locally or within the cloud, which will be a suitable solution for many researchers. Besides analysis techniques specific to AXIOME, our software offers some features not present in either Galaxy-associated packages. For example, AXIOME uses a package manager, greatly simplifying installation (apt-get install). Furthermore, AXIOME excels at local management and extension of marker gene workflows with modular XML scripting and checkpointing, allowing for rapid exploration of parameter and analysis modifications. When marker gene workflows are more fully integrated into Galaxy, we envision AXIOME as a complementary system for workflow management and extension. To actively contribute to the open source analysis community, we are in the process of contributing to Galaxy the various analysis routines specific to AXIOME (Figure 1).

Availability of AXIOME

AXIOME is an actively developed, open source project written in Vala and available from GitHub (http://neufeld.github.com/axiome) and also as a Debian package, serving as a companion to any native QIIME (v.1.4 and above) or mothur install. Specific details of the design and implementation of AXIOME are packaged with the source, including detailed explanations of tool development and the relationship between files in the repository. Axiometic, a GUI companion tool for easily generating AXIOME XML analysis instructions, is also freely available (http://neufeld.github.com/axiometic). AXIOME is compatible with the .biom universal data file format [15] and was designed to work within a Linux environment, including suitable cloud-computing infrastructures such as Amazon EC2. A comprehensive manual, dependencies list, tutorial and sample data are also provided.

Given that data analysis has become an important bottleneck for the effectiveness of microbial ecology studies, the development of user-friendly computational tools remains a high priority. AXIOME represents an important step in this direction by automating multi-step bioinformatic analyses and enabling the customization of procedures to suit the diverse research needs of the microbial ecology community.

Availability and requirements

Project name: AXIOME, Axiometic

Project home page: http://neufeld.github.com/axiome, http://neufeld.github.com/axiometic

Operating system: Linux (AXIOME), Platform independent (Axiometic)

Programming language: C, Vala, R, Python

Other requirements: QIIME (and dependencies therein), make, awk, mothur (optional), PANDAseq (optional); see documentation for a comprehensive list of optional dependencies, based on workflow requirements.

License: GPL v3

Any restrictions to use by non-academics: No

Abbreviations

AXIOME:

Automation, eXtension, and Integration Of Microbial Ecology

CPU:

Central processing unit

GUI:

Graphical user interface

MRPP:

Multi-response permutation procedures

NMF:

Non-negative matrix factorization

OTU:

Operational taxonomic unit

PANDAseq:

PAired-eND assembler for Illumina sequences

QIIME:

Quantitative insights into microbial ecology

SSU:

Small subunit

References

  1. Schloss PD, Westcott SL, Ryabin T, Hall JR, Hartmann M, Hollister EB, Lesniewski RA, Oakley BB, Parks DH, Robinson CJ, Sahl JW, Stres B, Thallinger GC, Van Horn DJ, Weber CF: Introducing mothur: open-source, platform-independent, community-supported software for describing and comparing microbial communities. Appl Environ Microbiol. 2009, 75: 7537-7541. 10.1128/AEM.01541-09.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Caporaso JG, Kuczynski J, Stombaugh J, Bittinger K, Bushman FD, Costello EK, Fierer N, Peña AG, Goodrich JK, Gordon JI, Huttley GA, Kelley ST, Knights D, Koenig JE, Ley RE, Lozupone CA, McDonald D, Muegge BD, Pirrung M, Reeder J, Sevinsky JR, Turnbaugh PJ, Walters WA, Widmann J, Yatsunenko T, Zaneveld J, Knight R: QIIME allows analysis of high-throughput community sequencing data. Nat Methods. 2010, 7: 335-336. 10.1038/nmeth.f.303.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Giongo A, Crabb DB, Davis-Richardson AG, Chauliac D, Mobberley JM, Gano KA, Mukherjee N, Casella G, Roesch LF, Walts B, Riva A, King G, Triplett EW: PANGEA: pipeline for analysis of next generation amplicons. ISME J. 2010, 4: 852-861. 10.1038/ismej.2010.16.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. McMurdie PJ, Holmes SP: phyloseq: A Bioconductor package for handling and analysis of high-throughput phylogenetic sequence data. Pac Symp Biocomput. 2012, 17: 235-246.

    Google Scholar 

  5. Yilmaz P, Kottmann R, Field D, Knight R, Cole JR, Amaral-Zettler L, Gilbert JA, Karsch-Mizrachi I, Johnston A, Cochrane G, Vaughan R, Hunter C, Park J, Morrison N, Rocca-Serra P, Sterk P, Arumugam M, Bailey M, Baumgartner L, Birren BW, Blaser MJ, Bonazzi V, Booth T, Bork P, Bushman FD, Buttigieg PL, Chain PS, Charlson E, Costello EK, Huot-Creasy H: Minimum information about a marker gene sequence (MIMARKS) and minimum information about any (x) sequence (MixS) specifications. Nat Biotechnol. 2011, 29: 415-420. 10.1038/nbt.1823.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Gentleman RC, Carey VJ, Bates DM, Bolstad B, Dettling M, Dudoit S, Ellis B, Gautier L, Ge Y, Gentry J, Hornik K, Hothorn T, Huber W, Iacus S, Irizarry R, Leisch F, Li C, Maechler M, Rossini AJ, Sawitzki G, Smith C, Smyth G, Tierney L, Yang JY, Zhang J: Bioconductor: open software development for computational biology and bioinformatics. Genome Biol. 2004, 5: R80-10.1186/gb-2004-5-10-r80.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Goecks J, Nekrutenko A, Taylor J, The Galaxy Team: Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences. Genome Biol. 2010, 11: R86-10.1186/gb-2010-11-8-r86.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Masella AP, Bartram AK, Truszkowski JM, Brown DG, Neufeld JD: PANDAseq: paired-end assembler for Illumina sequences. BMC Bioinformatics. 2012, 13: 31-10.1186/1471-2105-13-31.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Jiang X, Weitz JS, Dushoff J: A non-negative matrix factorization framework for identifying modular patterns in metagenomic profile data. J Math Biol. 2012, 64: 697-711. 10.1007/s00285-011-0428-2.

    Article  PubMed  Google Scholar 

  10. Mielke PW: Meteorological applications of permutation techniques based on distance functions. Handbook of Statistics, Volume 4: Nonparametric Methods. Edited by: Krishnaiah P, Sen P. 1984, Amsterdam: Elsevier, 813-830.

    Google Scholar 

  11. Lynch MDJ, Bartram AK, Neufeld JD: Targeted recovery of novel phylogenetic diversity from next-generation sequence data. ISME J. 2012, 6: 2067-2077. 10.1038/ismej.2012.50.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Dufrêne M, Legendre P: Species assemblages and indicator species: the need for a flexible asymmetrical approach. Ecol Monogr. 1997, 67: 345-366.

    Google Scholar 

  13. Blankenberg D, Von Kuster G, Coraor N, Ananda G, Lazarus R, Mangan M, Nekrutenko A, Taylor J: Galaxy: a web-based genome analysis tool for experimentalists. Curr Protoc Mol Biol. 2010, 89: 19.10.1-19.10.21.

    Google Scholar 

  14. Giardine B, Riemer C, Hardison RC, Burhans R, Elnitski L, Shah P, Zhang Y, Blankenberg D, Albert I, Taylor J, Miller W, Kent WJ, Nekrutenko A: Galaxy: a platform for interactive large-scale genome analysis. Genome Res. 2005, 15: 1451-1455. 10.1101/gr.4086505.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. McDonald M, Clemente JC, Kuczynski J, Rideout JR, Stombaugh J, Wendel D, Wilke A, Huse S, Hufnagle J, Meyer F, Knight R, Caporaso JG: The Biological Observation Matrix (BIOM) format or: how I learned to stop worrying and love the ome-ome. GigaScience. 2012, 1: 7-

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

This work was funded by the Canadian Institutes of Health Research (CIHR) and both Strategic Project and Discovery Grants from the Natural Sciences and Engineering Research Council of Canada (NSERC).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Josh D Neufeld.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

MDJL contributed to the design of AXIOME and manuscript preparation. APM designed and implemented AXIOME. MWH contributed to AXIOME and implemented Axiometic. AKB contributed to testing of AXIOME. JDN contributed to the design and coordination of the project, testing of AXIOME and manuscript preparation. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Lynch, M.D., Masella, A.P., Hall, M.W. et al. AXIOME: automated exploration of microbial diversity. GigaSci 2, 3 (2013). https://doi.org/10.1186/2047-217X-2-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/2047-217X-2-3

Keywords