Reproducibility is a crucial aspect of data analysis, particularly in the context of microbiome data. The ability to consistently replicate an analysis and obtain the same results is essential for ensuring the reliability of findings and facilitating scientific collaboration.
The dar
package includes two key functions, export_steps
and import_steps
, which promote reproducibility in microbiome data analysis. These functions allow you to export the steps of a recipe to a JSON file and then import those steps to reproduce the analysis in a different environment.
The export_steps
function facilitates the export of a recipe’s steps to a JSON file. This is useful for documenting and sharing the parameters used in the analysis.
Here’s an example of how to use the export_steps
function:
library(dar)
data(metaHIV_phy)
# Create a recipe with steps
rec <-
recipe(metaHIV_phy, "RiskGroup2", "Species") |>
step_subset_taxa(tax_level = "Kingdom", taxa = c("Bacteria", "Archaea")) |>
step_filter_taxa(.f = "function(x) sum(x > 0) >= (0.3 * length(x))") |>
step_maaslin()
# Export the steps to a JSON file
out_file <- tempfile(fileext = ".json")
export_steps(rec, out_file)
In this example, a recipe with multiple steps is created, and then the steps are exported to a JSON file using the export_steps
function.
The import_steps
function allows you to import steps from a JSON file and add them to an existing recipe. This is useful when you want to reuse a previously saved set of steps or incorporate steps from another recipe into your current analysis.
Here’s an example of how to use the import_steps
function:
# Initialize a recipe with a phyloseq object
rec <- recipe(metaHIV_phy, "RiskGroup2", "Species")
# Import the steps from a JSON file
json_file <- out_file
rec <- import_steps(rec, json_file)
rec
#> ── DAR Recipe ──────────────────────────────────────────────────────────────────
#> Inputs:
#>
#> ℹ phyloseq object with 451 taxa and 156 samples
#> ℹ variable of interes RiskGroup2 (class: character, levels: hts, msm, pwid)
#> ℹ taxonomic level Species
#>
#> Preporcessing steps:
#>
#> ◉ step_subset_taxa() id = subset_taxa__Fazuelos_Fijuelas_or_Deblas
#> ◉ step_filter_taxa() id = filter_taxa__Kroštule
#>
#> DA steps:
#>
#> ◉ step_maaslin() id = maaslin__Kroštule
In this example, an empty recipe is initialized, and then the steps are imported from a JSON file using the import_steps
function. The imported steps are added to the existing recipe.
Once the recipe is imported, we can choose to add more steps or execute the code using the prep
function. In this case, we choose to execute prep
directly.
## Execute
da_results <- prep(rec, parallel = FALSE) |> bake()
da_results
#> ── DAR Results ─────────────────────────────────────────────────────────────────
#> Inputs:
#>
#> ℹ phyloseq object with 101 taxa and 156 samples
#> ℹ variable of interes RiskGroup2 (class: character, levels: hts, msm, pwid)
#> ℹ taxonomic level Species
#>
#> Results:
#>
#> ✔ maaslin__Kroštule diff_taxa = 86
#>
#> ℹ 86 taxa are present in all tested methods
#>
#> Bakes:
#>
#> ◉ 1 -> count_cutoff: NULL, weights: NULL, exclude: NULL, id: bake__Pastry_heart
It’s important to note some limitations and considerations when using the export_steps
and import_steps
functions:
The JSON files generated by export_steps
only contain the parameters of the recipe steps and bakes, not the original data used in the analysis. Therefore, when importing the steps from a JSON file, ensure that you have access to the same data that was originally used.
The export_steps
and import_steps
functions are specific to the dar
package and are designed for use in microbiome data analysis. They are not applicable to other types of analyses or packages.
When importing steps from a JSON file, it’s important to check if the file contains “bake” steps. If so, the recipe will be automatically prepared after importing the steps. This may have implications for runtime and resource requirements of the analysis.
Make sure you have the correct versions of the dependencies of the dar
package when exporting and importing recipe steps. Updates in dependencies can affect the compatibility and reproducibility of the analyses.
Reproducibility is essential in microbiome data analysis, and the dar
package facilitates this aspect by providing the export_steps
and import_steps
functions. These functions allow you to export the steps of a recipe to a JSON file and then import them to reproduce the analysis in a different environment. With these tools, you can effectively document and share your analyses, increasing transparency and the reliability of your results.
devtools::session_info()
#> ─ Session info ───────────────────────────────────────────────────────────────
#> setting value
#> version R version 4.4.1 (2024-06-14)
#> os Ubuntu 24.04.1 LTS
#> system x86_64, linux-gnu
#> ui X11
#> language (EN)
#> collate C
#> ctype en_US.UTF-8
#> tz America/New_York
#> date 2024-10-29
#> pandoc 2.7.3 @ /usr/bin/ (via rmarkdown)
#>
#> ─ Packages ───────────────────────────────────────────────────────────────────
#> package * version date (UTC) lib source
#> abind 1.4-8 2024-09-12 [2] CRAN (R 4.4.1)
#> ade4 1.7-22 2023-02-06 [2] CRAN (R 4.4.1)
#> ape 5.8 2024-04-11 [2] CRAN (R 4.4.1)
#> archive 1.1.9 2024-09-12 [2] CRAN (R 4.4.1)
#> assertthat 0.2.1 2019-03-21 [2] CRAN (R 4.4.1)
#> backports 1.5.0 2024-05-23 [2] CRAN (R 4.4.1)
#> base64enc 0.1-3 2015-07-28 [2] CRAN (R 4.4.1)
#> beachmat 2.22.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> beeswarm 0.4.0 2021-06-01 [2] CRAN (R 4.4.1)
#> biglm 0.9-3 2024-06-12 [2] CRAN (R 4.4.1)
#> Biobase * 2.66.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> BiocGenerics * 0.52.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> BiocNeighbors 2.0.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> BiocParallel 1.40.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> BiocSingular 1.22.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> biomformat 1.34.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> Biostrings * 2.74.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> bit 4.5.0 2024-09-20 [2] CRAN (R 4.4.1)
#> bit64 4.5.2 2024-09-22 [2] CRAN (R 4.4.1)
#> bluster 1.16.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> boot 1.3-31 2024-08-28 [3] CRAN (R 4.4.1)
#> brio 1.1.5 2024-04-24 [2] CRAN (R 4.4.1)
#> bslib 0.8.0 2024-07-29 [2] CRAN (R 4.4.1)
#> ca 0.71.1 2020-01-24 [2] CRAN (R 4.4.1)
#> cachem 1.1.0 2024-05-16 [2] CRAN (R 4.4.1)
#> checkmate 2.3.2 2024-07-29 [2] CRAN (R 4.4.1)
#> cli 3.6.3 2024-06-21 [2] CRAN (R 4.4.1)
#> cluster 2.1.6 2023-12-01 [3] CRAN (R 4.4.1)
#> codetools 0.2-20 2024-03-31 [3] CRAN (R 4.4.1)
#> colorspace 2.1-1 2024-07-26 [2] CRAN (R 4.4.1)
#> crayon 1.5.3 2024-06-20 [2] CRAN (R 4.4.1)
#> crosstalk 1.2.1 2023-11-23 [2] CRAN (R 4.4.1)
#> dar * 1.2.0 2024-10-29 [1] Bioconductor 3.20 (R 4.4.1)
#> data.table 1.16.2 2024-10-10 [2] CRAN (R 4.4.1)
#> DBI 1.2.3 2024-06-02 [2] CRAN (R 4.4.1)
#> DECIPHER 3.2.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> decontam 1.26.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> DelayedArray 0.32.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> DelayedMatrixStats 1.28.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> dendextend 1.18.1 2024-10-13 [2] CRAN (R 4.4.1)
#> DEoptimR 1.1-3 2023-10-07 [2] CRAN (R 4.4.1)
#> devtools 2.4.5 2022-10-11 [2] CRAN (R 4.4.1)
#> digest 0.6.37 2024-08-19 [2] CRAN (R 4.4.1)
#> DirichletMultinomial 1.48.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> dplyr 1.1.4 2023-11-17 [2] CRAN (R 4.4.1)
#> ellipsis 0.3.2 2021-04-29 [2] CRAN (R 4.4.1)
#> evaluate 1.0.1 2024-10-10 [2] CRAN (R 4.4.1)
#> fansi 1.0.6 2023-12-08 [2] CRAN (R 4.4.1)
#> farver 2.1.2 2024-05-13 [2] CRAN (R 4.4.1)
#> fastmap 1.2.0 2024-05-15 [2] CRAN (R 4.4.1)
#> foreach 1.5.2 2022-02-02 [2] CRAN (R 4.4.1)
#> foreign 0.8-87 2024-06-26 [3] CRAN (R 4.4.1)
#> Formula 1.2-5 2023-02-24 [2] CRAN (R 4.4.1)
#> fs 1.6.4 2024-04-25 [2] CRAN (R 4.4.1)
#> furrr 0.3.1 2022-08-15 [2] CRAN (R 4.4.1)
#> future 1.34.0 2024-07-29 [2] CRAN (R 4.4.1)
#> generics 0.1.3 2022-07-05 [2] CRAN (R 4.4.1)
#> GenomeInfoDb * 1.42.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> GenomeInfoDbData 1.2.13 2024-10-01 [2] Bioconductor
#> GenomicRanges * 1.58.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> getopt 1.20.4 2023-10-01 [2] CRAN (R 4.4.1)
#> ggbeeswarm 0.7.2 2023-04-29 [2] CRAN (R 4.4.1)
#> ggplot2 3.5.1 2024-04-23 [2] CRAN (R 4.4.1)
#> ggrepel 0.9.6 2024-09-07 [2] CRAN (R 4.4.1)
#> globals 0.16.3 2024-03-08 [2] CRAN (R 4.4.1)
#> glue 1.8.0 2024-09-30 [2] CRAN (R 4.4.1)
#> gridExtra 2.3 2017-09-09 [2] CRAN (R 4.4.1)
#> gtable 0.3.6 2024-10-25 [2] CRAN (R 4.4.1)
#> hash 2.2.6.3 2023-08-19 [2] CRAN (R 4.4.1)
#> heatmaply 1.5.0 2023-10-06 [2] CRAN (R 4.4.1)
#> highr 0.11 2024-05-26 [2] CRAN (R 4.4.1)
#> Hmisc 5.2-0 2024-10-28 [2] CRAN (R 4.4.1)
#> hms 1.1.3 2023-03-21 [2] CRAN (R 4.4.1)
#> htmlTable 2.4.3 2024-07-21 [2] CRAN (R 4.4.1)
#> htmltools 0.5.8.1 2024-04-04 [2] CRAN (R 4.4.1)
#> htmlwidgets 1.6.4 2023-12-06 [2] CRAN (R 4.4.1)
#> httpuv 1.6.15 2024-03-26 [2] CRAN (R 4.4.1)
#> httr 1.4.7 2023-08-15 [2] CRAN (R 4.4.1)
#> igraph 2.1.1 2024-10-19 [2] CRAN (R 4.4.1)
#> IRanges * 2.40.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> irlba 2.3.5.1 2022-10-03 [2] CRAN (R 4.4.1)
#> iterators 1.0.14 2022-02-05 [2] CRAN (R 4.4.1)
#> jquerylib 0.1.4 2021-04-26 [2] CRAN (R 4.4.1)
#> jsonlite 1.8.9 2024-09-20 [2] CRAN (R 4.4.1)
#> knitr 1.48 2024-07-07 [2] CRAN (R 4.4.1)
#> labeling 0.4.3 2023-08-29 [2] CRAN (R 4.4.1)
#> later 1.3.2 2023-12-06 [2] CRAN (R 4.4.1)
#> lattice 0.22-6 2024-03-20 [3] CRAN (R 4.4.1)
#> lazyeval 0.2.2 2019-03-15 [2] CRAN (R 4.4.1)
#> lifecycle 1.0.4 2023-11-07 [2] CRAN (R 4.4.1)
#> listenv 0.9.1 2024-01-29 [2] CRAN (R 4.4.1)
#> lme4 1.1-35.5 2024-07-03 [2] CRAN (R 4.4.1)
#> logging 0.10-108 2019-07-14 [2] CRAN (R 4.4.1)
#> lpSolve 5.6.21 2024-09-12 [2] CRAN (R 4.4.1)
#> Maaslin2 1.20.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> magrittr 2.0.3 2022-03-30 [2] CRAN (R 4.4.1)
#> MASS 7.3-61 2024-06-13 [3] CRAN (R 4.4.1)
#> Matrix 1.7-1 2024-10-18 [3] CRAN (R 4.4.1)
#> MatrixGenerics * 1.18.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> matrixStats * 1.4.1 2024-09-08 [2] CRAN (R 4.4.1)
#> mediation 4.5.0 2019-10-08 [2] CRAN (R 4.4.1)
#> memoise 2.0.1 2021-11-26 [2] CRAN (R 4.4.1)
#> mgcv 1.9-1 2023-12-21 [3] CRAN (R 4.4.1)
#> mia * 1.14.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> microbiome 1.28.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> mime 0.12 2021-09-28 [2] CRAN (R 4.4.1)
#> miniUI 0.1.1.1 2018-05-18 [2] CRAN (R 4.4.1)
#> minqa 1.2.8 2024-08-17 [2] CRAN (R 4.4.1)
#> MultiAssayExperiment * 1.32.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> multtest 2.62.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> munsell 0.5.1 2024-04-01 [2] CRAN (R 4.4.1)
#> mvtnorm 1.3-1 2024-09-03 [2] CRAN (R 4.4.1)
#> nlme 3.1-166 2024-08-14 [3] CRAN (R 4.4.1)
#> nloptr 2.1.1 2024-06-25 [2] CRAN (R 4.4.1)
#> nnet 7.3-19 2023-05-03 [3] CRAN (R 4.4.1)
#> optparse 1.7.5 2024-04-16 [2] CRAN (R 4.4.1)
#> parallelly 1.38.0 2024-07-27 [2] CRAN (R 4.4.1)
#> pbapply 1.7-2 2023-06-27 [2] CRAN (R 4.4.1)
#> pcaPP 2.0-5 2024-08-19 [2] CRAN (R 4.4.1)
#> permute 0.9-7 2022-01-27 [2] CRAN (R 4.4.1)
#> phyloseq * 1.50.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> pillar 1.9.0 2023-03-22 [2] CRAN (R 4.4.1)
#> pkgbuild 1.4.5 2024-10-28 [2] CRAN (R 4.4.1)
#> pkgconfig 2.0.3 2019-09-22 [2] CRAN (R 4.4.1)
#> pkgload 1.4.0 2024-06-28 [2] CRAN (R 4.4.1)
#> plotly 4.10.4 2024-01-13 [2] CRAN (R 4.4.1)
#> plyr 1.8.9 2023-10-02 [2] CRAN (R 4.4.1)
#> profvis 0.4.0 2024-09-20 [2] CRAN (R 4.4.1)
#> promises 1.3.0 2024-04-05 [2] CRAN (R 4.4.1)
#> purrr 1.0.2 2023-08-10 [2] CRAN (R 4.4.1)
#> R6 2.5.1 2021-08-19 [2] CRAN (R 4.4.1)
#> rbiom 1.0.3 2021-11-05 [2] CRAN (R 4.4.1)
#> RColorBrewer 1.1-3 2022-04-03 [2] CRAN (R 4.4.1)
#> Rcpp 1.0.13 2024-07-17 [2] CRAN (R 4.4.1)
#> RcppParallel 5.1.9 2024-08-19 [2] CRAN (R 4.4.1)
#> readr 2.1.5 2024-01-10 [2] CRAN (R 4.4.1)
#> registry 0.5-1 2019-03-05 [2] CRAN (R 4.4.1)
#> remotes 2.5.0 2024-03-17 [2] CRAN (R 4.4.1)
#> reshape2 1.4.4 2020-04-09 [2] CRAN (R 4.4.1)
#> rhdf5 2.50.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> rhdf5filters 1.18.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> Rhdf5lib 1.28.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> rlang 1.1.4 2024-06-04 [2] CRAN (R 4.4.1)
#> rmarkdown 2.28 2024-08-17 [2] CRAN (R 4.4.1)
#> robustbase 0.99-4-1 2024-09-27 [2] CRAN (R 4.4.1)
#> rpart 4.1.23 2023-12-05 [3] CRAN (R 4.4.1)
#> rstudioapi 0.17.1 2024-10-22 [2] CRAN (R 4.4.1)
#> rsvd 1.0.5 2021-04-16 [2] CRAN (R 4.4.1)
#> Rtsne 0.17 2023-12-07 [2] CRAN (R 4.4.1)
#> S4Arrays 1.6.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> S4Vectors * 0.44.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> sandwich 3.1-1 2024-09-15 [2] CRAN (R 4.4.1)
#> sass 0.4.9 2024-03-15 [2] CRAN (R 4.4.1)
#> ScaledMatrix 1.14.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> scales 1.3.0 2023-11-28 [2] CRAN (R 4.4.1)
#> scater 1.34.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> scuttle 1.16.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> seriation 1.5.6 2024-08-19 [2] CRAN (R 4.4.1)
#> sessioninfo 1.2.2 2021-12-06 [2] CRAN (R 4.4.1)
#> shiny 1.9.1 2024-08-01 [2] CRAN (R 4.4.1)
#> SingleCellExperiment * 1.28.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> slam 0.1-54 2024-10-15 [2] CRAN (R 4.4.1)
#> SparseArray 1.6.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> sparseMatrixStats 1.18.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> stringi 1.8.4 2024-05-06 [2] CRAN (R 4.4.1)
#> stringr 1.5.1 2023-11-14 [2] CRAN (R 4.4.1)
#> SummarizedExperiment * 1.36.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> survival 3.7-0 2024-06-05 [3] CRAN (R 4.4.1)
#> testthat 3.2.1.1 2024-04-14 [2] CRAN (R 4.4.1)
#> tibble 3.2.1 2023-03-20 [2] CRAN (R 4.4.1)
#> tidyr 1.3.1 2024-01-24 [2] CRAN (R 4.4.1)
#> tidyselect 1.2.1 2024-03-11 [2] CRAN (R 4.4.1)
#> tidytree 0.4.6 2023-12-12 [2] CRAN (R 4.4.1)
#> treeio 1.30.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> TreeSummarizedExperiment * 2.14.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> TSP 1.2-4 2023-04-04 [2] CRAN (R 4.4.1)
#> tzdb 0.4.0 2023-05-12 [2] CRAN (R 4.4.1)
#> UCSC.utils 1.2.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> UpSetR 1.4.0 2019-05-22 [2] CRAN (R 4.4.1)
#> urlchecker 1.0.1 2021-11-30 [2] CRAN (R 4.4.1)
#> usethis 3.0.0 2024-07-29 [2] CRAN (R 4.4.1)
#> utf8 1.2.4 2023-10-22 [2] CRAN (R 4.4.1)
#> vctrs 0.6.5 2023-12-01 [2] CRAN (R 4.4.1)
#> vegan 2.6-8 2024-08-28 [2] CRAN (R 4.4.1)
#> vipor 0.4.7 2023-12-18 [2] CRAN (R 4.4.1)
#> viridis 0.6.5 2024-01-29 [2] CRAN (R 4.4.1)
#> viridisLite 0.4.2 2023-05-02 [2] CRAN (R 4.4.1)
#> vroom 1.6.5 2023-12-05 [2] CRAN (R 4.4.1)
#> webshot 0.5.5 2023-06-26 [2] CRAN (R 4.4.1)
#> withr 3.0.2 2024-10-28 [2] CRAN (R 4.4.1)
#> xfun 0.48 2024-10-03 [2] CRAN (R 4.4.1)
#> xtable 1.8-4 2019-04-21 [2] CRAN (R 4.4.1)
#> XVector * 0.46.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> yaml 2.3.10 2024-07-26 [2] CRAN (R 4.4.1)
#> yulab.utils 0.1.7 2024-08-26 [2] CRAN (R 4.4.1)
#> zlibbioc 1.52.0 2024-10-29 [2] Bioconductor 3.20 (R 4.4.1)
#> zoo 1.8-12 2023-04-13 [2] CRAN (R 4.4.1)
#>
#> [1] /home/biocbuild/bbs-3.20-bioc/tmpdir/RtmpyY1G1u/Rinst3c69f426b4186b
#> [2] /home/biocbuild/bbs-3.20-bioc/R/site-library
#> [3] /home/biocbuild/bbs-3.20-bioc/R/library
#>
#> ──────────────────────────────────────────────────────────────────────────────