Overview of the condiments workflow
Hector Roux de Bézieux
19 May , 2021
Initial pre-processing
Generating a synthetic dataset
We will use a synthetic dataset to illustrate the functionalities of the condiments package. We start directly with a dataset where the following steps are assumed to have been run:
- Obtaining count matrices for each setting (i.e. each condition).
- Integration and normalization between the conditions.
- Reduced Dimension Estimations
- (Clustering)
# For analysis
library(condiments)
library(slingshot)
# For data manipulation
library(dplyr)
library(tidyr)
# For visualization
library(ggplot2)
library(RColorBrewer)
library(viridis)
set.seed(2071)
theme_set(theme_classic())data("toy_dataset", package = "condiments")
df <- toy_dataset$sdAs such, we start with a matrix df of metadata for the cells: coordinates in a reduced dimension space (Dim1, Dim2), a vector of conditions assignments conditions (A or B) and a lineage assignment.
Vizualisation
We can first plot the cells on the reduced dimensions
p <- ggplot(df, aes(x = Dim1, y = Dim2, col = conditions)) +
geom_point() +
scale_color_brewer(type = "qual")
p
We can also visualize the underlying skeleton structure of the two conditions.
p <- ggplot(df, aes(x = Dim1, y = Dim2, col = conditions)) +
geom_point(alpha = .5) +
geom_point(data = toy_dataset$mst, size = 2) +
geom_path(data = toy_dataset$mst, aes(group = lineages), size = 1.5) +
scale_color_brewer(type = "qual") +
facet_wrap(~conditions) +
guides(col = FALSE)
p
Differential Topology
Exploratory analysis
We can then compute the imbalance score of each cell using the imbalance_score function.
scores <- imbalance_score(Object = df %>% select(Dim1, Dim2) %>% as.matrix(),
conditions = df$conditions)
df$scores <- scores$scores
df$scaled_scores <- scores$scaled_scoresThere are two types of scores. The raw score is computed on each cell and looks at the condition distribution of its neighbors compared the the overall distribution. The size of the neighborhood can be set using the k argument, which specify the number of neighbors to consider. Higher values means more local imbalance.
ggplot(df, aes(x = Dim1, y = Dim2, col = scores)) +
geom_point() +
scale_color_viridis_c(option = "C")
The local scores are quite noisy so we can then use local smoothers to smooth the scores of individual cells. The smoothness is dictated by the smooth argument. Those smoothed scores were also computed using the imbalance_score function.
ggplot(df, aes(x = Dim1, y = Dim2, col = scaled_scores)) +
geom_point() +
scale_color_viridis_c(option = "C")
As could be guessed from the original plot, the bottom lineage shows a lot of imbalance while the top one does not. The imbalance score can be used to check: + If the integration has been successful. In general, some regions should be balanced + To identify the regions of imbalance for further analyses.
Trajectory Inference
The first step of our workflow is to decide whether or not to infer the trajectories separately or not. On average, it is better to infer a common trajectory, since a) this allow for a wider range of downstream analyses, and b) more cells are used to estimate the trajectory. However, the condition effect might be strong enough to massively disrupt the differentiation process, which would require fitting separate trajectories.
slingshot(Street et al. 2018) relies on a reduced dimensionality reduction representation of the data, as well as on cluster labels. We can visualize those below:
ggplot(df, aes(x = Dim1, y = Dim2, col = cl)) +
geom_point()
The topologyTest assess the quality of the common trajectory inference done by slingshot and test whether we should fit a common or separate trajectory. This test relies on repeated permutations of the conditions followed by trajectory inference so it can take a few seconds.
rd <- as.matrix(df[, c("Dim1", "Dim2")])
sds <- slingshot(rd, df$cl)
## Takes ~1m30s to run
top_res <- topologyTest(sds = sds, conditions = df$conditions)## Generating permuted trajectories## Running KS-mean testknitr::kable(top_res)| method | thresh | statistic | p.value |
|---|---|---|---|
| KS_mean | 0.01 | 0 | 1 |
The test clearly fails to reject the null that we can fit a common trajectory so we can continue with the sds object. This will facilitate downstream analysis. For an example of how to proceed if the topologyTest reject the null, we invite the user to refer to relevant case study used in our paper.
We can thus visualize the trajectory
ggplot(df, aes(x = Dim1, y = Dim2, col = cl)) +
geom_point() +
geom_path(data = slingCurves(sds, as.df = TRUE) %>% arrange(Order),
aes(group = Lineage), col = "black", size = 2)
Differential Progression
Even though we can fit a common trajectory, it does not mean that the cells will differentiate similarly between the conditions. The first question we can ask is: for a given lineage, are cells equally represented along pseudotime between conditions?
psts <- slingPseudotime(sds) %>%
as.data.frame() %>%
mutate(cells = rownames(.),
conditions = df$conditions) %>%
pivot_longer(starts_with("Lineage"), values_to = "pseudotime", names_to = "lineages")Visualization
ggplot(psts, aes(x = pseudotime, fill = conditions)) +
geom_density(alpha = .5) +
scale_fill_brewer(type = "qual") +
facet_wrap(~lineages) +
theme(legend.position = "bottom")
The pseudotime distributions are identical across conditions for the first lineage but there are clear differences between the two conditions in the second lineage.
Testing for differential progression
To test for differential progression, we use the progressionTest. The test can be run with global = TRUE to test when pooling all lineages, or lineages = TRUE to test every lineage independently, or both. Several tests are implemented in the progressionTest. function. Here, we will use the default, the custom KS test (Smirnov 1939).
prog_res <- progressionTest(sds, conditions = df$conditions, global = TRUE, lineages = TRUE)
knitr::kable(prog_res)| lineage | statistic | p.value |
|---|---|---|
| All | 5.5063660 | 0.0000000 |
| 1 | 0.0343831 | 0.9940762 |
| 2 | 0.4699371 | 0.0000000 |
As expected, there is a global difference over all lineages, which is driven by differences of distribution across lineage 2 (i.e. the bottom one).
Differential differentiation
Even though we can fit a common trajectory, it does not mean that the cells will differentiate similarly between the conditions. The first question we can ask is: for a given lineage, are cells equally between the two lineages for the two conditions?
Vizualisation
Visualizing differences 2D distributions can be somewhat tricky. However, it is important to note that the sum of all lineage weights should sum to 1. As such, we can only plot the weights for the first lineage.
df$weight_1 <- slingCurveWeights(sds, as.probs = TRUE)[, 1]
ggplot(df, aes(x = weight_1, fill = conditions)) +
geom_density(alpha = .5) +
scale_fill_brewer(type = "qual") +
labs(x = "Curve weight for the first lineage")
The distribution has tri modes, which is very often the case for two lineages: + A weight around 0 represent a cell that is mostly assigned to the other lineage (i.e. lineage 2 here) + A weight around .5 represent a cell that is equally assigned to both lineages, i.e. before the bifurcation. + A weight around 1 represent a cell that is mostly assigned to this lineage (i.e. lineage 1 here)
In condition A, we have many more cells with a weight of 0 and, since those are density plots, fewer cells with weights around .5 and 1. Visually, we can guess that cells in condition B differentiate preferentially along lineage 1.
Testing for differential differentiation
To test for differential differentiation, we use the differentiationTest. The test can be run with global = TRUE to test when pooling all pairs of lineages, or pairwise = TRUE to test every pair independently, or both. Here, there is only one pair so the options are equivalent. Several tests are implemented in the differentiationTest. function. Here, we will use the default, the classifier test(Lopez-Paz and Oquab 2016).
set.seed(12)
dif_res <- differentiationTest(sds, conditions = df$conditions, global = FALSE, pairwise = TRUE)## note: only 1 unique complexity parameters in default grid. Truncating the grid to 1 .## Loading required package: lattice## note: only 1 unique complexity parameters in default grid. Truncating the grid to 1 .knitr::kable(dif_res)| pair | statistic | p.value |
|---|---|---|
| 1vs2 | 0.6476577 | 5.6e-06 |
As could be guessed from the plot, we have clear differential differentiation.
Differential Expression
The workflow above focus on global differences, looking at broad patterns of differentiation. While this is a necessary first step, gene-level information is also quite meaningful.
To do so requires tradeSeq(Van den Berge et al. 2020) > 1.3.0. Considering that we have a count matrix counts, the basic workflow is:s
library(tradeSeq)
sce <- fitGAM(counts = counts, sds = sds, conditions = df$conditions)
cond_genes <- conditionTest(sds)For more details on fitting the smoothers, we refer users to the tradeSeq website and to the accompanying Bioconductor workshop.
Conclusion
For both of the above procedures, it is important to note that we are making multiple comparisons (in this case, 5). The p-values we obtain from these tests should be corrected for multiple testing, especially for trajectories with a large number of lineages.
That said, trajectory inference is often one of the last computational methods in a very long analysis pipeline (generally including gene-level quantification, gene filtering / feature selection, and dimensionality reduction). Hence, we strongly discourage the reader from putting too much faith in any p-value that comes out of this analysis. Such values may be useful suggestions, indicating particular features or cells for follow-up study, but should generally not be treated as meaningful statistical quantities.
Session Info
sessionInfo()## R version 4.1.0 RC (2021-05-10 r80283)
## Platform: x86_64-w64-mingw32/x64 (64-bit)
## Running under: Windows Server x64 (build 17763)
##
## Matrix products: default
##
## locale:
## [1] LC_COLLATE=C
## [2] LC_CTYPE=English_United States.1252
## [3] LC_MONETARY=English_United States.1252
## [4] LC_NUMERIC=C
## [5] LC_TIME=English_United States.1252
##
## attached base packages:
## [1] parallel stats4 stats graphics grDevices utils datasets
## [8] methods base
##
## other attached packages:
## [1] caret_6.0-88 lattice_0.20-44
## [3] viridis_0.6.1 viridisLite_0.4.0
## [5] RColorBrewer_1.1-2 ggplot2_3.3.3
## [7] tidyr_1.1.3 dplyr_1.0.6
## [9] slingshot_2.0.0 TrajectoryUtils_1.0.0
## [11] SingleCellExperiment_1.14.0 SummarizedExperiment_1.22.0
## [13] Biobase_2.52.0 GenomicRanges_1.44.0
## [15] GenomeInfoDb_1.28.0 IRanges_2.26.0
## [17] S4Vectors_0.30.0 BiocGenerics_0.38.0
## [19] MatrixGenerics_1.4.0 matrixStats_0.58.0
## [21] princurve_2.1.6 condiments_1.0.0
## [23] knitr_1.33
##
## loaded via a namespace (and not attached):
## [1] colorspace_2.0-1 deldir_0.2-10
## [3] ellipsis_0.3.2 class_7.3-19
## [5] XVector_0.32.0 proxy_0.4-25
## [7] spatstat.data_2.1-0 farver_2.1.0
## [9] prodlim_2019.11.13 fansi_0.4.2
## [11] lubridate_1.7.10 sparseMatrixStats_1.4.0
## [13] codetools_0.2-18 splines_4.1.0
## [15] polyclip_1.10-0 jsonlite_1.7.2
## [17] pROC_1.17.0.1 kernlab_0.9-29
## [19] spatstat.linnet_2.1-1 spatstat.sparse_2.0-0
## [21] compiler_4.1.0 assertthat_0.2.1
## [23] Matrix_1.3-3 htmltools_0.5.1.1
## [25] tools_4.1.0 igraph_1.2.6
## [27] gtable_0.3.0 glue_1.4.2
## [29] GenomeInfoDbData_1.2.6 RANN_2.6.1
## [31] reshape2_1.4.4 Rcpp_1.0.6
## [33] spatstat_2.1-0 jquerylib_0.1.4
## [35] vctrs_0.3.8 nlme_3.1-152
## [37] DelayedMatrixStats_1.14.0 iterators_1.0.13
## [39] timeDate_3043.102 gower_0.2.2
## [41] xfun_0.23 stringr_1.4.0
## [43] Ecume_0.9.1 lifecycle_1.0.0
## [45] goftest_1.2-2 zlibbioc_1.38.0
## [47] MASS_7.3-54 scales_1.1.1
## [49] ipred_0.9-11 spatstat.core_2.1-2
## [51] spatstat.utils_2.1-0 yaml_2.2.1
## [53] gridExtra_2.3 pbapply_1.4-3
## [55] sass_0.4.0 rpart_4.1-15
## [57] stringi_1.6.2 highr_0.9
## [59] randomForest_4.6-14 foreach_1.5.1
## [61] e1071_1.7-6 BiocParallel_1.26.0
## [63] lava_1.6.9 rlang_0.4.11
## [65] pkgconfig_2.0.3 bitops_1.0-7
## [67] evaluate_0.14 purrr_0.3.4
## [69] tensor_1.5 labeling_0.4.2
## [71] recipes_0.1.16 transport_0.12-2
## [73] tidyselect_1.1.1 plyr_1.8.6
## [75] magrittr_2.0.1 R6_2.5.0
## [77] generics_0.1.0 DelayedArray_0.18.0
## [79] DBI_1.1.1 pillar_1.6.1
## [81] withr_2.4.2 mgcv_1.8-35
## [83] survival_3.2-11 abind_1.4-5
## [85] RCurl_1.98-1.3 nnet_7.3-16
## [87] tibble_3.1.2 crayon_1.4.1
## [89] utf8_1.2.1 spatstat.geom_2.1-0
## [91] rmarkdown_2.8 grid_4.1.0
## [93] data.table_1.14.0 ModelMetrics_1.2.2.2
## [95] digest_0.6.27 munsell_0.5.0
## [97] bslib_0.2.5.1References
Lopez-Paz, David, and Maxime Oquab. 2016. “Revisiting Classifier Two-Sample Tests.” Arxiv, October, 1–15. http://arxiv.org/abs/1610.06545.
Smirnov, Nikolai V. 1939. “On the Estimation of the Discrepancy Between Empirical Curves of Distribution for Two Independent Samples.” Bull. Math. Univ. Moscou 2 (2): 3–14.
Street, Kelly, Davide Risso, Russell B. Fletcher, Diya Das, John Ngai, Nir Yosef, Elizabeth Purdom, and Sandrine Dudoit. 2018. “Slingshot: cell lineage and pseudotime inference for single-cell transcriptomics.” BMC Genomics 19 (1): 477. https://doi.org/10.1186/s12864-018-4772-0.
Van den Berge, Koen, Hector Roux de Bézieux, Kelly Street, Wouter Saelens, Robrecht Cannoodt, Yvan Saeys, Sandrine Dudoit, and Lieven Clement. 2020. “Trajectory-based differential expression analysis for single-cell sequencing data.” Nature Communications 11 (1): 1201. https://doi.org/10.1038/s41467-020-14766-3.