Filter, Plot and Explore Single-cell RNA-seq Data
Author(s) | Wendi Bacon |
Editor(s) | Helena Rasche |
Tester(s) | Julia Jakiela |
OverviewQuestions:Objectives:
Is my single cell dataset a quality dataset?
How do I generate and annotate cell clusters?
How do I pick thresholds and parameters in my analysis? What’s a “reasonable” number, and will the world collapse if I pick the wrong one?
Requirements:
Interpret quality control plots to direct parameter decisions
Repeat analysis from matrix to clustering
Identify decision-making points
Appraise data outputs and decisions
Explain why single cell analysis is an iterative (i.e. the first plots you generate are not final, but rather you go back and re-analyse your data repeatedly) process
- Introduction to Galaxy Analyses
- Sequence analysis
- Quality Control: slides slides - tutorial hands-on
- Mapping: slides slides - tutorial hands-on
- Transcriptomics
- Generating a single cell matrix using Alevin: tutorial hands-on
- Combining datasets after pre-processing: tutorial hands-on
Time estimation: 3 hoursSupporting Materials:Last modification: Oct 18, 2022
Introduction
You’ve done all the work to make a single cell matrix, with gene counts and mitochondrial counts and buckets of cell metadata from all your variables of interest. Now it’s time to fully process our data, to remove low quality cells, to reduce the many dimensions of data that make it difficult to work with, and ultimately to try to define our clusters and to find our biological meaning and insights! There are many packages for analysing single cell data - Seurat Satija et al. 2015, Scanpy Wolf et al. 2018, Monocle Trapnell et al. 2014, Scater McCarthy et al. 2017, and so forth. We’re working with Scanpy, because currently Galaxy hosts the most Scanpy tools of all of those options.
Comment: Tutorials everywhere?This tutorial is similar to another fantastic tutorial: Clustering 3k PBMC. That tutorial will go into much further depth on the analysis, in particular the visualisation and science behind identifying marker genes. Their experimental data is clean and well annotated, which illustrates the steps beautifully. Here, we work more as a case study with messier data, to help empower you in making choices during the analysis. We highly recommend you work through all the galaxy single cell tutorials to build confidence and expertise! For trainers, note that there are small-group options in this tutorial.
AgendaIn this tutorial, we will cover:
Get data
We’ve provided you with experimental data to analyse from a mouse dataset of fetal growth restriction Bacon et al. 2018. This is the full dataset generated from this tutorial if you used the full FASTQ files rather than the subsampled ones (see the study in Single Cell Expression Atlas here and the project submission here). You can find this dataset in this input history or download from Zenodo below.
Hands-on: Data upload
- Create a new history for this tutorial
Import the AnnData object from Zenodo
https://zenodo.org/record/7053673/files/Mito-counted_AnnData
- Copy the link location
Open the Galaxy Upload Manager (galaxy-upload on the top-right of the tool panel)
- Select Paste/Fetch Data
Paste the link into the text field
Press Start
- Close the window
- Rename galaxy-pencil the datasets
Mito-counted AnnData
Check that the datatype is
h5ad
- Click on the galaxy-pencil pencil icon for the dataset to edit its attributes
- In the central panel, click on the galaxy-chart-select-data Datatypes tab on the top
- Select
h5ad
- tip: you can start typing the datatype into the field to filter the dropdown menu
- Click the Save button
Filtering
You have generated an annotated AnnData object from your raw scRNA-seq fastq files. However, you have only completed a ‘rough’ filter of your dataset - there will still be a number of ‘cells’ that are actually just background from empty droplets or simply low-quality. There will also be genes that could be sequencing artifacts or that appear with such low frequency that statistical tools will fail to analyse them. This background garbage of both cells and genes not only makes it harder to distinguish real biological information from the noise, but also makes it computationally heavy to analyse. These spurious reads take a lot of computational power to analyse! First on our agenda is to filter this matrix to give us cleaner data to extract meaningful insight from, and to allow faster analysis.
Tools are frequently updated to new versions. Your Galaxy may have multiple versions of the same tool available. By default, you will be shown the latest version of the tool. This may NOT be the same tool used in the tutorial you are accessing. Furthermore, if you use a newer tool in one step, and try using an older tool in the next step… this may fail! To ensure you use the same tool versions of a given tutorial, use the Tutorial mode feature.
- Open your Galaxy server
- Click on the curriculum icon on the top menu, this will open the GTN inside Galaxy.
- Navigate to your tutorial
- Tool names in tutorials will be blue buttons that open the correct tool for you
- Note: this does not work for all tutorials (yet)
- You can click anywhere in the grey-ed out area outside of the tutorial box to return back to the Galaxy analytical interface
Question
- What information is stored in your AnnData object? The last tool to generate this object counted the mitochondrial associated genes in your matrix. Where is that data stored?
- While you are figuring that out, how many genes and cells are in your object?
You want to use the same tool you used in the previous tutorial to examine your AnnData, since it’s not necessarily as simple as examining the Anndata dataset in the history!
Hands-on: Inspecting AnnData Objects
- Inspect AnnData Tool: toolshed.g2.bx.psu.edu/repos/iuc/anndata_inspect/anndata_inspect/0.7.5+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
Mito-counted AnnData
- “What to inspect?”:
General information about the object
- Inspect AnnData Tool: toolshed.g2.bx.psu.edu/repos/iuc/anndata_inspect/anndata_inspect/0.7.5+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
Mito-counted AnnData
- “What to inspect?”:
Key-indexed observations annotation (obs)
- Inspect AnnData Tool: toolshed.g2.bx.psu.edu/repos/iuc/anndata_inspect/anndata_inspect/0.7.5+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
Mito-counted AnnData
- “What to inspect?”:
Key-indexed annotation of variables/features (var)
- If you examine your AnnData object, you’ll find a number of different quality control metrics for both cells tool obs and tool genes var.
- For instance, you can see a
n_cells
under var, which counts the number of cells that gene appears in.- In the obs, you have both discrete and log-based metrics for
n_genes
, how many genes are counted in a cell, andn_counts
, how many UMIs are counted per cell. So, for instance, you might count multiple GAPDHs in a cell. Yourn_counts
should thus be higher thann_genes
.- But what about the mitochondria?? Within the cells information obs, the
total_counts_mito
,log1p_total_counts_mito
, andpct_counts_mito
has been calculated for each cell.- You can see in the tool General information about the object output that the matrix is
31178 x 35734
. This isobs x vars
, or rather,cells x genes
, so there are31178 cells
and35734 genes
in the matrix.
time Top time-saving advice - turn the 3 Inspect AnnData outputs above into a workflow for quick access!
Clean up your history: remove any failed (red) jobs from your history by clicking on the galaxy-cross button.
This will make the creation of the workflow easier.
Click on galaxy-gear (History options) at the top of your history panel and select Extract workflow.
The central panel will show the content of the history in reverse order (oldest on top), and you will be able to choose which steps to include in the workflow.
Replace the Workflow name to something more descriptive.
Rename each workflow input in the boxes at the top of the second column.
If there are any steps that shouldn’t be included in the workflow, you can uncheck them in the first column of boxes.
Click on the Create Workflow button near the top.
You will get a message that the workflow was created.
Generate QC Plots
We want to filter our cells, but first we need to know what our data looks like. There are a number of subjective choices to make within scRNA-seq analysis, for instance we now need to make our best informed decisions about where to set our thresholds (more on that soon!). We’re going to plot our data a few different ways. Different bioinformaticians might prefer to see the data in different ways, and here we are only generating some of the myriad of plots you can use. Ultimately you need to go with what makes the most sense to you.
time Top time-saving advice - turn the following QC plots into a workflow so you can re-run it easily throughout analysing your own data!.
Creating the plots
Hands-on: Making QC plots
- Plot with scanpy Tool: toolshed.g2.bx.psu.edu/repos/iuc/scanpy_plot/scanpy_plot/1.7.1+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
Mito-counted AnnData
- “Method used for plotting”:
Generic: Violin plot, using 'pl.violin'
- “Keys for accessing variables”:
Subset of variables in 'adata.var_names' or fields of '.obs'
- “Keys for accessing variables”:
log1p_total_counts,log1p_n_genes_by_counts,pct_counts_mito
- “The key of the observation grouping to consider”:
genotype
Rename galaxy-pencil output
Violin - genotype - log
- Plot with scanpy Tool: toolshed.g2.bx.psu.edu/repos/iuc/scanpy_plot/scanpy_plot/1.7.1+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
Mito-counted AnnData
- “Method used for plotting”:
Generic: Violin plot, using 'pl.violin'
- “Keys for accessing variables”:
Subset of variables in 'adata.var_names' or fields of '.obs'
- “Keys for accessing variables”:
log1p_total_counts,log1p_n_genes_by_counts,pct_counts_mito
- “The key of the observation grouping to consider”:
sex
Rename galaxy-pencil output
Violin - sex - log
- Plot with scanpy Tool: toolshed.g2.bx.psu.edu/repos/iuc/scanpy_plot/scanpy_plot/1.7.1+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
Mito-counted AnnData
- “Method used for plotting”:
Generic: Violin plot, using 'pl.violin'
- “Keys for accessing variables”:
Subset of variables in 'adata.var_names' or fields of '.obs'
- “Keys for accessing variables”:
log1p_total_counts,log1p_n_genes_by_counts,pct_counts_mito
- “The key of the observation grouping to consider”:
batch
Rename galaxy-pencil output
Violin - batch - log
- Plot with scanpy Tool: toolshed.g2.bx.psu.edu/repos/iuc/scanpy_plot/scanpy_plot/1.7.1+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
Mito-counted AnnData
- “Method used for plotting”:
Generic: Scatter plot along observations or variables axes, using 'pl.scatter'
- “Plotting tool that computed coordinates”:
Using coordinates
- “x coordinate”:
log1p_total_counts
- “y coordinate”:
pct_counts_mito
Rename galaxy-pencil output
Scatter - mito x UMIs
- Plot with scanpy Tool: toolshed.g2.bx.psu.edu/repos/iuc/scanpy_plot/scanpy_plot/1.7.1+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
Mito-counted AnnData
- “Method used for plotting”:
Generic: Scatter plot along observations or variables axes, using 'pl.scatter'
- “Plotting tool that computed coordinates”:
Using coordinates
- “x coordinate”:
log1p_n_genes_by_counts
- “y coordinate”:
pct_counts_mito
Rename galaxy-pencil output
Scatter - mito x genes
- Plot with scanpy Tool: toolshed.g2.bx.psu.edu/repos/iuc/scanpy_plot/scanpy_plot/1.7.1+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
Mito-counted AnnData
- “Method used for plotting”:
Generic: Scatter plot along observations or variables axes, using 'pl.scatter'
- “Plotting tool that computed coordinates”:
Using coordinates
- “x coordinate”:
log1p_total_counts
- “y coordinate”:
log1p_n_genes_by_counts
- “Color by”:
pct_counts_mito
- Rename galaxy-pencil output
Scatter - genes x UMIs
Analysing the plots
That’s a lot of information! Let’s attack this in sections and see what questions these plots can help us answer. The scratchbook galaxy-scratchbook may help here to look at the different plots at the same time!
If you would like to view two or more datasets at once, you can use the Scratchbook feature in Galaxy:
- Click on the Scratchbook icon galaxy-scratchbook on the top menu bar.
- You should see a little checkmark on the icon now
- View galaxy-eye a dataset by clicking on the eye icon galaxy-eye to view the output
- You should see the output in a window overlayed over Galaxy
- You can resize this window by dragging the bottom-right corner
- Click outside the file to exit the Scratchbook
- View galaxy-eye a second dataset from your history
- You should now see a second window with the new dataset
- This makes it easier to compare the two outputs
- Repeat this for as many files as you would like to compare
- You can turn off the Scratchbook galaxy-scratchbook by clicking on the icon again
Question: Batch VariationAre there differences in sequencing depth across the samples?
- Which plot(s) addresses this?
- How do you interpret it?
- The plot
violin - batch - log
will have what you’re looking for!- Keeping in mind that this is a log scale - which means that small differences can mean large differences - the violin plots probably look pretty similar.
N703
andN707
might be a bit lower on genes and counts (or UMIs), but the differences aren’t catastrophic.- The
pct_counts_mito
looks pretty similar across the batches, so this also looks good.- Nothing here would cause us to eliminate a sample from our analysis, but if you see a sample looking completely different from the rest, you would need to question why that is and consider eliminating it from your experiment!
Question: Biological VariablesAre there differences in sequencing depth across sex? Genotype?
- Which plot(s) addresses this?
- How do you interpret the
sex
differences?- How do you interpret the
genotype
differences?
- Similar to above, the plots
violin - sex - log
andviolin - genotype - log
will have what you’re looking for!- There isn’t a major difference in sequencing depth across sex, I would say - though you are welcome to disagree!
- It is clear there are far fewer female cells, which makes sense given that only one sample was female. Note - that was an unfortunate discovery made long after generating libraries. It’s quite hard to identify the sex of a neonate in the lab! In practice, try hard to not let such a confounding factor into your data! You could consider re-running all the following analysis without that female sample, if you wish.
- In
Violin - genotype - log
, however, we can see there is a difference. Theknockout
samples clearly have fewer genes and counts. From an experimental point of view, we can consider, does this make sense?
- Would we biologically expect that those cells would be smaller or having fewer transcripts? Possibly, in this case, given that these cells were generated by growth restricted neonatal mice, and in which case we don’t need to worry about our good data, but rather keep this in mind when generating clusters, as we don’t want depth to define clusters, we want biology to!
- On the other hand, it may be that those cells didn’t survive dissociation as well as the healthy ones (in which case we’d expect higher mitochondrial-associated genes, which we don’t see, so we can rule that out!).
- Maybe we unluckily poorly prepared libraries for specifically those knockout samples. There are only three, so maybe those samples are under-sequenced.
- So what do we do about all of this?
- Ideally, we consider re-sequencing all the samples but with a higher concentration of the knockout samples in the library. Any bioinformatician will tell you that the best way to get clean data is in the lab, not the computer! Sadly, absolute best practice isn’t necessarily always a realistic option in the lab - for instance, that mouse line was long gone! - so sometimes, we have to make the best of it. There are options to try and address such discrepancy in sequencing depth. Thus, we’re going to take these samples forward and see if we can find biological insight despite the technical differences.
Now that we’ve assessed the differences in our samples, we will look at the libraries overall to identify appropriate thresholds for our analysis.
Question: Filter ThresholdsWhat threshold should you set for
log1p_n_genes_by_counts
?
- Which plot(s) addresses this?
- What number would you pick?
- Any plot with
log1p_n_genes_by_counts
would do here, actually! Some people prefer scatterplots to violins.
- In
Scatter - mito x genes
you can see how cells withlog1p_n_genes_by_counts
up to around, perhaps,5.7
(around 300 genes) often have highpct_counts_mito
.
- You can plot this as just
n_counts
and see this same trend at around 300 genes, but with this data the log format is clearer so that’s how we’re presenting it.- You could also use the violin plots to come up with the threshold, and thus also take batch into account. It’s good to look at the violins as well, because you don’t want to accidentally cut out an entire sample (i.e. N703 and N707).
- Some bioinformaticians would recommend filtering each sample individually, but this is difficult in larger scale and in this case (you’re welcome to give it a go! You’d have to filter separately and then concatenate), it won’t make a notable difference in the final interpretation.
What threshold should you set for
log1p_total_counts
?
- Which plot(s) addresses this?
- What number would you pick?
- As before, any plot with
log1p_total_counts
will do! Again, we’ll use a scatterplot here, but you can use a violin plot if you wish!
- We can see that we will need to set a higher threshold (which makes sense, as you’d expect more UMI’s per cell rather than unique genes!). Again, perhaps being a bit aggressive in our threshold, we might choose
6.3
, for instance (which amounts to around 500 counts/cell).
- In an ideal world, you’ll see a clear population of real cells separated from a clear population of debris. Many samples, like this one, are under-sequenced, and such separation would likely be seen after deeper sequencing!
What threshold should you set for
pct_counts_mito
?
- Which plot(s) addresses this?
- What number would you pick?
- Any plot with
pct_counts_mito
would do here, however the scatterplots are likely the easiest to interpret. We’ll use the same as last time.
- We can see a clear trend wherein cells that have around 5% mito counts or higher also have far fewer total counts. These cells are low quality, will muddy our data, and are likely stressed or ruptured prior to encapsulation in a droplet. While 5% is quite a common cut-off, this is quite messy data, so just for kicks we’ll go more aggressive with a
4.5%
.
- In general, you must adapt all cut-offs to your data - metabolically active cells might have higher mitochondrial RNA in general, and you don’t want to lose a cell population because of a cut-off.
Apply the thresholds
It’s now time to apply these thresholds to our data! First, a reminder of how many cells and genes are in your object: 31178 cells
and 35734 genes
. Let’s see how that changes each time!
If you are working in a group, you can now divide up a decision here with one control and the rest varied numbers so that you can compare results throughout the tutorials.
- Control
- log1p_n_genes_by_counts >
5.7
- log1p_total_counts >
6.3
- pct_counts_mito <
4.5%
- Everyone else: Choose your own thresholds and compare results!
Hands-on: Filter cells by log1p_n_genes_by_counts
- Scanpy FilterCells Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/scanpy_filter_cells/scanpy_filter_cells/1.8.1+galaxy0 with the following parameters:
- param-file “Input object in AnnData/Loom format”:
Mito-counted AnnData
- In “Parameters to select cells to keep”:
- param-repeat “Insert Parameters to select cells to keep”
- “Name of parameter to filter on”:
log1p_n_genes_by_counts
- “Min value”:
5.7
- “Max value”:
20.0
Rename galaxy-pencil output as
Genes-filtered Object
- Plot with scanpy Tool: toolshed.g2.bx.psu.edu/repos/iuc/scanpy_plot/scanpy_plot/1.7.1+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
Genes-filtered Object
- “Method used for plotting”:
Generic: Violin plot, using 'pl.violin'
- “Keys for accessing variables”:
Subset of variables in 'adata.var_names' or fields of '.obs'
- “Keys for accessing variables”:
log1p_total_counts,log1p_n_genes_by_counts,pct_counts_mito
- “The key of the observation grouping to consider”:
genotype
Rename galaxy-pencil output
Violin - Filterbygenes
- Inspect AnnData Tool: toolshed.g2.bx.psu.edu/repos/iuc/anndata_inspect/anndata_inspect/0.7.5+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
Genes-filtered Object
- “What to inspect?”:
General information about the object
- Rename galaxy-pencil output
General - Filterbygenes
Note that the tool Scanpy Filtercells allows you to put param-repeat multiple parameters at the same time (i.e. filter log1p_total_counts
, log1p_n_genes_by_counts
,and pct_counts_mito
) in the same step. The only reason we aren’t doing that here is so you can see what each filter accomplishes. As such, examine your plot and general information.
Question
- Interpret the violin plot
- How many genes & cells do you have in your object now?
- The only part that seems to change is the
log1p_n_genes_by_counts
. You can see a flatter bottom to the violin plot - this is the lower threshold set. Ideally, this would create a beautiful violin plot because there would be a clear population of low-gene number cells. Sadly not the case here, but still a reasonable filter.- In
General - Filterbygenes
, you can see you now have17,040 cells x 35,734 genes
.
Hands-on: Filter cells by log1p_total_counts
- Scanpy FilterCells Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/scanpy_filter_cells/scanpy_filter_cells/1.8.1+galaxy0 with the following parameters:
- param-file “Input object in AnnData/Loom format”:
Genes-filtered Object
- In “Parameters to select cells to keep”:
- param-repeat “Insert Parameters to select cells to keep”
- “Name of parameter to filter on”:
log1p_total_counts
- “Min value”:
6.3
- “Max value”:
20.0
Rename galaxy-pencil output as
Counts-filtered Object
- Plot with scanpy Tool: toolshed.g2.bx.psu.edu/repos/iuc/scanpy_plot/scanpy_plot/1.7.1+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
Counts-filtered Object
- “Method used for plotting”:
Generic: Violin plot, using 'pl.violin'
- “Keys for accessing variables”:
Subset of variables in 'adata.var_names' or fields of '.obs'
- “Keys for accessing variables”:
log1p_total_counts,log1p_n_genes_by_counts,pct_counts_mito
- “The key of the observation grouping to consider”:
genotype
Rename galaxy-pencil output
Violin - Filterbycounts
- Inspect AnnData Tool: toolshed.g2.bx.psu.edu/repos/iuc/anndata_inspect/anndata_inspect/0.7.5+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
Counts-filtered Object
- “What to inspect?”:
General information about the object
- Rename galaxy-pencil output
General - Filterbycounts
Question
- Interpret the violin plot
- How many genes & cells do you have in your object now?
- We will focus on the
log1p_total_counts
as that shows the biggest change. Similar to above, the bottom of the violin shape has flattered due to the threshold.- In
General - Filterbycounts
, you can see you now have8,678 cells x 35,734 genes
.
Hands-on: Filter cells by pct_counts_mito
- Scanpy FilterCells Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/scanpy_filter_cells/scanpy_filter_cells/1.8.1+galaxy0 with the following parameters:
- param-file “Input object in AnnData/Loom format”:
Counts-filtered Object
- In “Parameters to select cells to keep”:
- param-repeat “Insert Parameters to select cells to keep”
- “Name of parameter to filter on”:
pct_counts_mito
- “Min value”:
0
- “Max value”:
4.5
Rename galaxy-pencil output as
Mito-filtered Object
- Plot with scanpy Tool: toolshed.g2.bx.psu.edu/repos/iuc/scanpy_plot/scanpy_plot/1.7.1+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
Mito-filtered Object
- “Method used for plotting”:
Generic: Violin plot, using 'pl.violin'
- “Keys for accessing variables”:
Subset of variables in 'adata.var_names' or fields of '.obs'
- “Keys for accessing variables”:
log1p_total_counts,log1p_n_genes_by_counts,pct_counts_mito
- “The key of the observation grouping to consider”:
genotype
- In “Violin plot attributes”:
- “Add a stripplot on top of the violin plot”:
Yes
- “Add a jitter to the stripplot”:
Yes
- “Display keys in multiple panels”:
No
Rename galaxy-pencil output
Violin - Filterbymito
- Inspect AnnData Tool: toolshed.g2.bx.psu.edu/repos/iuc/anndata_inspect/anndata_inspect/0.7.5+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
Mito-filtered Object
- “What to inspect?”:
General information about the object
- Rename galaxy-pencil output
General - Filterbymito
Question
- Interpret the violin plot
- How many genes & cells do you have in your object now?
- If we carefully check the axes, we can see that the
pct_counts_mito
has shrunk.- In
General - Filterbymito
, you can see you now have8,605 cells x 35,734 genes
.
Here’s a quick overall summary for easy visualisation if you fancy it.
Fantastic work! However, you’ve now removed a whole heap of cells, and since the captured genes are sporadic (i.e. a small percentage of the overall transcriptome per cell) this means there are a number of genes in your matrix that are currently not in any of the remaining cells. Genes that do not appear in any cell, or even in only 1 or 2 cells, will make some analytical tools break and overall will not be biologically informative. So let’s remove them! Note that 3
is not necessarily the best number, rather it is a fairly conservative threshold. You could go as high as 10 or more.
If you are working in a group, you can now divide up a decision here with one control and the rest varied numbers so that you can compare results throughout the tutorials.
- Variable: n_cells
- Control >
3
- Everyone else: Choose your own thresholds and compare results! Note if you go less than 3 (or even remove this step entirely), future tools are likely to fail due to empty gene data.
Hands-on: Filter genes
- Scanpy FilterGenes Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/scanpy_filter_genes/scanpy_filter_genes/1.8.1+galaxy0 with the following parameters:
- param-file “Input object in AnnData/Loom format”:
Mito-filtered Object
- In “Parameters to select genes to keep”:
- param-repeat “Insert Parameters to select genes to keep”
- “Name of parameter to filter on”:
n_cells
- “Min value”:
3
- “Max value”:
1000000000
Rename galaxy-pencil output as
Filtered Object
- Inspect AnnData Tool: toolshed.g2.bx.psu.edu/repos/iuc/anndata_inspect/anndata_inspect/0.7.5+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
Filtered Object
- “What to inspect?”:
General information about the object
- Rename galaxy-pencil output
General - Filtered object
In practice, you’ll likely choose your thresholds then set up all these filters to run without checking plots in between each one. But it’s nice to see how they work!
Using the final General - Filtered object
, we can summarise the results of our filtering:
Cells | Genes | |
---|---|---|
Raw | 31178 | 35734 |
Filter genes/cell | 17040 | 35734 |
Filter counts/cell | 8678 | 35734 |
Filter mito/cell | 8605 | 35734 |
Filter cells/gene | 8605 | 15395 |
congratulations Congratulations! You have filtered your object! Now it should be a lot easier to analyse.
Processing
So currently, you have a matrix that is 8605 cells by 15395 genes. This is still quite big data. We have two issues here - firstly, you already know there are differences in how many transcripts and genes have been counted per cell. This technical variable can obscure biological differences. Secondly, we like to plot things on x/y plots, so for instance Gapdh could be on one axis, and Actin can be on another, and you plot cells on that 2-dimensional axis based on how many of each transcript they possess. While that would be fine, adding in a 3rd dimension (or, indeed, in this case, 15393 more dimensions), is a bit trickier! So our next steps are to transform our big data object into something that is easy to analyse and easy to visualise.
Hands-on: Normalisation
- Scanpy NormaliseData Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/scanpy_normalise_data/scanpy_normalise_data/1.8.1+galaxy0 with the following parameters:
- param-file “Input object in AnnData/Loom format”:
Filtered Object
Normalisation helps reduce the differences between gene and UMI counts by fitting total counts to 10,000 per cell. The inherent log-transform (by log(count+1)) aligns the gene expression level better with a normal distribution. This is fairly standard to prepare for any future dimensionality reduction.
Now we need to look at reducing our gene dimensions. We have loads of genes, but not all of them are different from cell to cell. For instance, housekeeping genes are defined as not changing much from cell to cell, so we could remove these from our data to simplify the dataset. We will flag genes that vary across the cells for future analysis.
Hands-on: Find variable genes
- Scanpy FindVariableGenes Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/scanpy_find_variable_genes/scanpy_find_variable_genes/1.8.1+galaxy0 with the following parameters:
- param-file “Input object in AnnData/Loom format”:
output_h5ad
(output of Scanpy NormaliseData tool)- “Flavor of computing normalised dispersion”:
Seurat
- “Number of top variable genes to keep, mandatory if flavor=’seurat_v3’“: `` (remove the automated 2000 here and leave the space blank)
- Rename galaxy-pencil plot output
Use_me_FVG
Next up, we’re going to scale our data so that all genes have the same variance and a zero mean. This is important to set up our data for further dimensionality reduction. It also helps negate sequencing depth differences between samples, since the gene levels across the cells become comparable. Note, that the differences from scaling etc. are not the values you have at the end - i.e. if your cell has average GAPDH levels, it will not appear as a ‘0’ when you calculate gene differences between clusters.
Hands-on: Scaling data
- Scanpy ScaleData Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/scanpy_scale_data/scanpy_scale_data/1.8.1+galaxy0 with the following parameters:
- param-file “Input object in AnnData/Loom format”:
Use_me_FVG
(output of Scanpy FindVariableGenes tool)- “Truncate to this value after scaling”:
10.0
- Rename galaxy-pencil plot output
Use_me_Scaled
congratulations Congratulations! You have processed your object!
Preparing coordinates
We still have too many dimensions. Transcript changes are not usually singular - which is to say, genes were in pathways and in groups. It would be easier to analyse our data if we could more easily group these changes.
Principal components
Principal components are calculated from highly dimensional data to find the most spread in the dataset. So in our, 3248
highly variable gene dimensions, there will be one line (axis) that yields the most spread and variation across the cells. That will be our first principal component. We can calculate the first x
principal components in our data to drastically reduce the number of dimensions.
Comment: 3248???Where did the
3248
come from? The quickest way to figure out how many highly variable genes you have, in my opinion, is to re-run galaxy-refresh the Scanpy FindVariableGenes tool and select the parameter to Remove genes not marked as highly variable. Then you can Inspect your resulting object and you’ll see only 3248 genes. The following processing steps will use only the highly variable genes for their calculations, but I strongly suggest you keep even the nonvariable genes in (i.e., use the original output of your FindVariableGenes tool with way more than 3248 genes!), as a general rule. This tutorial will not work at the end plotting stage if you only take forward the 3248 or 2000 (if you set a limit on it) highly variable genes.
Check your AnnData object!</warning> Your AnnData object should have far more than 3248 genes in it (if you followed our settings and tool versions, you'd have a matrix 8605 × 15395 (cells x genes). Make sure to use that AnnData object output from FindVariableGenes, rather than the 3248 or 2000 output from your testing in the section above labelled '3248'.
Hands-on: Calculate Principal Components
- Scanpy RunPCA Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/scanpy_run_pca/scanpy_run_pca/1.8.1+galaxy0 with the following parameters:
- param-file “Input object in AnnData/Loom format”:
Use_me_Scaled
(output of Scanpy ScaleData tool)- “Number of PCs to produce”:
50
- Plot with scanpy Tool: toolshed.g2.bx.psu.edu/repos/iuc/scanpy_plot/scanpy_plot/1.7.1+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
output_h5ad
(output of Scanpy RunPCA tool)- “Method used for plotting”:
PCA: Scatter plot in PCA coordinates, using 'pl.pca_variance_ratio'
- “Number of PCs to show”:
50
- Rename galaxy-pencil plot output
PCA Variance
Why 50 principal components you ask? Well, we’re pretty confident 50 is an over-estimate. Examine PCA Variance
.
We can see that there is really not much variation explained past component 19. So we might save ourselves a great deal of time and muddied data by focusing on the top 20
PCs.
Neighborhood graph
We’re still looking at around 20 dimensions at this point. We need to identify how similar a cell is to another cell, across every cell across these dimensions. For this, we will use the k-nearest neighbor (kNN) graph, to identify which cells are close together and which are not. The kNN graph plots connections between cells if their distance (when plotted in this 20 dimensional space!) is amonst the k-th smallest distances from that cell to other cells. This will be crucial for identifying clusters, and is necessary for plotting a UMAP. From UMAP developers: “Larger neighbor values will result in more global structure being preserved at the loss of detailed local structure. In general this parameter should often be in the range 5 to 50, with a choice of 10 to 15 being a sensible default”.
If you are working in a group, you can now divide up a decision here with one control and the rest varied numbers so that you can compare results throughout the tutorials.
- Control
- Number of PCs to use =
20
- Maximum number of neighbours used =
15
- Everyone else: Use the PC variance plot to pick your own PC number, and choose your own neighbour maximum as well!b
Hands-on: ComputeGraph
- Scanpy ComputeGraph Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/scanpy_compute_graph/scanpy_compute_graph/1.8.1+galaxy1 with the following parameters:
- param-file “Input object in AnnData/Loom format”:
output_h5ad
(output of Scanpy RunPCA tool)- “Use programme defaults”: history-share
No
- “Maximum number of neighbours used”:
15
- “Use the indicated representation”:
X_pca
- “Number of PCs to use”:
20
Dimensionality reduction for visualisation
Two major visualisations for this data are tSNE and UMAP. We must calculate the coordinates for both prior to visualisation. For tSNE, the parameter perplexity can be changed to best represent the data, while for UMAP the main change would be to change the kNN graph above itself, by changing the neighbours.
If you are working in a group, you can now divide up a decision here with one control and the rest varied numbers so that you can compare results throughout the tutorials.
- Control
- Perplexity =
30
- Everyone else: Choose your own perplexity, between 5 and 50!
Hands-on: Calculating tSNE & UMAP
- Scanpy RunTSNE Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/scanpy_run_tsne/scanpy_run_tsne/1.8.1+galaxy1 with the following parameters:
- param-file “Input object in AnnData/Loom format”:
output_h5ad
(output of Scanpy ComputeGraph tool)- “Use the indicated representation”:
X_pca
- “Use programme defaults”: history-share
No
- “The perplexity is related to the number of nearest neighbours, select a value between 5 and 50”:
30
- Scanpy RunUMAP Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/scanpy_run_umap/scanpy_run_umap/1.8.1+galaxy0 with the following parameters:
- param-file “Input object in AnnData/Loom format”:
output_h5ad
(output of Scanpy RunTSNE tool)- “Use programme defaults”: history-share
Yes
congratulations Congratulations! You have prepared your object and created neighborhood coordinates. We can now use those to call some clusters!
Cell clusters & gene markers
QuestionLet’s take a step back here. What is it, exactly, that you are trying to get from your data? What do you want to visualise, and what information do you need from your data to gain insight?
Really we need two things - firstly, we need to make sure our experiment was set up well. This is to say, our biological replicates should overlap and our variables should, ideally, show some difference. Secondly, we want insight - we want to know which cell types are in our data, which genes drive those cell types, and in this case, how they might be affected by our biological variable of growth restriction. How does this affect the developing cells, and what genes drive this? So let’s add in information about cell clusters and gene markers!
Finally, let’s identify clusters! Unfortunately, it’s not as majestic as biologists often think - the maths doesn’t necessarily identify true cell clusters. Every algorithm for identifying cell clusters falls short of a biologist knowing their data, knowing what cells should be there, and proving it in the lab. Sigh. So, we’re going to make the best of it as a starting point and see what happens! We will define clusters from the kNN graph, based on how many connections cells have with one another. Roughly, this will depend on a resolution parameter for how granular you want to be.
Oh yes, yet another decision! Single cell analysis is sadly not straight forward.
- Control
- Resolution, high value for more and smaller clusters =
0.6
- Clustering algorithm =
Louvain
- Everyone else: Pick your own number. If it helps, this sample should have a lot of very similar cells in it. It contains developing T-cells, so you aren’t expecting massive differences between cells, like you would in, say, an entire embryo, with all sorts of unrelated cell types.
- Everyone else: Consider the newer Leiden clustering method. Note that in future parameters, you will likely need to specify ‘leiden’ rather than ‘louvain’, which is the default, if you choose this clustering method.
Hands-on: FindClusters
- Scanpy FindCluster Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/scanpy_find_cluster/scanpy_find_cluster/1.8.1+galaxy0 with the following parameters:
- param-file “Input object in AnnData/Loom format”:
output_h5ad
(output of Scanpy RunUMAP tool)- “Use programme defaults”: history-share
No
- “Resolution, high value for more and smaller clusters”:
0.6
Nearly plotting time! But one final piece is to add in SOME gene information. Let’s focus on genes driving the clusters.
FindMarkers
Hands-on: FindMarkers
- Scanpy FindMarkers Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/scanpy_find_markers/scanpy_find_markers/1.8.1+galaxy0 with the following parameters:
- param-file “Input object in AnnData/Loom format”:
output_h5ad
(output of Scanpy FindClusters tool)- “Use programme defaults”: history-share
Yes
<— trust me, there’s an odd glitch here in some tool versions that is solved by simply tickingYes
Rename galaxy-pencil output table (not h5ad)
Markers - cluster
- Rename galaxy-pencil output h5ad file
Final object
But we are also interested in differences across genotype, so let’s also check that (note that in this case, it’s turning it almost into bulk RNA-seq, because you’re comparing all cells of a certain genotype against all cells of the other)
- Scanpy FindMarkers Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/scanpy_find_markers/scanpy_find_markers/1.8.1+galaxy0 with the following parameters:
- param-file “Input object in AnnData/Loom format”:
Final object
- “The sample grouping/clustering to use”:
genotype
- “Use programme defaults”: history-share
Yes
Rename galaxy-pencil output table (not h5ad)
Markers - genotype
- Do not Rename the output AnnData object (in fact, you can delete it!). You have the genotype marker table to enjoy, but we want to keep the cluster comparisons, rather than gene comparisons, stored in the AnnData object for later.
Now, there’s a small problem here, which is that if you galaxy-eye inspect the output marker tables, you won’t see gene names, you’ll see Ensembl IDs. While this is a more bioinformatically accurate way of doing this (not every ID has a gene name!), we might want to look at more well-recognised gene names, so let’s pop some of that information in!
Hands-on: Adding in Gene Names
- Inspect AnnData Tool: toolshed.g2.bx.psu.edu/repos/iuc/anndata_inspect/anndata_inspect/0.7.5+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
Final object
- “What to inspect?”:
Key-indexed annotation of variables/features (var)
This gives us our table of all the possible genes with their names.
- Join two Datasets side by side on a specified field Tool: join1 with the following parameters:
- param-file “Join”: param-files Select multiple files:
Markers - cluster
andMarkers - genotype
- “using column”:
Column: 4
- param-file “with”:
var
(output of Inspect AnnData tool)- “and column”:
Column: 2
- “Keep lines of first input that do not join with second input”:
Yes
- “Keep lines of first input that are incomplete”:
Yes
- “Fill empty columns”:
No
- “Keep the header lines”:
Yes
We have lots of extra information we don’t need in our marker gene tables, so…
- Cut columns from a table Tool: Cut1 with the following parameters:
- “Cut columns”:
c1,c2,c3,c4,c11,c5,c6,c7,c8
- param-file “From”: param-files Select multiple files:
out_file1
andoutput_file2
(outputs of Join two Datasets tool)- Rename galaxy-pencil output tables
Markers - cluster - named
andMarkers - genotype - named
congratulations Well done! It’s time for the best bit, the plotting!
Plotting!
It’s time! Let’s plot it all!
But first, let’s pick some marker genes from the Markers-cluster
list that you made as well. I’ll be honest, in practice, you’d now be spending a lot of time looking up what each gene does (thank you google!). There are burgeoning automated-annotation tools, however, so long as you have a good reference (a well annotated dataset that you’ll use as the ideal). In the mean time, let’s do this the old-fashioned way, and just copy a bunch of the markers in the original paper.
Hands-on: Plot the cells!
- Scanpy PlotEmbed Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/scanpy_plot_embed/scanpy_plot_embed/1.8.1+galaxy0 with the following parameters:
- param-file “Input object in AnnData/Loom format”:
Final object
- “name of the embedding to plot”:
pca
- “color by attributes, comma separated texts”:
louvain,sex,batch,genotype,Il2ra,Cd8b1,Cd8a,Cd4,Itm2a,Aif1,log1p_total_counts
- “Field for gene symbols”:
Symbol
- “Use raw attributes if present”:
No
- time You can re-run galaxy-refresh the same tool again, but change
pca
totsne
and then finally toumap
in order to skip the following two steps.- Scanpy PlotEmbed Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/scanpy_plot_embed/scanpy_plot_embed/1.8.1+galaxy0 with the following parameters:
- param-file “Input object in AnnData/Loom format”:
Final object
- “name of the embedding to plot”:
tsne
- “color by attributes, comma separated texts”:
louvain,sex,batch,genotype,Il2ra,Cd8b1,Cd8a,Cd4,Itm2a,Aif1,log1p_total_counts
- “Field for gene symbols”:
Symbol
- “Use raw attributes if present”:
No
- Scanpy PlotEmbed Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/scanpy_plot_embed/scanpy_plot_embed/1.8.1+galaxy0 with the following parameters:
- param-file “Input object in AnnData/Loom format”:
Final object
- “name of the embedding to plot”:
umap
- “color by attributes, comma separated texts”:
louvain,sex,batch,genotype,Il2ra,Cd8b1,Cd8a,Cd4,Itm2a,Aif1,log1p_total_counts
- “Field for gene symbols”:
Symbol
- “Use raw attributes if present”:
No
congratulations Congratulations! You now have plots galore!
Insights into the beyond
Now it’s the fun bit! We can see where genes are expressed, and start considering and interpreting the biology of it. At this point, it’s really about what information you want to get from your data - the following is only the tip of the iceberg. However, a brief exploration is good, because it may help give you ideas going forward with for your own data. Let us start interrogating our data!
Biological Interpretation
Question: Appearance is everythingWhich visualisation is the most useful for getting an overview of our data, pca, tsne, or umap?
You can see why a PCA is generally not enough to see clusters in samples - keep in mind, you’re only seeing components 1 and 2! - and therefore why the tSNE and UMAP visualisation dimensionality reductions are so useful. But there is not necessarily a clear winner between tSNE and UMAP, but I think UMAP is slightly clearer with its clusters, so we’ll stick with that for the rest of the analysis.
Note that the cluster numbering is based on size alone - clusters 0 and 1 are not necessarily related, they are just the clusters containing the most cells. It would be nice to know what exactly these cells are. This analysis (googling all of the marker genes, both checking where the ones you know are as well as going through the marker tables you generated!) is a fun task for any individual experiment, so we’re going to speed past that and nab the assessment from the original paper!
Clusters | Marker | Cell type |
---|---|---|
4 | Il2ra | Double negative (early T-cell) |
0,1,2,6 | Cd8b1, Cd8a, Cd4 | Double positive (middle T-cell) |
5 | Cd8b1, Cd8a, Cd4 - high | Double positive (late middle T-cell) |
3 | Itm2a | Mature T-cell |
7 | Aif1 | Macrophages |
The authors weren’t interested in further annotation of the DP cells, so neither are we. Sometimes that just happens. The maths tries to call similar (ish) sized clusters, whether it is biologically relevant or not. Or, the question being asked doesn’t really require such granularity of clusters.
If you have deviated from any of the original parameters in this tutorial, you will likely have a different number of clusters. You will, therefore, need to change the ‘Annotating clusters’ “Comma-separated list of new categories” accordingly. Best of luck!
Annotating Clusters
Hands-on: Annotating clusters
- Manipulate AnnData Tool: toolshed.g2.bx.psu.edu/repos/iuc/anndata_manipulate/anndata_manipulate/0.7.5+galaxy1 with the following parameters:
- param-file “Annotated data matrix”:
Final object
- “Function to manipulate the object”:
Rename categories of annotation
- “Key for observations or variables annotation”:
louvain
- “Comma-separated list of new categories”:
DP-M4,DP-M3,DP-M1,T-mat,DN,DP-L,DP-M2,Macrophages
- Hang on here, though. This unfortunately deletes the original cluster numbering. Just in case you might want this back, we can add that annotation back in.
- AnnData Operations Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/anndata_ops/anndata_ops/1.8.1+galaxy0 with the following parameters:
- param-file “Input object in hdf5 AnnData format”:
Final object
- “Copy observations (such as clusters)”: history-share Yes
- Keys from obs to copy
- ”+ Insert Keys from obs to copy”
- “Key contains”:
louvain
param-file “AnnData objects with obs to copy”: (output of Manipulate AnnData tool)
- You’ve added the new cell annotations in, now titled
louvain_0
. What, that’s not good enough? You want to change the title as well? So be it.- AnnData Operations Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/anndata_ops/anndata_ops/1.8.1+galaxy0 tool with the following parameters:
- param-file “Input object in hdf5 AnnData format”: (output of AnnData Operations tool)
- Change field names in AnnData observations
- galaxy-wf-new ”+ Insert Change field names in AnnData observations”
- 1: Change field names in AnnData observations
- “Original name”:
louvain_0
- “New name”:
cell_type
- Rename galaxy-pencil output h5ad
Final cell annotated object
- Time to re-plot! time Feel free to re-run galaxy-refresh the Scanpy PlotEmbed tool tool on the new object plotting
cell_type
to speed this up. Otherwise…- Scanpy PlotEmbed Tool: toolshed.g2.bx.psu.edu/repos/ebi-gxa/scanpy_plot_embed/scanpy_plot_embed/1.8.1+galaxy0 with the following parameters:
- param-file “Input object in AnnData/Loom format”:
Final cell annotated object
- “name of the embedding to plot”:
umap
- “color by attributes, comma separated texts”:
sex,batch,genotype,Il2ra,Cd8b1,Cd8a,Cd4,Itm2a,Aif1,Hba-a1,log1p_total_counts,cell_type
- “Field for gene symbols”:
Symbol
- “Use raw attributes if present”:
No
Now that we know what we’re dealing with, let’s examine the effect of our variable, proper science!
Question: GenotypeAre there any differences in genotype? Or in biological terms, is there an impact of growth restriction on T-cell development in the thymus?
We can see that DP-L, which seems to be extending away from the DP-M bunch, as well as the mature T-cells (or particularly the top half) are missing some knockout cells. Perhaps there is some sort of inhibition here? INTERESTING! What next? We might look further at the transcripts present in both those populations, and perhaps also look at the genotype marker table… So much to investigate! But before we set you off to explore to your heart’s delight, let’s also look at this a bit more technically.
Technical Assessment
Is our analysis real? Is it right? Well, we can assess that a little bit.
Question: Batch effectIs there a batch effect?
While some shifts are expected and nothing to be concerned about, DP-L looks to be mainly comprised of N705. There might be a bit of batch effect, so you could consider using batch correction on this dataset. However, if we focus our attention on the other cluster - mature T-cells - where there is batch mixing, we can still assess this biologically even without batch correction. Additionally, we will also look at the confounding effect of sex.
We note that the one female sample - unfortunately one of the mere three knockout samples - seems to be distributed in the same areas as the knockout samples at large, so luckily, this doesn’t seem to be a confounding factor and we can still learn from our data. Ideally, this experiment would be re-run with either more female samples all around or swapping out this female from the male sample.
Question: Depth effectAre there any clusters or differences being driven by sequencing depth, a technical and random factor?
Eureka! This explains the odd DP shift between wildtype and knockout cells - the left side of the DP cells simply have a higher sequencing depth (UMIs/cell) than the ones on the right side. Well, that explains some of the sub-cluster that we’re seeing in that splurge. Importantly, we don’t see that the DP-L or (mostly) the mature T-cell clusters are similarly affected. So, whilst again, this variable of sequencing depth might be something to regress out somehow, it doesn’t seem to be impacting our dataset. The less you can regress/modify your data, in general, the better - you want to stay as true as you can to the raw data, and only use maths to correct your data when you really need to (and not to create insights where there are none!).
Question: Sample purityDo you think we processed these samples good enough?
We have seen in the previous images that these clusters are not very tight or distinct, so we could consider stronger filtering. Additionally, hemoglobin - a red blood cell marker that should NOT be found in T-cells - appears throughout the entire sample in low numbers. This suggests some background in the media the cells were in, and we might consider in the wet lab trying to get a purer, happier sample, or in the dry lab, techniques such as SoupX or others to remove this background. Playing with filtering settings (increasing minimum counts/cell, etc.) is often the place to start in these scenarios.
Question: Clustering resolutionDo you think the clustering is appropriate? i.e. are there single clusters that you think should be separate, and multiple clusters that could be combined?
Important to note, lest all bioinformaticians combine forces to attack the biologists: just because a cluster doesn’t look like a cluster by eye is NOT enough to say it’s not a cluster! But looking at the biology here, we struggled to find marker genes to distinguish the DP population, which we know is also affected by depth of sequencing. That’s a reasonable argument that DP-M1, DP-M2, and DP-M3 might not be all that different. Maybe we need more depth of sequencing across all the DP cells, or to compare these explicitly to each other (consider variations on FindMarkers!). However, DP-L is both seemingly leaving the DP cluster and also has fewer knockout cells, so we might go and look at what DP-L is expressing in the marker genes. If we look at T-mat further, we can see that its marker gene - Itm2a - is only expressed in half of the cluster. You might consider sub-clustering this to investigate further, either through changing the resolution or through analysing this cluster alone. If we look at the differences between genotypes alone (so the pseudo-bulk), we can see that most of the genes in that list are actually ribosomal. This might be a housekeeping background, this might be cell cycle related, this might be biological, or all three. You might consider investigating the cycling status of the cells, or even regressing this out (which is what the authors did).
Ultimately, there are quite a lot ways to analyse the data, both within the confines of this tutorial (the many parameters that could be changed throughout) and outside of it (batch correction, sub-clustering, cell-cycle scoring, inferred trajectories, etc.) Most analyses will still yield the same general output, though: there are fewer knockout cells in the mature T-cell population.
congratulations Congratulations! You have interpreted your plots in several important ways!
Interactive visualisations
Before we leave you to explore the unknown, you might have noticed that the above interpretations are only a few of the possible options. Plus you might have had fun trying to figure out which sample is which genotype is which sex and flicking back and forth between plots repeatedly. Figuring out which plots will be your final publishable plots takes a lot of time and testing. Luckily, there is a helpful interactive viewer Cakir et al. 2020 export tool Moreno et al. 2020 that can help you explore without having to produce new plots over and over!
Hands-on: Cellxgene
- Interactive CellXgene Environment Tool: interactive_tool_cellxgene with the following parameters:
- param-file “Concatenate dataset”:
Final cell annotated object
- When ready, you will see a message
- details There is an InteractiveTool result view available, click here to display <—- Click there!
Sometimes this link can aggravate a firewall or something similar. It should be fine to go to the site. You will be asked to
name your annotation
, so do so to start playing around!
You can also access it by going to
User
in the top menu of Galaxy, then selectingActive Interactive Tools
You will need to
STOP
this active environment in Galaxy by going toUser
,Interactive Tools
, selecting the environment, and selectingStop
. You may also want to delete the dataset in the history, because otherwise it continues appearing as if it’s processing.
Be warned - this visualisation tool is a powerful option for exploring your data, but it takes some time to get used to. Consider exploring it as your own tutorial for another day!
Conclusion
Hopefully, no matter which pathway of analysis you took, you found the same general interpretations. If not, this is a good time to discuss and consider with your group why that might be - what decision was ‘wrong’ or ‘ill-advised’, and how would you go about ensuring you correctly interpreted your data in the future? Top tip - trial and error is a good idea, believe it or not, and the more ways you find the same insight, the more confident you can be! But nothing beats experimental validation… For those that did not take the ‘control’ options, please
- Rename your history (by clicking on the history title) as
DECISION-Filtering and Plotting Single-cell RNA-seq Data
Add a history annotation history-annotate that includes which parameters you changed/steps you changed from the control
Sharing your history allows others to import and access the datasets, parameters, and steps of your history.
- Share via link
- Open the History Options galaxy-gear menu (gear icon) at the top of your history panel
- galaxy-toggle Make History accessible
- A Share Link will appear that you give to others
- Anybody who has this link can view and copy your history
- Publish your history
- galaxy-toggle Make History publicly available in Published Histories
- Anybody on this Galaxy server will see your history listed under the Shared Data menu
- Share only with another user.
- Click the Share with a user button at the bottom
- Enter an email address for the user you want to share with
- Your history will be shared only with this user.
- Finding histories others have shared with me
- Click on User menu on the top bar
- Select Histories shared with me
- Here you will see all the histories others have shared with you directly
Note: If you want to make changes to your history without affecting the shared version, make a copy by going to galaxy-gear History options icon in your history and clicking Copy
- Feel free to explore any other similar histories
congratulations Congratulations! You’ve made it to the end! You might find this example control history helpful to compare with, or this workflow.
In this tutorial, you moved from technical processing to biological exploration. By analysing real data - both the exciting and the messy! - you have, hopefully, experienced what it’s like to analyse and question a dataset, potentially without clear cut-offs or clear answers. If you were working in a group, you each analysed the data in different ways, and most likely found similar insights. One of the biggest problems in analysing scRNA-seq is the lack of a clearly defined pathway or parameters. You have to make the best call you can as you move through your analysis, and ultimately, when in doubt, try it multiple ways and see what happens!
To discuss with like-minded scientists, join our Gitter channel for all things Galaxy-single cell!
Key points
Single cell data is huge, and must have its many (# genes) dimensions reduced for analysis
Analysis is more subjective than we think, and biological understanding of the samples as well as many iterations of analysis are important to give us our best change of attaining real biological insights - Ready for the [final] tutorial](https://training.galaxyproject.org/training-material/topics/transcriptomics/tutorials/scrna-case_JUPYTER-trajectories/tutorial.html) in this case study
Frequently Asked Questions
Have questions about this tutorial? Check out the tutorial FAQ page or the FAQ page for the Transcriptomics topic to see if your question is listed there. If not, please ask your question on the GTN Gitter Channel or the Galaxy Help ForumUseful literature
Further information, including links to documentation and original publications, regarding the tools, analysis techniques and the interpretation of results described in this tutorial can be found here.
References
- Trapnell, C., D. Cacchiarelli, J. Grimsby, P. Pokharel, S. Li et al., 2014 The dynamics and regulators of cell fate decisions are revealed by pseudotemporal ordering of single cells. Nature Biotechnology 32: 381–386. 10.1038/nbt.2859
- Satija, R., J. A. Farrell, D. Gennert, A. F. Schier, and A. Regev, 2015 Spatial reconstruction of single-cell gene expression data. Nature Biotechnology 33: 495–502. 10.1038/nbt.3192
- McCarthy, D. J., K. R. Campbell, A. T. L. Lun, and Q. F. Wills, 2017 Scater: pre-processing, quality control, normalization and visualization of single-cell RNA-seq data in R. Bioinformatics btw777. 10.1093/bioinformatics/btw777
- Bacon, W. A., R. S. Hamilton, Z. Yu, J. Kieckbusch, D. Hawkes et al., 2018 Single-Cell Analysis Identifies Thymic Maturation Delay in Growth-Restricted Neonatal Mice. Frontiers in Immunology 9: 10.3389/fimmu.2018.02523
- Wolf, F. A., P. Angerer, and F. J. Theis, 2018 SCANPY: large-scale single-cell gene expression data analysis. Genome Biology 19: 10.1186/s13059-017-1382-0
- Cakir, B., M. Prete, N. Huang, S. van Dongen, P. Pir et al., 2020 Comparison of visualization tools for single-cell RNAseq data. NAR Genomics and Bioinformatics 2: 10.1093/nargab/lqaa052
- Moreno, P., N. Huang, J. R. Manning, S. Mohammed, A. Solovyev et al., 2020 User-friendly, scalable tools and workflows for single-cell analysis. bioRxiv. 10.1101/2020.04.08.032698 https://www.biorxiv.org/content/early/2020/04/09/2020.04.08.032698
Feedback
Did you use this material as an instructor? Feel free to give us feedback on how it went.
Did you use this material as a learner or student? Click the form below to leave feedback.
Citing this Tutorial
- , 2022 Filter, Plot and Explore Single-cell RNA-seq Data (Galaxy Training Materials). https://training.galaxyproject.org/training-material/topics/transcriptomics/tutorials/scrna-case_basic-pipeline/tutorial.html Online; accessed TODAY
- Batut et al., 2018 Community-Driven Data Analysis Training for Biology Cell Systems 10.1016/j.cels.2018.05.012
Congratulations on successfully completing this tutorial!@misc{transcriptomics-scrna-case_basic-pipeline, author = "Wendi Bacon", title = "Filter, Plot and Explore Single-cell RNA-seq Data (Galaxy Training Materials)", year = "2022", month = "10", day = "18" url = "\url{https://training.galaxyproject.org/training-material/topics/transcriptomics/tutorials/scrna-case_basic-pipeline/tutorial.html}", note = "[Online; accessed TODAY]" } @article{Batut_2018, doi = {10.1016/j.cels.2018.05.012}, url = {https://doi.org/10.1016%2Fj.cels.2018.05.012}, year = 2018, month = {jun}, publisher = {Elsevier {BV}}, volume = {6}, number = {6}, pages = {752--758.e1}, author = {B{\'{e}}r{\'{e}}nice Batut and Saskia Hiltemann and Andrea Bagnacani and Dannon Baker and Vivek Bhardwaj and Clemens Blank and Anthony Bretaudeau and Loraine Brillet-Gu{\'{e}}guen and Martin {\v{C}}ech and John Chilton and Dave Clements and Olivia Doppelt-Azeroual and Anika Erxleben and Mallory Ann Freeberg and Simon Gladman and Youri Hoogstrate and Hans-Rudolf Hotz and Torsten Houwaart and Pratik Jagtap and Delphine Larivi{\`{e}}re and Gildas Le Corguill{\'{e}} and Thomas Manke and Fabien Mareuil and Fidel Ram{\'{\i}}rez and Devon Ryan and Florian Christoph Sigloch and Nicola Soranzo and Joachim Wolff and Pavankumar Videm and Markus Wolfien and Aisanjiang Wubuli and Dilmurat Yusuf and James Taylor and Rolf Backofen and Anton Nekrutenko and Björn Grüning}, title = {Community-Driven Data Analysis Training for Biology}, journal = {Cell Systems} }