This is an introduction to RNAseq analysis involving reading in quantitated gene expression data from an RNA-seq experiment, exploring the data using base R functions and then analysis with the DESeq2 package. This lesson assumes a basic familiarity with R, data frames, and manipulating data with dplyr and %>%
. See also the Bioconductor heading on the setup page – you’ll need a few additional packages that are available through Bioconductor, not CRAN (the installation process is slightly different).
Recommended reading prior to class:
read_*
functions from the readr package. These functions load data into a tibble instead of R’s traditional data.frame. Tibbles are data frames, but they tweak some older behaviors to make life a little easier. These sections explain the few key small differences between traditional data.frames and tibbles.Slides: click here.
countData
): airway_scaledcounts.csvcolData
): airway_metadata.csvThe data for this lesson comes from:
Himes et al. “RNA-Seq Transcriptome Profiling Identifies CRISPLD2 as a Glucocorticoid Responsive Gene that Modulates Cytokine Function in Airway Smooth Muscle Cells.” PLoS ONE. 2014 Jun 13;9(6):e99625. PMID: 24926665.
Glucocorticoids are potent inhibitors of inflammatory processes, and are widely used to treat asthma because of their anti-inflammatory effects on airway smooth muscle (ASM) cells. But what’s the molecular mechanism? This study used RNA-seq to profile gene expression changes in four different ASM cell lines treated with dexamethasone, a synthetic glucocorticoid molecule. They found a number of differentially expressed genes comparing dexamethasone-treated ASM cells to control cells, but focus much of the discussion on a gene called CRISPLD2. This gene encodes a secreted protein known to be involved in lung development, and SNPs in this gene in previous GWAS studies are associated with inhaled corticosteroid resistance and bronchodilator response in asthma patients. They confirmed the upregulated CRISPLD2 mRNA expression with qPCR and increased protein expression using Western blotting.
They did their analysis using Tophat and Cufflinks. We’re taking a different approach and using an R package called DESeq2. Click here to read more on DESeq2 and other approaches.
Analyzing an RNAseq experiment begins with sequencing reads. There are many ways to begin analyzing this data, and you should check out the three papers below to get a sense of other analysis strategies. In the workflow we’ll use here, sequencing reads were pseudoaligned to a reference transcriptome and the abundance of each transcript quantified using kallisto (software, paper). Transcript-level abundance estimates were then summarized to the gene level to produce length-scaled counts using txImport (software, paper), suitable for using in count-based analysis tools like DESeq. This is the starting point - a “count matrix,” where each cell indicates the number of reads mapping to a particular gene (in rows) for each sample (in columns). This is one of several potential workflows, and relies on having a well-annotated reference transcriptome. However, there are many well-established alternative analysis paths, and the goal here is to provide a reference point to acquire fundamental skills that will be applicable to other bioinformatics tools and workflows.
This data was downloaded from GEO (GSE:GSE52778). You can read more about how the data was processed by going over the slides. If you’d like to see the code used for the upstream pre-processing with kallisto and txImport, see the code.
We’ll come back to this again later, but the data at our starting point looks like this (note: this is a generic schematic - our genes are not actually geneA
and geneB
, and our samples aren’t called ctrl_1
, ctrl_2
, etc.):
That is, we have two tables:
countData
in DESeq-speak) – where genes are in rows and samples are in columns, and the number in each cell is the number of reads that mapped to exons in that gene for that sample: airway_scaledcounts.csv.colData
in DESeq-speak) – where samples are in rows and metadata about those samples are in columns: airway_metadata.csv. It’s called the colData
because this table supplies metadata/information about the columns of the countData
matrix. Notice that the first column of colData
must match the column names of countData
(except the first, which is the gene ID column).1First, let’s load the readr, dplyr, and ggplot2 packages. Then let’s import our data with readr’s read_csv()
function (note: not read.csv()
). Let’s read in the actual count data and the experimental metadata.
library(readr)
library(dplyr)
library(ggplot2)
mycounts <- read_csv("data/airway_scaledcounts.csv")
metadata <- read_csv("data/airway_metadata.csv")
Now, take a look at each.
mycounts
## # A tibble: 38,694 x 9
## ensgene SRR1039508 SRR1039509 SRR1039512 SRR1039513 SRR1039516
## <chr> <dbl> <dbl> <dbl> <dbl> <dbl>
## 1 ENSG00000000003 723 486 904 445 1170
## 2 ENSG00000000005 0 0 0 0 0
## 3 ENSG00000000419 467 523 616 371 582
## 4 ENSG00000000457 347 258 364 237 318
## 5 ENSG00000000460 96 81 73 66 118
## 6 ENSG00000000938 0 0 1 0 2
## 7 ENSG00000000971 3413 3916 6000 4308 6424
## 8 ENSG00000001036 2328 1714 2640 1381 2165
## 9 ENSG00000001084 670 372 692 448 917
## 10 ENSG00000001167 426 295 531 178 740
## # ... with 38,684 more rows, and 3 more variables: SRR1039517 <dbl>,
## # SRR1039520 <dbl>, SRR1039521 <dbl>
metadata
## # A tibble: 8 x 4
## id dex celltype geo_id
## <chr> <chr> <chr> <chr>
## 1 SRR1039508 control N61311 GSM1275862
## 2 SRR1039509 treated N61311 GSM1275863
## 3 SRR1039512 control N052611 GSM1275866
## 4 SRR1039513 treated N052611 GSM1275867
## 5 SRR1039516 control N080611 GSM1275870
## 6 SRR1039517 treated N080611 GSM1275871
## 7 SRR1039520 control N061011 GSM1275874
## 8 SRR1039521 treated N061011 GSM1275875
Notice something here. The sample IDs in the metadata sheet (SRR1039508, SRR1039509, etc.) exactly match the column names of the countdata, except for the first column, which contains the Ensembl gene ID. This is important, and we’ll get more strict about it later on.
Let’s look for differential gene expression. Note: this analysis is for demonstration only. NEVER do differential expression analysis this way!
Let’s start with an exercise.
If we look at our metadata, we see that the control samples are SRR1039508, SRR1039512, SRR1039516, and SRR1039520. This bit of code will take the mycounts
data, mutate()
it to add a column called controlmean
, then select()
only the gene name and this newly created column, and assigning the result to a new object called meancounts
. (Hint: mycounts %>% mutate(...) %>% select(...)
)
meancounts <- mycounts %>%
mutate(controlmean = (SRR1039508+SRR1039512+SRR1039516+SRR1039520)/4) %>%
select(ensgene, controlmean)
meancounts
## # A tibble: 38,694 x 2
## ensgene controlmean
## <chr> <dbl>
## 1 ENSG00000000003 900.75
## 2 ENSG00000000005 0.00
## 3 ENSG00000000419 520.50
## 4 ENSG00000000457 339.75
## 5 ENSG00000000460 97.25
## 6 ENSG00000000938 0.75
## 7 ENSG00000000971 5219.00
## 8 ENSG00000001036 2327.00
## 9 ENSG00000001084 755.75
## 10 ENSG00000001167 527.75
## # ... with 38,684 more rows
mutate()
it once more (prior to the select()
) function, to add another column called treatedmean
that takes the mean of the expression values of the treated samples. Then select()
only the ensgene
, controlmean
and treatedmean
columns, assigning it to a new object called meancounts.## # A tibble: 38,694 x 3
## ensgene controlmean treatedmean
## <chr> <dbl> <dbl>
## 1 ENSG00000000003 900.75 658.0
## 2 ENSG00000000005 0.00 0.0
## 3 ENSG00000000419 520.50 546.0
## 4 ENSG00000000457 339.75 316.5
## 5 ENSG00000000460 97.25 78.8
## 6 ENSG00000000938 0.75 0.0
## 7 ENSG00000000971 5219.00 6687.5
## 8 ENSG00000001036 2327.00 1785.8
## 9 ENSG00000001084 755.75 578.0
## 10 ENSG00000001167 527.75 348.2
## # ... with 38,684 more rows
summarize()
the data to show the sum
of the mean counts across all genes for each group. Your answer should look like this:## # A tibble: 1 x 2
## `sum(controlmean)` `sum(treatedmean)`
## <dbl> <dbl>
## 1 2.3e+07 22196524
How about another?
... + scale_..._log10()
)We can find candidate differentially expressed genes by looking for genes with a large change between control and dex-treated samples. We usually look at the \(log_2\) of the fold change, because this has better mathematical properties. On the absolute scale, upregulation goes from 1 to infinity, while downregulation is bounded by 0 and 1. On the log scale, upregulation goes from 0 to infinity, and downregulation goes from 0 to negative infinity. So, let’s mutate our meancounts
object to add a log2foldchange
column. Optionally pipe this to View()
.
meancounts %>% mutate(log2fc=log2(treatedmean/controlmean))
## # A tibble: 38,694 x 4
## ensgene controlmean treatedmean log2fc
## <chr> <dbl> <dbl> <dbl>
## 1 ENSG00000000003 900.75 658.0 -0.453
## 2 ENSG00000000005 0.00 0.0 NaN
## 3 ENSG00000000419 520.50 546.0 0.069
## 4 ENSG00000000457 339.75 316.5 -0.102
## 5 ENSG00000000460 97.25 78.8 -0.304
## 6 ENSG00000000938 0.75 0.0 -Inf
## 7 ENSG00000000971 5219.00 6687.5 0.358
## 8 ENSG00000001036 2327.00 1785.8 -0.382
## 9 ENSG00000001084 755.75 578.0 -0.387
## 10 ENSG00000001167 527.75 348.2 -0.600
## # ... with 38,684 more rows
There are a couple of “weird” results. Namely, the NaN
(“not a number”) and -Inf
(negative infinity) results. The NaN
is returned when you divide by zero and try to take the log. The -Inf
is returned when you try to take the log of zero. It turns out that there are a lot of genes with zero expression. Let’s filter our meancounts
data, mutate it to add the \(log_2(Fold Change)\), and when we’re happy with what we see, let’s reassign the result of that operation back to the meancounts object. (Note: this is destructive. If you’re coding interactively like we’re doing now, before you do this it’s good practice to see what the result of the operation is prior to making the reassignment.)
# Try running the code first, prior to reassigning.
meancounts <- meancounts %>%
filter(controlmean>0 & treatedmean>0) %>%
mutate(log2fc=log2(treatedmean/controlmean))
meancounts
## # A tibble: 21,817 x 4
## ensgene controlmean treatedmean log2fc
## <chr> <dbl> <dbl> <dbl>
## 1 ENSG00000000003 900.8 658.0 -0.453
## 2 ENSG00000000419 520.5 546.0 0.069
## 3 ENSG00000000457 339.8 316.5 -0.102
## 4 ENSG00000000460 97.2 78.8 -0.304
## 5 ENSG00000000971 5219.0 6687.5 0.358
## 6 ENSG00000001036 2327.0 1785.8 -0.382
## 7 ENSG00000001084 755.8 578.0 -0.387
## 8 ENSG00000001167 527.8 348.2 -0.600
## 9 ENSG00000001460 226.8 185.5 -0.290
## 10 ENSG00000001461 3169.5 2701.2 -0.231
## # ... with 21,807 more rows
A common threshold used for calling something differentially expressed is a \(log_2(FoldChange)\) of greater than 2 or less than -2. Let’s filter the dataset both ways to see how many genes are up or down-regulated.
meancounts %>% filter(log2fc>2)
## # A tibble: 250 x 4
## ensgene controlmean treatedmean log2fc
## <chr> <dbl> <dbl> <dbl>
## 1 ENSG00000004799 270.50 1429.25 2.40
## 2 ENSG00000006788 2.75 19.75 2.84
## 3 ENSG00000008438 0.50 2.75 2.46
## 4 ENSG00000011677 0.50 2.25 2.17
## 5 ENSG00000015413 0.50 3.00 2.58
## 6 ENSG00000015592 0.50 2.25 2.17
## 7 ENSG00000046653 323.00 2126.50 2.72
## 8 ENSG00000070190 0.50 3.00 2.58
## 9 ENSG00000070388 3.50 17.50 2.32
## 10 ENSG00000074317 0.25 1.75 2.81
## # ... with 240 more rows
meancounts %>% filter(log2fc<(-2))
## # A tibble: 367 x 4
## ensgene controlmean treatedmean log2fc
## <chr> <dbl> <dbl> <dbl>
## 1 ENSG00000015520 32.00 6.00 -2.42
## 2 ENSG00000019186 26.50 1.75 -3.92
## 3 ENSG00000025423 295.00 54.25 -2.44
## 4 ENSG00000028277 88.25 22.00 -2.00
## 5 ENSG00000029559 1.25 0.25 -2.32
## 6 ENSG00000049246 405.00 93.00 -2.12
## 7 ENSG00000049247 1.25 0.25 -2.32
## 8 ENSG00000052344 2.25 0.25 -3.17
## 9 ENSG00000054179 3.00 0.25 -3.58
## 10 ENSG00000064201 30.00 6.50 -2.21
## # ... with 357 more rows
In total, we’ve got 617 differentially expressed genes, in either direction.
Look up help on ?inner_join
or Google around for help for using dplyr’s inner_join()
to join two tables by a common column/key. You downloaded annotables_grch38.csv from the data downloads page. Load this data with read_csv()
into an object called anno
. Pipe it to View()
or click on the object in the Environment pane to view the entire dataset. This table links the unambiguous Ensembl gene ID to things like the gene symbol, full gene name, location, Entrez gene ID, etc.
anno <- read_csv("data/annotables_grch38.csv")
anno
## # A tibble: 66,531 x 9
## ensgene entrez symbol chr start end strand
## <chr> <int> <chr> <chr> <int> <int> <int>
## 1 ENSG00000000003 7105 TSPAN6 X 100627109 100639991 -1
## 2 ENSG00000000005 64102 TNMD X 100584802 100599885 1
## 3 ENSG00000000419 8813 DPM1 20 50934867 50958555 -1
## 4 ENSG00000000457 57147 SCYL3 1 169849631 169894267 -1
## 5 ENSG00000000460 55732 C1orf112 1 169662007 169854080 1
## 6 ENSG00000000938 2268 FGR 1 27612064 27635277 -1
## 7 ENSG00000000971 3075 CFH 1 196651878 196747504 1
## 8 ENSG00000001036 2519 FUCA2 6 143494811 143511690 -1
## 9 ENSG00000001084 2729 GCLC 6 53497341 53616970 -1
## 10 ENSG00000001167 4800 NFYA 6 41072945 41099976 1
## # ... with 66,521 more rows, and 2 more variables: biotype <chr>,
## # description <chr>
meancounts
object, and arrange()
it desc
ending by the absolute value (abs()
) of the log2fc
column. The first few rows should look like this:## # A tibble: 3 x 4
## ensgene controlmean treatedmean log2fc
## <chr> <dbl> <dbl> <dbl>
## 1 ENSG00000179593 0.25 129.5 9.02
## 2 ENSG00000277196 0.50 63.8 6.99
## 3 ENSG00000109906 14.75 808.8 5.78
inner_join()
it to the anno
data by the ensgene
column. Either assign it to a temporary object or pipe the whole thing to View
to take a look. What do you notice? Would you trust these results? Why or why not?## # A tibble: 21,995 x 12
## ensgene controlmean treatedmean log2fc entrez symbol
## <chr> <dbl> <dbl> <dbl> <int> <chr>
## 1 ENSG00000179593 0.25 129.50 9.02 247 ALOX15B
## 2 ENSG00000277196 0.50 63.75 6.99 102724788 AC007325.2
## 3 ENSG00000109906 14.75 808.75 5.78 7704 ZBTB16
## 4 ENSG00000128285 12.75 0.25 -5.67 2847 MCHR1
## 5 ENSG00000171819 9.00 427.25 5.57 10218 ANGPTL7
## 6 ENSG00000137673 0.25 10.25 5.36 4316 MMP7
## 7 ENSG00000241713 0.25 7.25 4.86 58496 LY6G5B
## 8 ENSG00000277399 0.50 13.25 4.73 440435 GPR179
## 9 ENSG00000118729 25.50 1.00 -4.67 845 CASQ2
## 10 ENSG00000127954 34.25 826.75 4.59 79689 STEAP4
## # ... with 21,985 more rows, and 6 more variables: chr <chr>, start <int>,
## # end <int>, strand <int>, biotype <chr>, description <chr>
Let’s do this the right way. DESeq2 is an R package for analyzing count-based NGS data like RNA-seq. It is available from Bioconductor. Bioconductor is a project to provide tools for analysing high-throughput genomic data including RNA-seq, ChIP-seq and arrays. You can explore Bioconductor packages here.
Bioconductor packages usually have great documentation in the form of vignettes. For a great example, take a look at the DESeq2 vignette for analyzing count data. This 40+ page manual is packed full of examples on using DESeq2, importing data, fitting models, creating visualizations, references, etc.
Just like R packages from CRAN, you only need to install Bioconductor packages once (instructions here), then load them every time you start a new R session.
library(DESeq2)
citation("DESeq2")
Take a second and read through all the stuff that flies by the screen when you load the DESeq2 package. When you first installed DESeq2 it may have taken a while, because DESeq2 depends on a number of other R packages (S4Vectors, BiocGenerics, parallel, IRanges, etc.) Each of these, in turn, may depend on other packages. These are all loaded into your working environment when you load DESeq2. Also notice the lines that start with The following objects are masked from 'package:...
. One example of this is the rename()
function from the dplyr package. When the S4Vectors package was loaded, it loaded it’s own function called rename()
. Now, if you wanted to use dplyr’s rename function, you’ll have to call it explicitly using this kind of syntax: dplyr::rename()
. See this Q&A thread for more.
DESeq works on a particular type of object called a DESeqDataSet. The DESeqDataSet is a single object that contains input values, intermediate calculations like how things are normalized, and all results of a differential expression analysis. You can construct a DESeqDataSet from a count matrix, a metadata file, and a formula indicating the design of the experiment. See the help for ?DESeqDataSetFromMatrix
. If you read through the DESeq2 vignette you’ll read about the structure of the data that you need to construct a DESeqDataSet object.
DESeqDataSetFromMatrix
requires the count matrix (countData
argument) to be a matrix or numeric data frame. either the row names or the first column of the countData
must be the identifier you’ll use for each gene. The column names of countData
are the sample IDs, and they must match the row names of colData
(or the first column when tidy=TRUE
). colData
is an additional dataframe describing sample metadata. Both colData
and countData
must be regular data.frame
objects – they can’t have the special tbl
class wrapper created when importing with readr::read_*
.
Let’s look at our mycounts and metadata again.
mycounts
## # A tibble: 38,694 x 9
## ensgene SRR1039508 SRR1039509 SRR1039512 SRR1039513 SRR1039516
## <chr> <dbl> <dbl> <dbl> <dbl> <dbl>
## 1 ENSG00000000003 723 486 904 445 1170
## 2 ENSG00000000005 0 0 0 0 0
## 3 ENSG00000000419 467 523 616 371 582
## 4 ENSG00000000457 347 258 364 237 318
## 5 ENSG00000000460 96 81 73 66 118
## 6 ENSG00000000938 0 0 1 0 2
## 7 ENSG00000000971 3413 3916 6000 4308 6424
## 8 ENSG00000001036 2328 1714 2640 1381 2165
## 9 ENSG00000001084 670 372 692 448 917
## 10 ENSG00000001167 426 295 531 178 740
## # ... with 38,684 more rows, and 3 more variables: SRR1039517 <dbl>,
## # SRR1039520 <dbl>, SRR1039521 <dbl>
metadata
## # A tibble: 8 x 4
## id dex celltype geo_id
## <chr> <chr> <chr> <chr>
## 1 SRR1039508 control N61311 GSM1275862
## 2 SRR1039509 treated N61311 GSM1275863
## 3 SRR1039512 control N052611 GSM1275866
## 4 SRR1039513 treated N052611 GSM1275867
## 5 SRR1039516 control N080611 GSM1275870
## 6 SRR1039517 treated N080611 GSM1275871
## 7 SRR1039520 control N061011 GSM1275874
## 8 SRR1039521 treated N061011 GSM1275875
class(mycounts)
## [1] "tbl_df" "tbl" "data.frame"
class(metadata)
## [1] "tbl_df" "tbl" "data.frame"
Remember, we read in our count data and our metadata using read_csv()
which read them in as those “special” dplyr data frames / tbls. We’ll need to convert them back to regular data frames for them to work well with DESeq2.
mycounts <- as.data.frame(mycounts)
metadata <- as.data.frame(metadata)
head(mycounts)
head(metadata)
class(mycounts)
class(metadata)
Let’s check that the column names of our count data (except the first, which is ensgene
) are the same as the IDs from our colData.
names(mycounts)[-1]
## [1] "SRR1039508" "SRR1039509" "SRR1039512" "SRR1039513" "SRR1039516"
## [6] "SRR1039517" "SRR1039520" "SRR1039521"
metadata$id
## [1] "SRR1039508" "SRR1039509" "SRR1039512" "SRR1039513" "SRR1039516"
## [6] "SRR1039517" "SRR1039520" "SRR1039521"
names(mycounts)[-1]==metadata$id
## [1] TRUE TRUE TRUE TRUE TRUE TRUE TRUE TRUE
all(names(mycounts)[-1]==metadata$id)
## [1] TRUE
Now we can move on to constructing the actual DESeqDataSet object. The last thing we’ll need to specify is a design – a formula which expresses how the counts for each gene depend on the variables in colData. Take a look at metadata
again. The thing we’re interested in is the dex
column, which tells us which samples are treated with dexamethasone versus which samples are untreated controls. We’ll specify the design with a tilde, like this: design=~dex
. (The tilde is the shifted key to the left of the number 1 key on my keyboard. It looks like a little squiggly line). So let’s contruct the object and call it dds
, short for our DESeqDataSet. If you get a warning about “some variables in design formula are characters, converting to factors” don’t worry about it. Take a look at the dds
object once you create it.
dds <- DESeqDataSetFromMatrix(countData=mycounts,
colData=metadata,
design=~dex,
tidy=TRUE)
dds
## class: DESeqDataSet
## dim: 38694 8
## metadata(1): version
## assays(1): counts
## rownames(38694): ENSG00000000003 ENSG00000000005 ...
## ENSG00000283120 ENSG00000283123
## rowData names(0):
## colnames(8): SRR1039508 SRR1039509 ... SRR1039520 SRR1039521
## colData names(4): id dex celltype geo_id
Next, let’s run the DESeq pipeline on the dataset, and reassign the resulting object back to the same variable. Before we start, dds
is a bare-bones DESeqDataSet. The DESeq()
function takes a DESeqDataSet and returns a DESeqDataSet, but with lots of other information filled in (normalization, dispersion estimates, differential expression results, etc). Notice how if we try to access these objects before running the analysis, nothing exists.
sizeFactors(dds)
## NULL
dispersions(dds)
## NULL
results(dds)
## Error in results(dds): couldn't find results. you should first run DESeq()
Here, we’re running the DESeq pipeline on the dds
object, and reassigning the whole thing back to dds
, which will now be a DESeqDataSet populated with all those values. Get some help on ?DESeq
(notice, no “2” on the end). This function calls a number of other functions within the package to essentially run the entire pipeline (normalizing by library size by estimating the “size factors,” estimating dispersion for the negative binomial model, and fitting models and getting statistics for each gene for the design specified when you imported the data).
dds <- DESeq(dds)
Since we’ve got a fairly simple design (single factor, two groups, treated versus control), we can get results out of the object simply by calling the results()
function on the DESeqDataSet that has been run through the pipeline. The help page for ?results
and the vignette both have extensive documentation about how to pull out the results for more complicated models (multi-factor experiments, specific contrasts, interaction terms, time courses, etc.).
Note two things:
tidy=TRUE
argument, which tells DESeq2 to output the results table with rownames as a first column called ‘row.’ If we didn’t do this, the gene names would be stuck in the row.names, and we’d have a hard time filtering or otherwise using that column.res
. You’ll see that it doesn’t print as nicly as the data we read in with read_csv
. We can add this “special” attribute to the raw data returned which just tells R to print it nicely.res <- results(dds, tidy=TRUE)
res <- as_tibble(res)
res
## # A tibble: 38,694 x 7
## row baseMean log2FoldChange lfcSE stat pvalue padj
## <chr> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl>
## 1 ENSG00000000003 747.194 -0.3507 0.168 -2.085 0.0371 0.163
## 2 ENSG00000000005 0.000 NA NA NA NA NA
## 3 ENSG00000000419 520.134 0.2061 0.101 2.040 0.0413 0.176
## 4 ENSG00000000457 322.665 0.0245 0.145 0.169 0.8658 0.962
## 5 ENSG00000000460 87.683 -0.1471 0.257 -0.573 0.5669 0.816
## 6 ENSG00000000938 0.319 -1.7323 3.494 -0.496 0.6200 NA
## 7 ENSG00000000971 5760.148 0.4593 0.234 1.960 0.0500 0.201
## 8 ENSG00000001036 2025.392 -0.2282 0.125 -1.826 0.0678 0.247
## 9 ENSG00000001084 652.173 -0.2530 0.203 -1.249 0.2116 0.495
## 10 ENSG00000001167 411.684 -0.5337 0.229 -2.333 0.0197 0.105
## # ... with 38,684 more rows
Either click on the res
object in the environment pane or pass it to View()
to bring it up in a data viewer. Why do you think so many of the adjusted p-values are missing (NA
)? Try looking at the baseMean
column, which tells you the average overall expression of this gene, and how that relates to whether or not the p-value was missing. Go to the DESeq2 vignette and read the section about “Independent filtering and multiple testing.”
The goal of independent filtering is to filter out those tests from the procedure that have no, or little chance of showing significant evidence, without even looking at the statistical result. Genes with very low counts are not likely to see significant differences typically due to high dispersion. This results in increased detection power at the same experiment-wide type I error [i.e., better FDRs].
%>%
, arrange
the results by the adjusted p-value.## # A tibble: 38,694 x 7
## row baseMean log2FoldChange lfcSE stat pvalue padj
## <chr> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl>
## 1 ENSG00000152583 955 4.37 0.2371 18.4 8.87e-76 1.34e-71
## 2 ENSG00000179094 743 2.86 0.1756 16.3 7.97e-60 6.04e-56
## 3 ENSG00000116584 2278 -1.03 0.0651 -15.9 5.80e-57 2.93e-53
## 4 ENSG00000189221 2384 3.34 0.2124 15.7 9.24e-56 3.50e-52
## 5 ENSG00000120129 3441 2.97 0.2037 14.6 5.31e-48 1.61e-44
## 6 ENSG00000148175 13494 1.43 0.1004 14.2 6.93e-46 1.75e-42
## 7 ENSG00000178695 2685 -2.49 0.1781 -14.0 2.11e-44 4.56e-41
## 8 ENSG00000109906 440 5.93 0.4282 13.8 1.40e-43 2.65e-40
## 9 ENSG00000134686 2934 1.44 0.1058 13.6 3.88e-42 6.53e-39
## 10 ENSG00000101347 14135 3.85 0.2849 13.5 1.28e-41 1.94e-38
## # ... with 38,684 more rows
inner_join()
, joining the results to the anno
object. See the help for ?inner_join
, specifically the by=
argument. You’ll have to do something like ... %>% inner_join(anno, by=c("row"="ensgene"))
. Once you’re happy with this result, reassign the result back to res
. It’ll look like this.## row baseMean log2FoldChange lfcSE stat pvalue padj
## 1 ENSG00000152583 955 4.37 0.2371 18.4 8.87e-76 1.34e-71
## 2 ENSG00000179094 743 2.86 0.1756 16.3 7.97e-60 6.04e-56
## 3 ENSG00000116584 2278 -1.03 0.0651 -15.9 5.80e-57 2.93e-53
## 4 ENSG00000189221 2384 3.34 0.2124 15.7 9.24e-56 3.50e-52
## 5 ENSG00000120129 3441 2.97 0.2037 14.6 5.31e-48 1.61e-44
## 6 ENSG00000148175 13494 1.43 0.1004 14.2 6.93e-46 1.75e-42
## entrez symbol chr start end strand biotype
## 1 8404 SPARCL1 4 87473335 87531061 -1 protein_coding
## 2 5187 PER1 17 8140472 8156506 -1 protein_coding
## 3 9181 ARHGEF2 1 155946851 156007070 -1 protein_coding
## 4 4128 MAOA X 43654907 43746824 1 protein_coding
## 5 1843 DUSP1 5 172768090 172771195 -1 protein_coding
## 6 2040 STOM 9 121338988 121370304 -1 protein_coding
## description
## 1 SPARC-like 1 (hevin) [Source:HGNC Symbol;Acc:HGNC:11220]
## 2 period circadian clock 1 [Source:HGNC Symbol;Acc:HGNC:8845]
## 3 Rho/Rac guanine nucleotide exchange factor (GEF) 2 [Source:HGNC Symbol;Acc:HGNC:682]
## 4 monoamine oxidase A [Source:HGNC Symbol;Acc:HGNC:6833]
## 5 dual specificity phosphatase 1 [Source:HGNC Symbol;Acc:HGNC:3064]
## 6 stomatin [Source:HGNC Symbol;Acc:HGNC:3383]
filter()
).## [1] 2187
Finally, let’s write out the significant results. See the help for ?write_csv
, which is part of the readr package (note: this is not the same as write.csv
with a dot.). We can continue that pipe and write out the significant results to a file like so:
res %>%
filter(padj<0.05) %>%
write_csv("sigresults.csv")
You can open this file in Excel or any text editor (try it now).
DESeq2 offers a function called plotCounts()
that takes a DESeqDataSet that has been run through the pipeline, the name of a gene, and the name of the variable in the colData
that you’re interested in, and plots those values. See the help for ?plotCounts
. Let’s first see what the gene ID is for the CRISPLD2 gene using res %>% filter(symbol=="CRISPLD2")
. Now, let’s plot the counts, where our intgroup
, or “interesting group” variable is the “dex” column.
plotCounts(dds, gene="ENSG00000103196", intgroup="dex")
That’s just okay. Keep looking at the help for ?plotCounts
. Notice that we could have actually returned the data instead of plotting. We could then pipe this to ggplot and make our own figure. Let’s make a boxplot.
# Return the data
plotCounts(dds, gene="ENSG00000103196", intgroup="dex", returnData=TRUE)
## count dex
## SRR1039508 775 control
## SRR1039509 6259 treated
## SRR1039512 1100 control
## SRR1039513 6093 treated
## SRR1039516 737 control
## SRR1039517 2742 treated
## SRR1039520 843 control
## SRR1039521 6225 treated
# Plot it
plotCounts(dds, gene="ENSG00000103196", intgroup="dex", returnData=TRUE) %>%
ggplot(aes(dex, count)) + geom_boxplot(aes(fill=dex)) + scale_y_log10() + ggtitle("CRISPLD2")
Let’s make some commonly produced visualizations from this data. First, let’s mutate our results object to add a column called sig
that evaluates to TRUE
if padj<0.05, and FALSE if not, and NA if padj is also NA.
# Create the new column
res <- res %>% mutate(sig=padj<0.05)
# How many of each?
res %>%
group_by(sig) %>%
summarize(n=n())
## # A tibble: 3 x 2
## sig n
## <lgl> <int>
## 1 FALSE 13105
## 2 TRUE 2187
## 3 NA 23665
Look up the Wikipedia articles on MA plots and volcano plots. An MA plot shows the average expression on the X-axis and the log fold change on the y-axis. A volcano plot shows the log fold change on the X-axis, and the \(-log_{10}\) of the p-value on the Y-axis (the more significant the p-value, the larger the \(-log_{10}\) of that value will be).
To test for differential expression we operate on raw counts. But for other downstream analyses like heatmaps, PCA, or clustering, we need to work with transformed versions of the data, because it’s not clear how to best compute a distance metric on untransformed counts. The go-to choice might be a log transformation. But because many samples have a zero count (and \(log(0)=-\infty\), you might try using pseudocounts, i. e. \(y = log(n + 1)\) or more generally, \(y = log(n + n_0)\), where \(n\) represents the count values and \(n_0\) is some positive constant.
But there are other approaches that offer better theoretical justification and a rational way of choosing the parameter equivalent to \(n_0\), and they produce transformed data on the log scale that’s normalized to library size. One is called a variance stabilizing transformation (VST), and it also removes the dependence of the variance on the mean, particularly the high variance of the log counts when the mean is low.
vsdata <- vst(dds, blind=FALSE)
Let’s do some exploratory plotting of the data using principal components analysis on the variance stabilized data from above. Let’s use the DESeq2-provided plotPCA
function. See the help for ?plotPCA
and notice that it also has a returnData
option, just like plotCounts
.
plotPCA(vsdata, intgroup="dex")
Principal Components Analysis (PCA) is a dimension reduction and visualization technique that is here used to project the multivariate data vector of each sample into a two-dimensional plot, such that the spatial arrangement of the points in the plot reflects the overall data (dis)similarity between the samples. In essence, principal component analysis distills all the global variation between samples down to a few variables called principal components. The majority of variation between the samples can be summarized by the first principal component, which is shown on the x-axis. The second principal component summarizes the residual variation that isn’t explained by PC1. PC2 is shown on the y-axis. The percentage of the global variation explained by each principal component is given in the axis labels. In a two-condition scenario (e.g., mutant vs WT, or treated vs control), you might expect PC1 to separate the two experimental conditions, so for example, having all the controls on the left and all experimental samples on the right (or vice versa - the units and directionality isn’t important). The secondary axis may separate other aspects of the design - cell line, time point, etc. Very often the experimental design is reflected in the PCA plot, and in this case, it is. But this kind of diagnostic can be useful for finding outliers, investigating batch effects, finding sample swaps, and other technical problems with the data. This YouTube video from the Genetics Department at UNC gives a very accessible explanation of what PCA is all about in the context of a gene expression experiment, without the need for an advanced math background. Take a look.
Heatmaps are complicated, and are often poorly understood. It’s a type of visualization used very often in high-throughput biology where data are clustered on rows and columns, and the actual data is displayed as tiles on a grid, where the values are mapped to some color spectrum. Our R useRs group MeetUp had a session on making heatmaps, which I summarized in this blog post. Take a look at the code from that meetup, and the documentation for the aheatmap
function in the NMF package to see if you can re-create this image. Here, I’m clustering all samples using the top 25 most differentially regulated genes, labeling the rows with the gene symbol, and putting two annotation color bars across the top of the main heatmap panel showing treatment and cell line annotations from our metadata. Take a look at the Rmarkdown source for this lesson for the code.
sessionInfo()
The sessionInfo()
prints version information about R and any attached packages. It’s a good practice to always run this command at the end of your R session and record it for the sake of reproducibility in the future.
sessionInfo()
## R version 3.4.2 (2017-09-28)
## Platform: x86_64-apple-darwin15.6.0 (64-bit)
## Running under: macOS Sierra 10.12.6
##
## Matrix products: default
## BLAS: /Library/Frameworks/R.framework/Versions/3.4/Resources/lib/libRblas.0.dylib
## LAPACK: /Library/Frameworks/R.framework/Versions/3.4/Resources/lib/libRlapack.dylib
##
## locale:
## [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
##
## attached base packages:
## [1] parallel stats4 stats graphics grDevices utils datasets
## [8] methods base
##
## other attached packages:
## [1] DESeq2_1.16.1 SummarizedExperiment_1.6.5
## [3] DelayedArray_0.2.7 matrixStats_0.52.2
## [5] Biobase_2.36.2 GenomicRanges_1.28.6
## [7] GenomeInfoDb_1.12.3 IRanges_2.10.5
## [9] S4Vectors_0.14.7 BiocGenerics_0.22.1
## [11] bindrcpp_0.2 readr_1.1.1
## [13] ggplot2_2.2.1 dplyr_0.7.4
## [15] knitr_1.17
##
## loaded via a namespace (and not attached):
## [1] foreach_1.4.3 bit64_0.9-7
## [3] splines_3.4.2 Formula_1.2-2
## [5] assertthat_0.2.0 latticeExtra_0.6-28
## [7] blob_1.1.0 GenomeInfoDbData_0.99.0
## [9] yaml_2.1.14 RSQLite_2.0
## [11] backports_1.1.1 lattice_0.20-35
## [13] glue_1.1.1 digest_0.6.12
## [15] RColorBrewer_1.1-2 XVector_0.16.0
## [17] checkmate_1.8.4 colorspace_1.3-2
## [19] htmltools_0.3.6 Matrix_1.2-11
## [21] plyr_1.8.4 XML_3.98-1.9
## [23] pkgconfig_2.0.1 genefilter_1.58.1
## [25] zlibbioc_1.22.0 xtable_1.8-2
## [27] scales_0.5.0 BiocParallel_1.10.1
## [29] htmlTable_1.9 tibble_1.3.4
## [31] annotate_1.54.0 pkgmaker_0.22
## [33] nnet_7.3-12 lazyeval_0.2.0
## [35] survival_2.41-3 magrittr_1.5
## [37] memoise_1.1.0 evaluate_0.10.1
## [39] doParallel_1.0.11 NMF_0.20.6
## [41] foreign_0.8-69 registry_0.3
## [43] tools_3.4.2 data.table_1.10.4-2
## [45] hms_0.3 gridBase_0.4-7
## [47] stringr_1.2.0 locfit_1.5-9.1
## [49] munsell_0.4.3 rngtools_1.2.4
## [51] cluster_2.0.6 AnnotationDbi_1.38.2
## [53] compiler_3.4.2 rlang_0.1.2
## [55] grid_3.4.2 RCurl_1.95-4.8
## [57] iterators_1.0.8 htmlwidgets_0.9
## [59] bitops_1.0-6 base64enc_0.1-3
## [61] labeling_0.3 rmarkdown_1.6
## [63] gtable_0.2.0 codetools_0.2-15
## [65] DBI_0.7 reshape2_1.4.2
## [67] R6_2.2.2 gridExtra_2.3
## [69] bit_1.1-12 bindr_0.1
## [71] Hmisc_4.0-3 rprojroot_1.2
## [73] stringi_1.1.5 Rcpp_0.12.13
## [75] geneplotter_1.54.0 rpart_4.1-11
## [77] acepack_1.4.1
Pathway analysis or gene set analysis means many different things, general approaches are nicely reviewed in: Khatri, et al. “Ten years of pathway analysis: current approaches and outstanding challenges.” PLoS Comput Biol 8.2 (2012): e1002375.
There are many freely available tools for pathway or over-representation analysis. Bioconductor alone has over 70 packages categorized under gene set enrichment and over 100 packages categorized under pathways. I wrote this tutorial in 2015 showing how to use the GAGE (Generally Applicable Gene set Enrichment)2 package to do KEGG pathway enrichment analysis on differential expression results.
While there are many freely available tools to do this, and some are truly fantastic, many of them are poorly maintained or rarely updated. The DAVID tool that a lot of folks use wasn’t updated at all between Jan 2010 and Oct 2016.
UVA has a site license to Ingenuity Pathway Analysis. Statistically, IPA isn’t doing anything revolutionary methodologically, but the real value comes in with its (1) ease of use, and (2) highly curated knowledgebase. You can get access to IPA through the Health Sciences Library at this link, and there are also links to UVA support resources for using IPA.
This summary report is the first thing you would get out of IPA after running a core analysis on the results of this analysis. Open it up and take a look.
It shows, among other things, that the endothelial nitric-oxide synthase signaling pathway is highly over-represented among the most differentially expressed genes. For this, or any pathway you’re interested in, IPA will give you a report like this one for eNOS with a very detailed description of the pathway, what kind of diseases it’s involved in, which molecules are in the pathway, what drugs might perturb the pathway, and more. If you’re logged into IPA, clicking any of the links will take you to IPA’s knowledge base where you can learn more about the connection between that molecule, the pathway, and a disease, and further overlay any of your gene expression data on top of the pathway.
The report also shows us some upstream regulators, which serves as a great positive control that this stuff actually works, because it’s inferring that dexamethasone might be an upstream regulator based on the target molecules that are dysregulated in our data.
You can also start to visualize networks in the context of biology and how your gene expression data looks in those molecules. Here’s a network related to “Connective Tissue Disorders, Inflammatory Disease, Inflammatory Response” showing dysregulation of some of the genes in our data.
This only works when using the argument tidy=TRUE
when creating the DESeqDataSetFromMatrix()
.↩
Luo, W. et al., 2009. GAGE: generally applicable gene set enrichment for pathway analysis. BMC bioinformatics, 10:161. Package: bioconductor.org/packages/gage.↩