The recount2 database is an online resource consisting of RNA-seq gene and exon counts as well as coverage bigWig files for 2041 different studies. It is the second generation of the ReCount project (2017; 2017) and at Nellore et al, Genome Biology, 2016 which created the coverage bigWig files. The raw sequencing data were processed with Rail-RNA as described in the recount2 paper. For ease of statistical analysis, for each study we created count tables at the gene and exon levels and extracted phenotype data, which we provide in their raw formats as well as in RangedSummarizedExperiment R objects (described in the SummarizedExperiment Bioconductor package).
This works aims at comparing at least two methods of supervised classification (LDA, QDA, SVM, KNN, …) using a dataset of your choice obtained from the reCount database. Below is a more detailled list of what is expected.
For each approch you will measure some indicators of accuracy (rate of correct classification, error rate, false positive, false negative,…) as a function of the number of selected variables comparing this rate to what could be obtained by chance.
Note: you may also add a random variable selection step to compare observed hit rate with those observed when variable are randomly selected.
Detection and interpretation of differentially expressed genes: run a statistical analysis of the read counts, in order to detect differentially expressed genes (DEG) between the two selected classes. This analysis should include the following steps.
Functional annotation
Use the gProfiler R package to study the functional associations of these genes, and provide a biological interpretation of these results.
Supervised learning: During the practical, we have used the linear discriminant analysis method (fonction lda() en R). Here you will have two compare two methods of supervized classification. You can use any relevant method (including LDA) for classification. However for ease of use we suggest to use a method whose interface is close to lda().
Impact of the number of selected variable: Your work will include an evaluation of the impact of the number of selected variables on classification accuracy. The general indicator of classification accuracy will be the rate of correct classification. You may also use some particular indicators including false positive rate, false negative rate, sensitivity or sensibility. The performance will be presented through a table and/or through a curve indicating the progression of the rate of good classification as a fonction of the number of selected variables.
Warning: The evaluations should be done in the cross validation mode using using different samples for training and test. We recommend to use classification that automatically deal with cross-validation. This can be for instance the lda() or qda() that include a “CV” argument indicating they are performing automatically a “Leave-one-out” cross validation (LOO).
An important goal of this course – and the report – is to learn how to use good practices for the analysis of NGS data. This includes
a. **Tractability:** you and other people should be able to track the origin of all your results. For this, you need to keep a trace of each step of each analysis.
b. **Reproducibility:** other people should be able not only to trace the origin of your results, but also to reproduce them by themselves. NGS data anlaysis lends itself particularly well to reproducibility, since everything is done on computers and managed via software (tools and scripts).
c. **Portability:** the analysis done on your computer should be reproducible on other computers as well. For this you need to ensure for isntance that all paths are defined relative rather than absolute, and that the path definitions rely on platform-independent methods.
Differential analysis. Analyse the full dataset to detect differentially expressed genes. This analysis should include the following steps.
Sub-sampling. Run the same analysis on randomly selected subsets of the samples, with various subset sizes (n=2,3,4,5,10,20,40).
Negative control. Run the same analysis with two subsets of samples belonging to the same group (psoriasis versus psoriasis, control versus control).
Les rapports peuvent être rédigés en français ou en anglais / reports can be written in either English or French.
Source document in Rmd. The primary report is an R markdown document (.Rmd extension) which must contain all the code used to run the anlayses, as well as the main tables and figures produced by the analysis, and a text structured according to the common practice for scientific articles.
Compiled report (html or pdf). This report should look like a small scientific article (see structure hereafter) with Figures, Tables, and interpretation of the results. The R code should not be displayed in the compiled report (set the knitr option echo=FALSE
when generating the last version). Think of your report as a document written for a biologists who want to understand the approach and the results, but is not interested by the technical details of the R programming.
In total, the report should not exceed 5-6 pages, including figures, but without counting the bibliographic references and appendices (for which there is no limit).
Introduction: a brief summary (5-10 lines) of the biological context (the disease, the transcriptome), the biological question addressed in the report, and the general approach envisaged to answer these questions.
Material and Methods: a summary of the bioinformatics / statistical methods and libraries used for the analysis (1/2 to 1 page), with a brief explanation about which tool was used to do what, and links to the official web page or publication about the tool. If required, additional details about the methods and parameters can be provided in appendix.
Data description: a brief description of the data source (with link to the GEO record), its content (how many samples, how many groups, …) and the data type (paired-ends or single-end, …).
Results and discussion: the results should be presented and discussed together in this section. This section contains the main figures and tables that are used to interpret the results. Additional figures and tables can be provided as appendices, or as separate files (for example full result tables with all the genes, …).
Conclusion and perspective (~1/2 page): summarize the results, show in what they did – or did not – enable you to answer the initial questions of the introduction, and add some perspectives about possible future extensions of the work presented here.
**Appendices:* any additional information or result that might be helpful to consult in order to get a deeper understanding of your results.
Format: the report can be submitted in either html or pdf format. The original Rmd file that was used to generate the report must be submitted together with the report. This file should allow the teachers to reprodue the analysis on their computers.
The evaluation of your report will be based on multiple criteria.
Collado-Torres, L., A. Nellore, and A. E. Jaffe. 2017. “recount workflow: Accessing over 70,000 human RNA-seq samples with Bioconductor.” F1000Res 6: 1558.
Collado-Torres, L., A. Nellore, K. Kammers, S. E. Ellis, M. A. Taub, K. D. Hansen, A. E. Jaffe, B. Langmead, and J. T. Leek. 2017. “Reproducible RNA-seq analysis using recount2.” Nat. Biotechnol. 35 (4): 319–21.