BTEP: Data Science Using Apache Spark for Biomedical Applications
When: Nov. 4th, 2019 11:00 am - 3:30 pm
To Know
Where:
Bldg 60, Rathskeller
Organizer:
BTEP
Presented By:
James Stratton (DataBricks), Frank Nothaft (DataBricks)
Class Files:
About this Class
This is a hands-on demo, please bring your laptop or let us know if you need to borrow one. The field of genomics has matured to a stage where organizations are sequencing DNA at population scale. However, taking raw DNAseq data and transforming it into a format suitable for analysis has become the new bottleneck to genomic discovery. Typically, teams are gluing together a series of bioinformatics tools with custom scripts and processing data on single node machines, one sample at a time. Bioinformatics scientists are spending more time building and maintaining pipelines than modeling data. To ease the burden of analyzing population scale genomic data, a number of open-source bioinformatics tools have moved to use Apache Spark™, such as the GATK4, Hail, and ADAM, but mastering these tools is no easy task. In this workshop, we’ll walkthrough how the Databricks Unified Analytics Platform for Genomics simplifies the end-to-end process of turning raw sequencing data into actionable insights at scale. Introduced by the original creators of Apache Spark, this platform makes it simple to deploy Spark-based bioinformatics tools on cloud computing, and rapidly accelerates common genomic analyses. Join this half day technical workshop to learn how to- Call variants, both in a single sample and across multiple samples, using our accelerated GATK4 pipelines
- Use Spark SQL to characterize the association of variants in a population with phenotypes
- Use machine learning to model genome-wide disease risk across multiple variants associated with a phenotype of interest