Topics
A variety of computations are essential for successful data science, including but not limited to traditional statistical and numerical methods. This course will examine current capabilities and challenges in data science including techniques important for: obtaining and organizing data; discovering and examining structure; valid explicit inference and prediction; and communicating scientific information effectively, both for policy advice and for general understanding.
The material may involve a variety of programming languages (e.g., R and Python), development environments (e.g., RStudio, Jupyter) and computing facilities (e.g., Cloud, GPU). Individuals are unlikely to be expert over this wide range, but our approach emphasizes being open to the best computing for the task and using modern tools to integrate facilities for a research goal.
Our first offering of this seminar will be in Spring quarter 2022 as a 1-credit seminar. This, of course, limits the selection of topics can be discussed, but we will use the experience to modify future offerings.
Some topics under consideration are:
- Privacy-preserving Computation
- Open differential privacy
- Homomorphic Encryption
- Valid Inference
- Knockoffs, Distributional shifts
- Conformal Inference
- Generating Training Data
- Weak Supervision
- Noisy labeling
- Machine Learning and Science
- Data + ML vs Models (good, bad examples)
- Cross validation pitfalls, what it measures…
- Natural Language Processing
- Stanford NLP SDK
- BERT/GPT
- Causal Inference
- The Framework
- R/Python packages
- Large-scale computation
- Managing large number of models
- Managing large number of HPC jobs
- Scripting cloud resources
- Deployment strategies (cloud, local center, personal)
- Metadata
- Ontologies tools and strategies
- Automatic computation with metadata
- Reproducibility frameworks
- Stanford CORES
- Workflows
- Publishing