Homework

due by 01/12/2023,03:39pm

Homework 0 - Description | Submission

due by 01/20/2023,11:59pm

Homework 1 - Description | Submission

due by 01/27/2023,11:59pm

Homework 2 - Description | Submission

due by 02/03/2023,11:59pm

Homework 3 - Description | Submission

due by 02/10/2023,11:59pm

Homework 4 - Description | Submission

due by 02/24/2023,11:59pm

Homework 5 - Description | Submission

due by 03/17/2023,11:59pm

Homework 6 - Description | Submission

due by 03/17/2023,11:59pm

Project Proposal - Description | Submission

due by 03/24/2023,11:59pm

Homework 7 - Description | Submission

due by 04/04/2023,11:59pm

Project Milestone Report - Description | Submission

due by 04/14/2023,11:59pm

Homework 8 - Description | Submission

due by 04/21/2023,11:59pm

Final Project Report - Description | Submission

Other Project Phases

03/12/2023,11:59pm

Announce your team and title

03/28/2023,03:40pm

Peer feedback (in-class)

03/28/2023,11:59pm

Written feedback from staff

04/15/2023 - 04/21/2023

Staff feedback by appointments

04/25/2023,03:40pm

Project Awards (in-class)

Lectures

1/10/23

Lecture 1: Introduction

Download slides

What is data science? Why is it important? Who are we? Course overview and syllabus.

Recommended reading

1/12/23

Lecture 2: Introduction to Programming in Python, Version Control

Running a Python program, IPython, Jupyter notebooks, variables and data types, operations, functions, scope. Version Control with GIT

1/17/23

Lecture 3: Introduction to Programming in Python II

Data types and operators, conditions, lists, loops.

1/19/23

Lecture 4: Introduction to Descriptive Statistics

Variable types, basic summary statistics and plotting, covariance and correlation, confounders, probability: Bernoulli, Binomial, and Normal distributions.

1/24/23

Lecture 5: Advanced Data Structures

Sets, dictionaries, pandas series, working with modules.

1/26/23

Lecture 6: Pandas DataFrames

Reading and writing data from files, pandas data frames, basic plotting.

Recommended reading

  • Learning the Pandas Library: Python Tools for Data Munging, Analysis, and Visualization. Matt Harrison
1/31/23

Lecture 7: Hypothesis Testing and Statistical Inference

Introduction to Hypothesis Testing, Central Limit Theorem, A/B testing.

Mandatory reading

WIRED article on A/B testing

2/2/23

Lecture 8: Temporal Data Analysis and Applications to Stock Analysis

Downloading, cleaning, analyzing, and visualizing stock data.

2/7/23

Lecture 9: Linear Regression 1

Introduction to simple linear regression, multiple linear regression, exploratory vs. inferential viewpoints

Recommended reading

2/9/23

Lecture 10: Linear Regression 2

Model generalizability, cross validation, and using categorical variables in regression

Recommended reading

2/14/23

Lecture 11: Ethics

What are the social impacts of computing technology such as personal privacy, intellectual property, interface usability, accessibility, and reliability. What are scenarios where pervasive use of automated systems can and has disproportionately and negatively impacted some groups more than others? What are solutions to mitigate these effects?

2/16/23

Lecture 12: Data Visualization 1

Data Visualization in Python with Matplotlib, Seaboarn, Altair.

2/21/23

Lecture 13: Data Visualization 2

Data Visualization for ethics: exploring and mitigating biases in word embeddings

2/23/23

Lecture 14: Web Scraping and APIs

Scrape HTML websites with Beautiful Soup. Data Cleanup with Pandas. Connect to APIs such as Twitter, Reddit. JSON, REST.

Recommended reading

2/28/23

Lecture 15: Data Visualization 3

Some Principles of Data Visualization

3/2/23

Lecture 16: Classification I: K-Nearest Neighbors, Decision Trees

Introduction to classification, k-nearest neighbors, generalizability, bias-variance, cross validation, discussion of course projects

Recommended reading

3/7/23

Lecture 17: No Class

Spring Break

3/9/23

Lecture 18: No Class

Spring Break

3/14/23

Lecture 19: Classification II: Logistic Regression and SVMs

Logistic Regression, Support Vector Machines (SVM), generalizability and cross validation

Recommended reading

  • ISL, Ch. 8 and 9
3/16/23

Lecture 20: Regular Expressions, NLP in Practice

NLP in Python with NLTK. Parsing strings with regular expressions.

3/21/23

Lecture 21: Natural Language Processing

NLP with (Almost) No Training Data

3/23/23

Lecture 22: Clustering I

Introduction to Clustering, supervised vs. unsupervised learning, k-means method

Recommended reading

3/28/23

Lecture 23: Project Peer Feedback

Give and receive feedback on your project proposal from a peer group.

3/30/23

Lecture 24: Clustering II

Hierarchical clustering, dendogram plots, clustering in practice

Recommended reading

4/4/23

Lecture 25: Dimensionality Reduction

Principal Component Analysis (PCA), using PCA for visualization

4/6/23

Lecture 26: Neural Networks, Deep Learning, Tensor Flow

Classification and regression with neural networks. Network architectures. Using Tensor Flow.

Recommended reading

4/11/23

Lecture 27: Neural Networks, Deep Learning, Tensor Flow

Classification and regression with neural networks. Network architectures. Using Tensor Flow.

Recommended reading

4/13/23

Lecture 28: Databases

Working with relational databases in Python. Introduction to the Structured Query Language.

4/18/23

Lecture 29: Network Analysis

Basics about Networks. Visualization methods for general graphs and trees. Graph algorithms - path search, centrality, pagerank.

Mandatory reading

  • Grus Ch. 21
4/20/23

Lecture 30: Guest Lecture: Quantitative Approaches to Social Justice

4/25/23

Lecture 31: Best Project Presentations, Recap, Wrap-up, Outlook

What did we learn, what else is out there, what can you learn next?