I will teach how to organize, transform, analyse and visualize small and big data, as well as how to effectively communicate the outcomes of the workflow. This is a path starting at Edgar Frank Codd, passing through Hadley Wickham, and ending at Giorgia Lupi.

The course will be multi-task (learn, make, use, watch, glance, read, dig, listen; see more below) and multi-teacher (I will be assisted by other real and virtual teachers). Some basics in programming and statistics are desirable.

Play

  1. Getting started
  2. Relational databases.
    • learn Introduction to databases. Chapters from 1.1 to 1.6 of book LL99
    • learn An informal overview of the relational model. Chapter 1.7.1 of book LL99
    • learn The data structure. Chapter 3.1 of book LL99
    • learn Integrity constraints. Chapter 3.4 of book LL99
    • learn Update anomalies and normal forms. Chapters 4.1 and 4.4 of book LL99
    • learn SQL. Chapter 3.2.2 of book LL99 and Teatro SQL
    • use SQLite
    • make Create a database in SQLite corresponding to the dataset nycflights13. At work
    • make Write queries in SQL on the nycflights13 database. At work
    • read DBI and RSQLite R packages’ vignettes
    • make Create, populate and query database nycflights13 using DBI and RSQLite packages of R. At work
    • read 10 Easy Steps to a Complete Understanding of SQL
    • dig Relational algebra and relational calculus. Chapters 3.2.1 and 3.2.2 of book LL99
    • dig Relational model and relational algebra
    • listen Invited speaker: Angelo Montanari on data normalization
  3. Explore
  4. Wrangle
  5. Program
  6. Model
  7. Non-tidy data
  8. Communicate

Task-tag legend

You will go through different tasks: learn, make, use, watch, glance, read, dig, listen. A legend is below:

Software

Books

Datasets

Data challenges

Data challenges have 3 components:

The following are examples of data challenges you are invited to try:

  1. Which are the winners and losers in the last Italian soccer Seria A league? challenge
  2. Which is the best team ever in Italian soccer? challenge
  3. In there a first-mover advantage in chess? challenge
  4. Are female dolphins more social than male dolphins? challenge
  5. Which are the most dangerous terrorists involved in Madrid train bombing attack of 2011? challenge
  6. Is child mortality decreasing over time? challenge
  7. Are low quality diamonds more expensive? challenge

Workshops