I will teach how to organize, transform, analyse and visualize small and big data, as well as how to effectively communicate the outcomes of the workflow. This is a path starting at Edgar Frank Codd, passing through Hadley Wickham, and ending at Giorgia Lupi.

The course will be multi-task (learn, make, use, watch, glance, read, dig, listen; see more below) and multi-teacher (I will be assisted by other real and virtual teachers). Some basics in programming and statistics are desirable.

## Play

1. Relational Databases
2. Data Science
3. Network Science
4. Hierarchical Data
• learn XML
• Query languages for XML
• glance Caffè XML
• use BaseX
• glance R and XML
• dig Tree structures. Chapter M.4 in BBLL12
5. Text Mining
6. Real-time Data
7. Communicate and collaborate

You will go through different tasks: learn, make, use, watch, glance, read, dig, listen. A legend is below:

• learn: I teach, you listen (and hopefully learn).
• make: I give you an assignment, you make it during the class. We discuss the solutions during the next class.
• use: you use a software: download, install and run it for the first time. I give you a brief practical introduction to it.
• watch: We watch a video together. By and large, the video acts as a teaser, introducing the next topic in an informal and attractive way.
• glance: You give a brief and fast look at something, generally an informative website. I steer you towards the most important sections.
• read: You read a story, typically at home. We discuss it together during the following class.
• dig: You read a theoretical deepening of the current topic, normally at home. We talk about it during one of the next classes.
• listen: The class is given by an invited speaker, an expert in the field.

## Books

• WG17 R for Data Science. Hadley Wickham and Garrett Grolemund. O’Reilly. 2017.
• BKH17 Modern Data Science with R. Benjamin S. Baumer, Daniel T. Kaplan, Nicholas J. Horton. Chapman and Hall/CRC. 2017
• T11 R Cookbook. Paul Teetor. O’Reilly Media. 2011.
• LL99 A Guided Tour of Relational Databases and Beyond. Mark Levene and George Loizou. Springer. 1999.
• T01 The Visual Display of Quantitative Information. Edward. R. Tufte. Graphics Press. 2001
• BBLL12 Generative design. Hartmut Bohnacker, Benedikt Gross, Julia Laub, Claudius Lazzeroni. Princeton Architectural Press. 2012

## Data challenges

Data challenges have 3 components:

• Input, which consists of:
1. a dataset of raw data. No data model is assumed. The data should be open so it can be freely distributed.
2. a set of data questions and challenges, formulated in natural language, whose answers might be (but not necessarily are) hidden behind the raw data. Questions should be sufficiently general and compelling to tease the attention and curiosity of scholars.
• Analysis notebook: a stream of analyses and visualizations aimed at approaching the given data questions and challenges. Ideally, the notebook is written in some popular, free language (like R or Python) and it is self-containing so that it can be easily distributed, executed and modified by other scholars. Issues like readability, conciseness, elegance, efficiency of the notebook are relevant, although not crucial.
• Output: these are the suggested answers to the given data questions and challenges. Answers might be partial (not definitive). The same question can be answered with different notebooks. A (modest) degree of subjectivity in the interpretation of the data answers is expected.

The following are examples of data challenges you are invited to try:

1. Which are the winners and losers in the last Italian soccer Serie A league? challenge
2. Which is the best team ever in Italian soccer? challenge
3. In there a first-mover advantage in chess? challenge
4. Is child mortality decreasing over time? challenge
5. Are low quality diamonds more expensive? challenge
6. Are female dolphins more social than male dolphins? (markup, markdown)
7. Which are the most powerful countries in the European natural gas market? (markup, markdown)
8. Detect the most dangerous terrorists involved in Madrid train bombing attack of 2011 (markup, markdown)
9. Discover the most interdisciplinary and autarchic disciplines in science (markup, markdown)
10. Detect communities in a Karate club friendship network (markup, markdown)
11. Attack the resilience of the Madrid train bombing terror network (markup, markdown)