Kevin Roitero
Kevin Roitero
Ph.D. Candidate
University of Udine

Kevin Roitero took the bachelor degree in computer science at University of Udine.
He took his master joint degree in International computer science at University of Udine in collaboration with Alpen-Adria-University of Klagenfurt, with final grade 110/110 cum laude. He presented a Master Thesis on using fewer topics in the effectiveness evaluation of Information Retrieval systems.

He currently is a Ph.D. Candidate in Computer Science at the University of Udine under the supervision of Prof. Stefano Mizzaro.

His Research interests include :

  • Information Retrieval.
  • Crowdsourcing
  • Artificial Intelligence and Machine Learning
  • Data mining and Analysis.

Here you can Download Kevin Roitero's Curriculum Vitae.

Current Position

November 2016 - Today

PhD Candidate.

University of Udine, Udine (UD), Italy.


Education & Positions

November 2016 - Today

Ph.D.

Department of Mathematics, Computer Science, and Physics. University of Udine.

Title of the research project: Economical Evaluation of IR systems (Supervisor Prof. Stefano Mizzaro).
Topics of interest: Information Retrieval, Crowdsourcing for Information Retrieval, Artificial Intelligence for Information Retrieval, Data mining and Analysis.

September 2018 - December 2018

Research Intern at Spotify.

Spotify, London.

Manager: Mounia Lalmas-Roelleke (Director, Tech Research).

March 2018 - July 2018

Visiting period at RMIT University.

ISAR Group, RMIT University, Melbourne, Victoria, Australia.

Visit J. Shane Culpepper, Mark Sanderson, and Falk Scholer.

April 2017 - June 2017

Visiting period at University Of Sheffield.

Information School, University Of Sheffield, United Kingdom.

Visit Gianluca Demartini, at Information School, University Of Sheffield, United Kingdom.

2014 - 2016

Master Joint Degree in International Computer Science.

University of Udine, Udine (UD), Italy,
Alpen-Adria-Universität, Klagenfurt, Austria. (6 months).

Title of the thesis: Improving the Efficiency of Retrieval Effectiveness Evaluation: Finding a Few Good Topics with Clustering and Dimensionality Reduction (Supervisor Prof. Stefano Mizzaro; Co-Supervisor Prof. Klaus Schoeffmann).

September 2015 - February 2016

Visiting period at Alpen-Adria-Universität.

Alpen-Adria-Universität, Klagenfurt, Austria.

2011 - 2014

Bachelor Degree in Computer Science.

University of Udine, Udine (UD), Italy.

Title of the thesis: Una Base di Dati per la Condivisione di Film e Serie Televisive - A database for sharing movies and tv-series informations (Supervisor Prof. Angelo Montanari).

2018

  • How Many Truth Levels? Six? One Hundred? Even more? Validating Truthfulness of Statements via Crowdsourcing.

    Kevin Roitero, Damiano Spina, Gianluca Demartini, and Stefano Mizzaro.

    RDSM 2018 : Workshop on Rumours and Deception in Social Media.
    Url: to appear..

    Conference Paper.

  • Reproduce. Generalize. Extend. On Information Retrieval Evaluation without Relevance Judgments.

    Kevin Roitero, Marco Passon, Giuseppe Serra, and Stefano Mizzaro.

    ACM Journal of Data and Information Quality (JDIQ).
    Url: to appear..

    Journal Paper.

  • Reproduce and Improve: An Evolutionary Approach to Select a Few Good Topics for Information Retrieval Evaluation.

    Kevin Roitero, Michael Soprano, Andrea Brunello, and Stefano Mizzaro.

    ACM Journal of Data and Information Quality (JDIQ).
    Url: to appear..

    Journal Paper.

  • On Fine-Grained Relevance Scales.

    Kevin Roitero, Eddy Maddalena, Gianluca Demartini and Stefano Mizzaro.

    Proceedings of the 41st International ACM SIGIR Conference on Research and Development in Information Retrieval. Ann Arbor Michigan, U.S.A. July 8-12, 2018.
    Url: https://dl.acm.org/citation.cfm?id=3210052.

    Conference Paper.

  • Query Performance Prediction and Effectiveness Evaluation Without Relevance Judgments: Two Sides of the Same Coin.

    Stefano Mizzaro, Josiane Mothe, Kevin Roitero, and Md Zia Ullah.

    Proceedings of the 41st International ACM SIGIR Conference on Research and Development in Information Retrieval. Ann Arbor Michigan, U.S.A. July 8-12, 2018.
    Url: https://dl.acm.org/citation.cfm?id=3210146.

    Conference Paper.

  • IRevalOO: An Object Oriented Framework for Retrieval Evaluation.

    Kevin Roitero, Eddy Maddalena, Ponte Yannick and Stefano Mizzaro.

    Proceedings of the 41st International ACM SIGIR Conference on Research and Development in Information Retrieval. Ann Arbor Michigan, U.S.A. July 8-12, 2018.
    Url: https://dl.acm.org/citation.cfm?id=3210084.

    Conference Paper.

  • Effectiveness Evaluation with a Subset of Topics: A Practical Approach.

    Kevin Roitero, Michael Soprano and Stefano Mizzaro.

    Proceedings of the 41st International ACM SIGIR Conference on Research and Development in Information Retrieval. Ann Arbor Michigan, U.S.A. July 8-12, 2018.
    Url: https://dl.acm.org/citation.cfm?id=3210108.

    Conference Paper.

  • CHeap and Engineered Evaluation of Retrieval Systems.

    Kevin Roitero.

    Doctoral Consortium of the 41st International ACM SIGIR Conference on Research and Development in Information Retrieval. Ann Arbor Michigan, U.S.A. July 8-12, 2018.
    Url: https://dl.acm.org/citation.cfm?id=3210229.

    Conference Paper.

2017

  • Let's Agree to Disagree: Fixing Agreement Measures for Crowdsourcing.

    Alessandro Checco, Kevin Roitero, Eddy Maddalena, Gianluca Demartini and Stefano Mizzaro.

    Proceedings of the The fifth AAAI Conference on Human Computation and Crowdsourcing, AAAI HCOMP2017. Quebec City, Canada. October 24-26 2017.
    Url: https://aaai.org/ocs/index.php/HCOMP/HCOMP17/paper/viewFile/15927/15258.

    Conference Paper.

  • Considering Assessor Agreement in IR Evaluation.

    Eddy Maddalena, Kevin Roitero, Gianluca Demartini and Stefano Mizzaro.

    Proceedings of the 3rd ACM International Conference on the Theory of Information Retrieval, ICTIR2017. Amsterdam, Netherlands. October 1-4 2017.
    Url: https://dl.acm.org/citation.cfm?id=3121060.

    Conference Paper.

  • Economic Evaluation of Recommender Systems: A Proposal.

    Kevin Roitero, Stefano Mizzaro, and Giuseppe Serra.

    Proceedings of the 8th Italian Information Retrieval Workshop, Switzerland. June 05-07, 2017.
    Url: http://ceur-ws.org/Vol-1911/8.pdf.

    Conference Paper.

  • Do Easy Topics Predict Effectiveness Better Than Difficult Topics?

    Kevin Roitero, Eddy Maddalena, and Stefano Mizzaro.

    Proceedings of the 39th European Conference on IR Research, ECIR 2017, Aberdeen, UK, April 8-13, 2017.
    pages: 605--611, isbn: 978-3-319-56608-5, doi: 10.1007/978-3-319-56608-5_55.
    Url: http://dx.doi.org/10.1007/978-3-319-56608-5_55.

    Conference Paper.

2016

  • 11 July 2018

    On fine Grained Relevance Scales.

    ACM SIGIR Conference on Research and Development in Information Retrieval. Ann Arbor Michigan, U.S.A.

  • 17 May 2018

    iPython notebooks for data analysis and plotting.

    RMIT University, Melbourne, Australia.

  • 10 May 2018

    Crowdsourcing relevance judgments and considering agreement in IR evaluation (with a new agreement measure)

    RMIT University, Melbourne, Australia.

  • 6 June 2017

    Economic Evaluation of Recommender Systems: A Proposal.

    IIR2017, Lugano. Switzerland.

  • 10 April 2017

    Do Easy Topics Predict Effectiveness Better Than Difficult Topics?

    ECIR2017, Aberdeen. UK.

  • 30 May 2016

    Improving the Efficiency of Retrieval Effectiveness Evaluation: Finding a Few Good Topics with Clustering?

    IIR 2016, Venezia. Italy.

  • 12 May 2016

    Improving the Efficiency of Retrieval Effectiveness Evaluation: Finding a Few Good Topics with Clustering and Dimensionality Reduction.

    MSc Course (Web Information Retrieval). University of Udine, Udine. Italy.

  • July 2018.

    Student Grant to attend ``SIGIR2018'', Ann Arbor, Michigan, U.S.A.

    Provided by ACM SIGIR.

  • March 2018 - July 2018.

    Allowance to visit RMIT Information Storage, Analysis and Retrieval (ISAR) at RMIT University (the Royal Melbourne Institute of Technology), Melbourne, Victoria, Australia.

    Provided by RMIT Information Storage, Analysis and Retrieval (ISAR).

  • October 2017.

    Student Grant to attend ``ICTIR2017'', Amsterdam, Netherlands.

    Provided by ACM SIGIR.

  • Apr 2017 - June 2017.

    Allowance to visit Information School at University of Sheffield, United Kingdom.

    Provided by ERASMUS+ Traineeship Project.

  • Apr 2017.

    Student Grant to attend ``ECIR2017'', Aberdeen, Scotland.

    Provided by BCS Information Retrieval Specialist Group (IRGS).

  • Sept 2015 - Feb 2016.

    Allowance to visit Alpen-Adria-Universität Kalgenfurt, Klagenfurt, Austria.

    Provided by University of Udine, and ERAMUS Project.

My main topics of interest are:
  • Information Retrieval.
  • Crowdsourcing for Information Retrieval.
  • Artificial Intelligence for Information Retrieval.
  • Data mining and Analysis.

Looking for thesis, projects, collarborations? write me an email.

2016 - 2017

Operating Systems Lab.

Bachelor Degree in Computer Science, University of Udine.

24 hours.

University of Udine
Dept. of Maths, Computer Science, and Physics.
Via delle Scienze 206
Udine (UD), Italy

Office: Rizzi Building, 2° floor, South Node, Room n° 4 (NS04)