Below, you will find a comprehensive list of my academic publications, which have been organized according to their respective categories: journal articles, conference proceedings, books, and my thesis.
Year Type Paper
2024 In proceedings Kevin Roitero, Michael Soprano, David La Barbera, Eddy Maddalena, and Stefano Mizzaro. Enhancing Fact-Checking: From Crowdsourced Validation to Integration with Large Language Models. In Proceedings of the 14th Italian Information Retrieval Workshop (IIR 2024) , Udine , Italy , pp. 74-77 .
2024 Journal Michael Soprano, Kevin Roitero, Ujwal Gadiraju, Eddy Maddalena, and Gianluca Demartini. Longitudinal Loyalty: Understanding The Barriers To Running Longitudinal Studies On Crowdsourcing Platforms. In ACM Transactions on Social Computing (TSC) . DOI: 10.1145/3674884.
2024 Journal David La Barbera, Eddy Maddalena, Michael Soprano, Kevin Roitero, Gianluca Demartini, Davide Ceolin, Damiano Spina, and Stefano Mizzaro. Crowdsourced Fact-checking: Does It Actually Work?. In Information Processing & Management (IPM) , volume 61 , issue 5 . DOI: 10.1016/j.ipm.2024.103792.
2023 In proceedings David La Barbera, Michael Soprano, Kevin Roitero, Eddy Maddalena, and Stefano Mizzaro. Fact-Checking at Scale with Crowdsourcing: Experiments and Lessons Learned. In Proceedings of the 13th Italian Information Retrieval Workshop (IIR 2023) , Pisa , Italy , pp. 85-90 .
2023 Journal Paola Chiara Rizzo, Alessandro Caputo, Eddy Maddalena, Nicolò Caldonazzi, Ilaria Girolami, Angelo Paolo Dei Tos, Aldo Scarpa, Marta Sbaraglia, Matteo Brunelli, Stefano Gobbo, Stefano Marletta, Liron Pantanowitz, Vincenzo Della Mea, and Albino Eccher. Digital pathology world tour. In Digital Health . DOI: 10.1177/20552076231194551.
2023 Journal Haoyu Xie, Eddy Maddalena, Rehab Qarout, and Alessandro Checco. The Dark Side of Recruitment in Crowdsourcing: Ethics and Transparency in Micro-Task Marketplaces. In Computer Supported Cooperative Work (CSCW) . DOI: 10.1007/s10606-023-09464-9.
2023 Journal Eddy Maddalena, Luis Daniel Ibáñez, Neal Reeves, and Elena Simperl. Qrowdsmith: Enhancing paid microtask crowdsourcing with gamification and furtherance incentives. In ACM Transactions on Intelligent Systems and Technology (TIST) . DOI: 10.1145/3604940.
2022 Book chapter Luis-Daniel Ibáñez, Eddy Maddalena, Richard Gomer, Elena Simperl, Mattia Zeni, Enrico Bignotti, Ronald Chenu-Abente, Fausto Giunchiglia, Patrick Westphal, Claus Stadler, Gordian Dziwis, Jens Lehmann, Semih Yumusak, Martin Voigt, Maria-Angeles Sanguino, Javier Villazán, Ricardo Ruiz, and Tomas Pariente-Lobo. QROWD—A Platform for Integrating Citizens in Smart City Data Analytics. In Sustainable Smart Cities: Theoretical Foundations and Practical Considerations , publisher Springer International Publishing , pp. 285-321 . DOI: 10.1007/978-3-031-08815-5_16.
2021 Journal Kevin Roitero, Eddy Maddalena, Stefano Mizzaro, and Falk Scholer. On the effect of relevance scales in crowdsourcing relevance assessments for Information Retrieval evaluation. In Information Processing & Management (IPM) , volume 58 , issue 6 . DOI: 10.1016/j.ipm.2021.102688.
2020 Journal Eddy Maddalena, Luis Daniel Ibáñez, and Elena Simperl. Mapping Points of Interest Through Street View Imagery and Paid Crowdsourcing. In ACM Transactions on Intelligent Systems and Technology (TIST) , volume 11 , issue 5 . DOI: 10.1145/3403931.
2020 Journal Pavlos Vougiouklis, Eddy Maddalena, Jonathon Hare, and Elena Simperl. Point at the Triple: Generation of Text Summaries from Knowledge Base Triples. In Journal of Artificial Intelligence Research (JAIR) , volume 69 . DOI: 10.1613/jair.1.11694.
2020 In proceedings Pavlos Vougiouklis, Eddy Maddalena, Jonathon Hare, and Elena Simperl. Point at the Triple: Generation of Text Summaries from Knowledge Base Triples (Extended Abstract). In Proceedings of the 29th International Joint Conference on Artificial Intelligence (IJCAI) , Yokohama , Japan , pp. 5080-5084 . DOI: 10.24963/ijcai.2020/711.
2020 In proceedings Lei Han, Eddy Maddalena, Alessandro Checco, Cristina Sarasua, Ujwal Gadiraju, Kevin Roitero, and Gianluca Demartini. Crowd Worker Strategies in Relevance Judgment Tasks. In ACM International Conference on Web Search and Data Mining (WSDM 2020) , Houston , Texas U.S.A. , pp. 241–249 . DOI: 10.1145/3336191.3371857.
2019 Journal Lei Han, Kevin Roitero, Ujwal Kumar, Cristina Sarasua, Alex Checco, Eddy Maddalena, and Gianluca Demartini. The Impact of Task Abandonment in Crowdsourcing. In IEEE Transactions on Knowledge and Data Engineering (TKDE) . DOI: 10.1109/TKDE.2019.2948168.
2019 Journal Qiong Bu, Elena Simperl, Adriane Chapman, and Eddy Maddalena. Quality assessment in crowdsourced classification tasks. In Published in International Journal of Crowd Science , volume 3 , issue 3 . DOI: 10.1108/IJCS-06-2019-0017.
2019 In proceedings Lei Han, Kevin Roitero, Eddy Maddalena, Stefano Mizzaro, and Gianluca Demartini. On Transforming Relevance Scales. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management (CIKM 2019) , Beijing , China , pp. 39–48 . DOI: 10.1145/3357384.3357988.
2019 In proceedings Eddy Maddalena, Luis-Daniel Ibáñez, Richard Gomer, Mattia Zeni, Donglei Song, Fausto Giunchiglia, and Elena Simperl. Hybrid Human Machine workflows for mobility management. In Proceedings of the 5th International ACM Smart City Workshop (AW4city 2019), in conjunction with The Web Conference (WWW 2019) , San Francisco , U.S.A. , pp. 102–109 . DOI: 10.1145/3308560.3317056.
2019 In proceedings Lei Han, Kevin Roitero, Ujwal Gadiraju, Cristina Sarasua, Alessandro Checco, Eddy Maddalena, and Gianluca Demartini. All Those Wasted Hours: On Task Abandonment in Crowdsourcing. In Proceedings of the 12th ACM International Conference on Web Search and Data Mining (WSDM 2019) , Melbourne , Australia , pp. 321–329 . DOI: 10.1145/3289600.3291035.
2018 In proceedings Eddy Maddalena, Davide Ceolin, and Stefano Mizzaro. Multidimensional News Quality: A Comparison of Crowdsourcing and Nichesourcing. In Proceedings of the 6th International Workshop on News Recommendation and Analytics (INRA 2018) , Turin , Italy .
2018 In proceedings Eddy Maddalena, Luis-Daniel Ibáñez, Elena Simperl, Mattia Zeni, Enrico Bignotti, Fausto Giunchiglia, Claus Stadler, Patrick Westphal, Luís PF Garcia, and Jens Lehmann. QROWD: Because Big Data Integration is Humanly Possible. In Proceedings of the Project Showcase of the 24th ACM SIGKDD Conference On Knowledge Discovery And Data Mining (KDD 2018) , London , UK .
2018 In proceedings Kevin Roitero, Eddy Maddalena, Gianluca Demartini, and Stefano Mizzaro. On Fine-Grained Relevance Scales. In Proceedings of the 41st International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2018) , Ann Arbor , Michigan, U.S.A. , pp. 675–684 . DOI: 10.1145/3209978.3210052.
2018 In proceedings Kevin Roitero, Eddy Maddalena, Yannick Ponte, and Stefano Mizzaro. IRevalOO: An Object Oriented Framework for Retrieval Evaluation. In International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2018) , Ann Arbor , Michigan, U.S.A. , pp. 913-916 . DOI: 10.1145/3209978.3210084.
2018 In proceedings Pavlos Vougiouklis, Eddy Maddalena, Jonathon Hare, and Elena Simperl. How biased is your NLG evaluation?. In Proceedings of the CrowdBias workshop of the 6th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2018) , Zurich , Switzerland , pp. 72-77 .
2017 In proceedings Alessandro Checco, Kevin Roitero, Eddy Maddalena, Stefano Mizzaro, and Gianluca Demartini. Let's Agree to Disagree: Fixing Agreement Measures for Crowdsourcing. In Proceedings of the 5th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2017) , Québec City , Canada , pp. 11-20 . ISBN: 978-1-57735-793-3.
2017 In proceedings Eddy Maddalena, Kevin Roitero, Gianluca Demartini, and Stefano Mizzaro. Considering Assessor Agreement in IR Evaluation. In Proceedings of the 3rd ACM International Conference on the Theory of Information Retrieval (ICTIR 2017) , Amsterdam , The Netherlands , pp. 75-82 . DOI: 10.1145/3121050.3121060.
2017 In proceedings Kevin Roitero, Eddy Maddalena, and Stefano Mizzaro. Do Easy Topics Predict Effectiveness Better Than Difficult Topics?. In Proceedings of the 39th European Conference on Information Retrieval (ECIR 2017) , Aberdeen , Scotland , pp. 605-611 . DOI: 10.1007/978-3-319-56608-5_55.
2017 PHD thesis Eddy Maddalena, and Stefano Mizzaro. Crowdsourcing Relevance: Two Studies on Assessment. In Department of Mathematics, Computer Science and Physics of the University of Udine . DOI: 11390/1132154.
2017 Journal Eddy Maddalena, Stefano Mizzaro, Falk Scholer, and Andrew Turpin. On Crowdsourcing Relevance Magnitudes for Information Retrieval Evaluation. In ACM Transactions on Information Systems (TOIS) , volume 35 . DOI: 10.1145/3002172.
2016 In proceedings Muhammad Helmy, Marco Basaldella, Eddy Maddalena, Stefano Mizzaro, and Gianluca Demartini. Towards Building a Standard Dataset for Arabic Keyphrase Extraction Evaluation. In Proceedings of the 20th International Conference on Asian Language Processing (IALP 2016) , Tainan , Taiwan . DOI: 10.1109/IALP.2016.7875927.
2016 In proceedings Eddy Maddalena, Marco Basaldella, Dario De Nart, Dante Degl'Innocenti, Stefano Mizzaro, and Gianluca Demartini. Crowdsourcing Relevance Assessments: The Unexpected Benefits of Limiting the Time to Judge. In Proceedings of the 4th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2016) , Austin , Texas (USA) , pp. 129-138 . ISBN: 978-1-57735-774-2.
2015 In proceedings Andrew Turpin, Falk Scholer, Stefano Mizzaro, and Eddy Maddalena. The Benefits of Magnitude Estimation Relevance Assessments for Information Retrieval Evaluation. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2015 , Santiago de Chile , Chile , pp. 565-574 . DOI: 10.1145/2766462.2767760.
2015 In proceedings Eddy Maddalena, Stefano Mizzaro, Falk Scholer, and Andrew Turpin. Judging Relevance Using Magnitude Estimation. In Proceedings of the 37th European Conference on Information Retrieval (ECIR 2015) , Vienna , Austria , pp. 215-220 . DOI: 10.1007/978-3-319-16354-3_23. View poster.
2015 Journal Vincenzo Della Mea, Eddy Maddalena, and Stefano Mizzaro. Mobile crowdsourcing: four experiments on platforms and tasks. In Distributed and Parallel Databases , volume 33 , issue 1 . DOI: 10.1007/s10619-014-7162-x.
2014 Journal Vincenzo Della Mea, Eddy Maddalena, Stefano Mizzaro, Piernicola Machin, and Carlo Alberto Beltrami. Preliminary results from a crowdsourcing experiment in immunohistochemistry. In Diagnostic pathology , volume 9 , issue 1 . DOI: 10.1186/1746-1596-9-S1-S6.
2014 In proceedings Vincenzo Della Mea, Eddy Maddalena, and Stefano Mizzaro. Crowdsourcing Mitosis count: an experiment on the MITOS dataset. In Proceedings of the 12th European Congress on Digital Pathology (ECDP 2014) , Paris , France .
2014 In proceedings Falk Scholer, Eddy Maddalena, Stefano Mizzaro, and Andrew Turpin. Magnitudes of relevance – relevance judgements, magnitude estimation, and crowdsourcing. In Proceedings of the 6th International Workshop on Evaluating Information Access (EVIA 2014) , Tokyo , Japan , pp. 9-16 .
2014 In proceedings Eddy Maddalena, and Stefano Mizzaro. Axiometrics: Axioms of Information Retrieval Effectiveness Metrics. In Proceedings of the 6th International Workshop on Evaluating Information Access (EVIA 2014) , Tokyo , Japan , pp. 17-24 .
2014 In proceedings Eddy Maddalena, and Stefano Mizzaro. The Axiometrics Project. In Proceedings of the 5th Italian Information Retrieval Workshop (IIR 2014) , Rome , Italy , pp. 11-15 .
2013 In proceedings Vincenzo Della Mea, Eddy Maddalena, and Stefano Mizzaro. Crowdsourcing to Mobile Users: A Study of the Role of Platforms and Tasks. In Proceedings of 1st VLDB Workshop on Databases and Crowdsourcing (DBCrowd 2013) , Riva del Garda , Italy , pp. 14-19 .