====== Machine Learning ====== ---- ===== News ===== * **02/10/2018**: Starting date * **11/10/2018**: Class on Tuesday 16/10/2018 will not take place * **18/10/2018**: This morning 18/10/2018 class will not take place * **11/10/2018**: Classes on Wednesdays are moved to Thursdays from 9:00 to 11:00 - Polo Lodovici, Room Lab2 * Slides form classes 3,4,5,6 and 7 have been added * **14/11/2018** Class on 15/11/2018 will not take place. Next lesson TUESDAY 20/11/2018 * **22/11/2018** Class on 27/11/2018 and 29/11/2018 will not take place. * **17/12/2018** Class on 18/12/2018 will not take place due to the persistence of bad weather conditions. * **18/12/2018** Class of 18/12/2018 will be recovered tomorrow 19/12/2018 from 14:00 to 17:00. ---- ===== General Info ===== **Teacher**: * [[https://docenti.unicam.it/pdett.aspx?ids=N&tv=d&UteId=1039&ru=PROFCONTR|Marco Piangerelli]] **ESSE3 Link** * [[https://didattica.unicam.it/Guide/PaginaADErogata.do?ad_er_id=2018*N0*N0*S1*14634*9989&ANNO_ACCADEMICO=2018&mostra_percorsi=S|Machine Learning - AY 2018/2019]] **Class schedule**: * Tuesday 11:00 - 13:00 - AB1 * Thursday 9:00 - 11:00 - LAB2 **Students Office hours**: * Thursday from 11:00 to 13:00 ---- ===== Course Objectives ===== KNOWLEDGE AND UNDERSTANDING The aim of the course is to provide the student with knowledge and skills in the area of machine learning.\\ At the end of the course the student should be able to: * distinguish the various machine learning paradigms; * know the learning theory * know classification algorithms, regression, clustering and dimension reduction; APPLYING KNOWLEDGE AND UNDERSTANDING\\ After completing the course, the student must demonstrate that he is able to: * apply the different machine learning paradigms * implement the classification, regression, clustering and dimensionality reduction algorithms; * design and implement systems able to learn automatically from real data and situations; COMMUNICATION SKILLS\\ At the end of this training activity, the student will be able to express himself clearly and with appropriate terms, using the English language, in the learning discussions as well as expose the results of a research concerning technical aspects of machine learning. LEARNING SKILLS At the end of this training activity the student will be able to: * Finding and learning the innumerable algorithms and techniques that are presented in the field of machine learning * Implementing and using the new algorithms ---- ===== Course Contents ===== * Probabilistic learning theory and the "learning problem" * The VC-dimension (Proof of the maximum margin) * Notions of Probability and Linear Algebra * Linear Models and Regression for Classification * Dimensionality Reduction * Clustering * Neural networks (an introduction) * Decision Tree, Random Forest, Ensemble * Balanced and unbalanced data * Evaluation Metrics (AUC, ROC, Confusion Matrix...) * Examples of coding in Python ---- ===== Study material ===== **Course Slides** * 02/10/2018 {{didattica:magistrale:ml:ay_1819:lezione0_protetta.pdf|Lezione0}} * 03/10/2018 {{didattica:magistrale:ml:ay_1819:lezione1_protetta.pdf|Lezione1}} * 09/10/2018 {{didattica:magistrale:ml:ay_1819:lezione2_protetta.pdf|Lezione2}} * 10/10/2018 {{didattica:magistrale:ml:ay_1819:lezione3_protetta.pdf|Lezione3}} * 23/10/2018 {{didattica:magistrale:ml:ay_1819:lezione4_protetta.pdf|Lezione4}} * 25/10/2018 {{didattica:magistrale:ml:ay_1819:lezione5_protetta.pdf|Lezione5}} * 30/10/2018 - 06/11/2018 {{didattica:magistrale:ml:ay_1819:lezione6_protetta.pdf|Lezione6}} * 8/11/2018 {{didattica:magistrale:ml:ay_1819:lezione7_protetta.pdf|Lezione7}} * 13/11/2018 {{didattica:magistrale:ml:ay_1819:linearmodels.pdf|Lezione 8}} * 15/11/2018 {{didattica:magistrale:ml:ay_1819:linearmodels.pdf|Lezione 9}} (Per usare il file, scaricare il file come allegato e cambiare l'estensione da .pdf a .py) * 04/12/2018 {{didattica:magistrale:ml:ay_1819:lezione10_11_protetta.pdf|Lezione 10-11}} * 06/12/2018, 11/12/2018 and 13/12/2018{{didattica:magistrale:ml:ay_1819:lezione12_protetto.pdf|Lezione 12}} * 19/12/2018 (3 hr) and 20/12/2018 {{didattica:magistrale:ml:ay_1819:lezione13_14_protetta.pdf|Lezione 13-14}} * 08/01/2019 {{didattica:magistrale:ml:ay_1819:lezione15_protetta.pdf|Lezione 15}} * 10/01/2019 {{didattica:magistrale:ml:ay_1819:lezione16_protetto.pdf|Lezione 16}} * 15/01/2019 {{didattica:magistrale:ml:ay_1819:lezione17_protetta.pdf|Lezione 17}} * 17/01/2019 {{didattica:magistrale:ml:ay_1819:lezione18_protetta.pdf|Lezione 18}} **Reference books** * C.M. Bishop, Pattern Recognition and Machine Learning, Springer - 2006 * D. Barber, Bayesian Reasoning and Machine Learning, Cambridge University Press. - 2012 [[http://web4.cs.ucl.ac.uk/staff/D.Barber/pmwiki/pmwiki.php?n=Brml.Online|Online version]] * T. Hastie, R. Tibshirani, J. Friedman, The Elements of Statistical Learning, Springer - 2008 [[https://web.stanford.edu/~hastie/ElemStatLearn//printings/ESLII_print10.pdf|Online version]] **Other sources** Some of the material is taken from the ML Course of Caltech given by Prof. Yaser Abu Mostafa and his collaborators ** Additional Material ** * 04/12/2018 {{didattica:magistrale:ml:ay_1819:hoeffding_protetto.pdf|Hoeffding's}} * 07/01/2019 {{didattica:magistrale:ml:ay_1819:optimization_protetto.pdf|Optimization_notes}} * 28/01/2019 {{didattica:magistrale:ml:ay_1819:svm_notes1.pdf|SVM1}} * 28/01/2019 {{didattica:magistrale:ml:ay_1819:svm_notes2.pdf|SVM2}} * 28/01/2019 {{didattica:magistrale:ml:ay_1819:svm_notes4.pdf|SVM3}} ---- ===== Exams ===== **Exam Dates A.Y. 2015/2016** * Winter session dates here * Summer session dates here * Autumn session dates here * Winter session dates here (2016) **Exam rules**: The exam consists in two sessions: a written session and an oral one. The oral session is reserved for people who pass the written part with a mark greater or equal to 18. ** Exam Results ** * N/A ---- ===== Introduction to Machine Learning (for Ph.D.) ===== ** Syllabus ** * Learning Probabilistic Theory * Learning paradigms * Classification * Clustering * Neural Networks * Support Vector Machines * Practical issues for ML ** Material ** * Lesson0 13/06/2019 {{didattica:magistrale:ml:ay_1819:lezione0_phd_protetto.pdf|Lezione0}} * Lesson1 09/06/2019 {{didattica:magistrale:ml:ay_1819:lezione1_phd_protetto.pdf|Lezione1}} * Lesson2 20/06/2019 {{didattica:magistrale:ml:ay_1819:lezione2_phd_protetto.pdf|Lezione2}} * Lesson3 24/06/2019 {{didattica:magistrale:ml:ay_1819:lezione3_phd_protetto.pdf|Lezione3}} * Lesson4 27/06/2019 {{didattica:magistrale:ml:ay_1819:lezione4_phd_protetto.pdf|Lezione4}} * Lesson5 04/07/2019 {{didattica:magistrale:ml:ay_1819:lezione5_phd_protetto.pdf|Lezione5}} * Lesson6 13/07/2019 {{didattica:magistrale:ml:ay_1819:lezione6_protetto.pdf|Lezione6}}