Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
didattica:magistrale:bda:ay_1718:main [2017/09/19 21:28] massimo [News] |
didattica:magistrale:bda:ay_1718:main [2020/09/17 16:55] (current) |
||
---|---|---|---|
Line 1: | Line 1: | ||
====== Big Data Analytics ====== | ====== Big Data Analytics ====== | ||
- | ---- | + | |
===== News ===== | ===== News ===== | ||
<WRAP center round important 95%> | <WRAP center round important 95%> | ||
+ | * <wrap em>**Exam update**</wrap>: Appello Big Data Analytics scheduled for 12/11/2018 has been re-scheduled for 26/07/2018 at 14:30pm. | ||
+ | * <wrap em>**Exam update**</wrap>: Appello Big Data Analytics scheduled for 12/11/2018 has been re-scheduled for 26/07/2018 . | ||
+ | * <wrap em>**Exam results 2018-06-14**</wrap>: results have been published {{ https://drive.google.com/file/d/1uEYyZEPAIllN0D8wrvbyAAG33itVjc5U/view?usp=sharing | link }}. Students can confirm their vote by mail and register at the next exam session. | ||
+ | * <wrap em>**Exam results 2018-03-06**</wrap>: results have been published {{ https://drive.google.com/file/d/1NGU79ju41ZGmAGy7WBBtph8y9F0vSCcr/view?usp=sharing | link }}. Students can confirm their vote by mail and register at the next exam session. | ||
+ | * <wrap em>**Exam update**</wrap>: Appello Big Data Analytics scheduled for 22/2/2018 has been re-scheduled for 6/3/2018 . | ||
+ | * <wrap em>**Exam update**</wrap>: Writing exam - BDA part 1 scheduled for 1/3/2018 has been re-scheduled for 6/3/2018 . | ||
+ | * <wrap em>**Exam results 2018-02-08 A.A. 2017-18**</wrap>: results have been published {{ https://drive.google.com/file/d/1HT_i75DA3DtQfa4dfpgmrpTi-BV70ey6/view?usp=sharing | link }}. Students can confirm their vote by mail and register at the next exam session. | ||
+ | * <wrap em>**Exam results 2018-02-08 A.A. 2016-17**</wrap>: results have been published {{ https://drive.google.com/file/d/1j1PlOMmjljp0tJvbGK6RZEYR1b6lSmnM/view?usp=sharing | link }}. Students can confirm their vote by mail and register at the next exam session. | ||
+ | * <wrap em>**Exam update**</wrap>: exam scheduled for 8/2/2018 will be held in AB3, 15:00-16:00. Two types of exam will be held: A.A. 2016-17 (full exam for the past course), A.A. 2017-18 (partial for the new course). | ||
+ | * <wrap em>**Exam update**</wrap>: exam scheduled for 1/2/2018 has been re-scheduled for 8/2/2018 . | ||
+ | * <wrap em>**Course update**</wrap>: Homeworks are now available in **Study Material** section. | ||
+ | * <wrap em>**Lecture update**</wrap>: Le lezioni della seconda parte del corso inizieranno l'8 gennaio e seguiranno per 4 settimane come corso intensivo di 21 ore. Siete invitati ad iscrivervi al gruppo facebook BIGDATA-2017 | ||
+ | * <wrap em>**Lecture update**</wrap>: Next lecture is scheduled for 27th november 2017 at 14:00pm - room LA2. | ||
+ | * <wrap em>**Lecture update**</wrap>: Next lecture is scheduled for 20th november 2017 at 14:00pm - room LA2. | ||
+ | * <wrap em>**No lesson 9th november 2017**</wrap>: Lecture suspended. Next lecture is 13th november 2017 at 14:00pm. | ||
+ | * <wrap em>**Papers 2016-17**</wrap>: available {{ https://drive.google.com/drive/folders/0B3Jl2zBf8Y-pV2hsTXRPZGJaZEE?usp=sharing | here }}. | ||
+ | * <wrap em>**No lesson 26th october 2017**</wrap>: Lecture suspended. Next lecture is 9th november 2017. | ||
* <wrap em>**Course start**</wrap>: lessons will start on 5th October 2017. | * <wrap em>**Course start**</wrap>: lessons will start on 5th October 2017. | ||
+ | * <wrap em>**Course 2017-16**</wrap>: {{https://goo.gl/PDpZPw | link }} | ||
</WRAP> | </WRAP> | ||
---- | ---- | ||
Line 9: | Line 27: | ||
<WRAP box round 95% center> | <WRAP box round 95% center> | ||
**Teacher**: | **Teacher**: | ||
+ | * **Prof.ssa Emanuela Merelli** <emanuela.merelli[at]unicam.it> | ||
* **Dr. Massimo Callisto De Donato** <massimo.callistodedonato[at]gruppofilippetti.it> | * **Dr. Massimo Callisto De Donato** <massimo.callistodedonato[at]gruppofilippetti.it> | ||
**Lessons schedule**: | **Lessons schedule**: | ||
- | * 42 h - lecture and exercise sessions | + | * 42 h - lectures (2 modules), exercise sessions |
- | * Thursday: 15:00 pm – 18:00 pm | + | * Thursday: 16:00 pm – 19:00 pm |
+ | * Room LA2 - Polo "Carla Lodovici" | ||
**Students Office hours**: | **Students Office hours**: | ||
Line 43: | Line 63: | ||
<WRAP round 95% center box> | <WRAP round 95% center box> | ||
* **Introduction to Big Data** | * **Introduction to Big Data** | ||
- | * What are Big Data | + | * Why Big Data |
- | * Big Data in the real world | + | * Big Data use cases in the real world |
- | * Needs and Challenges of Big Data | + | * Needs, challenges and opportunities of Big Data |
- | * Characterize Big Data | + | * **Big Data models: Methodologies and Techniques** |
- | * **Big Data models: from storage to processing** | + | * The 3V model |
- | * The V model | + | |
* From datawarehouse to Big Data | * From datawarehouse to Big Data | ||
- | * Aspect of Distributing Storage | + | * Enable Big Data Analysis |
- | * Distributed Processing | + | * **Big Data Analysis: storage** |
- | * NoSQL | + | * Storage models for Big Data |
- | * Distributed Search | + | * Hadoop framework |
- | * **Big Data Analisys: Methodologies and Techniques** | + | * hdfs filesystem |
- | * How enabling Big Data Processing | + | * **Big Data Analysis: computation** |
- | * The Hadoop framework | + | * Computational framework for Big Data Analysis |
- | * HDFS: hadoop filesystem | + | * Data at rest and Data in motion |
- | * Computational framework: MapReduce and YARN | + | * MapReduce and YARN framework |
- | * HBase as NoSQL database | + | * Other related processing frameworks |
- | * Other related hadoop processing frameworks | + | * **Big Data Analysis: NoSQL** |
- | * Practical Examples | + | * Databases in Big Data systems |
- | * Apache Spark | + | * The CAP theorem and BASE model |
- | * Apache Cassandra | + | * NoSQL data models |
+ | * **Big Data Analysis: streaming** | ||
+ | * How enabling Big Data Streaming Processing | ||
* Batch processing Vs RealTime processing | * Batch processing Vs RealTime processing | ||
- | * Apache Spark Streaming | + | * An overview of Apache Spark |
- | * Apache Storm | + | * **Advance topics in Big Data Analysis** |
- | * **Big Data Analysis applications** | + | |
- | * Big Data in practice: connecting with IoT | + | |
- | * Use cases scenario | + | |
- | * **Advance Big Data Analysis** | + | |
- | * Distribuited graph modelling framework | + | |
- | * Machine Learning | + | |
- | * Baysian Newtork | + | |
</WRAP> | </WRAP> | ||
---- | ---- | ||
Line 80: | Line 94: | ||
<WRAP box round center 95%> | <WRAP box round center 95%> | ||
**Course Slides** | **Course Slides** | ||
- | * slide 1st_0 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pdmpSUmdIdzRCTk0/view?usp=sharing | slides_1}} | + | * slide 1st_0 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pSWJqaDQ5WWVoeWs/view?usp=sharing | slides_1}} |
- | * slide 1st_1 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pck5Hd1FES0pmVW8/view?usp=sharing | slides_1_1}} | + | * slide 1st_1 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pbG0zcm5aS0pmSUU/view?usp=sharing | slides_1_1}} |
- | * slide 2st_1 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pQV9HNHh3SnVZOTQ/view?usp=sharing | slides_2_1}} | + | * slide 2st lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pNHZlUXFCbXV2NGs/view?usp=sharing | slides_2}} |
- | * slide 2st_2 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pVkNTSzlUMWhTZWM/view?usp=sharing | slides_2_2}} | + | * slide 3st_1 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pV0p4ekJ0RnhpdXM/view?usp=sharing | slides_3st_1}} |
- | * slide 2st_3 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pYWZJck13Vm1TMTA/view?usp=sharing | slides_2_3}} | + | * slide 3st_2 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pYU5HRVBYV3lNYU0/view?usp=sharing | slides_3st_2}} |
- | * slide 3st_1 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pSnJ3d1Z3dTBqS3c/view?usp=sharing | slides_3}} | + | * slide 4st lesson {{ https://drive.google.com/file/d/1ENRrfxuhoH8h4Kuir8Omx7B5jZUaGYht/view?usp=sharing | slides_4st}} |
- | * slide 4st_1 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pcVc1Um5maFRIUnc/view?usp=sharing | slides_4}} | + | * slide 5st lesson {{ https://drive.google.com/file/d/1ncOQ2skwVcp-UVQtjR7Zfcw3n6JXSLxB/view?usp=sharing | slides_5st}} |
- | * slide 4st_2 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pQ1h3azIxZUtOams/view?usp=sharing | slides_4_2}} | + | * slide 6st lesson {{ https://drive.google.com/file/d/10WsuwCjFC4SiyQnKZnfFICX2DXK6X75D/view?usp=sharing | slides_6st}} |
- | * slide 5st_1 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pLXE4SThZZ2ZDMFE/view?usp=sharing | slide 5_1}} | + | * slide 6_1st lesson {{ https://drive.google.com/file/d/1VZIkzkO9F2_Ok7Lwhy8mA_6rPy6opklC/view?usp=sharing | slides_6_1st}} |
- | * slide 5st_2 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pZU5NWVZEVURSZDQ/view?usp=sharing | slide 5_2}} | + | * slide 7st lesson {{ https://drive.google.com/file/d/1TSSCo4iaazxD5Ua02T2V_c-fV3wbTOP3/view?usp=sharing | slides_7st}} |
- | * slide 6st_1 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pODVvTFdxQndWX2M/view?usp=sharing | slide 6_1}} | + | |
- | * slide 7st_1 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pRWdsMFAzQTBRQ3M/view?usp=sharing | slide 7_1}} | + | |
- | * slide 8st_1 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pbVg3WU9jRDJ5R1k/view?usp=sharing | slide 8_1}} | + | |
- | * slide 9st_1 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-peGxlMEpWaHRtWGs/view?usp=sharing | slide 9_1}} | + | |
- | * slide 10st_1 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pTnBXWjB0VXJuMFE/view?usp=sharing | slide 10_1}} | + | |
- | * slide 11st_1 lesson {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pazd1dGlGMTJrRVE/view?usp=sharing | slide 11_1}} | + | |
* **Reference materials** | * **Reference materials** | ||
* Slides course. | * Slides course. | ||
* Material provided by the teacher. | * Material provided by the teacher. | ||
- | * Examples: {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pdjdYeGRUWDBjQ0k/view?usp=sharing | wordcount }} {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pNkNTeTlyM2RvR1E/view?usp=sharing | exportdbms}} {{ https://drive.google.com/drive/folders/0B3Jl2zBf8Y-pakNOZi14d3JFb28?usp=sharing | hbase}} {{ https://drive.google.com/drive/folders/0B3Jl2zBf8Y-pN1oybzN0NzhmMVU?usp=sharing | spark}} {{ https://drive.google.com/drive/folders/0B3Jl2zBf8Y-pTGJRaTZ0czBuZzg?usp=sharing | spark-streaming}} {{ https://drive.google.com/drive/folders/0B3Jl2zBf8Y-pNFV4QVg4UDh1QW8?usp=sharing | storm}} | + | * Examples |
* **Homework** | * **Homework** | ||
- | * {{ https://drive.google.com/file/d/0B3Jl2zBf8Y-pR3dSNWtXMGxjbDA/view?usp=sharing | info}} | + | * {{ https://drive.google.com/file/d/15r_hh1dpREW9GgwaMqJEShRwDcN9D-aB/view?usp=sharing | Info and available homeworks}} |
- | * {{ https://docs.google.com/document/d/1ziU3J8xGDXAixTMndIdQfseVb5uuTAH5Jyrhew6T3lE/edit?usp=sharing | hw-bidata-001}} {{ https://docs.google.com/document/d/1Wnf1vF-9Ltjv_kJAlh5A6wWQnFx6d7MfLgpLUgbqI6w/edit?usp=sharing | hw-bidata-002}} {{ https://docs.google.com/document/d/1wEZWjBktuFu9yL10IcXlGr17OB5WhTUCBwvJsNtv23w/edit?usp=sharing | hw-bidata-003}} {{ https://docs.google.com/document/d/1HMwSg6zk5TVFaC9oJ3Y5kI94uQEJAURvgf3Hjh259qc/edit?usp=sharing | hw-bidata-004}} {{ https://docs.google.com/document/d/1Jq-NUFgCbyk044HSUiblPrdjAutqfmDb97u8ZQXUeLE/edit?usp=sharing | hw-bidata-005}} {{ https://docs.google.com/document/d/1RSkyV3ZTFP6_zDjC0U0aj_cPCngUgwZhJUoEw5mTjY4/edit?usp=sharing | hw-bidata-006}} | + | * {{ https://drive.google.com/file/d/1bHKfxpLIyQCBjfuNOnbFRHH9qUhO4qPW/view?usp=sharing | Template (.doc) }} |
</WRAP> | </WRAP> | ||
Line 111: | Line 119: | ||
===== Exams ===== | ===== Exams ===== | ||
<WRAP box round center 95%> | <WRAP box round center 95%> | ||
- | **Exam Dates A.Y. 2015/2016** | + | **Exam Dates A.Y. 2017/2018** |
- | * 16/03/2017 - 15:00 | + | * 08/02/2018 - 15:00 |
- | * 30/03/2017 - 15:00 | + | * 06/03/2018 - 15:00 |
- | * 22/06/2017 - 15:00 | + | * 14/06/2018 - 15:00 |
- | * 13/07/2017 - 15:00 | + | * 12/07/2018 - 15:00 |
- | * 21/09/2017 - 15:00 | + | * 20/09/2018 - 15:00 |
- | * 01/02/2018 - 15:00 | + | * 22/11/2019 - 15:00 |
- | * 22/02/2018 - 15:00 | + | * 07/02/2019 - 15:00 |
**Exam rules**: | **Exam rules**: | ||
Line 128: | Line 136: | ||
** Exam Results ** | ** Exam Results ** | ||
- | * {{https://drive.google.com/file/d/0B3Jl2zBf8Y-pVTg5X1BUYXNpUVU/view?usp=sharing | 2017-03-30 }} | + | * - |
- | * {{https://drive.google.com/file/d/0B3Jl2zBf8Y-pTkc5aV9zSXMxUEk/view?usp=sharing | 2017-03-16 }} | + | |
</WRAP> | </WRAP> | ||
+ | |||
+ |