The course aims to illustrate modern technical and methodological solutions for managing big data, that is, collections of unstructured data whose size exceeds the storage, management, and analysis capabilities typical of traditional database systems. Starting from the requirements of modern database applications, the course will address the various issues of storing and using big data, illustrating the hardware and software architectures that have been proposed for their management. The topics that will be covered include: cluster-based architectures, the map-reduce paradigm, cloud computing, NoSQL systems, tools and languages for data analysis. During the course, there will be an effort to combine methodological and technological aspects through practical exercises using real systems, corporate seminars, and the execution of practical projects.
teacher profile teaching materials
- The Hadoop Ecosystem
- Cloud computing
- Big data processing (MapReduce, Hive, Spark)
- NoSQL systems
- Big data analytics
- Data lakes
- Systems and applications
- Business seminars
Teacher slides in english (available on the Web side of the course on Moodle)
Fruizione: 20802125 BIG DATA in Ingegneria informatica e dell'intelligenza artificiale LM-32 (docente da definire)
Programme
- Infrastructures and programming paradigms for big data- The Hadoop Ecosystem
- Cloud computing
- Big data processing (MapReduce, Hive, Spark)
- NoSQL systems
- Big data analytics
- Data lakes
- Systems and applications
- Business seminars
Core Documentation
Martin J. Fowler, PramodkumarJ. Sadalage. "NoSQL Distilled: A Brief Guide to the Emerging World of Polyglot Persistence".Teacher slides in english (available on the Web side of the course on Moodle)
Attendance
Attendance at all activities is strongly suggested, but not mandatory.Type of evaluation
The final evaluation is based on the development of some projects and on a written test lasting 1 hour. - The projects are carried out in groups and consist of both solving problems assigned by the teacher and carrying out activities agreed with the teacher. - The written test is organized through exercises aimed at verifying the level of effective understanding of the concepts and the students' ability to apply them in real contexts. The tests assigned in previous years are available on the course website.