COMP37332 - Data Integration and Analysis
Additional Course Information (2010)
Lecturers: Goran Nenadic (GN) and Sandra Sampaio (SS)
Official module description and syllabus
Schedule of lectures, tutorials and labs
All sessions are on Tuesdays between 12:00 - 14:00Venue: 1.4 (for lectures); or 3rd year lab (for labs)
| Week | Date | Lecture/Tutorial/Lab | Lecturer |
| 1 | 02/02 |
Lecture 0: Introduction to Data Integration and Analysis Lecture 1: Introduction to Distributed Databases | GN SS |
| 2 | 09/02 | Lecture 2: Distributed Database Design | SS |
| 3 | 16/02 |
Lecture 3: Distributed databases in Oracle Tutorial 1: Distributed Databases | SS |
| 4 | 23/02 | Lecture 4: Data warehousing | GN |
| 5 | 02/03 | Lecture 5: Introduction to OLAP | GN |
| 6 | 09/03 |
Lecture 6: Introduction to Data Mining Lab test 1: DW and OLAP | GN |
| 7 | 16/03 | Lecture 7: Association rule mining | GN |
| 8 | 23/03 | Lecture 8: Data Classification | GN | Easter break |
| 9 | 20/04 | Lecture 9: Data Clustering | GN |
| 10 | 27/04 | Guest lecture: "Smart Analytics for Policing - Data Warehousing for real" | Ron Fellows, IBM |
| 11 | 04/05 |
Lecture 10: Enterprise Resource Planning (ERP) Wrapping up | GN |
| 12 | 11/05 | Lab test 2: Data Mining | GN |
Assessment
- Examination: 85% (3 questions from 5).
- Laboratory: 15% (2 test sessions, practicing tools and methods discussed during the lectures).
Past exam papers
Past exam papers are available here and here. Feedback on past papers is available here.General information about Examination is here.
Lab-test sessions
There are 2 assessed lab session: Lab-test 1 on Data warehousing and OLAP (worth 5%), and Lab-test 2 on Data Mining (worth 10% of the total mark). The detailed information about tests (including necessary prepration) is available here: Lab test 1 and Lab test 2.Study Materials
- Introduction: data integration and analysis
- Lecture handouts
- Data, data everywhere: The Data Deluge Report
- a special report on Information management (The Economist) - Case study: Crime Prediction
- Case study: Traffic control in Stockholm (see also here)
- Distributed Databases
- Lecture handouts 1; 2; 3; 4
- Tutorial questions and guide answers
- Oracle documentation: Distributed Database concepts
- Data warehousing
- Lecture handouts
- Tutorial questions and guide answers
- Additional materials
- Chaudhuri, Dayal: An overview of data warehousing and OLAP technology
- Oracle data warehousing (documentation and case studies)
- SQL Server 2000 (documentation and case studies)
- IBM DB data warehousing (documention and case studies)
- Talend Open Studio for ETL, data integration and management (open source)
- On-line analytical processing (OLAP)
- Lecture handouts
- Tutorial questions and guide answers
- Additional materials
- Business Intelligence (BI) Verdict web site
- Oracle documentation (with examples)
- Microsoft Business Intelligence
- OLAP software (examples and demos)
- Talend Webinars
- Open Source Data Analysis with Talend & Palo (March 4th, 2010)
- Get ahead of the Game with Next Generation Open Source BI (March 11, 2010)
- Data Mining (introduction)
- Lecture handouts
- Tutorial questions and guide answers
- Data mining with WEKA - slides
- Lab tutorial (Weka)
- Additional materials
- From Data Mining to Knowledge Discovery in Databases (1996)
- Data mining tutorial (1998)
- Data mining and privacy
- Weka 3: data mining software
- Data Mining with Weka (tutorial)
- Association rules mining
- Lecture handouts
- Tutorial questions and guide answers
- Lab tutorial (Weka)
- Additional materials
- Association rule mining in ORACLE
- Association rules using WebSphere Commerce Analyzer
- Association Rule Mining with WEKA (tutorial)
- Association rules tutorial
- Apriori - Association Rule Induction / Frequent Item Set Mining software
- Classification
- Lecture handouts
- Tutorial questions and guide answers
- Lab tutorial (Weka)
- Additional materials
- Classification in ORACLE
- Classification via Decision Trees in WEKA (tutorial)
- Decision tree tutorial
- Dtree - Decision and Regression Tree Induction software
- svmlight: http://www.cs.cornell.edu/People/tj/svm_light/
- SVMLIB: http://www.csie.ntu.edu.tw/~cjlin/libsvm
- Clustering
- Lecture handouts
- Tutorial questions and guide answers
- Lab tutorial (Weka)
- Additional materials
- An overview of Enterprise Resource Planning (ERP)
- Additional materials
- Enterprise Resource Planning (slides from eprfans.com)
- SAP (Business Software Solutions, Applications and Services)
- SAP/Business Objects Intelligence Platform
- Information Builders (Business Intelligence and Enterprise Reporting)
- WebFOCUS from Information Builders
- IBM Cognos (Business Intelligence, Budgeting, Forecasting, Performace management and Scorecarding)
- SAS Institute (Business analytics)
- ORACLE's Siebel (Business analytics solutions, CRM, ERP)
- ORACLE's Hyperion (Financial Performance Management, etc.)
- Qlik View (Business intelligence, etc.)
- MUSING project - next generation semantic-based business intelligence solutions
- Wrapping up
Tutorial materials
- Distributed databases tutorial sheet
- Data warehousing and OLAP tutorial sheet
- Weka introductory lab/tutorial
- data files: labor.arff; contact-lenses.arff
- Association rule mining in Weka (lab/tutorial)
- data files: contact-lenses.arff; zoo.arff
- Classification lab/tutorial (Weka)
- data files: labor.arff; glass.arff; glass-minusatt.arff; vehicle.arff
- Clustering lab/tutorial (Weka)
- data files: weather.arff; iris.arff; bank.arff; flagdata.arff
- Dendrogram (task B1)
- Data Mining tutorial sheet
Lab Materials
- Lab test 1: Data warehousing and OLAP
- Dundas OLAP Services
- Dundas OLAP Services
- Dundas - Quick start
- Lab demo 1
- Lab demo 2
- Tutorial sheet and guide answers
- Dundas OLAP Services
- Lab test 2: Data mining (association rules, classification, clustering).