Data Integration

Knowledges on procedural programming.

The weekly teaching load is as follows:

– 2 theoretical hours used to present new concepts and approach methodologies for data integration. All the concepts explained are complemented with the presentation of simple examples;

– 2 practical hours in which students have the opportunity to apply the concepts learned in solving specific problems.

The assessment is divided into 2 components:

• Theoretical (70%): Students can choose to carry out the theoretical assessment on a continuous basis, by taking two tests throughout the semester or taking only one exam at the end of the semester.
• Practice (30%) Students have to carry out practical work throughout the semester.

Students to pass the curricular unit must obtain a minimum of 35% in both assessment components (theoretical and practical).

Goals

To provide students the capacities of analyze and solve data integration problems in different levels of an organization. The unit focus different types and strategies of data integration and explores the use of tools and/or programming solutions for data integration.

Skills

Knowledge and understanding:
• Explain the main reasons for integrating data
• Identify the main types of data integration
• Identify and explain data integration technologies and strategies
• Explain the steps involved in the data integration process.

Knowledge application
• Acquisition and understanding of the essential concepts for the integration of data and systems.
• Acquisition and application of knowledge about the communication between components and applications, built with different languages ​​and / or running in heterogeneous systems.
• Ability to use markup languages ​​to question heterogeneous data sources.
• Ability to design, implement, integrate and maintain distributed applications and systems made up of heterogeneous sources.

Justification in decision-making
• Ability to make fundamental choices in terms of integration technologies.

Conducting judgments
• Critical evaluation of systems integration solutions.

Communication
Prepare clear documentation in the scope of the development of practical work, identifying and justifying the main decisions taken.

Autonomy and self-learning
• Ability to perform autonomous and group work.
• Development and autonomy in learning.
Encourage the ability to address new problems posed in terms of systems integration as well as in the realization of solutions that support that same integration

1. Introduction
1.1. Motivation and context
1.2. Definition of Data Integration
1.3. Data Integration Difficulties
1.4. Data Integration Architectures
2. Data Extraction
2.1. Extracting Web Data
2.2. Extracting data from text
2.3. Regular Expressions
2.4. String matching algorithms
3. Formats for storing and integrating data
3.1. JSON
3.2. XML
4. JSON Data Models
4.1. Features
4.2. Advantages / Disadvantages
4.3. Examples
5. XML data models
5.1. XML Language
5.2. Validation of XML documents
5.3. Interrogation and modification languages: XPath, XSLT, XQuery, XQuery Update
6. Data Integration Techniques
6.1. Schema Mapping
6.2. Mediators and wrappers
6.3. Query processing
6.4. Matching Strings
7. Service-based integration
7.1. Web services
7.2. Simple Object Access Protocol (SOAP)
7.3. Web Services Description Language (WSDL)

The final classification will be obtained by the grades of the theoretical component and the practical component.
The theoretical component is worth 14 values and can be obtained by continuous evaluation or by final exam.
The practical component is worth 6 values and consists of the accomplishment of a practical work.

To obtain approval of the course unit, a student must obtain a grade of 9.5 or higher, and the following requirements:
• Minimum of 35% of the price in the theoretical component (average of the tests or final exam).
• Minimum of 35% in practical work

Components of evaluation:
Theoretical:
The grade of the theoretical component is obtained by one of the following modalities (at the student's choice):
Continuous assessment: 2 written theoretical tests to be carried out without consultation during the semester
Each test is scored to 7 points (in 20)

Assessment by examination: 1 written exam without consultation
Exam is scored to 14 values (in 20)

The tests and exams are without consultation.

Practice:
The grade of the practical component corresponds to the grade obtained in the practical work to be carried out during
the semester
Work: Quotation: 6 points.
Mandatory defense in dates to be schedule

The work should be done individually or in groups of two students.

The practical work can only be delivered once, on the date indicated in the statement, being valid for all epochs of evaluation (normal, resource, special).
The delivery of the work is done through Moodle.

The grade of the practical component is valid for the normal, resource and special exams, and all the evaluation epochs for students with special status to have access.
Students who have access to the special exam and students under other regimes (associative leader, high competition athlete, etc.), who may require several dates for the theoretical exam, must deliver the practical work on the same date as above, and must have the minimum required.

NAO