ODI Training



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0

ODI Training Uploaded by Nguyen Ba Quoc An



Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join

ODI 12c Workshop Syd

1

of 79

 

ODI-1Z0-482 (Oracle Data

ODI faqs

 Search document



Oracle Data Integrator Hands-On Workshop Version 2.2

Nguyen Tuan Khang [email protected] (0913 008994) Sign up to vote on this title

Senior Solutions Consultant  Oracle Fusion Oracle Fusion Middleware Oracle Vietnam Oracle Vietnam

Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Table of Contents

LAB 1: SOFTWARE SOFTWARE INSTALLATION INSTALLATION AND SETUP ............................... ............................................. ..............

Download the Software (Pre-Requisite)........ (Pre-Requisite)................... .................... ................... ..................... ........... .................... ........... ......... Install Oracle Data Integrator.......... ................... .......... .................... ........... .................... ........... ................... .................... ................ ...... Install Oracle XE .................. ......... .................... ..................... ................... .................... ........... .................... ........... ................... .................... ................ ...... Setup the ODI Metadata Metadata Repositories........ Repositories......................... ............................... .............................. ................................ ................

DATA INTEGRATION SCENARIO: PERMIT PROCESSING ................... ......... .................... ..........

LAB 2: CAPTURING CAPTURING METADATA................ METADATA................................ ................................ .............................. .......................... ............

Configure Data Servers in the ODI Topology Manager.. .................... ........... ................... .................... ................ ...... Define Data Models in the ODI Designer... .................... ......... ........... ..................... ........... ................... .................... ...........

LAB 3: SIMPLE DATA INTEGRATION INTEGRATION.............. .............................. ................................ .............................. ................... .....

Create an Integration Integration Project in the ODI Designer Designer .............................. .............................................. ....................... ....... Import the Knowledge Modules Modules .................... ......... .................... .................. .................... .................... ................... ..................... ........... ..... Create the Interface to Load the Applicant Data............. .................... ........... ................... ..................... ........... Define Basic Transformations ........... .................... ........... .................. .................... .................... ................... ..................... ........... Define a Filter..... .................. ......... .................... ..................... ................... .................... ........... .................... ........... ................... ..................... ........... ..... Execute the Interface. ................... .......... .................... ........... ..................... ........... ................... .................... ........... ..................... ........... ................. ....... Monitor the Execution ........... ..................... ........... ................... .................... ........... ..................... ........... ................... .................... ........... .....

LAB 4: HETEROGENEOUS DATA INTEGRATION INTEGRATION AND VALIDATION .........

Create the Interface to Load the Permit Data .............................. ............................................. ............................... ................ Integrate Heterogeneous Sources ................... .......... ................... ..................... .................... ................... .................... ................... ......... Create Data Validation Validation Rules............................... Rules.............................................. ............................... ................................ ......................... ......... Execute the Interface. ................... .......... .................... ........... ..................... ........... ................... .................... ........... ..................... ........... ................. ....... Monitor the Execution ........... ..................... ........... ................... .................... ........... ..................... ........... ................... .................... ........... .....

LAB 5: CHANGE DATA CAPTURE CAPTURE .............................. ............................................ .............................. ............................ ............

Import the Journalization Knowledge Knowledge Module ..................... ........... ................... ................... .................... ................... ......... Enable Journalization .................... ........... .................. .................... ..................... ................... .................... ........... ..................... ........... ................. ....... Using Journalized Journalized Data in an Interface............................. Interface........................................... .............................. ............................ ............  LAB 6: ORCHESTRATE INTERFACES INTO PACKAGES .......... .................. ......... Sign up to vote on................... this title

Not................... useful..................... Create the Permit Integration Package............. .................... ......... ..................... ................... ...........  Useful  Archive the Input File........ .................... .......... ................... .................... ........... ..................... ........... ................... ................... .................... .......... Execute the Package.............. ..................... ........... ................... .................... .................... .................. .................... ..................... ................. .......





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Table of Contents

LAB 1: SOFTWARE SOFTWARE INSTALLATION INSTALLATION AND SETUP ............................... ............................................. ..............

Download the Software (Pre-Requisite)........ (Pre-Requisite)................... .................... ................... ..................... ........... .................... ........... ......... Install Oracle Data Integrator.......... ................... .......... .................... ........... .................... ........... ................... .................... ................ ...... Install Oracle XE .................. ......... .................... ..................... ................... .................... ........... .................... ........... ................... .................... ................ ...... Setup the ODI Metadata Metadata Repositories........ Repositories......................... ............................... .............................. ................................ ................

DATA INTEGRATION SCENARIO: PERMIT PROCESSING ................... ......... .................... ..........

LAB 2: CAPTURING CAPTURING METADATA................ METADATA................................ ................................ .............................. .......................... ............

Configure Data Servers in the ODI Topology Manager.. .................... ........... ................... .................... ................ ...... Define Data Models in the ODI Designer... .................... ......... ........... ..................... ........... ................... .................... ...........

LAB 3: SIMPLE DATA INTEGRATION INTEGRATION.............. .............................. ................................ .............................. ................... .....

Create an Integration Integration Project in the ODI Designer Designer .............................. .............................................. ....................... ....... Import the Knowledge Modules Modules .................... ......... .................... .................. .................... .................... ................... ..................... ........... ..... Create the Interface to Load the Applicant Data............. .................... ........... ................... ..................... ........... Define Basic Transformations ........... .................... ........... .................. .................... .................... ................... ..................... ........... Define a Filter..... .................. ......... .................... ..................... ................... .................... ........... .................... ........... ................... ..................... ........... ..... Execute the Interface. ................... .......... .................... ........... ..................... ........... ................... .................... ........... ..................... ........... ................. ....... Monitor the Execution ........... ..................... ........... ................... .................... ........... ..................... ........... ................... .................... ........... .....

LAB 4: HETEROGENEOUS DATA INTEGRATION INTEGRATION AND VALIDATION .........

Create the Interface to Load the Permit Data .............................. ............................................. ............................... ................ Integrate Heterogeneous Sources ................... .......... ................... ..................... .................... ................... .................... ................... ......... Create Data Validation Validation Rules............................... Rules.............................................. ............................... ................................ ......................... ......... Execute the Interface. ................... .......... .................... ........... ..................... ........... ................... .................... ........... ..................... ........... ................. ....... Monitor the Execution ........... ..................... ........... ................... .................... ........... ..................... ........... ................... .................... ........... .....

LAB 5: CHANGE DATA CAPTURE CAPTURE .............................. ............................................ .............................. ............................ ............

Import the Journalization Knowledge Knowledge Module ..................... ........... ................... ................... .................... ................... ......... Enable Journalization .................... ........... .................. .................... ..................... ................... .................... ........... ..................... ........... ................. ....... Using Journalized Journalized Data in an Interface............................. Interface........................................... .............................. ............................ ............  LAB 6: ORCHESTRATE INTERFACES INTO PACKAGES .......... .................. ......... Sign up to vote on................... this title

Not................... useful..................... Create the Permit Integration Package............. .................... ......... ..................... ................... ...........  Useful  Archive the Input File........ .................... .......... ................... .................... ........... ..................... ........... ................... ................... .................... .......... Execute the Package.............. ..................... ........... ................... .................... .................... .................. .................... ..................... ................. .......





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Before you begin

General notes: 1. All functions or actions performed by the student (for example, text to be entered buttons to click) are written in bold print. 2. When you see a reference to , enter the name of the host for your assig system (for example, edrsrsp1). For this workshop, using “localhost” should w correctly. 3. All references to the installation home directory of the Oracle Data Integrator a . . (change this as per your install directory) 4. If a Welcome page appears as the first page of a wizard, then just click Next to advanc the first step of the wizard. 5. The data used in this workshop are are all fictional. Applicant names, SSNs, telephone numbers, addresses and email addresses were all randomly created for training purpose

Sign up to vote on this title



Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Sign In

Upload

Join

RELATED TITLES

0




Books



Audiobooks



Magazines

Training









Save

Embed

Share

Print

Download



News



Documents



Sheet Music




1

of 79

 


ODI faqs

 Search document



Lab 1: Software Installation and Setup Time estimate: 30 minutes (not including software download)

Download the Software (Pre-Requisite) 1. Go to the following web site: http://www.oracle.com/technology/products/oracle-data-integrator/index.html 2. Follow the link to download: Oracle Data Integrator (10.1.3.4.0) (odi_windows_x86_101340.zip)

3. We will use the Oracle XE database for the workshop. Go to the following URL: http://www.oracle.com/technology/software/products/database/xe/index.html 4. Following the link to download: Oracle Database 10g Express Edition (Western European) (OracleXE.exe)

Install Oracle Data Integrator To install the Oracle Data Integrator, perform the following steps:

You're Reading a Preview

1. Unzip the odi_windows_x86_101340.zip file to some temporary directory . Unlock full access with a free trial.

2. From the directory where you unzipped the files, navigate to the sub-directory \setup\windows and execute the setup.bat program to start the installer. Download With Free Trial 3. From the installation wizard, select the following options for each step: Select a Product to Install: Oracle Data Integrator 10.1.3.4 Sign up to vote on this title



Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Installation Type: Complete

Oracle Home: ODIHome c:\oracle\product\10.1.3.4\oracledi Path:

You're Reading a Preview Unlock full access with a free trial.

Download With Free Trial




Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



4. From the Summary Screen, Click Install.

5. From the End of Installation Screen, Click Exit.






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Sign In

Upload

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Install Oracle XE

The Oracle Database 10g Express Edition (Oracle XE) is a n entry-level, small-footprint database based on the Oracle Database 10g Release 2 code base that's free to develop, depl and distribute; fast to download; and simple to administer.

For this workshop, we will use Oracle XE as the database engine for ODI. To install Oracle XE, perform the following steps:

1. Double-click the OracleXE.exe that was downloaded earlier to launch the installer

2. Click Next.


3. Review and Accept the Licensing Agreement. Click Next.


4. Accept the Default Destination Location (c:\OracleXE). Click Next. 5. Enter a password for the SYS and SYSTEM accounts. Recommended to just “oracle” for the purposes of this workshop. Click Next. 6. From the Summary Screen, click Install.




Useful

 Not useful



7. From the InstallShield Wizard Complete window, check t he Launch the Database homepage. Then click Finish.





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print


1

Download



Join

of 79

 


ODI faqs

 Search document



Setup the ODI Metadata Repositories Oracle Data Integrator uses 2 types of repositories: •

•

The Master Repository is where all the information on the topology of resources, security and version management of projects and da ta models is stored. Only one master repository is required for typical Oracle Data Integrator installations.

The Work Repository is where the information on data models, projects, and their u is stored. A work repository can be linked with only one master repository for versi management purposes.

These repositories are stored in a relational database accessible in client/server mode from different Oracle Data Integrator modules. For this workshop, we will use the Oracle XE database to store these repositories.

Note: For this workshop, you may skip the creation of the master and work repositorie by running a script that will import the repository schemas into Oracle XE. If you wish to do so, please refer to Appendix A: Importing the ODI Repository Schemas.

Setup Oracle Users


First, we need to create Oracle database users for the Master and Work Repositories. Unlock full access with a free trial.

1. From the Oracle XE Database Home Page, login using the system account with the password you specified.





Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



2. From the Database Home Page, select the Administration module, and from the menu select Database Users > Create User.

3. From the Create Data User page, create a user called master and set the passwords to master. Check the DBA role under User Privileges.


Unlock full access with a free trial.





Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



4. From the Manage Database Users page, click the Create button to create another user called workrep1 and set the passwords to workrep1. Again, check the DBA role unde User Privileges.

You're Reading a Preview full access with a free trial. 5. Verify that the master andUnlock users have been created as shown: workrep1





Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Install the Master Repository

To install the Master Repository on the Oracle XE database, perform the following steps:

1. From the Start Menu, go to Oracle > Oracle Data Integrator > Repository Management Master Repository Creation. 2. This will launch the Master Data Creation Wizard.



3. For the Driver, click the browse button and select the Oracle JDBC Driver fro the list. This should populate the text box with oracle.jdbc.driver.OracleDriver. 

4. For the URL, click the browse button and select Sign upthe to vote on this title the theuseful populated text bo jdbc:oracle:thin:@:: URL from  Usefullist.InNot replace with localhost, with 1521 and sid with XE. The resulting URL should be:





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



8. Click the OK and OK again on the wizard to start the repository creation.

9. The Command Window will display log messages during the creation of the repository. You're Reading a Preview After successful repository creation, you should see the following: Unlock full access with a free trial.





Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Access the Master Repository from the Topology Manager

1. Start the Oracle Data Integrator Topology Manager. From the Start Menu, go to Oracle Oracle Data Integrator > Topology Manager

2. The Security Repository Connection dialog box will prompt for login information. Clic on the New Connection icon to configure the Topology Manager to access the ne wly created Master Repository.

3. Configure the Repository Connection as follows:






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



4. Back in the Security Repository Connection, use the ODI Master Repository and login with the user SUPERVISOR and password SUNOPSIS. This will launch Oracle Data Integrator Topology Manager connected to your Master Repository in Oracle XE database.

Install the Work Repository

To install the Work Repository on the Oracle XE database, perform the following steps: th

1. Login to the ODI Topology Manager and click the Repositories tab (the 5 tab) fro the Topology Manager as shown:






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



3. On the Data Server Definition tab, enter the name WORKREP1 and select Oracle from the Technology list. Under the connection, enter the username workrep1 and password workrep1.

4. Click on the JDBC tab, enter oracle.jdbc.driver.OracleDriver for the JDBC Drive and enter jdbc:oracle:thin:@localhost:1521:XE for the JDBC URL. You can use the browse button to selectReading the values. You're a Preview Unlock full access with a free trial.





Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document








Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Access the Work Repository from the ODI Designer

To login to the Work Repository, perform the following steps: 1. Start the Oracle Data Integrator Designer. From the Start Menu, go to Oracle > Oracle Data Integrator > Designer.

2. The Oracle Data Integrator Login box will prompt for login information. Click on th New Connection icon to configure the Designer to access the newly created Work Repository.

You're Reading a Preview 3. Configure the Work Repository Connection as follows: Unlock full access with a free trial.





Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



the default username SUPERVISOR and password SUNOPSIS. This is the default admin user for the master repository. 2. For the Database Connection use information you entered earlier for the master repository connection (Username/Password: master). You can also browse for JDBC driver and URL by clicking t he browse icon on the right.

3. For the Work Repository Name, enter WORKREP1 (or you can browse for by clicking the browse icon on the right.) 4. Check the Default Connection option to make this the default. 5. Click Test to make sure the connection is valid and Click OK .

4. Back in the Oracle Data Integrator Login, select WORKREP1 and login with the u SUPERVISOR and password SUNOPSIS. This will launch the Oracle Data Integrator Designer connected to your Work Repository.



You are now ready to use the Work Repository called WORKREP1 for the other sections o  this Workshop. Sign up to vote on this title



Useful

 Not useful





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Data Integration Scenario: Permit Processing Time estimate: 10 minutes

For this workshop, we will work on the integration requirements of a Permit Processing application. The Permit Processing application is used for receiving and handling permit requests. Aside from real-time permit processing, the Permit Processing application needs process permit requests in batches coming from various groups.

Multiple permit requests that include permit and applicant information are sent in a flat file The file typically contains more than 10000 requests including applicant information. This has to be extracted, transformed and loaded into the Permit Application tables. Backgroun check data coming from another relational database s ystem will need to be merged to each permit request as well.

Before the data gets loaded to the Permit Application, we need to make sure that the data is valid (based on certain business validation rules). We also need to make sure that we only process data that has changed from the background check system and that we archive the permit files after processing it successfully. Lastly, there is a limited-time window involve for processing, so we need to make sure that the data processing is done in the most efficien manner.

-------------------------------------------------------------------------------------------


-------

L o

a d Unlock full access with a free trial.

Permit Request Flat File

Integration Download With Free Trial BGCHECK a d L o

Transformation Data Validation



CDC Background Check Data

Permit Application RDBMS




Oracle Data Integrator Metadata Repository

Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print


1

Download



Join

of 79

 


ODI faqs

 Search document



5. Use change-data-capture (CDC) to process changed data from the background check system

6. Arrange these tasks in a data integration package with error notifications and f ile archiv after successful completion. Before continuing, please perform the following tasks:

1. Open up the “ODIWorkshop-MyFiles.zip” file from the workshop DVD.

2. Unzip the file to your C:\ drive. This will create a directory called C:\MyFiles. This includes the Permit Request flat file ( permit_batch.csv in the CSV subdirectory) and database scripts that will be utilized during the workshop. 3. Start a command prompt window. Go to Windows Start > Run and enter cmd.

4. From the command prompt, navigate to c:\MyFiles and enter the following commands •

sqlplus system/oracle (Note: replace oracle with the password you specified during installation of OracleXE.)

You're Reading a Preview 5. At the SQL Prompt, enter the following: @workshopschema






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Sign In

Upload

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



This command populates the background check RDBMS with data.






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Lab 2: Capturing Metadata Time estimate: 20 minutes

Before we can implement our data integration interfaces, it is essential to capture the variou sources and targets into a unified data integration platform. This lab shows how ODI can be used to capture the metadata information for the Permit Application and Background Check database schemas and the Permit Request Flat File into a central metadata repository.

Configure Data Servers in the ODI Topology Manager

The ODI Topology Manager is what we use to manage the physical and logical architecture the data sources. Each data source is configured as a data server belonging to a specific technology. In this workshop, we will use Oracle database tables and a flat-file as our data sources, so we need to create the data servers for these specific technologies. 1. Start the Oracle Data Integrator Topology Manager. From the Start Menu, go to Oracle > Oracle Data Integrator > Topology Manager 2. Login using User SUPERVISOR and Password SUNOPSIS.






usefulfrom the  Useful  Not 3. To define technologies, click the Physical Architecture tab (the 1 tab) Topology Manager as shown: st





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Let’s first capture the Permit Application’s Oracle database that will be used as the target.


4. From the list of Technologies, right-click on the Oracle technology and select Insert Unlock full access with a free trial. Data Server.

5. From the Data Server Definition Tab, enter name Download With the Free TrialPERMIT_APP. On the connect enter the username PERMIT_APP and password PERMIT_APP.




Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print


1

Download



Join

of 79

 


ODI faqs

 Search document




6. Click on the JDBC tab. For the Driver, click the browse button and select the Oracle JDBC Driver from the list. This should populate the text box with Download With Free Trial oracle.jdbc.driver.OracleDriver . 7. For the URL, enter jdbc:oracle:thin:@localhost:1521:XE. 8. Click OK . 

Sign up to for votethe on Directory this title (Schema 9. In the Physical Schema dialog box, select PERMIT_APP Schema) and PERMIT_APP_WORK for the Directory (Work as useful shown:  Useful  Not





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print


1

Download



Join

of 79

 


ODI faqs

 Search document



10. Click on the Context tab. Click the new context button and type in PERMIT_APP_TARGET as the Logical Schema.

This defines the schema in the Logical Architecture. 11. Click on OK . Next, lets do the same steps for the Oracle database that contains background check information. This will be used as a source. 12. Repeat steps 4-11 for the Oracle schema BGCHECK . BGCHECK Name: BGCHECK Connection User: BGCHECK Connection Password: oracle.jdbc.driver.OracleDriver JDBC Driver: jdbc:oracle:thin:@localhost:1521:XE JDBC URL You're Reading a Preview BGCHECK Directory (Schema): BGCHECK_WORK Directory (Work Schema):Unlock full access with a free trial. BGCHECK_SRC Logical Schema

Download With Free Trial on the same database instance a Important Note: The BGCHECK schema actually resides the PERMIT_APP. For this workshop, we are simulating that the BGCHECK is a totally separate database server, which is why we are configuring it as a separate data server. In real-life scenarios, if your database schemas belong to the same instance, the best practice to just use the same data server for these schemas.  Sign up to vote on this title Next, lets configure the Permit File source:  Useful  Not useful 13. From the list of Technologies, right-click on the File and select Insert Data Server





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print


1

Download



Join

of 79

 


ODI faqs

 Search document



14. From the Data Server Definition Tab, enter the name PERMIT_FILE.

15. Click on the JDBC tab. For the driver, click the icon and select Sunopsis File JD Driver. For the URL, enter jdbc:snps:dbfile, as shown below:

16. Click OK.


Unlock full access with a free trial. 17. In the Physical Schema dialog box, type c:\MyFiles\CSV for both Directory (Schem and Directory (Work Schema) as shown:





Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Sign In

Upload

Join

RELATED TITLES

0




Books



Audiobooks



Magazines

Training









Save

Embed

Share

Print

News



Documents



Sheet Music


1

Download





of 79

 


ODI faqs

 Search document



18. Click on the Context tab. Click the new context button and type in PERMIT_SRC Logical Schema.

19. Click OK.

Define Data Models in the ODI Designer

After we configure the data servers, we can now define data models in ODI Designer. The ODI Designer is what we use to define data models and integration projects that use the dat models. Before we can create integration projects, we need to be able to capture metadata information from sources and targets and use this for defining the data models. This is the process called Reverse Engineering, which we perform through the ODI Designer.

1. Login to the ODI Designer. Start the Oracle Data Integrator Designer. From the Sta Menu, go to Oracle > Oracle Data Integrator > Designer .


2. Login using User SUPERVISOR and Password SUNOPSIS. Unlock full access with a free trial.

With Free Trial Reverse Engineer the PermitDownload Application Database Let’s start with Reverse Engineering the Permit Application target. nd 1. To define models, click the Models tab (the 2 tab) from Designer as shown:

2. Click the new Model icon.




Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



4. Click the Reverse tab and select the context called Global.

5. Click the Selective Reverse tab and check the check boxes for Selective Reverse and Objects to Reverse. You’ll see the APPLICANTS, PERMITS and PERMIT_TYPE tables from the list. Click the Reverse button to start the Reverse-Engineering Process.






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



6. You should now see the APPLICANTS, PERMITS and PERMIT_TYPES under yo data models with their corresponding columns and constraints.






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Reverse Engineer the Background Check Database

Next, let’s reverse engineer the Background Check database. 1. Click the new Model icon.

2. Enter BGCHECK_MODEL for the model name. Select Oracle as the Technology an BGCHECK_SRC as the Logical Schema.

3. Repeat the Reverse-Engineering process done earlier to capture the BGCHECK table.




Reverse Engineer the Permit Request Flat File



Useful



 Not useful

Lastly, lets reverse engineer the Permit Request Flat File. The Permit Request Flat File,





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Note: If you do not see the PERMIT_SRC in the Logical Schema combo box (just see FILE_GENERIC_SRC), check the Topology again that you put the PERMIT_SRC in the technology 3. Click the Reverse tab and select the context called Global. 4. Click OK. (For Files, we do not perform Selective Reverse since each file is reverseengineered individually.) 5. From the Models window, right-click on PERMIT_SRC_MODEL and select Insert Data Store.






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



6. Enter PERMIT_CSV for the name and click the Browse icon to locate the permit_batch.csv file.

7. Click the Files tab and select Delimited for the File Format, 1 for the Heading and comma (,) for the Other Field Separator:






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print


1

Download



Join

of 79

 


ODI faqs

 Search document



8. Click the Columns tab and click the Reverse button to generate the column names bas on the file header as shown:

9. Click OK.

Reading Preview You have successfully capturedYou're the sources andatarget metadata for the data integration scenarios in the next labs. Unlock full access with a free trial.





Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Lab 3: Simple Data Integration Time estimate: 30 minutes

Now that the Permit Application, Background Check database and Permit Request File dat models have been defined, we can use them as sources or targets in our interfaces. For this lab, we will create a simple data integration interface that reads applicant data from the Per Request file, performs basic transformation, and then stores it in the Permit Application’s applicant table.

Create an Integration Project in the ODI Designer

As mentioned earlier, the ODI Designer is what we use to define data models and integratio projects that use the data models. Now that data models are defined, we can proceed in usi the data models for interfaces in data integration projects. Let’s start by creating a new Project for this workshop. 1. Login to the ODI Designer. 2. To create a project, click the Projects tab (the 1st tab) from Designer as shown:






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



5. You will now see an Integration Project 1 project in your project list. Click the + sign on the left to expand and you will see a default folder called First Folder. Double-Cli the First Folder and rename this to Permit Integration as shown:

Import the Knowledge Modules We will now import the knowledge modules that will be used for loading the Permit File Source to the Permit Application. Knowledge Modules are customizable integration strategy templates that can be re-used to perform a specific set of tasks against a s pecific technology or set of technologies. ODI comes outReading of the box with more than 100 Knowledge Modules You're a Preview for the major database engines and application packages of the market. Unlock full access with a free trial.


We will use the following knowledge modules: 1. Loading Knowledge Module 2. Integration Knowledge Module 3. Check Knowledge Module To import the knowledge module:

LKM File to SQL IKM SQL Incremental Update CKM Oracle Sign up to vote on this title



Useful



 Not useful

1. Expand the Knowledge Modules folder under Integration Project 1 and you will see various types of knowledge modules.





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



c:\oracle\product\10.1.3.4\oracledi\impexp (Replace with your ODI installation home directory if you used a different one.)

4. From the list of files(s) to import, select LKM File to SQL, as shown.

You're a Preview 5. Repeat the same steps for the otherReading knowledge modules listed above. You should see t imported knowledge modules as shown: Unlock full access with a free trial. Download With Free Trial




Useful

Create the Interface to Load the Applicant Data

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



3. Click the Diagram tab.

4. You drag and drop data stores from models as sources and the target in this diagram. nd do this, select the Models tab in the left-navigation window (2 tab from the bottom of the left navigation window)You're to display the list of Data Models. Reading a Preview Unlock full access with a free trial.





Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

Join

RELATED TITLES

0




Books



Audiobooks



Magazines

Training









Save

Embed

Share

Print

Download



News



Documents



Sheet Music




1

of 79

 


ODI faqs

 Search document



7. You will be asked if you want to perform an automatic mapping. Select Yes.

8. The mapping is based on exact field names so all the fields except the APPLICANT_I will be automatically mapped.

(Note that you will see a warning for the Phone and SSN mappings, indicating that the target column is smaller than the source column. This can be ignored.)

9. To manually map the APPLICANT_ID, click the empty mapping field of the APPLICANT_ID column from the Target Data Store . This will bring up the APPLICANT_ID’s mapping implementation below (which is empty). Drag the Appl column from the PERMIT_CSV source node to the mapping implementation text area shown:






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print


1

Download



Join

of 79

 


ODI faqs

 Search document



1. Click the mapping field of the APPLICANTS FIRST column from the Target Data Store. This will bring up the mapping implementation below, which shows the MAPPING as PER.First.

2. ODI is based on an E-L-T architecture that utilizes the database engine’s transformation capabilities. For this transformation, we will use Oracle’s INITCAP function. To do th we need to specify to execute the transformation in the Staging Area rather than the source. Select the option Execute on Staging Area below the mapping implementatio 3. Enter the mapping implementation as: INITCAP(PER.First) as shown below. Optionally, you can click on the icon on the right to launch the expression editor select the INITCAP function under the list of String functions.


4. Repeat the same transformation for the last name column ( APPLICANTS.LAST).



 Define a Filter

Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Execute the Interface Now we’re ready to fire off this interface. 1. Click on the Flow tab. The diagram shows you how the execution takes place.



Notice that only the source and target nodes are show. There is no separate  transformation engine. All the transformation and is done the target Signfiltering up to vote on thisattitle database where the data is processed and loaded a set-based operation rather Useful using  Not useful than processing it row-by-row in a separate engine. This approach yields much higher performance and shows the benefits of the E-L-T Architecture.





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Sign In

Upload

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Notice that all we had to for this interface was drag the source to the target and specify the transformations and filters, which are all part of the integration rules. The knowledge modules take care of all the underlying technical details such as creating the staging and error tables, committing, cleaning up temporary objects, and performing flow controls, among others. These are the benefits of Declarative Design.

3. Click on the Execute button below.

4. Click OK in the execution dialog box. You will be informed that the session has starte Click OK again.

Monitor the Execution


Unlock access the withexecution a free trial. of sessions. The ODI Operator is what we use to full monitor

1. Start the ODI Operator by clicking the With Operator Download Freeicon Trialfrom top menu in Designer.

 Sign up to vote on this title Integrator Operator . You can also use the Start Menu: Oracle > Oracle Data Useful Not>useful





2. Drill down on All Executions and find the Load Application Data session. Click and expand the second step. You will see the loading, integration a





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



3. On the left hand window, scroll to the right to view the various statistics f or each step. You’ll see that 18000 rows have been staged and 10000 rows have been inserted into th target table.






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document




6. Lastly, go back to ODI Designer, click on the Diagram tab for the Load Applicant Da full access with a free trial. Target Data Store interface and right click theUnlock - APPLICANTS header as shown:





Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Congratulations! You have successfully implemented an interface that loaded 10000 applicants from a flat-file into a target database.






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Sign In

Upload

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Lab 4: Heterogeneous Data Integration and Validation Time estimate: 30 minutes

We will now create the interface that populates the PERMIT table. The data will still come from the permit file, but this time, we will need to do a heterogeneous join between the file and the background check database table to get the results of the background check for the applicant. We will also apply data validation rules to the data models so that only valid d is stored in the Permit Application. Invalid data will be captured in an error table.

Create the Interface to Load the Permit Data Let’s create the interface to load the permit data from the Permit Data file: 1. Start and login to the ODI Designer, if it is not al ready running. 2. Expand the Permit Integration folder, right-click on the Interfaces folder and select Insert Interface. 3. For the Interface name, enter Load Permit Data.






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

Join

RELATED TITLES

0




Books



Audiobooks



Magazines

Training









Save

Embed

Share

Print

Download



News



Documents



Sheet Music




1

of 79

 


ODI faqs

 Search document



6. Drag the PERMIT_CSV data store from the PERMIT_SRC_MODEL and drop it on the Source section. 7. Drag the PERMITS data store from the PERMIT_APP_MODEL and drop it on the You're Reading a Preview Target section. Unlock full access with a free trial.

8. You will be asked if you want to perform an automatic mapping. Select Yes.

With Free from Trial the PERMIT_CSV source to th 9. Like earlier, manually mapDownload the Appl_Id column APPLICANT_ID target column. 10. Add the TO_DATE conversion function to the PER.Application_Date and PER.Request_Date target columns to convert the string data into a date. Signinupthe to vote on this title . Make sure you specify to execute this transformation Staging Area



Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



12. Like earlier, create a filter for Permit_ID using the expression PER.Permit_ID > 4008000. 13. You should now have something like:

Integrate Heterogeneous Sources You're Reading a Preview

Now we need to get the background check data from another relational system to join to th Unlock full access with a free trial. Permit File using the Social Security Number.

Download Free 1. Since we are now using a database as aWith s ource, weTrial need to import the appropriate knowledge module. Go to the Projects tab, expand the Knowledge Modules folder an right-click on the Loading (LKM) folder to import the knowledge module called: LKM SQL to Oracle. Sign up to vote on this title



Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Sign In

Upload

Join

RELATED TITLES

0




Books



Audiobooks



Magazines

Training









Save

Embed

Share

Print

Download



News



Documents



Sheet Music




1

of 79

 


ODI faqs

 Search document



3. Drag the SSN column from PERMIT_CSV to the SSN column in BGCHECK to crea the join.

4. Map the BGCHECK’s RESULT column from the source to the PERMIT’s BACKGROUND_CHECK column in the target. 5. Map the BGCHECK’s REASON column from the source to the PERMIT’s You're Reading BACKGROUND_CHECK_MSG columnainPreview the target. Unlock full access with a free trial.

6. We need to only accept background check data only for the current year. Create a filter on the BGCHECK’s DATE_CHECKED column using the expression:


BGCHECK.DATE_CHECKED > TO_DATE('01-JAN-07')




Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



7. Drag the PERMIT_TYPES data store from the PERMIT_APP_MODEL and drop it the Source section.

8. You will be asked if you want to perform an automatic mapping. Select Yes. This wil automatically create the mapping for the PERMIT_TYPE_CODE.

9. Drag the Permit_Type column from PERMIT_CSV to the PERMIT_TYPE_NAME column in PERMIT_TYPES to create the join. 10. You should now have the following:


Note: Download With Free Trial - Because Technology File does not support all functions like RDBMS, make sure th you set the “Execute on” for the following fields on “Staging Area” i nstead of “Source”: APPLICATION_DATE; REQUEST_DAT E; APPLICANT_ID; LOAD_DATE - Make sure that you have used TO_DATE for APPLICATION_DATE , REQUEST_DATE - You should use : PERMIT_ID = TO_CHAR(PER.Permit_ID) if you receive an mis-dataty  error Sign up to vote on this title



Useful

 Not useful

11. Click on the Flow tab and observe how and where the transformations and merges take place:





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print


1

Download



Join

•

•

of 79

 


ODI faqs

 Search document



Notice that PERMIT_TYPES, although we brought it in as a source, is not staged li the other sources. ODI detects that PERMIT_TYPES belongs to the same data serv as the PERMITS target and therefore it integrates this directly in the staging area.

Notice that the filter for BGCHECK occurs on the source since BGCHECK is a relational source that can perform filtering logic. It will be more optimal to perfor filtering on the source when possible to minimize the data coming in. Since the PERMIT_CSV is a file, it does not have an engine to perform filtering and so i utilizes the staging area for applying the filters.

12. Click Apply to save the interface.

Create Data Validation Rules

Before we execute, lets add some validation rules on the Permit data model. These rules w be enforced during execution time. Data that do not meet the rules will be rejected and captured in an error table, where it can then be corrected and reprocessed.

1. Go to the Models tab and drill down on PERMITS and view its Constraints. There a constraints there, the primary key and the foreign key to the APPLICANTS table. Thes were captured during the reverse-engineering process.






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Sign In

Upload

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print


1

Download



Join

of 79

 


ODI faqs

 Search document



2. Right-click the Constraints folder and select Insert Condition. 3. Enter the following information: • • •

•

Name: Type: Where:

Message:

Reason is Required Oracle Data Integrator Constraint PERMITS.REQUEST_REASON IS NOT NULL Optionally, use the Expression Editor to build the expression. Hint: Use the Test Query icon to validate your expression. There has to be a reason



Note you can also create "NOT NULL" rules at the column level by checking the "mandatory" check box. The advantage of utilizing conditions as shown above is that error messages can be customized. Sign up to vote on this title

4. Click Ok .



Useful



 Not useful

Now let’s create a rule to make sure only valid and completed background check results are





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print


1

Download



Join

of 79

 


ODI faqs

 Search document



7. Click Ok.

8. Go back to the Load Permit Data Interface and click the Controls tab. Verify that yo validation rules are listed under constraints and that they are enabled.






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Execute the Interface 1. Click on the Execute button below.


Monitor the Execution 1. Go to the ODI Operator by clicking the Operator icon from top menu in Designer.

2. Drill down on All Executions and find the Load Permit Data session. Click and expa the second Load Permit Data step.

3. On the left hand window, scroll to the right to view the various statistics f or each step. Notice that 8066 rows loaded with errors caught for the PK and CK constraints that you created.






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



6. You seed the data that was inserted as shown below:






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



You have successfully implemented an ODI interface that performs heterogonous data integration and validation.







Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Sign In

Upload

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Lab 5: Change Data Capture Time estimate: 30 minutes

ODI provides a Change Data Capture (CDC) framework to be able to identify and capture changed data from the sources (inserted, updated, or deleted data) and use these changes integration processes. Changed Data Capture is performed by enabling journalization on da models. Journalizing a model consists of setting up the infrastructure to capture the change (inserts, updates and deletes) made to the records of this model's data stores. Behind the scenes, the CDC framework utilizes database triggers or log mining capabilities of the database. These are implemented by the Journalization Knowledge Modules. For this workshop, we will enable journalization on the RDBMS source, which is the BGCHECK database table. This will enable us to only new or updated background check information.

Import the Journalization Knowledge Module 1. Start and login to the ODI Designer, if it is not al ready running. 2. Go to the Projects tab, expand the Knowledge Modules folder and right-click on the Journalization (JKM) folder to import the knowledge module called: JKM Oracle Simple. You're Reading a Preview Unlock full access with a free trial.



Enable Journalization



Useful



 Not useful

To enable journalization on the BGCHECK data store, perform the following steps:





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



3. Expand the BGCHECK_MODEL, right-click on the BGCHECK data store and selec Change Data Capture > Add to CDC.


4. Next, right-click on the BGCHECK data store and select Change Data Capture > Download With Free Trial Subscriber > Subscribe. 5. When asked to Select your Subscriber(s), enter SUNOPSIS and click the the ODI subscriber to the list as shown. Click OK. Sign up to vote on this title



Useful

 Not useful

icon 





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print


1

Download



Join

of 79

 


ODI faqs

 Search document



Journal.

8. When asked to Select your Subscriber(s), select SUNOPSIS from the list and click


10. Go to the ODI Operator and verify that the 2 jobs for BGCHECK completed successful Optionally, examine the steps under each job. These are the journalization setup work performed by the Journalizing Knowledge Module (JKM).



Using Journalized Data in an Interface




Useful

 Not useful



1. Open the Load Permit Data Interface that you create earlier and click the Diagram





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



3. Notice the BGCHECK table contains several rows that have already been processed earlier. This is because the interface is not set up to use the journalized data.

4. To use the journalized data in the interface, click on the BGCHECK source node head From the source configuration below the diagram, mark the Journalized Data only option as shown below.






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



@c:\myfiles\newBGData.sql

9. This will insert 10 new background check results into the background check table.

10. Go back to Load Permit Data interface in ODI Designer and view the BGCHECK sou data again. This time you will see 10 new rows waiting to be processed. 11. Execute the interface and verify through the ODI Operator that only10 new rows have been added and not the entire data set.






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Lab 6: Orchestrate Interfaces into Packages Time estimate: 30 minutes

Now, let's put together these 2 interfaces in a data integration package. A package is a sequence of steps organized in an execution diagram. The steps can be interface execution variable assignments, procedure calls, file operations, w eb service calls, OS commands, notifications and many other utilities. Packages can then be compiled as scenarios, which c be invoked by external applications such as web service clients.

Create the Permit Integration Package 1. Go to ODI Designer and click on the Projects tab. 2. Expand the Permit Integration folder, right-click on the Packages folder and select Insert Package. 3. For the Package name, enter Run Permit Integration.


Download With Free Trial 4. Click the Diagram tab. You can drag and drop interfaces that you want to orchestrate part of the package in this diagram. 5. Drag the Load Applicant Data interface into the diagram. Sign up to vote on this title

6. Drag the Load Permit Data interface into the diagram.  Useful 7. Click the OK connector icon

on the package toolbar.

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



9. Click on the Internet folder from the toolbar. 10. Click on the OdiSendMail step and then click on the diagram.


11. Click on the step and rename it to Error Notification from the properties section below the diagram. Don’t worry about configuration for now, we’ll just make t Unlockthe full mail accessserver with a free trial. error out.


12. Click the KO connector icon

on the package toolbar.

13. Drag the mouse from the Load Applicant Data step to the Error Notification step to create an exception path. This will make the Error Notification step run if the Load Applicant Data throws an exception. Sign up to vote on this title 14. Create the same exception path for Load Permit Data.  Useful  Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

Join

RELATED TITLES

0




Books



Audiobooks



Magazines

Training









Save

Embed

Share

Print

Download



News



Documents



Sheet Music




1

of 79

Archive the Input File

 


ODI faqs

 Search document




As the last step in the package after successfully loading the permit data, we need to move source file into an archive directory with the current appended to the filename. Download With Freetimestamp Trial 1. First, let’s create a variable for the current timestamp. From your Integration Project, right click on Variables and select Insert Variable. For the name, use CurrentTimestamp  2. Click the Refreshing tab. Select PERMIT_APP_TARGET foron the Schema Sign up to vote this title and enter following SQL for the Select Query enter:



Useful

 Not useful

SELECT TO_CHAR(SYSDATE,'YYYYMMDDHH24MISS') FROM DUAL





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document

3. Drag the variable to the package diagram and create an OK connection Permit Data to CurrentTimestamp.



from Load



4. Click on the Files folder from the toolbar.




Useful



 Not useful

5. Click the OdiFileMove step and bring it to the diagram and create an OK connection from CurrentTimestamp.





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Execute the Package 1. Execute the interface and verify t hrough the ODI Operator it completed successfully. 2. Verify that the archived file exists in C:\myfiles\archive.




Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

Join

RELATED TITLES

0




Books



Audiobooks



Magazines

Training









Save

Embed

Share

Print

Download



News



Documents



Sheet Music




1

of 79

 


ODI faqs

 Search document



Lab 7: Setup Agent Time estimate: 20 minutes

Once ODI Scenarios are created they can be scheduled and orchestrated using an ODI Age The ODI agent is a lightweight java process that orchestrates the execution of ODI Scenar The ODI Agent can be installed as a service to allow for lights out processing of O Scenarios.

Setup ODI Parameters for Agent

ODI Agent will use the repository connection information stored in the file \bin\odiparams.bat. For security, the password information is stored in this as an encrypted 1. Generate password to access Master Repository from command line or service \bin\Agent encode master where ‘master’ is the password to access work repository in this lab document

When the password is generated, copy the generated encrypted password for later usage

Note that, the ODI_ENCODED_PASS is set to the encoded password for SUNOPSIS default; this does not need to be modified unless the SUPERVISOR password has be changed.  Sign up to vote on this title

2. Open the odiparams.bat with any text editor, andedit the following parameters: Useful  Not useful set ODI_SECU_DRIVER=oracle.jdbc ODI_SECU_DRIVER=oracle.jdbc.driver.OracleDriver .driver.OracleDriver





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Create a Physical Agent 1. Go to ODI Topology Designer and click on the Physical Architecture ta b. 2. Right click “Agents”

3. Select “Insert Agent” and the following screen apprears

Set values as following Name: Host: Port:

Localagent Localhost 20910




useful  Useful  Not > Oracle Data Integrator > Ag 4. Launch the agent: Start menu > Programs > Oracle

The following screen should apprear





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



5. Click button “Test” and the following screen should apprear

6. Click “Yes” and the following screen apprears






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Create a Logical Agent 1. Click the Logical Architecture tab

2. Right click “Agents” and click Insert Logical Agent


Download With Free Trial 3. The following screen should apprear




Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print


1

Download



Join

of 79

 


ODI faqs

 Search document



4. Click OK

The Physical and Logical Agent are now setup successfully. The ODI Agent can now be u to execute ODI objects

Execute the Agent (use command line) Make sure that you already have at least 1 scenario to execute 1. Close any Agent windows if you have executed 2. Run the Agent Scheduler in the \bin (case sensitive)


Agentscheduler –name=Localagent


3. The following screen should appear





Useful



 Not useful

4. Check the numbers of scheduled executions is equal to your scheduled scenarios. If y do not run the lab 8 below, the number should be zero (0).





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Lab 8: Create and Schedule an ODI Scenario Time estimate: 20 minutes

When a set of objects are complete and tested it is a good practice is to create ODI Scenar for each object. Once a scenario is created it cannot be edited and the code for the objec regenerated and stored in the scenario. Once a scenario is created it can also be scheduled be run on virtually any interval within ODI.

Create an ODI Scenario 1. Go to ODI Designer and click on the Projects tab. 2. Expand the Permit Integration folder, right-click on the Packages folder and select package “Run Permit Integration” 3. Click “Generate Scenario”






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Sign In

Upload

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



6. Right click the scenario to view options

The scenario has now been successfully created, you can now execute the scenario direc use the scenario within a package or schedule the package within ODI.

Schedule a New Scenario within Oracle Data Integrator 1. To schedule the package expand the scenario “Run Permit Integration”



2. Click “Insert Scheduling”

If an agent is not setup within the ODI Topology Manager, the following messagewill app Sign up to vote on this title and the scenario cannot be scheduled.



Useful

 Not useful





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



3. Click OK to see scheduling options Once an ODI agent is setup correctly the scenario can be scheduled. Make sure to start agent using (case sensitive), you must run only 1 screen Agentscheduler.bat –NAME=Localagent

to start agent as a scheduler






Useful

4. Select tab [Definition] and set the values as following

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Sign In

Upload

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



5. Select tab “Execution Cycle” to set the execution frequency and contraints when failure

Set Repetition: Many times: Interval between Repetitions Constraints: Number of Attempts on Failure Stop Executive After

: 1 minutes : 10 : 5 minutes

6. Click OK. An entry will now be inserted under Scheduling


Download With Free Trial 7. Start the Topology Manager to review scheduling of the agent




Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print


1

Download



Join

of 79

 


ODI faqs

 Search document



9. Click Update Scheduling Information. The following screen appears

10. Click OK 11. Click Scheduling Information. The following screen appears






12. Check the execution of the job in the ODI Operator

Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



13. Refresh Operator and job should be e xecuted at appropriate time.

You have now successfully scheduled a scenario with an agent scheduler, and the scenario was executed by the agent successfully.

Congratulations! You have completed the Oracle Data Integrator Hands-On Works for Public Sector. For more learning material on ODI go to: http://www.oracle.com/technology/products/oracle-data-integrator/index.html






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Appendix A: Importing the ODI Repository Schemas

If you wish to import the ODI Metadata repository, or if you wish to go back to a fresh cop of the repository, please follow the instructions below. Note that running this script will drop the MASTER and WORKREP1 database schemas.

1. If you have not unzipped the workshop files unzipped to c:\MyFiles, unzip the ODIWorkshop-MyFiles.zip file from the workshop DVD into your c: drive. This will create the c:\MyFiles directory containing the workshop files. Important: Shutdown all the ODI Applications (Topology Manager, Designer and Operator) before you begin importing.

2. Start a command prompt window. Go to Windows Start > Run and enter cmd.

3. From the command prompt, navigate to c:\MyFiles and enter the following commands ImportODIRepositories.cmd

Enter the system password used to install Oracle XE.






Useful

 Not useful







Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join



Search



Home



Saved

258 views

0



Upload

Sign In

RELATED TITLES

0




Books



Audiobooks



Magazines News



Documents



Sheet Music



Training









Save

Embed

Share

Print

Download



Join


1

of 79

 


ODI faqs

 Search document



Appendix B: Resetting the Permit Application Scenario If you wish to reset the Permit Application target da tabase, the Background Check and the Permit Request File, please follow the instructions below. 1. Make sure journalization is disabled for the BGCHECK data store.

a. Right-click on the BGCHECK data store and from the Models and select Chan Data Capture > Drop Journal. a. Right-click on the BGCHECK data store and select Change Data Capture > Remove from CDC



2. Make sure journalization is disabled for the Load Permit Data interface.




Useful  Not useful  the a. Open the Load Permit Data interface from Projects and go to the diagram.

b. Click on the BGCHECK source node header. From the source configuration





Home



Saved



Books



Audiobooks



Magazines



News



Documents



Sheet Music



Upload

Sign In

Join

ODI Training

Recommend Documents