AdmUser: Error Handling In Informatica

1 of 4

http://admuser.blogspot.in/2016/02/error-handling-in-informatica.html

Monday, 1 February 2016

Error Handling In Informatica

Google+ Followers
Naresh Neelam

Error Handling in Data Warehousing:

In any Data warehousing project Error handling deals with Bad Data from source. Example:
Invalid Date Fields, Invalid Data fields (multi byte character), inserting null value to not null
fields, Unique Key Violation etc...
Unique Key Violations:
In this section i will show you how to handling this issue in the existing mapping. I have
mapping m_AdmUser_Unique_Violation_Error. I have taken csv file as source and included so
many transformations to load the data into final Target Table. So this job is running fine in
production suddenly its got failed due to this error.
ere is my mapping:

26 have me in circles

Search This Blog

Contributors
Naresh Neelam
Kalavathi Gandla

Blog Archive
2030 (1)
2016 (18)
February (18)
Informatica: SQL Transformation
Informatica: Update Strategy
Transformation
Informatica: Lookup Caches
Informatica: Lookup Transformation
Informatica: Stored Procedure
Transformation
Informatica: Normalizer
Transformation
Informatica : Union Transformation
Informatica : Expression
Transformation
Informatica : Joiner Transformation
Informatica : Sequence Generator
Transformation
Informatica : Rank Transformation
Informatica : Router Transformation
Informatica : Sorter Transformation
Informatica : Filter Transformation
Informatica : Aggregator
Transformation

Make Sure stop on errors should be zero. Now go to the csv file and insert the same record
78915.

SQL : Cross Joins

SQL : Finding and Removing
Duplicates
Error Handling In Informatica
2015 (16)

Home

About

Now run the job

20-Mar-16 5:20 PM

AdmUser: Error Handling In Informatica

2 of 4

http://admuser.blogspot.in/2016/02/error-handling-in-informatica.html

Here is the error in session log

Here is the rejected record in session log

Session log have so much information so first go to target table script and find what are
unique keys.

We have item_key and Cust_key. Need to back track how these two are populating. Item key
is populating from lookup with condition of source item_id=looup.item_id. SEQ_ITEM is the
lookup table.So you can find the schema details in session level lookup connection.

We don't have any duplicates in SEQ_ITEM table. Now we can check in joiner , CUSTOMER_DIM
is the join table

We don't have any duplicates CUSTOMER_DIM as well. So we can check the source file

20-Mar-16 5:20 PM

AdmUser: Error Handling In Informatica

3 of 4

http://admuser.blogspot.in/2016/02/error-handling-in-informatica.html

Finally CSV file have the issue. And you can find the rejected records in bad file as well. Just
ignore D from the list.

You can find this from Repository tables as well.By using this below query you can notify the
rejected records to the users. The query should be execute in repository schema. First find
the what is the repository schema.

Now run the below Query in Repository Schema.

01
02 SELECT
03
WFLF.WORKFLOW_NAME,
04
TO_CHAR(WFLF.START_TIME, 'Mon-DD-YYYY HH24:MI:SS') AS WF_START_TIME,
05
TO_CHAR(WFLF.END_TIME, 'Mon-DD-YYYY HH24:MI:SS') AS WF_END_TIME,
06
TRUN.INSTANCE_NAME AS SESSION_NAME,
07
TO_CHAR(TRUN.START_TIME, 'Mon-DD-YYYY HH24:MI:SS') AS SESS_START_TIME,
08
TO_CHAR(TRUN.END_TIME, 'Mon-DD-YYYY HH24:MI:SS') AS SESS_END_TIME,
09
SLF.MAPPING_NAME,
10
SLF.SRC_SUCCESS_ROWS,
11
SLF.SRC_FAILED_ROWS,
12
SLF.TARG_SUCCESS_ROWS,
13
SLF.TARG_FAILED_ROWS,
14
ROUND((TRUN.END_TIME - TRUN.START_TIME) * 24 * 60, 0) || ':' ||
15
MOD(ROUND((TRUN.END_TIME - TRUN.START_TIME) * 24 * 60 * 60, 0), 60) AS TOTAL_SESSION_TIME,
16
SLF.FIRST_ERROR_MSG,
17
WFLF.WORKFLOW_RUN_ID
18
FROM INFO_REPO.OPB_SESS_TASK_LOG SLF
19
INNER JOIN INFO_REPO.OPB_WFLOW_RUN WFLF
20
ON SLF.WORKFLOW_RUN_ID = WFLF.WORKFLOW_RUN_ID
21
INNER JOIN INFO_REPO.OPB_TASK_INST_RUN TRUN
22
ON SLF.INSTANCE_ID = TRUN.INSTANCE_ID
23
AND SLF.WORKFLOW_RUN_ID = TRUN.WORKFLOW_RUN_ID
24
AND ((SLF.SRC_FAILED_ROWS <> 0 OR SLF.TARG_FAILED_ROWS <> 0 OR SLF.FIRST_ERROR_MSG <> 'No
errors encountered.' )
AND SLF.FIRST_ERROR_MSG NOT LIKE '%[upd_REJECT]%')
25
ORDER BY WFLF.START_TIME DESC, TRUN.START_TIME

Posted by Naresh Neelam at 2/01/2016 08:24:00 pm

No comments:
Post a Comment

20-Mar-16 5:20 PM

AdmUser: Error Handling In Informatica

4 of 4

http://admuser.blogspot.in/2016/02/error-handling-in-informatica.html

Comment as:

Publish

Newer Post

Home

Older Post

Subscribe to: Post Comments (Atom)

Popular Posts
The Power Of Unix In Data Warehousing
Unix Commands in Data Warehousing Basics " ls " is most common command to see the list of...

Exception Handling in Data Warehousing

Exception Handling in Data Warehousing: Th e se are the common tasks need to perform every Data Warehousing Project...

Teradata Indexes
Teradata Indexes Teradata Indexes are Primary Index Secondary Index Join Index Hash Index Reference Indexes Primary Index and Se...

Teradata BTEQ
Teradata BTEQ - BTEQ Scripts and FAQS Teradata BTEQ: (part 1) Batch Teradata Query (BTEQ) tool was the original way t...

MongoDB mongo (NO SQL Queries)

MongoDB mongo (NO SQL Queries) MongoDB is an Document Database.No need to write SQL queries but you need a good idea on logic of...

MongoDB Import
MongoDB Import Make sure export the path variable and run mongod (minimize the terminal), and open another terminal and run mongo....

SQL : Finding and Removing Duplicates

Finding and Removing Duplicates Most of the cases we need to find out and remove the duplicates in real time. For sm...

Teradata BTEQ
Teradata BTEQ (Part 2) Exporting Data Using BTEQ BTEQ allows data to be exported directly from Teradata to a file There are ...
Data Warehousing Concepts
Data Warehousing Concepts Here is the Link to Download: https://drive.google.com/file/d/0B7BpM4ACG2RoblhMbjZQLWxpaUk/view?usp=...
MongoDB mongofiles
MongoDB mongofiles: First we have to understand the GridFS model in Mongo DB. GridFS: is a specification for storing and retr...

Download

Followers

with Google Friend Connect

There are no members yet.

Be the first!

Already a member? Sign in

20-Mar-16 5:20 PM