Sunday, 12 September 2021

Batch group and need of Batch Automation in Informatica MDM

Hello everyone!! If you want to know why we create batch group and why there is need of Batch job Automation then this is the right place to know about what does it mean and why we need it. In this article we are going to see what is Batch group and automation in Informatica MDM.

What is batch group?

- Batch groups are nothing but, the collection of all the batch jobs like Stage, Load, Match and Merge, Tokenization will be executed using single command.

- Each job in a batch group is get executed in parallel or sequentially with other jobs in batch group.

Need of batch groups-

-Whenever we create Base-Object table, corresponding stage tables, and Landing tables we also configure the mappings. Based on mappings stage jobs get created.

-Also based on internal mapping between Staging table and Base-Object table, Load job will be available to execute. So, there might be a question like, When all these jobs are available, how to execute those jobs?

- So here is the answer- Instead of executing each batch job we create batch group, so that all the jobs will get sequentially executed according to how we configured those jobs in batch group.

Need of Automation-

- Automation is used for the jobs that need to be executed on a regular basis without any manual intervention.

-In real time prod environment, we have to atomize the batch processing so that those batch can be called by some of the scheduler. E.g., Autosys is a scheduler which executes the job in batch.

-We have to configure the shell script in those tools so that this tool itself will take care the execution of the process, so no manual intervention is required.

 


No comments:

Post a Comment