temporary assignment in peoplesoft

• Best way to master any HCM software in just few days
• How COBRA Act works in US
• Recruitment Process Life Cycle
• How Self Service Works in Time and Leave Management (TLM)
• Training Video : Administering Affordable Care Act (ACA) in any HCM ERP Software
• Training Video : Implementing Recruitment Module in any HCM Software
• PeopleSoft Set Control Field
• PeopleSoft Set Control Field Concept and Tableset Sharing
• New Set ID not visible in Control Data Setup pages in PeopleSoft
• How the FTE is Calculated in PeopleSoft
• FTE For Multiple Jobs in PoeopleSoft
• Adding and Maintaining Person Of Interest in PeopleSoft
• POI Security in PeopleSoft
• Hiring a Person in PeopleSoft
• Creating an Organizational Relationship in PeopleSoft
• Understanding PeopleSoft Checklists
• Part Time/Full Time, Regular/Temporary and Contingent Workers in PeopleSoft
• Employee Class (EMPL_CLASS) Field in PeopleSoft
• Business Unit, Company and Regulatory Region in PeopleSoft
• Understanding PeopleSoft Group IDs
• How to enable Signon Tracing option in PeopleSoft
• PeopleSoft 9.1 Person Model
• How the Various Date Fields on Employement Data Page are Updated
• 'Override Position Data' and 'Use Position Data' Option in Job Data Page
• PeopleSoft Benefit Record Number Vs Employee Record Number
• A Quick Walk-through of PeopleSoft Absence Management
• How Absences are Processed in PeopleSoft Absence Management System
• How the Time is Processed in PeopleSoft Time and Labor
• PeopleSoft Time and Labor Setup Architecture
• Most frequently queried tables in PeopleSoft Global Payroll
• How to unfinalize a calendar in PeopleSoft Global Payroll
• Prompt isn't fetching the elements in the Rule Package Definition in PeopleSoft Global Payroll
• Unable to stop retro processing for a payee in PeopleSoft Global Payroll
• Retro trigger not picked up when created through INSERT SQL in PeopleSoft Global Payroll
• Segmentation not created for a payee in PeopleSoft Global Payroll
• Is it time to go FLUID?
• Branding Options – Fluid/Classic/Classic Plus
• Tiles in PeopleSoft fluid homepages
• Peoplesoft Row Level Security Search Records
• Unable to See Future Dated Employee Record in Job Data Component
• Simplified Way to Provide a Page Access in PeopleSoft
• How to Resolve a Row Level Security Issue in PeopleSoft
• How to find the List of Users Assigned to a Role
• Process Security in PeopleSoft
• Definition Security Error "You are not authorized to access the definition XXXXXXX"
• Why the dynamic role isn't getting assigned to intended users in PeopleSoft"
• You are not authorized to access this component. (40,20)
• PeopleSoft Functional and Technical Online Training
• PeopleSoft HRMS Session Recording Videos
• NA Payroll Course Content
• Benefit Course Content
• Time and Labor Course Content
• Core HR Course Content
• Global Payroll Course Content
• Absence Management Course Content
• Profile Management Course Content
• PeopleSoft Security Content
• Core Technical Course Content
• Advance Technical Course Content
• PeopleSoft Installation Made Extremely Easy
• PeopleSoft Installation Made Extremely Easy: Part 1
• PeopleSoft Installation made Extremely Easy: Part 2
• PeopleSoft Installation made Extremely Easy: Part 3
• PeopleSoft Installation Made Extremely Easy: Part 4
• PeopleSoft Installation Made Extremely Easy: Part 5
• How to Connect to a Database through SQL Developer in MS Window
• Connecting and Starting the Database through sqlplus Command Utility
• Installing PeopleSoft 9.2 with PeopleTools 8.54
• Setting up Approval Process in PeopleSoft Approval Workflow Engine (AWE)

Parallel Processing using Temporary Record with Application Engine in PeopleSoft

• Application Engine with Disable Restart "off" is going "No Success" in PeopleSoft
• Fundamentals Of PeopleSoft Integration Broker
• PeopleSoft to PeopleSoft Integration through Integration Broker
• PeopleSoft to Third Party Integration Through Web Services
• PeopleSoft Installation: Change from host-only to bridged to enable internet in VM
• Understanding Component Interface in PeopleSoft
• How to use PeopleSoft ExceltoCI Utility
• Understanding Dynamic Prompts in PeopleSoft
• 4 Key advantages of Application Package over traditional Functional Libraries
• SQL Query for Max Effective MAX (EFFDT) dated row from JOB table
• SQL Query to Find Direct Reports for a Manager in PeopleSoft
• Creating a Content Reference in PeopleSoft
• Difference Between FieldEdit and FieldChange Event in PeopleSoft
• Creating Query Report with PS Query in PeopleSoft
• Creating the PS Query in PeopleSoft
• Security Configuration for PS Query or PeopleSoft Query Security
• Why query is not visible in Query Manager
• How to get rid of sytem generated OPRID criteria in PS Query without having to create View

Tuesday, February 18, 2014

Implementing parallel processing using temporary record with application engine.

25 comments:

Hello, Wonderful article. Thank you for elaborating concept of Parallel processing in AE. However, I got one question. Is Parallel or concurrent processing simply means having more than one instance of your app engine program running at the same time and each instance of the program gets it's dedicated Temp table instance. OR Parallel or concurrent processing could be achieved using Temp tables. For example if there are 100K rows to be processed and 10 temp table instances, each table is responsible to process 10K rows simultaneously on a single execution of application engine. I believe your blog indicates a second concept. I tried to implement lattar in one of the application engine to process about over one Million records and when executed there is only one instance of Temp table allocated to the process. I want to know how it will process 10 temp tables (or more than one temp table) in single run of program.

As this is written it is going to dump 100,000 records into BN_EMPLID_WRK1 (actually BN_EMPLID_WRK04). It will not split up the 100,000 rows. You could create 10 programs and limit the initial load to say 10,000 rows,then each program would be processing that specific data at the same time. Or you could actually have one AE and it could determine the number of total rows to load, divide it by the number of temp tables you have, then create a SQL statement to load this data, store it in your state record and schedule each app engine to run. Either way, I do not see how what is written here is going to AUTOMATICALLY know how to divide the 100,000 rows and actually use all instances of the temp tables and process all 10 instances of the data at the same time. If I am missing anything please let me know, but I just do not see it here.

Dale- you are absolutely correct.

If I were to process 100 K rows in an application Engine, do I need to run different instances of application Engine for parallel processing of the process or data could automatically be spread out into number of Temp tables (Say 10000 rows among 10 temp tables where 10000 is arbitrary) in single run of program. My objective is to divide data among instances of temp tables in a single run without running many instances of the same program as our program will be scheduled and must not require any user intervention therefore no one will be there to enter run control parameters manually. Our expected setting: One process -> one instance run of the program -> Uses 5 temp tables instances to insert huge data simultaneously in a single run using parallel processing to achieve performance. Your blog gives us a clue that we can implement that way (referring to para starting with 'Lets say....'). Are you sure your AE program when executed were using all instance of the temp tables to process data on a single run of an application engine.

@Mavarick_1979 - It can be implemented in both ways however the second one PeopleSoft delivered one and a lot easier to implement too. Did you mention number of instance count in "Instance count " filed of App engine program properties (Explained in Step: 5) @PeopleSoftOracleFusion - Yes, your understanding is correct.

This comment has been removed by the author.

I can not see the SQL that is referred to in Step 8, BUT, the way this is written, it will not spread the 100,000 rows across multiple temp tables. It will simply use 1 instance of the 10 tables created. If you want to spread this across 10 tables, you would need to have 10 copies of this app engine. the initial load in step 8, of each AE, would need to setup to only load a specific number or 'chunk' of data. From that point on, each program would be processing the 10k rows that it has loaded, The only value in what I see here is if this AE abended, you would be able to run it again using a different run control and it would use the next available instance of the temp tables

A very elaborated explanation thanks for sharing it...

Hi Santosh, Nice explanation. Could you please explain restart-ability in app engine.

I have queued it up in my to be published list.. thanks for visiting guys I am delighted that you all are liking the blog. .

Dale barthold is correct- parallel processing means you have the ability to run the same appengine working on different sets of data- if you implement this as it is elaborated here- it is only going to use one instance of the temp table. You need to segregate data at the runcontrol level and desing your insert sql for Insert into %table (temp_table) so that it fetches data based on different runcontrol parameters.

Dale is correct

can anybody please explain on the calculation of total instance count of temporary tables, if count is defined online as well as in application engine

Thanks Santhosh . Very nicely explained.

errors PeopleTools 8.50 - Application Engine Copyright (c) 1988-2015 PeopleSoft, Inc. All Rights Reserved Application error: no SQL statement defined for SQL action (108,535) Message Set Number: 108 Message Number: 535 Message Reason: Application error: no SQL statement defined for SQL action (108,535) Process 1335 ABENDED at Step PARR_AE.MAIN.Step02 (SQL) -- RC = ? (108,524) Message Set Number: 108 Message Number: 524 Message Reason: Process 1335 ABENDED at Step PARR_AE.MAIN.Step02 (SQL) -- RC = ? (108,524) Process %s ABENDED at Step %s.%s.%s (Action %s) -- RC = %s

Such a wonderful work....You are Guru of Guru Sir....Thanks.

Hi Blogger, Thanks a lot for sharing this knowledge. But can u please address Dale's view point. It seems your logic is not splitting the data and its not parallel processing. Can you please clarify. Thanks in advance.

Hi, I have created a 10 instance as above mentioned .I am getting below error when I am processing. Note:PS_DLT_OPR ID_TM1 is my Temp Table SQL error. Stmt #: 2660 Error Position: 0 Return: 9999 - A n unknown error code (9999) wa s encountered (SQLSTATE PS999) RUN TRUNCATE TABLE (PS_DLT_OPR ID_TM14)

Worthful Spark tutorial. Appreciate a lot for taking up the pain to write such a quality content on Spark Training. Just now I watched this similar Spark tutorial and I think this will enhance the knowledge of other visitors for sure. Thanks anyway.:-https://www.youtube.com/watch?v=8Kcu63H0d8c&

I have been reading various topics on your blog and I love the clarity in the explanation. Thank you!

Thanks for sharing with us. Business Setup in Dubai Ajman Free Zone offshore formation Ajman Free Zone Ajman Media City Free Zone Dubai PRO Service DNRD Typing Dubai Immigration PRO Services in UAE Dubai Local Sponsor Dubai Company Liquidation

Great read! Thank you for such useful insights. Visit here for advanced technical courses on OKTA ONLINE TRAINING

is that explained set processing or parllel processing? what is diffence between dividing and sharing temp tables inbetween same program run and multiple program runs?

Pročitajte moje svjedočanstvo o tome kako sam dobio brzi zajam od pouzdane tvrtke. Pozdrav, ja sam gospođica Veronica iz Hrvatske. Bio sam u financijskoj situaciji i trebao sam kupiti kuću. Pokušao sam potražiti zajam od različitih kreditnih tvrtki, privatnih i korporativnih, ali nije išlo, a većina banaka mi je odbila kredit. Ali kako bi Bog htio, upoznali su me s privatnim zajmodavcem koji mi je dao zajam od 90,000 eura i danas imam vlastitu kuću i vlasnik sam tvrtke i trenutno mi je dobro, ako morate ići na tvrtka za osiguranje zajma. bez kolaterala, bez provjere kreditne sposobnosti, samo 3% kamatna stopa i supotpisnik s boljim planovima i rasporedom otplate, kontaktirajte Davidson Albert Loan ([email protected]). On ne zna da to radim, ali sada sam tako sretna i odlučila sam dati ljudima više informacija o njemu i želim da ga Bog još više blagoslovi. Možete ga kontaktirati putem njegove e-pošte. [email protected] {WhatsApp: +38761545894}