cancel
Showing results for 
Search instead for 
Did you mean: 

Import Monitor - R3load Process Question

former_member229542
Active Participant
0 Kudos

Hi Guys

Im working on a project of performing a Unicode Migration of a ERP 6 EHP7 / SQL Server System. Since DB is around 6tb, we are using parallel export/import

Each Server has around 30CPUs so we have plenty of processing capacity for each R3Load process

Top 20 tables were splitted as a pre-task so it was divided in several chunks

As you can see on the Orderby.txt file, top files where splitted in chunks and therefore whr files were created.

Then, this orderby.txt was used as parameter for Export Migration properties file

[CE1OCLA]

JobNum=1

CE1OCLA-1

CE1OCLA-2

...

CE1OCLA-48

[BSIS]

JobNum=1

BSIS-1

BSIS-2

...

BSIS-32

...

(Standard_Packages)

# Package order: name | file with package names

orderBy=R:\EXPORT_PCL_TEST_2211\orderby.txt

# DDL control file, default is DDL<DB_TYPE>.TPL

ddlFile=

# File with mapping between DDL files and package names

ddlMap=

# Monitor timeout in seconds

monitorTimeout=180

#

# R3load options

#

# Optional path of R3load executable


r3loadExe=E:\usr\sap\PCL\SYS\exe\nuc\NTAMD64\R3load

# Generation of task files: yes | no

tskFiles=yes

# Code page for data files

dataCodepage=4103

# Additional R3load arguments for TASK phase

taskArgs=

# Additional R3load arguments for LOAD phase

loadArgs=-stop_on_error

# Number of parallel export jobs

jobNum=56

My main concern is that Migration Monitor doesnt seen to take in account that it can use 56 R3load process, nevertheless is displayed in outfile when it updated

As you can see there are only 30 process running, and 266 are waiting. So, how can I force those waiting process to start. Mostly of those 266 waiting process are chunks of large tables waiting to be processed like.

BSIS-1

BSIS-2

BSIS-3

BSIS-4

CE1OCLA-1

CE1OCLA-2

CE1OCLA-3

CE1OCLA-4

CE1OCLA-5

and so on..

Why aren't those packages processed in parallel? On the screenshot you can see it says Package Group xxxxx Max Threads: 1. I mean, I want those max threads be increased.

In import_state file, it says CE1OCLA-1 completed but CE1OCLA-2 is still running but a long time ago. How can i make R3load processes more parallel CE1OCLA packages

CE1OCLA-1=++

CE1OCLA-10=0

CE1OCLA-11=0

CE1OCLA-12=0

CE1OCLA-13=0

CE1OCLA-14=0

CE1OCLA-15=0

CE1OCLA-16=0

CE1OCLA-17=0

CE1OCLA-18=0

CE1OCLA-19=0

CE1OCLA-2=?

CE1OCLA-20=0

In the orderby.txt file, tried to increment JobNum to higher value but it doesnt seem to be a dynamic value

[CE1OCLA]

JobNum=1

CE1OCLA-1

CE1OCLA-2

Any recommendations on how to improve R3load parallel processing would be welcome

Best

Martin

Accepted Solutions (0)

Answers (2)

Answers (2)

julo134567
Discoverer
0 Kudos

serus

caute idem spat mam 100 roku, CAU

former_member229542
Active Participant
0 Kudos

After seeing no dynamic changes, I decided to cancel R3load process, and restart with updated JobNum Value.

#

# R3load options

#

# Optional path of R3load executable

r3loadExe=E:\usr\sap\PCL\SYS\exe\nuc\NTAMD64\R3load.exe

# Generation of task files: yes | no

tskFiles=yes

# Code page for data files

dataCodepage=4103

# Additional R3load arguments for TASK phase

taskArgs=

# Additional R3load arguments for LOAD phase

loadArgs=-stop_on_error -merge_bck

# Number of parallel export jobs

jobNum=12

Actual JobNum Value was set to 12. So Export Monitor is taking 12 as value for Max Threads for each group I defined in OrderBy.txt

Import_monitor.log shows 12 as Max Threads value

INFO: 2015-11-28 15:20:02 com.sap.inst.migmon.LoadThreadDispatcher loadPackage_report

Monitor jobs: running 114, waiting 182, completed 285, failed 0, total 581  Package Group YYG001A max threads: 12 current running threads : 5 processing package: YYG001A-8

INFO: 2015-11-28 15:20:02 com.sap.inst.migmon.LoadThreadDispatcher loadPackage_report

Monitor jobs: running 115, waiting 181, completed 285, failed 0, total 581  Package Group CDCLS max threads: 12 current running threads : 0 processing package: CDCLS-1

INFO: 2015-11-28 15:20:02 com.sap.inst.migmon.LoadThreadDispatcher loadPackage_report

Monitor jobs: running 107, waiting 189, completed 285, failed 0, total 581  Package Group BSAS max threads: 12 current running threads : 10 processing package: BSAS-12

INFO: 2015-11-28 15:20:02 com.sap.inst.migmon.LoadThreadDispatcher loadPackage_report

Monitor jobs: running 24, waiting 272, completed 285, failed 0, total 581  Package Group BSIS max threads: 12 current running threads : 11 processing package: BSIS-12

Now the Export Monitor is showing around 142 running process.

but when checking Resource Monitor there are around 42 processes writing to disk and I dont see any of the BSIS or CE1OCLA packages running, since those are the ones I put to export first.

So, resuming...

12 R3load process set in properties

142 process running at the same time

40 System process writing to files

So, Im clueless how Export Monitor handles R3load process for exporting data.

If anyone can give me a hint on how to better distribute the R3load process, is quite welcome.

Best

Martin