on 11-28-2015 4:33 PM
Hi Guys
Im working on a project of performing a Unicode Migration of a ERP 6 EHP7 / SQL Server System. Since DB is around 6tb, we are using parallel export/import
Each Server has around 30CPUs so we have plenty of processing capacity for each R3Load process
Top 20 tables were splitted as a pre-task so it was divided in several chunks
As you can see on the Orderby.txt file, top files where splitted in chunks and therefore whr files were created.
Then, this orderby.txt was used as parameter for Export Migration properties file
[CE1OCLA]
JobNum=1
CE1OCLA-1
CE1OCLA-2
...
CE1OCLA-48
[BSIS]
JobNum=1
BSIS-1
BSIS-2
...
BSIS-32
...
(Standard_Packages)
# Package order: name | file with package names
orderBy=R:\EXPORT_PCL_TEST_2211\orderby.txt
# DDL control file, default is DDL<DB_TYPE>.TPL
ddlFile=
# File with mapping between DDL files and package names
ddlMap=
# Monitor timeout in seconds
monitorTimeout=180
#
# R3load options
#
# Optional path of R3load executable
r3loadExe=E:\usr\sap\PCL\SYS\exe\nuc\NTAMD64\R3load
# Generation of task files: yes | no
tskFiles=yes
# Code page for data files
dataCodepage=4103
# Additional R3load arguments for TASK phase
taskArgs=
# Additional R3load arguments for LOAD phase
loadArgs=-stop_on_error
# Number of parallel export jobs
jobNum=56
My main concern is that Migration Monitor doesnt seen to take in account that it can use 56 R3load process, nevertheless is displayed in outfile when it updated
As you can see there are only 30 process running, and 266 are waiting. So, how can I force those waiting process to start. Mostly of those 266 waiting process are chunks of large tables waiting to be processed like.
BSIS-1
BSIS-2
BSIS-3
BSIS-4
CE1OCLA-1
CE1OCLA-2
CE1OCLA-3
CE1OCLA-4
CE1OCLA-5
and so on..
Why aren't those packages processed in parallel? On the screenshot you can see it says Package Group xxxxx Max Threads: 1. I mean, I want those max threads be increased.
In import_state file, it says CE1OCLA-1 completed but CE1OCLA-2 is still running but a long time ago. How can i make R3load processes more parallel CE1OCLA packages
CE1OCLA-1=++
CE1OCLA-10=0
CE1OCLA-11=0
CE1OCLA-12=0
CE1OCLA-13=0
CE1OCLA-14=0
CE1OCLA-15=0
CE1OCLA-16=0
CE1OCLA-17=0
CE1OCLA-18=0
CE1OCLA-19=0
CE1OCLA-2=?
CE1OCLA-20=0
In the orderby.txt file, tried to increment JobNum to higher value but it doesnt seem to be a dynamic value
[CE1OCLA]
JobNum=1
CE1OCLA-1
CE1OCLA-2
Any recommendations on how to improve R3load parallel processing would be welcome
Best
Martin
serus
caute idem spat mam 100 roku, CAU
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
After seeing no dynamic changes, I decided to cancel R3load process, and restart with updated JobNum Value.
#
# R3load options
#
# Optional path of R3load executable
r3loadExe=E:\usr\sap\PCL\SYS\exe\nuc\NTAMD64\R3load.exe
# Generation of task files: yes | no
tskFiles=yes
# Code page for data files
dataCodepage=4103
# Additional R3load arguments for TASK phase
taskArgs=
# Additional R3load arguments for LOAD phase
loadArgs=-stop_on_error -merge_bck
# Number of parallel export jobs
jobNum=12
Actual JobNum Value was set to 12. So Export Monitor is taking 12 as value for Max Threads for each group I defined in OrderBy.txt
Import_monitor.log shows 12 as Max Threads value
INFO: 2015-11-28 15:20:02 com.sap.inst.migmon.LoadThreadDispatcher loadPackage_report
Monitor jobs: running 114, waiting 182, completed 285, failed 0, total 581 Package Group YYG001A max threads: 12 current running threads : 5 processing package: YYG001A-8
INFO: 2015-11-28 15:20:02 com.sap.inst.migmon.LoadThreadDispatcher loadPackage_report
Monitor jobs: running 115, waiting 181, completed 285, failed 0, total 581 Package Group CDCLS max threads: 12 current running threads : 0 processing package: CDCLS-1
INFO: 2015-11-28 15:20:02 com.sap.inst.migmon.LoadThreadDispatcher loadPackage_report
Monitor jobs: running 107, waiting 189, completed 285, failed 0, total 581 Package Group BSAS max threads: 12 current running threads : 10 processing package: BSAS-12
INFO: 2015-11-28 15:20:02 com.sap.inst.migmon.LoadThreadDispatcher loadPackage_report
Monitor jobs: running 24, waiting 272, completed 285, failed 0, total 581 Package Group BSIS max threads: 12 current running threads : 11 processing package: BSIS-12
Now the Export Monitor is showing around 142 running process.
but when checking Resource Monitor there are around 42 processes writing to disk and I dont see any of the BSIS or CE1OCLA packages running, since those are the ones I put to export first.
So, resuming...
12 R3load process set in properties
142 process running at the same time
40 System process writing to files
So, Im clueless how Export Monitor handles R3load process for exporting data.
If anyone can give me a hint on how to better distribute the R3load process, is quite welcome.
Best
Martin
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
User | Count |
---|---|
88 | |
23 | |
11 | |
9 | |
8 | |
5 | |
5 | |
5 | |
5 | |
4 |
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.