Lotus Notes initial load to IdM hangs

[Former Member]

The Lotus Notes initial load framework is using Windows Runtime engine and it usually hangs after 3100 user are read (There are about 30000 users in Lotus Server to be read). IdM first reads Lotus servers which worked fine but when it runs "read notes users" pass it hangs at 3100, or 4700 or 5500, so it changes but mostly at 3100. Even though that the dispatcher was chnaged to debug mode there are no errors. The IC options for execution timeout settings (normal and bootstrap) are currently set 745600 seconds.

Has this happened to anyone else?

[Former Member]

Hi Sarah,

at first, some questions about your landscape:

are you using MS SQL Server as the IdM database? If so, which version are you using?

have you checked the temporary table?

How many entries do you have in that table?

Last year we had a similar problem, and had to change some configuration within the database.

Kind regards,

Achim

Edited by: Achim Heinekamp on Sep 22, 2010 11:53 AM

[mukesh_mahadik]

Hello Achim,

We are using Oracle 10.2.0.2 Version. We have enough temp tablespace around 80GB & its free.We want to load around 30,0000 entries from Lotes notes.

Here is our Landscape.

Mangement Console is on WIN2003 server - 64 bit

IDM - IC DB is Oralce 10.2.0.2

Runtime components are installed on WIN2003 server same server where MC installed.

UI - Is CE7.1 JAVA Server.

Thanks,

Mukesh

[Former Member]

Hi Mukesh,

how many entries do you have in the temporary table (like mxmc_rt_u.notesusers, mxmc_rt_u.notesgroups, mxmc_rt_u.notesservers), created by the initial load?

Does the count of rows of the temporary tables is equivalent to your count of notes users within your notes landscape?

Sometime we had some problems loading the certificates of the notes users, cause the target field isn't large enough. Please try to disable the certificate attribute within the IC.

kind regards,

achim

[mukesh_mahadik]

Hello Achim,

Thank you much for your prompt response.

I did't find notesgroups entries..

SQL> select count(*) from MXMC_RT.notesusers;

COUNT(*)

-

---

2488

SQL>

SQL> select count(*) from MXMC_RT.notesservers;

COUNT(*)

-

---

198

SQL> select count(*) from MXMC_RT.notesgroups;

select count(*) from MXMC_RT.notesgroups

*

ERROR at line 1:

ORA-00942: table or view does not exist

SQL>

How to disable the certificate attribute within the IC database?

Thanks and Regards,

Mukesh

[Former Member]

Hi Mukesh,

please go to the "Read Notes User"-Pass within the initial load job and have a look at target "Certificate".

Kind regards,

achim

[mukesh_mahadik]

Hello Achim ,

Here are the MXMC.RT schema tables:

NOTESSERVERS

NOTESUSERS

NOTES_SERVERLOCALADMIN

NOTES_SERVEROWNER

NOTES_USEROWNER

NOTES_USERSLOCALADMIN

Z_LNCERTS

The count from Cert table.

SQL> select count(*) from mxmc_rt.Z_LNCERTS;

COUNT(*)

-

---

331

SQL>

Where will get that Certificate attribute in IC ?

Thanks and Regards,

Mukesh

[mukesh_mahadik]

Hello Achim ,

We got the MX_CERTIFICATE attribute in IC. How to disable it ?

Thanks and Regards,

Mukesh

[mukesh_mahadik]

Hi Achim ,

Thanks again for your reply.

We got that path as you suggested & the Certificate attribute is disabled there.

Thanks and Regards,

Mukesh

[Former Member]

Hi Mukesh,

don't change the attribute "MX_CERTIFICATE" within your identity store.

names.nsf -

---

> temp-table -

---

> identity store

Read Notes Server write Notes Servers

Read Notes Users write Notes Users

Read Notes Groups write Notes groups

Please change the Pass "Read Notes Users" to disable the certificate attribute (destination tab, column "Target", row "Certificate"). Infront of this row there is another field, please insert a "#" to disable this row for the initial load.

Another point, have you activated the "Bootstrap" option at the "options" tab of the job?

May be it is just a timeout problem.

kind regards,

achim

[mukesh_mahadik]

Hi Achim,

The Certificate filed is already disabled and Bootstrap job option is not enabled.

Thanks and Regards,

Mukesh

[Former Member]

Hi Mukesh,

please activate the bootstrap option and run the job again.

If this doesn't help, please give me some information about the job log. It seems the job aborts before reading notes groups.

Kind regards,

achim

[mukesh_mahadik]

Hello Achim,

Thanks for reply. I'll activate it & run the job & let you know ASAP.

Thanks and Regards,

Mukesh

[mukesh_mahadik]

Hello Achim,

We have tried rerunning the job with this option but still no luck yet.

Thanks and Regards,

Mukesh

[Former Member]

Hi Mukesh,

do you have any log information for me to analyse the problem?

Kind regards,

achim

[Former Member]

I haven't had your problem specifically, but we have had problems loading large user lists (around 10-20k) from AD or ABAP systems. It's possible the problem is related. Those use Java runtime, but maybe there is something similar for the Windows runtime...

At least for the Java runtime, the dispatchers are set to use a very low amount of memory. This causes serious problems when you need to load 30k users!

In the Service-Scripts folder on the IdM Server, the dispatchers have properties files ( like Dispatcher_Service_<dispatcherName>.prop) that control various settings. For Java runtime, we edit the java options section so it contains the "-Xmx512M" parameter:

# ---------------------------------------------------------------------
# --- Additional Java options
# --- Please note that if you specify more than one option here you
# --- need to set MXDISPATCHER_EXECSTRING=1
# ---------------------------------------------------------------------
JAVAOPTIONS=-Xmx512M

This increases the maximum memory for the process, so it should be able to handle larger data sets.

I don't know if there is an equivilent for the Windows runtime dispatchers, but I'm also not clear as to exactly what distinguishes them, as our dispatchers that are for Windows runtime also have JavaOptions and seem to be set up the same... You could always give it a shot and see if it helps.

Edited by: Adam Harwell on Sep 15, 2010 9:14 AM