Reporting Services Hung
When we perform a load testing of crystal reports on BOXI 3.1 SP6 (shipped with CA Clarity 13.3 PPM) on a Linux RHEL 6.5 x64 environment with 16GB RAM and 3vCPU, we are facing multiple errors on the server logs after few min.
User experience - Reports running for long and eventually no output
BO CMC -
1) Reports that complete in 10-12 sec continue to be in Running or Pending state
2) Report output window of completed report - hangs
3) Server properties on CMC - hangs (a blank window is disaplyed)
4) Reports randomly fail with errors such as (Internal error, Object failed due to an error while processing on job server, File Repository server input is down)
After running a trace on RAS, RPC, Crystal report servers (as all the 8 reports we are executing for load testing are Crystal reports), we see multiple errors in the logs. The below ones are most prominent
boe_jobcd_1658_2015_10_20_07_50_20_159_trace.log:2015/10/20 07:50:20.543|==| | | 1658|1454376432| |||||||||||||||procReport.dll: CrpeMgrPEOpenEngineEx() failed with error: Report engine not opened.
boe_crprocd.bin_4520_2015_10_20_06_11_54_494_trace.log:2015/10/20 06:11:56.950|==| | | 4520|1566858096| |||||||||||||||procReport.dll: CRPE FAILED: GetLastPEErrorInfo(1) returns crpe error code  with extended error string . Localized error string is 
boe_jobcd_2272_2015_10_20_07_53_30_225_trace.log:2015/10/20 07:53:31.438|==| | | 2272|1559841648| |||||||||||||||procReport.dll: IJobDllRun() returns error:( [src/ijobdll.cpp : 308] Unknown exception caught. This is bad!: Error in the report processing unit. )
boe_jobcd_29720_2015_10_20_07_43_55_322_trace.log:2015/10/20 08:00:21.293|==| | |29720|1583344496| |||||||||||||||procReport.dll: FAILED: Error message in the language of the server[File Repository Server Input is down.], resID, sLocale
Has anyone faced this issue before?
We have a lower environment with 4GB RAM and 2v CPU where the load testing of these reports pass with no issues.