Brarchive online backup failed on BI Ides system

[former_member556006]

Dear Expert,

We have two databases on BI Ides server ID7 and ID8, and we are taking online archive backup for ID7 and it's fine but when taking the same for ID8, it fails with the following error:

[shaun_wimpory2]

Hi Ola,

Can you please enable verbose logging on your netbackup agent?

To configure verbose logging for Netbackup, execute the following:

Enter:             cd /usr/openv/netbackup/logs

Enter:             mkdir bp bparchive bpbackup bpbkar bpcd bpdbsbora

Enter:             mkdir bpfilter bphdb bpjava-msvc bpjava-usvc bpkeyutil

Enter:             mkdir bplist bpmount bpnbat bporaexp bporaexp64

Enter:             mkdir bporaimp bporaimp64 bprestore db_log dbclient

Enter:             mkdir symlogs tar user_ops backint

Enter:             chmod 777 *

Enter:             cd /usr/openv/netbackup

Enter:             vi bp.conf

Add:               VERBOSE = 5

  Restart the Netbackup agents.

You should find that logs are written to a number of these directories ... hopefully this will provide you with a little more insight into what NetBackup is complaining about.

Regards

Shaun

[former_member182657]

Dear Ola,

We are taking an online backup for ID7 database but we don't take any backup for ID8 except the archive backup.

As you stated you're not taking backup for ID8 except archive log backup ,so from now missing or deletion of logs completely depends on the redo log script.As per me with use of this script archive logs first backed up & then removed from the system.You can confirm by using DB24 logs as like below:

[former_member182657]

Try to check your netbackup script for redo log backup.This script keeps the current redo backup & after backup deletes the backed up file to make space or free space on your system.(Scenario at my end)

[former_member556006]

Dear Gaurav,

We are taking an online backup for ID7 database but we don't take any backup for ID8 except the archive backup. Could this make a problem with ID8 and the archive backup and not deleting the archive logs?

[former_member182657]

So last as per me if logs are not present then every third party backup tool will end with some error code as like symantec throwing code 6 on not finding required logs for backup under oraarch directory.

Hope you'll be agree with me.

Regards,

Gaurav

[former_member556006]

But this is not happening with ID7.

[former_member182657]

This is not happening on ID7 as because symantec will be able to find required logs at the time of backup schedule.

Please confirm redo log creation frequency on both ID7 & ID8 and also classify these two (Which one is DEV,QTY or PRD).

[former_member556006]

When running the following command on /ID8/oraarch i found a very old archive logs still exist

[former_member556006]

http://scn.sap.com/message/14993193#14993193

Dear Gaurav,

Can you please participate in this link

Thanks,

[former_member182657]

Hi Ola,

Thanks for marking.Will revert on discussion at http://scn.sap.com/message/14993193#14993193

Regards,

Gaurav

[Reagan]

Can you share the output.

su - sidadm

cdexe

ls -la br*

Regards

RB

[former_member556006]

Please check the image

[former_member182657]

Hi Ola,

Please follow

1.chown  –R root:root /usr/openv

2.chmod –R 777 /usr/openv

3.Give orasid:dba ownership permissions on initSID.sap and initSID.utl

Then try to take backup again from the OS terminal by execution of brachive commnad from the script.Share the results from there .

Regards,

Gaurav

[former_member182657]

Hi Ola,

Please share the results after following http://www.symantec.com/business/support/index?page=content&id=TECH51356

You need to check the permissions & ownerships for oracle directory & please confirm are you able to connect your client system from the Symantec netbackup server w/t any issues,try to fetch client info from the netbackup server.

Regards,

Gaurav

[Former Member]

Could you please attach the error logs / screen shot.

[former_member556006]

Detailed Status

[former_member556006]

[Reagan]

Check the permissions and ownership of the brtools files at /sapmnt/SID/exe

Regards

RB

[former_member556006]

We are not using Brtools for backup, we are using symantec netbackup.

[former_member688119]

Kindly Change Ownership of brtools files.

Thanks,

Amit

[former_member688119]

Kindly Extend the file system for backup Drive.

Thanks and Regards,

Amit

[Former Member]

Provide list of files from $ORACLE_HOME/lib for both systems (ID7 and ID8). More likely you need to create a soft link to libobk library from netbackup in $ORACLE_HOME/lib directory for ID8.

[Reagan]

Backups are triggered using brbackup whether you are using Symantec or TSM backup solutions.

It is visible in the logs that BRbackup is used. The errors starting with BR00 are for brtools.

Regards

RB

[former_member556006]

Dear Amit,

Please check

[former_member556006]

Dear Roman,

In ID7 i can find this link

but in ID8

i couldn't find it

[former_member688119]

Please check /usr/openv/netbackup/scripts/sapsld_online_backup.sh for name and location of the output file.

Check permissions on the script to ensure they are "owner oracle group dba   rwxr-xr-x"

http://www.symantec.com/business/support/index?page=content&id=TECH18717

STATUS CODE: 6 " the backup failed to back up the requested files" | Symantec Connect Comm...

Thanks and Regards,

Amit Patel

[former_member688119]

Please check /usr/openv/netbackup/scripts/sapsld_online_backup.sh for name and location of the output file.

Check permissions on the script to ensure they are "owneroracle group dba   rwxr-xr-x"

http://www.symantec.com/business/support/index?page=content&id=TECH18717

STATUS CODE: 6 " the backup failed to back up the requested files" | Symantec Connect Comm...

Thanks and Regards,

Amit Patel

[former_member556006]

There is no such path and file

[former_member556006]

Please check

[Former Member]

Create the same in ID8 and try to perform backup again.

[former_member556006]

I have created the link and it's working now, I'll update you once the job finish.

Thanks,

[former_member688119]

This message was moderated.

[former_member556006]

After 8 hours of backup, the backup failed with same error

[former_member556006]

[former_member182657]

Hi Ola,

Could you please share script for backup of redo log as per your logs it's showing no offline redo files for backup.

Regards,

Gaurav

[Former Member]

It's not the same error. Please attach if possible full log file (as attachment).

[former_member556006]

Please find the attached log

sap_stdout.040814.zip

[Former Member]

as per the log you have provided the backup is getting completed but there are errors in the logs due to missing log file at OS level. This may be due to the logs may have deleted. You can rename the archive log file (/oracle/ID8/saparch/archID8.log)  and I hope if you trigger the backup again the backup should complete without any issues.

[former_member182657]

Hi Ola,

Are the offline redo files still present under dir /oracle/ID8/oraarch/ ..Please check for an e.g search for this ID8arch1_701_825170362.dbf' .

Also as per message

BR0522E 1008 of 1388 files / save sets processed by RMAN

Netbackup backed up 1008 & left the offline redo files which are not present at the oraarch location.For more analysis could you share script cgcbiides_sap_archivebackup_id8 from the system.

Thanks,

Gaurav

[Former Member]

Can you attach log file for ID7 system?

[former_member556006]

[former_member556006]

Please check the script

sap_rman_archivebackup_id8.txt.zip

[former_member182657]

Hi Ola,

With your last screenshot it's clear that you are getting error code 6 on symantec netbackup as because offline redo logs not present under oraarch.As you've shared  sap_stdout.040814.zip

On analysis you can also find that lots of offline redo files are not present under the oraarch,So during the back up you're getting error code 6 on netbackup (This issue comes when required files for backup not present or some permission issues).

I request have a close look for sap_stdout.040814.zip file & you'll be able to find your solution.

Regards,

Gaurav

[former_member182657]

Hi Ola,

Could you please share the init<SID>.ora (in your case initID8.ora) file & result for the parameter log_archive_dest_1.

Thanks,

Gaurav

[former_member182657]

Hello again,

Could you please refer SCN link brarchive not backing up offline redo log on RAC | SCN

& http://www.symantec.com/business/support/index?page=content&id=TECH180321

Also it could be an issue with wrong value for parameter log_archive_dest

Thanks,

Gaurav

[former_member556006]

But it should be the same configuration of ID7, why it is failing here in ID8.

[former_member182657]

Hi,

Please share the result required in my previous reply to you.

Thanks,

[former_member556006]

Dear Gaurav,

Please check the attached file and the value inside.

[former_member556006]

log_archive_dest_1='LOCATION=/ORACLE/ID8/oraarch/ID8arch'

[former_member182657]

What is the value of same parameter for ID7 server.Please share.

Thanks,

[former_member556006]

The same but for ID7

[former_member182657]

Please make this parameter value same as like for ID7,So it would be log_archive_dest_1='LOCATION=/ORACLE/ID8/oraarch  & after that check again.

Thanks,

[former_member556006]

Sorry it was a mistake. It is similar to ID8, Both have the same path

[former_member182657]

Hi Ola,

As per my opinion logs are not present at the specified location that's way you're getting error code 6(Replied you earlier messages). Are you able to find out the missing redo logs under the location /ORACLE/ID8/oraarch/ID8arch .Please confirm.

Regards,

Gaurav

[former_member556006]

No, i couldn't find the logs in this folder.

[former_member182657]

So it's clear if logs are not present at the required path the third party software i.e netbackup will end with error code 6.Same tool is using by me for backup for SAP applications.

You can test for the successful message by backup of available redo logs in that dir,and for successful backup symantec will revert with code 0.

Hope this will clear you.

Regards,

Gaurav

[former_member556006]

It's clear but where could those logs be?

[former_member182657]

Try to search out for these logs into your system by using command

find / -name ID8arch1_701_825170362.dbf

Similarly find for others.If logs presents on the system then above command will reterive & will show you the exact path where these are located.If no logs comes out by using above command then check into Symantec Netbackup end for previous dates under Backup/Restore console.

[former_member556006]

I can't find the file anywhere, what do you mean by checking in symantec Netbackup end (Backup  &Restore) what can i find there?

[former_member182657]

On Symantec end find it under all programs

On execution of highlighted you'll get

Hope this will be helpful for you.

[former_member556006]

[former_member182657]

Are you able to find the missing logs at this end (Symantec Netbackup) in previous dates?

[former_member556006]

No

[former_member556006]

error 6