root file system getting full SLES 10 SAP ERP6

[Former Member]

Hi Gurus

Iam having an unusual problem.My / file system is getting full and i can`tv pick up what causing it .I have checked the logs in /var/messages.I dont know whats writing to / .I didnt copy anything directly on /

Filesystem Size Used Avail Use% Mounted on

/dev/sda5 7.8G 7.5G 0 100% /

SLES 10 64 bit ERP6 SR2

Anyone who had a similar problem.

Any ideas are welcome

[hannes_kuehnemund]

Great that the issue is solved. I mark your question as answers.

Thanks, Hannes

[Former Member]

Hi,

As asked earlier can you please let us know which directories that are part of / occupying the highest space.

[Former Member]

Hi

The other file systems are:

Filesystem Size Used Avail Use% Mounted on

/dev/sda5 7.8G 7.8G 0 100% /----

---

root file system getting full

udev 18G 152K 18G 1% /dev

/dev/sda1 7.8G 136M 7.3G 2% /boot

/dev/sda7 11G 5.1G 5.3G 49% /sapdb

/dev/sdb1 380G 220G 142G 61% /sapdb/XDP/data

/dev/sda9 16G 9.7G 5.4G 65% /sapdb/XDP/log

/dev/sdb3 7.8G 2.2G 5.2G 30% /sapdb/XDP/sapsave

/dev/sda8 5.0G 2.0G 2.8G 42% /sapmnt

/dev/sda6 14G 9.4G 3.8G 72% /usr/sap

shm 18G 302M 18G 2% /dev/shm

/dev/sdc1 1.5T 1.1T 256G 82% /dailybackups----

---

External mounted USB disk

/dev/sdc2 392G 314G 59G 85% /fulloffline----

---

External mounted USB disk

[hannes_kuehnemund]

twn,

you have to execute this command to get a clue who uses much space on /

cd /
du -hmx --max-depth=1

this command excludes all other files systems which are not part of /. This way you find the directory which causes the trouble.

Best, Hannes

[Former Member]

cd /

xwbr1:/ # du -hmx --max-depth=1

1 ./lost+found

48 ./etc

1 ./boot

1 ./sapdb

1 ./sapmnt

1430 ./usr

0 ./proc

0 ./sys

0 ./dev

85 ./var

8 ./bin

1 ./home

83 ./lib

12 ./lib64

1 ./media

1 ./mnt

488 ./opt

56 ./root

14 ./sbin

2 ./srv

1 ./tmp

1 ./sapcd

1 ./backupdisk

1 ./dailybackups

1 ./fulloffline

cd /root

xwbr1:~ # du -hmx --max-depth=1

1 ./.gnupg

1 ./bin

1 ./.kbd

1 ./.fvwm

2 ./.wapi

12 ./dsadiag

1 ./.gconf

1 ./.gconfd

1 ./.skel

1 ./.gnome

1 ./.gnome2

1 ./.gnome2_private

1 ./.metacity

1 ./.gstreamer-0.10

1 ./.nautilus

1 ./.qt

1 ./Desktop

1 ./.config

1 ./Documents

1 ./.thumbnails

38 ./.sdtgui

1 ./sdb

1 ./.sdb

4 ./.mozilla

56 .

[hannes_kuehnemund]

Interestingly, only ~3GB of space is used on / (just add the numbers - they are in MB - that are given before the folder).

I suspect, that you have hidden data in some of the folders on which you have mounted other file systems. Let me give you an example.

You have a directory on /, let's say it is named /dailybackup

In this directory you have a file with 4GB.

When you mount a new file system (e.g. /dev/sdx2) over /dailybackup you cannot find the 4GB file. So the space is used on / but you cannot find it.

Maybe this is the issue ...

[Former Member]

Thanks Hannes

That was exactly the problem.There seems to have been a problem mounting the external disk before but since the mount pount was created it backed up directly on /dailybackups.

The reason was it was difficult to pick up was because if i checked the size of /dailybackups it was the size i expected to see as it was reading from the external disk.

So i unmounted the disk.Checked the mount point mount /dailybackup and in there there was 5gb failed backups.So cleared them all good now.

thanks to u all

[Former Member]

Hi twm,

Maybe there is some process which is caused any core dump and create core dump file (usually huge file). Remember that on SAP installation, we are suggested to make nolimit on file size (ulimit command) and this caused huge core dump file created when any process is dumped.

Try to create a little script (on OS level), schedule it on cron and run it periodically.

ardhian

http://basishowto.blogspot.com

http://sapbasis.wordpress.com

[former_member189546]

Sorry

6604 Deleting job logs at operating system level

5855 Job logs occupy a lot of storage space

16513 File system is full - what do I do?

regards,

John Feely

[former_member189546]

Hello,

Please check these notes.

604 Deleting job logs at operating system level

855 Job logs occupy a lot of storage space

6513 File system is full - what do I do?

regards,

John Feely

[markus_doehr2]

is /usr/sap on a different filesystem?

try

cd /
for i in `ls`; do du -ks $i; done

to find the directory occupying the space.

Markus

[Former Member]

Thanks Markus

/usr/sap is mounted on a different partition and filesystem. I have noticed /proc/kcore is 6442455040 in size .The file system that has very large sizes are the data,logs,db which is normal .

[markus_doehr2]

/proc is the runtime filesystem, no actual files are there, that's just a dump of memory.

Markus