Out of memory

terrell

I am a chinese person，So far, I haven't had the English cet 4！So, please forgive my grammatical errors，Thank you very much！

I have a problem about out of memory:

My company has a server, the system is a 64 - bit Asianux:

Memory:32GB

CPU core：24

In system, the deployment of a number of tomcat web services and a few other services consume memory

/opt:tomcat_2080、tomcat_2081、tomcat_2082、tomcat_8080、tomcat_8081、tomcat_8888、DispSvrV3、

mapabc、mongodb .........

Java version of the system used：

[root@rdcp tomcat_2080]# java -version

java version "1.6.0_22"

Java(TM) SE Runtime Environment (build 1.6.0_22-b04)

Java HotSpot(TM) 64-Bit Server VM (build 17.1-b03, mixed mode)

The current situation is:

When all of the services in the system up and running after a period of time, the tomcat_8888 will be some mistakes：

JRockit dump produced after 0 days, 00:02:49 on Thu Sep 5 13:50:28 2013

**************************************************************************

* If you see this dump, please go to *

* http://download.oracle.com/docs/ ... roubleshooting.html *

* for troubleshooting information. *

**************************************************************************

Additional information is available in:

/opt/tomcat_8888/jrockit.5669.dump

No snapshot file (core dump) will be created because core dumps have been

disabled. To enable core dumping, try "ulimit -c unlimited"

before starting JRockit again.

Error Message: Illegal memory access. [54]

Signal info : si_signo=11, si_code=1 si_addr=0x241433460

Version : Oracle JRockit(R) R28.2.7-7-155314-1.6.0_45-20130329-0641-linux-x86_64

CPU : Intel Core 2 SSE SSE2 SSE3 SSSE3 SSE4.1 Core Intel64

Number CPUs : 24

Tot Phys Mem : 33751126016 (32187 MB)

OS version : Red Hat Enterprise Linux Server release 5.3 (Tikanga)

Linux version 2.6.18-128.7AXS3 ([email protected]) (gcc version 4.1.2 20080704 (Asianux 3.0 4.1.2-44)) #1 SMP Fri Jun 19 13:48:55 EDT 2009 (x86_64)

Thread System: Linux NPTL

LibC release : 2.5-stable

Java locking : Lazy unlocking enabled (class banning) (transfer banning)

State : JVM is running

Command Line : -Xms4096m -Xmx4096m -Xgc:parallel -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=/opt/tomcat_8888/conf/logging.properties -Djava.endorsed.dirs=/opt/tomcat_8888/endorsed -Dcatalina.base=/opt/tomcat_8888 -Dcatalina.home=/opt/tomcat_8888 -Djava.io.tmpdir=/opt/tomcat_8888/temp -Dsun.java.command=org.apache.catalina.startup.Bootstrap start -Dsun.java.launcher=SUN_STANDARD org.apache.catalina.startup.Bootstrap start

Repository :

java.home : /root/jrockit-jdk1.6.0_45-R28.2.7-4.1.0/jre

j.class.path : :/opt/tomcat_8888/bin/bootstrap.jar:/opt/tomcat_8888/bin/commons-logging-api.jar

j.lib.path : /usr/java/packages/lib/amd64:/root/jrockit-jdk1.6.0_45-R28.2.7-4.1.0/jre/lib/amd64/jrockit:/root/jrockit-jdk1.6.0_45-R28.2.7-4.1.0/jre/lib/amd64:/root/jrockit-jdk1.6.0_45-R28.2.7-4.1.0/jre/../lib/amd64

JAVA_HOME : /root/jrockit-jdk1.6.0_45-R28.2.7-4.1.0

_JAVA_OPTIONS:

LD_LIBRARY_PATH: /root/jrockit-jdk1.6.0_45-R28.2.7-4.1.0/jre/lib/amd64/jrockit:/root/jrockit-jdk1.6.0_45-R28.2.7-4.1.0/jre/lib/amd64:/root/jrockit-jdk1.6.0_45-R28.2.7-4.1.0/jre/../lib/amd64

LD_ASSUME_KERNEL:

LD_PRELOAD :

StackOverFlow: 0 StackOverFlowErrors have occured

OutOfMemory : 8599 OutOfMemoryErrors have occured

C Heap : Good; no memory allocations have failed

GC Strategy : Mode: throughput, with strategy: singleparpar (basic strategy: singleparpar)

GC Status : OC is not running. Last finished OC was OC#0.

Heap : 0x100000000 - 0x200000000 (Size: 4096 MB)

Compaction : (no compaction area)

Allocation : TLA-min: 2048, TLA-preferred: 262144 TLA-waste limit: 2048

CompRefs : References are compressed, with heap base 0x0 and shift 3.

Registers (from ThreadContext: 0x41432810:

rax = 0000000041433370 rcx = 00000000ffffffff

rdx = 00002b6d4ebe5211 rbx = 0000000241433468

rsp = 0000000041432c50 rbp = 0000000041432ca0

rsi = 0000000241433468 rdi = 00002aaaf2bf4010

r8 = 0000000241433458 r9 = 000000000000001b

r10 = 00002aaaf2bf4000 r11 = 0000000000000206

r12 = 00002aaaf2bf4010 r13 = 0000000000000001

r14 = 0000000000000010 r15 = 0000000000000003

cs = 0000000000000033 fs = 0000000400000000

gs = 0004000000000000

rip = 00002b6d4f16e508 flags = 0000000000000206

Loaded modules:

(* denotes the module where the exception occured)

0000000000400000-00000000004128c3 /root/jrockit-jdk1.6.0_45-R28.2.7-4.1.0/bin/java

0000003c20400000-0000003c20401f93 /lib64/libdl.so.2

0000003c20800000-0000003c20815507 /lib64/libpthread.so.0

Stack:

(* marks the word pointed to by the stack pointer)

0000000041432c50: 0000000041433160* 0000000000000003 0000000041432c70 00002b6d4ec0778e

0000000041432c70: 0000000000000000 0000000000000001 0000000000000002 0000000000000001

0000000041432c90: 0000000000000010 0000000000000003 0000000041433220 00002b6d4ec7c500

0000000041432cb0: 0000000041432cd0 00002b6d4ed57462 000000000d4fe9f0 00002aaaf2bfcda8

0000000041432cd0: 0000000041433370 00002aaafa3d9aa0 00002aaaf2bf44e0 ffffffff00000001

0000000041432cf0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Code:

(* marks the word pointed to by the instruction pointer)

00002b6d4f16e4a8: ffffb7c8e9c93e89 ffb7bfe9c93e8b48 00000000801f0fff 56415741e5894855

00002b6d4f16e4c8: 53fc894954415541 4828ec8348f38948 00000500840fff85 0000ab840ff68548

...........................................................

rw 0x00002b6d4eb7c000 ( 8KB)

OS *libjvm.so r x 0x00002b6d4eb7e000 ( 3108KB)

OS *libjvm.so 0x00002b6d4ee87000 ( 2044KB)

OS *libjvm.so rw 0x00002b6d4f086000 ( 188KB)

OS **libjvm.so rw 0x00002b6d4f0b5000 ( 684KB)

OS *libjrosal.so r x 0x00002b6d4f160000 ( 128KB)

OS *libjrosal.so 0x00002b6d4f180000 ( 2044KB)

OS *libjrosal.so rw 0x00002b6d4f37f000 ( 8KB)

OS **libjrosal.so rw 0x00002b6d4f381000 ( 4KB)

OS *libjrutil.so r x 0x00002b6d4f382000 ( 52KB)

OS *libjrutil.so 0x00002b6d4f38f000 ( 2044KB)

OS *libjrutil.so rw 0x00002b6d4f58e000.( 4KB)

OS *[stack] rwx 0x00007fff93a73000.( 84KB)

OS *[vdso] 0xffffffffff600000 ( 8192KB)

................................................................................

But,if i close mapabc service or the mongodb or other ,tomcat_8888 will run normally.(I didn't shut down other tomcat service )

If I start the tomcat_8888 , then mapabc or mongdb database because of insufficient memory will shoot down.

Anyway,the physical memory forever is enough,there will always be around 10G of space.

Please forgive my poor English！！！！！！ Heh heh Heh heh！！！