Bugzilla – Full Text Bug Listing
| Summary: | JVM Crash on solaris (Generic_141444-09) while using OSGI(org.eclipse.osgi_3.6.0.v20100128-1430.jar) for creation of an instance. | ||||||
|---|---|---|---|---|---|---|---|
| Product: | [Eclipse Project] Equinox | Reporter: | Ashwani Kumar <ku_ashwani> | ||||
| Component: | Framework | Assignee: | equinox.framework-inbox <equinox.framework-inbox> | ||||
| Status: | RESOLVED NOT_ECLIPSE | QA Contact: | |||||
| Severity: | critical | ||||||
| Priority: | P3 | CC: | remy.suen, tjwatson | ||||
| Version: | 3.6 | ||||||
| Target Milestone: | --- | ||||||
| Hardware: | Sun | ||||||
| OS: | Solaris | ||||||
| Whiteboard: | |||||||
| Attachments: |
|
||||||
Created attachment 209254 [details]
Attached is the file generated after JVM crash.
This is happening in the Zip support in the VM and appears to be a VM bug. There is support in the Framework to limit the number of zip files the framework keeps open at one time. This support can cause quick open/close operations on zip files if you have many bundles involved. This has caused some problems for VMs in the past (pre 1.6 I think). You could try disabling this support by setting the configuration option osgi.bundlefile.limit=0 in the config.ini to see if that helps. (In reply to comment #2) > This is happening in the Zip support in the VM and appears to be a VM bug. > There is support in the Framework to limit the number of zip files the > framework keeps open at one time. This support can cause quick open/close > operations on zip files if you have many bundles involved. This has caused > some problems for VMs in the past (pre 1.6 I think). You could try disabling > this support by setting the configuration option osgi.bundlefile.limit=0 in the > config.ini to see if that helps. Thanks for the reply. In our case there is only one bundle started as we are handling the same version. Also we are not stopping the bundle in our code. As we are starting the multiple VMs and all try to create the instance of class loaded through OSGI in their own space. Do you think there could be a problem of synchronization as all will be trying to start the same bundle and making a native call? (In reply to comment #3) > Thanks for the reply. > > In our case there is only one bundle started as we are handling the same > version. > Also we are not stopping the bundle in our code. > > As we are starting the multiple VMs and all try to create the instance of class > loaded through OSGI in their own space. > Do you think there could be a problem of synchronization as all will be trying > to start the same bundle and making a native call? I guess it is possible, but that synchronization issue is in the VM, not the framework. It should not matter that multiple instances of the VM are trying to read entries out of the same jar file on disk. (In reply to comment #4) > (In reply to comment #3) > > Thanks for the reply. > > > > In our case there is only one bundle started as we are handling the same > > version. > > Also we are not stopping the bundle in our code. > > > > As we are starting the multiple VMs and all try to create the instance of class > > loaded through OSGI in their own space. > > Do you think there could be a problem of synchronization as all will be trying > > to start the same bundle and making a native call? > > I guess it is possible, but that synchronization issue is in the VM, not the > framework. It should not matter that multiple instances of the VM are trying > to read entries out of the same jar file on disk. Yea, it seems the VM issues. Will try the issue on the latest solaris version. If still it fails need to report VM bug. Thanks for your help. (In reply to comment #5) > Yea, it seems the VM issues. Will try the issue on the latest solaris version. > If still it fails need to report VM bug. > > Thanks for your help. Closing as not eclipse for now. If you do report a VM bug, it would be helpful to place the link to the bug report in this equinox bug. Thanks. |
Build Identifier: org.eclipse.osgi_3.6.0.v20100128-1430.jar We are launching multiple VMs(68) based on the versions with some common jars and OSGI is being used for loading the version specific jars. For a particular version while launching these VMs, mostly 2 VMs gets crashed out of 68 VMs. JVM Crash occurs while trying to create the instance of a class which got loaded through OSGI. The issue is reproducible almost always. The exception occurs in the native code. It failed for both the solaris versions mentioned below. Environment: OS -- SunOS 5.10 Generic_141444-09 sun4u sparc SUNW,SPARC-Enterprise, SunOS 5.10 Generic_144488-17 sun4u sparc SUNW,SPARC-Enterprise OSGI version -- org.eclipse.osgi_3.6.0.v20100128-1430.ja JRE -- 1.6.0_24 Memory size: 262144 Megabytes CPUS: ==================================== CPUs ==================================== CPU CPU Run L2$ CPU CPU LSB Chip ID MHz MB Impl. Mask --- ---- ---------------------------------------- ---- --- ----- ---- 00 0 0, 1, 2, 3, 4, 5, 6, 7 2530 5.5 7 161 00 1 8, 9, 10, 11, 12, 13, 14, 15 2530 5.5 7 161 01 0 32, 33, 34, 35, 36, 37, 38, 39 2530 5.5 7 161 01 1 40, 41, 42, 43, 44, 45, 46, 47 2530 5.5 7 161 The error file is attached for this issue. We have to relaunch the VMs to recover from the JVM crash. Here is the file generated upon JVM crash. -------------------------------------------------------------------------------------------------- # # A fatal error has been detected by the Java Runtime Environment: # # SIGBUS (0xa) at pc=0xfe2cd218, pid=21671, tid=76 # # JRE version: 6.0_24-b07 # Java VM: Java HotSpot(TM) Server VM (19.1-b02 mixed mode solaris-sparc ) # Problematic frame: # C [libzip.so+0xd218] # # If you would like to submit a bug report, please visit: # http://java.sun.com/webapps/bugreport/crash.jsp # The crash happened outside the Java Virtual Machine in native code. # See problematic frame for where to report the bug. # --------------- T H R E A D --------------- Current thread (0x0036ac00): JavaThread "pool-1-thread-2" [_thread_in_native, id=76, stack(0xdc800000,0xdc880000)] siginfo:si_signo=SIGBUS: si_errno=Bad address, si_code=3 (BUS_OBJERR), si_addr=0xe0bb8096 Registers: O0=0x02934870 O1=0x00000001 O2=0x000d90fc O3=0xfe56860c O4=0xff3303e8 O5=0xff33a5e0 O6=0xdc87d6a8 O7=0xfe2cd1c4 G1=0x02d05380 G2=0x012e094c G3=0x00000000 G4=0xff1c0000 G5=0x00001580 G6=0x00000000 G7=0xfbde5200 Y=0x00000000 PC=0xfe2cd218 nPC=0xfe2cd260 Register to memory mapping: O0=0x02934870 0x02934870 is pointing to unknown location O1=0x00000001 0x00000001 is pointing to unknown location O2=0x000d90fc 0x000d90fc is pointing to unknown location O3=0xfe56860c 0xfe56860c: JVM_RawMonitorEnter+0x3c in /optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/1.6.0_24/jre/lib/sparc/server/libjvm.so at 0xfe400000 O4=0xff3303e8 0xff3303e8: _GLOBAL_OFFSET_TABLE_+0 in /lib/libc.so.1 at 0xff200000 O5=0xff33a5e0 0xff33a5e0: __nis_debug_rpc+0x4 in /lib/libc.so.1 at 0xff200000 O6=0xdc87d6a8 0xdc87d6a8 is pointing into the stack for thread: 0x0036ac00 "pool-1-thread-2" prio=3 tid=0x0036ac00 nid=0x4c runnable [0xdc87d000] java.lang.Thread.State: RUNNABLE O7=0xfe2cd1c4 0xfe2cd1c4: Java_java_util_zip_ZipFile_getZipMessage+0x59d0 in /optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/1.6.0_24/jre/lib/sparc/libzip.so at 0xfe2c0000 G1=0x02d05380 0x02d05380 is pointing to unknown location G2=0x012e094c 0x012e094c is pointing to unknown location G3=0x00000000 0x00000000 is pointing to unknown location G4=0xff1c0000 0xff1c0000 is pointing to unknown location G5=0x00001580 0x00001580 is pointing to unknown location G6=0x00000000 0x00000000 is pointing to unknown location G7=0xfbde5200 0xfbde5200 is pointing to unknown location Top of Stack: (sp=0xdc87d6a8) 0xdc87d6a8: e0bb6000 00026000 e0bde079 dc87df8c 0xdc87d6b8: dc87df00 dc87de90 00000001 00000000 0xdc87d6c8: 02740600 0045972c 00000000 02934870 0xdc87d6d8: 80808080 e0bb8079 dc87d708 fe2c23a0 0xdc87d6e8: e159dcd0 dc87d908 dc87d780 fe5dd138 0xdc87d6f8: dc87d7e8 000002c4 00000000 00000000 0xdc87d708: 0000002f 233ad607 00000013 0045972c 0xdc87d718: 233ad60e 00459648 000000e4 00000039 Instructions: (pc=0xfe2cd218) 0xfe2cd208: e2 06 20 24 a4 04 00 1d ba 24 80 11 10 80 00 13 0xfe2cd218: e0 0f 60 1d 12 80 00 09 92 10 20 00 90 10 00 18 Stack: [0xdc800000,0xdc880000], sp=0xdc87d6a8, free space=501k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) C [libzip.so+0xd218] C [libzip.so+0x23a8] ZIP_GetEntry+0xe4 C [libzip.so+0x282c] Java_java_util_zip_ZipFile_getEntry+0xc4 J java.util.zip.ZipFile.getEntry(JLjava/lang/String;Z)J J java.util.zip.ZipFile.getEntry(Ljava/lang/String;)Ljava/util/zip/ZipEntry; j org.eclipse.osgi.baseadaptor.bundlefile.ZipBundleFile.getZipEntry(Ljava/lang/String;)Ljava/util/zip/ZipEntry;+28 j org.eclipse.osgi.baseadaptor.bundlefile.ZipBundleFile.getEntry(Ljava/lang/String;)Lorg/eclipse/osgi/baseadaptor/bundlefile/BundleEntry;+11 j org.eclipse.osgi.baseadaptor.loader.ClasspathManager.findClassImpl(Ljava/lang/String;Lorg/eclipse/osgi/baseadaptor/loader/ClasspathEntry;[Lorg/eclipse/osgi/baseadaptor/hooks/ClassLoadingStatsHook;)Ljava/lang/Class;+67 j org.eclipse.osgi.baseadaptor.loader.ClasspathManager.findLocalClassImpl(Ljava/lang/String;[Lorg/eclipse/osgi/baseadaptor/hooks/ClassLoadingStatsHook;)Ljava/lang/Class;+43 j org.eclipse.osgi.baseadaptor.loader.ClasspathManager.findLocalClass_LockClassLoader(Ljava/lang/String;[Lorg/eclipse/osgi/baseadaptor/hooks/ClassLoadingStatsHook;)Ljava/lang/Class;+10 j org.eclipse.osgi.baseadaptor.loader.ClasspathManager.findLocalClass(Ljava/lang/String;)Ljava/lang/Class;+69 j org.eclipse.osgi.internal.baseadaptor.DefaultClassLoader.findLocalClass(Ljava/lang/String;)Ljava/lang/Class;+5 j org.eclipse.osgi.internal.loader.BundleLoader.findLocalClass(Ljava/lang/String;)Ljava/lang/Class;+47 j org.eclipse.osgi.internal.loader.BundleLoader.findClassInternal(Ljava/lang/String;ZLjava/lang/ClassLoader;)Ljava/lang/Class;+183 j org.eclipse.osgi.internal.loader.BundleLoader.findClass(Ljava/lang/String;Z)Ljava/lang/Class;+45 j org.eclipse.osgi.internal.loader.BundleLoader.findClass(Ljava/lang/String;)Ljava/lang/Class;+3 j org.eclipse.osgi.internal.baseadaptor.DefaultClassLoader.loadClass(Ljava/lang/String;Z)Ljava/lang/Class;+47 j java.lang.ClassLoader.loadClass(Ljava/lang/String;)Ljava/lang/Class;+3 v ~StubRoutines::call_stub V [libjvm.so+0x16b1a4] V [libjvm.so+0x52e888] V [libjvm.so+0x52e918] V [libjvm.so+0x187730] V [libjvm.so+0x1524a8] V [libjvm.so+0x162b48] V [libjvm.so+0x83c9a8] V [libjvm.so+0x1fb918] V [libjvm.so+0x1d18dc] C [libjava.so+0xdc5c] Java_java_lang_Class_forName0+0x130 j java.lang.Class.forName0(Ljava/lang/String;ZLjava/lang/ClassLoader;)Ljava/lang/Class;+0 j java.lang.Class.forName0(Ljava/lang/String;ZLjava/lang/ClassLoader;)Ljava/lang/Class;+0 j java.lang.Class.forName(Ljava/lang/String;)Ljava/lang/Class;+5 j com.ciena.ems.server.mediation.Cn54XX.osgi.MediatorOsgiServiceImpl.getMediator(Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;IZLjava/util/Hashtable;)Lcom/ciena/ems/server/mediation/MediatorIntf;+11 j com.ciena.ems.server.mediation.deploymentfw.osgi.OsgiHelper.getMediatorFromService(Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;IZLjava/util/Hashtable;)Lcom/ciena/ems/server/mediation/MediatorIntf;+105 j com.ciena.ems.server.mediation.common.coreDirector.CoreDirectorMediationFactory.createMediator(Ljava/lang/String;Ljava/lang/String;IZLjava/util/Hashtable;)Lcom/ciena/ems/server/mediation/MediatorIntf;+40 j com.ciena.ems.server.mediation.common.coreDirector.CoreDirectorMediationFactory.create(Ljava/lang/String;IZLjava/util/Hashtable;)Lcom/ciena/ems/server/mediation/MediatorIntf;+449 j com.ciena.ems.server.mediation.deploymentfw.mediatorGroup.coredirector.helper.CdVersionFactoryLauncher.launchMediator(Ljava/lang/String;IZLjava/util/Hashtable;)Lcom/ciena/ems/server/mediation/MediatorIntf;+53 j com.ciena.ems.server.mediation.deploymentfw.mediatorGroup.common.switching.SwitchingMediatorLauncher.doStartMediatorProcess(Ljava/util/Hashtable;Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;Z)V+246 j com.ciena.ems.server.mediation.Cn54XX.osgi.MediatorOsgiServiceImpl.setMediatorParams([Ljava/lang/Object;)V+110 j com.ciena.ems.server.mediation.deploymentfw.osgi.OsgiHelper.sendMessageToService(Ljava/lang/String;[Ljava/lang/Object;)V+94 j com.ciena.ems.server.mediation.deploymentfw.mediatorGroup.common.switching.SwitchingMediatorCreatorHelper.create(Lcom/ciena/ems/dataModel/ManageNe;)V+642 j com.ciena.ems.server.mediation.deploymentfw.mediatorGroup.common.switching.SwitchingMediatorCreatorHelper.access$000(Lcom/ciena/ems/server/mediation/deploymentfw/mediatorGroup/common/switching/SwitchingMediatorCreatorHelper;Lcom/ciena/ems/dataModel/ManageNe;)V+2 j com.ciena.ems.server.mediation.deploymentfw.mediatorGroup.common.switching.SwitchingMediatorCreatorHelper$1.run()V+8 j java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Ljava/lang/Runnable;)V+59 j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+28 j java.lang.Thread.run()V+11 v ~StubRoutines::call_stub V [libjvm.so+0x16b1a4] V [libjvm.so+0x52e888] V [libjvm.so+0x1ff2cc] V [libjvm.so+0x212228] V [libjvm.so+0x858bf8] V [libjvm.so+0x77d894] Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) J java.util.zip.ZipFile.getEntry(JLjava/lang/String;Z)J J java.util.zip.ZipFile.getEntry(Ljava/lang/String;)Ljava/util/zip/ZipEntry; j org.eclipse.osgi.baseadaptor.bundlefile.ZipBundleFile.getZipEntry(Ljava/lang/String;)Ljava/util/zip/ZipEntry;+28 j org.eclipse.osgi.baseadaptor.bundlefile.ZipBundleFile.getEntry(Ljava/lang/String;)Lorg/eclipse/osgi/baseadaptor/bundlefile/BundleEntry;+11 j org.eclipse.osgi.baseadaptor.loader.ClasspathManager.findClassImpl(Ljava/lang/String;Lorg/eclipse/osgi/baseadaptor/loader/ClasspathEntry;[Lorg/eclipse/osgi/baseadaptor/hooks/ClassLoadingStatsHook;)Ljava/lang/Class;+67 j org.eclipse.osgi.baseadaptor.loader.ClasspathManager.findLocalClassImpl(Ljava/lang/String;[Lorg/eclipse/osgi/baseadaptor/hooks/ClassLoadingStatsHook;)Ljava/lang/Class;+43 j org.eclipse.osgi.baseadaptor.loader.ClasspathManager.findLocalClass_LockClassLoader(Ljava/lang/String;[Lorg/eclipse/osgi/baseadaptor/hooks/ClassLoadingStatsHook;)Ljava/lang/Class;+10 j org.eclipse.osgi.baseadaptor.loader.ClasspathManager.findLocalClass(Ljava/lang/String;)Ljava/lang/Class;+69 j org.eclipse.osgi.internal.baseadaptor.DefaultClassLoader.findLocalClass(Ljava/lang/String;)Ljava/lang/Class;+5 j org.eclipse.osgi.internal.loader.BundleLoader.findLocalClass(Ljava/lang/String;)Ljava/lang/Class;+47 j org.eclipse.osgi.internal.loader.BundleLoader.findClassInternal(Ljava/lang/String;ZLjava/lang/ClassLoader;)Ljava/lang/Class;+183 j org.eclipse.osgi.internal.loader.BundleLoader.findClass(Ljava/lang/String;Z)Ljava/lang/Class;+45 j org.eclipse.osgi.internal.loader.BundleLoader.findClass(Ljava/lang/String;)Ljava/lang/Class;+3 j org.eclipse.osgi.internal.baseadaptor.DefaultClassLoader.loadClass(Ljava/lang/String;Z)Ljava/lang/Class;+47 j java.lang.ClassLoader.loadClass(Ljava/lang/String;)Ljava/lang/Class;+3 v ~StubRoutines::call_stub j java.lang.Class.forName0(Ljava/lang/String;ZLjava/lang/ClassLoader;)Ljava/lang/Class;+0 j java.lang.Class.forName(Ljava/lang/String;)Ljava/lang/Class;+5 j com.ciena.ems.server.mediation.Cn54XX.osgi.MediatorOsgiServiceImpl.getMediator(Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;IZLjava/util/Hashtable;)Lcom/ciena/ems/server/mediation/MediatorIntf;+11 j com.ciena.ems.server.mediation.deploymentfw.osgi.OsgiHelper.getMediatorFromService(Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;IZLjava/util/Hashtable;)Lcom/ciena/ems/server/mediation/MediatorIntf;+105 j com.ciena.ems.server.mediation.common.coreDirector.CoreDirectorMediationFactory.createMediator(Ljava/lang/String;Ljava/lang/String;IZLjava/util/Hashtable;)Lcom/ciena/ems/server/mediation/MediatorIntf;+40 j com.ciena.ems.server.mediation.common.coreDirector.CoreDirectorMediationFactory.create(Ljava/lang/String;IZLjava/util/Hashtable;)Lcom/ciena/ems/server/mediation/MediatorIntf;+449 j com.ciena.ems.server.mediation.deploymentfw.mediatorGroup.coredirector.helper.CdVersionFactoryLauncher.launchMediator(Ljava/lang/String;IZLjava/util/Hashtable;)Lcom/ciena/ems/server/mediation/MediatorIntf;+53 j com.ciena.ems.server.mediation.deploymentfw.mediatorGroup.common.switching.SwitchingMediatorLauncher.doStartMediatorProcess(Ljava/util/Hashtable;Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;Z)V+246 j com.ciena.ems.server.mediation.Cn54XX.osgi.MediatorOsgiServiceImpl.setMediatorParams([Ljava/lang/Object;)V+110 j com.ciena.ems.server.mediation.deploymentfw.osgi.OsgiHelper.sendMessageToService(Ljava/lang/String;[Ljava/lang/Object;)V+94 j com.ciena.ems.server.mediation.deploymentfw.mediatorGroup.common.switching.SwitchingMediatorCreatorHelper.create(Lcom/ciena/ems/dataModel/ManageNe;)V+642 j com.ciena.ems.server.mediation.deploymentfw.mediatorGroup.common.switching.SwitchingMediatorCreatorHelper.access$000(Lcom/ciena/ems/server/mediation/deploymentfw/mediatorGroup/common/switching/SwitchingMediatorCreatorHelper;Lcom/ciena/ems/dataModel/ManageNe;)V+2 j com.ciena.ems.server.mediation.deploymentfw.mediatorGroup.common.switching.SwitchingMediatorCreatorHelper$1.run()V+8 j java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Ljava/lang/Runnable;)V+59 j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+28 j java.lang.Thread.run()V+11 v ~StubRoutines::call_stub --------------- P R O C E S S --------------- Java Threads: ( => current thread ) 0x02728400 JavaThread "ServerSocketListener" daemon [_thread_in_native, id=85, stack(0xdc200000,0xdc280000)] 0x00434400 JavaThread "RequestController-1" daemon [_thread_blocked, id=84, stack(0xdc300000,0xdc380000)] 0x002cb400 JavaThread "AOMRemoval-1" daemon [_thread_blocked, id=83, stack(0xdc400000,0xdc480000)] 0x0291f800 JavaThread "Cn54xxDiscoveryDispatcher" [_thread_blocked, id=82, stack(0xdc500000,0xdc580000)] 0x0291e000 JavaThread "State Saver" [_thread_blocked, id=81, stack(0xdc600000,0xdc680000)] 0x00427000 JavaThread "pool-1-thread-3" [_thread_blocked, id=77, stack(0xdc700000,0xdc780000)] =>0x0036ac00 JavaThread "pool-1-thread-2" [_thread_in_native, id=76, stack(0xdc800000,0xdc880000)] 0x00368400 JavaThread "pool-1-thread-1" [_thread_blocked, id=75, stack(0xdc900000,0xdc980000)] 0x01503400 JavaThread "Udp_Heartbeat_Thread" [_thread_in_native, id=74, stack(0xdca00000,0xdca80000)] 0x00350800 JavaThread "GenericDispatcher-13305839" [_thread_blocked, id=73, stack(0xdcb00000,0xdcb80000)] 0x00350400 JavaThread "CN54XX Discovery Task Submitter" [_thread_blocked, id=72, stack(0xdcc00000,0xdcc80000)] 0x002ef400 JavaThread "DiscoveryDispatcher" [_thread_blocked, id=71, stack(0xdcd00000,0xdcd80000)] 0x01506c00 JavaThread "weblogic.transaction.TxTimer: '1'" daemon [_thread_blocked, id=70, stack(0xdce00000,0xdce80000)] 0x0296a400 JavaThread "Timer-0" daemon [_thread_blocked, id=69, stack(0xdcf00000,0xdcf80000)] 0x02964400 JavaThread "weblogic.timers.TimerThread" daemon [_thread_blocked, id=68, stack(0xdd000000,0xdd080000)] 0x0029cc00 JavaThread "ExecuteThread: '29' for queue: 'default'" daemon [_thread_in_native, id=67, stack(0xdd100000,0xdd180000)] 0x0029b400 JavaThread "ExecuteThread: '28' for queue: 'default'" daemon [_thread_blocked, id=66, stack(0xdd200000,0xdd280000)] 0x00299c00 JavaThread "ExecuteThread: '27' for queue: 'default'" daemon [_thread_blocked, id=65, stack(0xdd300000,0xdd380000)] 0x00297c00 JavaThread "ExecuteThread: '26' for queue: 'default'" daemon [_thread_blocked, id=64, stack(0xdd400000,0xdd480000)] 0x00293000 JavaThread "ExecuteThread: '25' for queue: 'default'" daemon [_thread_blocked, id=63, stack(0xdd500000,0xdd580000)] 0x00291800 JavaThread "ExecuteThread: '24' for queue: 'default'" daemon [_thread_blocked, id=62, stack(0xdd600000,0xdd680000)] 0x00290000 JavaThread "ExecuteThread: '23' for queue: 'default'" daemon [_thread_blocked, id=61, stack(0xdd700000,0xdd780000)] 0x0028e800 JavaThread "ExecuteThread: '22' for queue: 'default'" daemon [_thread_blocked, id=60, stack(0xdd800000,0xdd880000)] 0x00289c00 JavaThread "ExecuteThread: '21' for queue: 'default'" daemon [_thread_blocked, id=59, stack(0xdd900000,0xdd980000)] 0x00288400 JavaThread "ExecuteThread: '20' for queue: 'default'" daemon [_thread_blocked, id=58, stack(0xdda00000,0xdda80000)] 0x00286c00 JavaThread "ExecuteThread: '19' for queue: 'default'" daemon [_thread_blocked, id=57, stack(0xddb00000,0xddb80000)] 0x01317c00 JavaThread "ExecuteThread: '18' for queue: 'default'" daemon [_thread_blocked, id=56, stack(0xddc00000,0xddc80000)] 0x01313000 JavaThread "ExecuteThread: '17' for queue: 'default'" daemon [_thread_blocked, id=55, stack(0xddd00000,0xddd80000)] 0x01311800 JavaThread "ExecuteThread: '16' for queue: 'default'" daemon [_thread_blocked, id=54, stack(0xdde00000,0xdde80000)] 0x01310000 JavaThread "ExecuteThread: '15' for queue: 'default'" daemon [_thread_blocked, id=53, stack(0xddf00000,0xddf80000)] 0x0130e800 JavaThread "ExecuteThread: '14' for queue: 'default'" daemon [_thread_blocked, id=52, stack(0xde000000,0xde080000)] 0x01309c00 JavaThread "ExecuteThread: '13' for queue: 'default'" daemon [_thread_blocked, id=51, stack(0xde100000,0xde180000)] 0x01308800 JavaThread "ExecuteThread: '12' for queue: 'default'" daemon [_thread_blocked, id=50, stack(0xde200000,0xde280000)] 0x01e49400 JavaThread "ExecuteThread: '11' for queue: 'default'" daemon [_thread_blocked, id=49, stack(0xde300000,0xde380000)] 0x01e47c00 JavaThread "ExecuteThread: '10' for queue: 'default'" daemon [_thread_blocked, id=48, stack(0xde400000,0xde480000)] 0x01e43000 JavaThread "ExecuteThread: '9' for queue: 'default'" daemon [_thread_blocked, id=47, stack(0xde500000,0xde580000)] 0x01e41800 JavaThread "ExecuteThread: '8' for queue: 'default'" daemon [_thread_blocked, id=46, stack(0xde600000,0xde680000)] 0x014fc400 JavaThread "ExecuteThread: '7' for queue: 'default'" daemon [_thread_blocked, id=45, stack(0xde700000,0xde780000)] 0x014fb000 JavaThread "ExecuteThread: '6' for queue: 'default'" daemon [_thread_blocked, id=44, stack(0xde800000,0xde880000)] 0x012ff000 JavaThread "ExecuteThread: '5' for queue: 'default'" daemon [_thread_blocked, id=43, stack(0xde900000,0xde980000)] 0x012fe400 JavaThread "ExecuteThread: '4' for queue: 'default'" daemon [_thread_blocked, id=42, stack(0xdea00000,0xdea80000)] 0x01520800 JavaThread "ExecuteThread: '3' for queue: 'default'" daemon [_thread_blocked, id=41, stack(0xdeb00000,0xdeb80000)] 0x02724c00 JavaThread "ExecuteThread: '2' for queue: 'default'" daemon [_thread_blocked, id=40, stack(0xdec00000,0xdec80000)] 0x009e2800 JavaThread "ExecuteThread: '1' for queue: 'default'" daemon [_thread_blocked, id=39, stack(0xded00000,0xded80000)] 0x00a89c00 JavaThread "ExecuteThread: '0' for queue: 'default'" daemon [_thread_blocked, id=38, stack(0xdee00000,0xdee80000)] 0x0160f400 JavaThread "Framework Event Dispatcher" daemon [_thread_blocked, id=37, stack(0xdef00000,0xdef80000)] 0x006d3c00 JavaThread "Start Level Event Dispatcher" daemon [_thread_blocked, id=36, stack(0xdf000000,0xdf080000)] 0x0068a000 JavaThread "ConsoleSocketGetter" daemon [_thread_in_native, id=35, stack(0xdf100000,0xdf180000)] 0x00389800 JavaThread "MultiFileJavaLogger-MainLogger" daemon [_thread_blocked, id=34, stack(0xdf580000,0xdf600000)] 0x00279000 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=32, stack(0xdf780000,0xdf800000)] 0x00277c00 JavaThread "CompilerThread1" daemon [_thread_blocked, id=31, stack(0xdf880000,0xdf900000)] 0x0026c400 JavaThread "CompilerThread0" daemon [_thread_blocked, id=30, stack(0xdf980000,0xdfa00000)] 0x0026ac00 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=29, stack(0xdfa80000,0xdfb00000)] 0x00257000 JavaThread "Finalizer" daemon [_thread_blocked, id=28, stack(0xdfb80000,0xdfc00000)] 0x00255800 JavaThread "Reference Handler" daemon [_thread_blocked, id=27, stack(0xdfc80000,0xdfd00000)] 0x00035c00 JavaThread "main" [_thread_blocked, id=2, stack(0xfe300000,0xfe380000)] Other Threads: 0x00252400 VMThread [stack: 0xdfd80000,0xdfe00000] [id=26] 0x0027ac00 WatcherThread [stack: 0xdf680000,0xdf700000] [id=33] VM state:not at safepoint (normal execution) VM Mutex/Monitor currently owned by a thread: None Heap PSYoungGen total 26368K, used 17886K [0xf4400000, 0xf6380000, 0xfbc00000) eden space 22528K, 62% used [0xf4400000,0xf51b8020,0xf5a00000) from space 3840K, 99% used [0xf5a80000,0xf5e3f7f0,0xf5e40000) to space 4864K, 0% used [0xf5ec0000,0xf5ec0000,0xf6380000) PSOldGen total 61440K, used 460K [0xe5400000, 0xe9000000, 0xf4400000) object space 61440K, 0% used [0xe5400000,0xe54730a0,0xe9000000) PSPermGen total 16640K, used 16591K [0xe1400000, 0xe2440000, 0xe5400000) object space 16640K, 99% used [0xe1400000,0xe2433e50,0xe2440000) Dynamic libraries: 0x00010000 /optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/1.6.0_24/jre/bin/java 0xff390000 /usr/lib/libthread.so.1 0xff360000 /optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/1.6.0_24/jre/bin/../lib/sparc/jli/libjli.so 0xff340000 /usr/lib/libdl.so.1 0xff200000 /usr/lib/libc.so.1 0xff380000 /platform/SUNW,SPARC-Enterprise/lib/libc_psr.so.1 0xfe400000 /optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/1.6.0_24/jre/lib/sparc/server/libjvm.so 0xff1b0000 /usr/lib/libsocket.so.1 0xff1d0000 /usr/lib/libsched.so.1 0xff190000 /usr/lib/libm.so.1 0xff160000 /usr/lib/libCrun.so.1 0xff140000 /usr/lib/libdoor.so.1 0xff080000 /usr/lib/libnsl.so.1 0xfef80000 /usr/lib/libm.so.2 0xff050000 /usr/lib/libscf.so.1 0xfef60000 /usr/lib/libuutil.so.1 0xfef40000 /usr/lib/libgen.so.1 0xfef10000 /usr/lib/libmd.so.1 0xfeef0000 /usr/lib/libmp.so.2 0xfee60000 /optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/1.6.0_24/jre/lib/sparc/libverify.so 0xfe3c0000 /optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/1.6.0_24/jre/lib/sparc/libjava.so 0xfe3a0000 /optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/1.6.0_24/jre/lib/sparc/native_threads/libhpi.so 0xfe2c0000 /optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/1.6.0_24/jre/lib/sparc/libzip.so 0xfe2a0000 /usr/lib/locale/iso_8859_1/iso_8859_1.so.3 0xfe020000 /optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/1.6.0_24/jre/lib/sparc/libnet.so 0xfbf90000 /optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/1.6.0_24/jre/lib/sparc/libnio.so 0xfbee0000 /usr/lib/librt.so.1 0xfbec0000 /usr/lib/libaio.so.1 0xfbea0000 /usr/lib/libsendfile.so.1 0xe13d0000 /optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/1.6.0_24/jre/lib/sparc/libj2pkcs11.so 0xe1390000 /usr/lib/libpkcs11.so 0xe12e0000 /usr/lib/libcryptoutil.so.1 0xe11a0000 /usr/lib/security/pkcs11_softtoken_extra.so 0xdf940000 /optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/1.6.0_24/jre/lib/sparc/libmanagement.so VM Arguments: jvm_args: -Xms90m -Xmx360m -Xoss200k -XX:HeapDumpPath=/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/logs/mediators -XX:+HeapDumpOnOutOfMemoryError -Dtiming.strategy=MEDIATOR -Dcom.ciena.ems.server.mediator.group.id=cn54xx_63_2_0 -Dems.home=/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/user_projects/domains/oncenter/cienaClasses -Dems.hostname=gax-svtm5000-1 -DEMS_LOG_BASEDIR=/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/logs -Djndi.url=t3://gax-svtm5000-1:7001 -Djava.naming.provider.url=t3://gax-svtm5000-1:7001 -Djava.naming.factory.initial=weblogic.jndi.WLInitialContextFactory -Djacorb.poa.thread_pool_max=45 -Djacorb.poa.thread_pool_min=30 -Dorg.osgi.framework.bootdelegation=* -Dmed.base.path=/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/user_projects/domains/oncenter -Dmed.coc.path=/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc -Dosgi.parentClassloader=app -Djava.nio.channels.spi.SelectorProvider=sun.nio.ch.DevPollSelectorProvider -Djndi.name=cn54xx_63_2_0 -DTrapServerIP=10.90.32.3 -DTrapServerPort=16163 -DUdpServerPort=21671 -Dorg.omg.CORBA.ORBClass=org.jacorb.orb.ORB -Dorg.omg.CORBA.ORBSingletonClass=org.jacorb.orb.ORBSingleton -Djacorb.interop.lax_boolean_encoding=on -Dems.logging=com.ciena.ems.util.JavaLogger -Dems.logging.javalogger.file.size.bytes=10240000 -Dems.logging.javalogger.file.count=30 -Dems.logging.javalogger.file.name.prefix=/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/logs/mediators/cn54xx_63_2_0.21671 -DgroupId=21671 -DdebugLevel=0 -Dems.propertyfilename=/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/user_projects/domains/oncenter/cienaClasses/server/cluster/ems_cluster.properties -Dems.discovery.params=35062 -DsslEnabled=false -DsslPort=7002 -Dweblogic.security.SSL.trustedCAKeyStore=/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/user_projects/domains/oncenter/OCTrustStore -Dbea.home=../.. -Dweblogic.security.SSL.ignoreHostnameVerification=true -Dnet.sourceforge.cobertura.datafile=/opt/cienaTEST/ocTEST/cobertura/cobertura.oc.com.ciena.ems.server.mediation.deploymentfw.mediatorGroup.cn54xx.Cn54xxBootstrapper.ser -Dnet.sourceforge.cobertura.flushfile=/opt/cienaTEST/ocTEST/cobertura/oc.com.ciena.ems.server.mediation.deploymentfw.mediatorGroup.cn54xx.Cn54xxBootstrapper.flush -Dweblogic.ThreadPoolSize=30 java_command: com.ciena.ems.server.mediation.deploymentfw.mediatorGroup.cn54xx.Cn54xxBootstrapper Launcher Type: SUN_STANDARD Environment Variables: JAVA_HOME=/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/jre PATH=/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/jre/bin:/u01/oracle/product/10g/bin:/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/jre/bin:/u01/oracle/product/10g/bin:/optjms/opt/CIENA/ON-Center/OC/OCVersion/CIENAoc/weblogic/server/bin:/optjms/opt/CIENA/ON-Center/OC/OCVersion/CIENAoc/modules/org.apache.ant_1.7.1/bin:/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/1.6.0_24/jre/bin:/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/1.6.0_24/bin:/optjms/opt/CIENA/ON-Center/OC/OCVersion/CIENAoc/weblogic/server/bin:/optjms/opt/CIENA/ON-Center/OC/OCVersion/CIENAoc/modules/org.apache.ant_1.7.1/bin:/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/1.6.0_24/jre/bin:/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/1.6.0_24/bin:/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/jre/bin:/u01/oracle/product/10g/bin:/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/jre/bin:/u01/oracle/product/10g/bin:/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/jre/bin:/u01/oracle/product/10g/bin:/optjms/opt/CIENA/ON-Center/OC/12.0.0/CIENAoc/jre/bin:/u01/oracle/product/10g/bin:/usr/bin:/usr/ucb:/etc:/usr/local/bin:/usr/sbin:/optjms/opt/CIENA/ON-Center/OC/OCVersion/CIENAoc/bin:/usr/openwin/bin:. SHELL=/bin/ksh DISPLAY=localhost:12.0 Signal Handlers: SIGSEGV: [libjvm.so+0x8b1aa0], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c SIGBUS: [libjvm.so+0x8b1aa0], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c SIGFPE: [libjvm.so+0x1d21a4], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c SIGPIPE: [libjvm.so+0x1d21a4], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c SIGXFSZ: [libjvm.so+0x1d21a4], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c SIGILL: [libjvm.so+0x1d21a4], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000 SIGUSR2: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000 SIGQUIT: [libjvm.so+0x78003c], sa_mask[0]=0xffbffeff, sa_flags=0x00000004 SIGHUP: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000 SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000 SIGTERM: [libjvm.so+0x78003c], sa_mask[0]=0xffbffeff, sa_flags=0x00000004 SIG39: [libjvm.so+0x783744], sa_mask[0]=0x00000000, sa_flags=0x00000008 SIG40: [libjvm.so+0x1d21a4], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c --------------- S Y S T E M --------------- OS: Solaris 10 10/09 s10s_u8wos_08a SPARC Copyright 2009 Sun Microsystems, Inc. All Rights Reserved. Use is subject to license terms. Assembled 16 September 2009 uname:SunOS 5.10 Generic_144488-17 sun4u (T2 libthread) rlimit: STACK 8192k, CORE infinity, NOFILE 65536, AS infinity load average:54.03 28.42 13.39 CPU:total 32 has_v8, has_v9, popc, has_vis1, has_vis2, is_ultra3 Memory: 8k page, physical 268435456k(218272064k free) vm_info: Java HotSpot(TM) Server VM (19.1-b02) for solaris-sparc JRE (1.6.0_24-b07), built on Feb 2 2011 17:17:59 by "" with Workshop 5.8 time: Tue Dec 27 21:38:45 2011 elapsed time: 83 seconds Reproducible: Always Steps to Reproduce: Launch the Multiple VMs on solaris with version Generic_144488-17 and in launched VMs, use the OSGI service to create the instance of a Class which got loaded through the OSGI framework.