Author Topic: Qube supe on os x 10.5.8 server keeps incompleting jobs  (Read 8776 times)

westernx

  • Hero Member
  • *****
  • Posts: 55
Qube supe on os x 10.5.8 server keeps incompleting jobs
« on: September 21, 2010, 10:47:01 PM »
Hello,

Keep getting the following in the supe log;

Code: [Select]
>>>> IN: QbQueue::releaseGlobalResource()
>>>> IN: QbQueue::releaseGlobalResource()
>>>> IN: QbQueue::releaseGlobalResource()
>>>> IN: QbQueue::releaseGlobalResource()
>>>> IN: QbQueue::releaseGlobalResource()
>>>> IN: QbQueue::releaseGlobalResource()
>>>> IN: QbQueue::releaseGlobalResource()
>>>> IN: QbQueue::releaseGlobalResource()

over and over again.  Then sometimes I get;

Code: [Select]
supervisor(45436) malloc: *** mmap(size=1785065472) failed (error code=12)
*** error: can't allocate region
*** set a breakpoint in malloc_error_break to debug
terminate called after throwing an instance of 'std::bad_alloc'
  what():  St9bad_alloc
supervisor(45183) malloc: *** mmap(size=1785065472) failed (error code=12)
*** error: can't allocate region
*** set a breakpoint in malloc_error_break to debug
terminate called after throwing an instance of 'std::bad_alloc'
  what():  St9bad_alloc

. . . and some jobs sit at pending when almost complete.

Is this bad RAM?  Have made a bad setting somewhere?
Any help would be appreciated,

Thanks

R
« Last Edit: September 21, 2010, 10:48:59 PM by ryjguy7 »

westernx

  • Hero Member
  • *****
  • Posts: 55
Re: Qube supe on os x 10.5.8 server keeps incompleting jobs
« Reply #1 on: September 21, 2010, 11:06:36 PM »
I have a crash log with the following;

Code: [Select]
Process:         supervisor [76909]
Path:            /Applications/pfx/qube/sbin/supervisor
Identifier:      supervisor
Version:         ??? (???)
Code Type:       X86 (Native)
Parent Process:  supervisor [35996]

Date/Time:       2010-09-21 14:55:14.753 -0700
OS Version:      Mac OS X Server 10.5.8 (9L34)
Report Version:  6
Anonymous UUID:  A61230D2-33A5-49DA-ADEE-3F91CEECC9BF

Exception Type:  EXC_CRASH (SIGABRT)
Exception Codes: 0x0000000000000000, 0x0000000000000000
Crashed Thread:  0

Application Specific Information:
*** single-threaded process forked ***

Thread 0 Crashed:
0   libSystem.B.dylib              0x922fde42 __kill + 10
1   libSystem.B.dylib              0x9237023a raise + 26
2   libSystem.B.dylib              0x9237c679 abort + 73
3   libstdc++.6.dylib              0x90dae005 0x90d66000 + 294917
4   libstdc++.6.dylib              0x90dac10c __gxx_personality_v0 + 1108
5   libstdc++.6.dylib              0x90dac14b std::terminate() + 29
6   libstdc++.6.dylib              0x90dac261 __cxa_throw + 101
7   libstdc++.6.dylib              0x90dac5d8 operator new(unsigned long) + 100
8   libstdc++.6.dylib              0x90dac689 operator new[](unsigned long) + 17
9   supervisor                    0x001f92b8 QbString::_resize(int) + 86 (QbString.cpp:242)
10  supervisor                    0x001f9331 QbString::copy(char const*, int) + 101 (QbString.cpp:229)
11  supervisor                    0x001e32b4 QbPack::restore(short, QbString&) + 236 (QbPack.cpp:563)
12  supervisor                    0x0019bc57 QbLog::decode() + 93 (QbLog.cpp:143)
13  supervisor                    0x001e3470 QbPack::_unpack(char*, int) + 44 (QbPack.cpp:306)
14  supervisor                    0x001e35fe QbPack::restore(short, QbPack&) + 330 (QbPack.cpp:443)
15  supervisor                    0x0015e286 QbReport::decode() + 128 (QbReport.cpp:70)
16  supervisor                    0x001e3470 QbPack::_unpack(char*, int) + 44 (QbPack.cpp:306)
17  supervisor                    0x0017e436 QbMessage::restoreptr(short, QbPack**) + 390 (QbMessage.cpp:85)
18  supervisor                    0x0017b875 QbMessage::decode() + 195 (QbMessage.cpp:251)
19  supervisor                    0x001e3470 QbPack::_unpack(char*, int) + 44 (QbPack.cpp:306)
20  supervisor                    0x001e369b QbPack::unpack(char*, int) + 111 (QbPack.cpp:284)
21  supervisor                    0x00191612 QbDaemon::eventloop(int) + 762 (QbDaemon.cpp:232)
22  supervisor                    0x00194e9f QbPreForkDaemon::forkChild() + 361 (QbPreForkDaemon.cpp:350)
23  supervisor                    0x00195657 QbPreForkDaemon::eventloop(int) + 851 (QbPreForkDaemon.cpp:675)
24  supervisor                    0x000cd362 QbSupervisor::run() + 1074 (QbSupervisor.cpp:356)
25  supervisor                    0x000de1f3 main + 2235 (supervisor_main.cpp:242)
26  supervisor                    0x0000285a _start + 216
27  supervisor                    0x00002781 start + 41

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000  ebx: 0x9237c639  ecx: 0xbfffd0ac  edx: 0x922fde42
  edi: 0xa028f5b8  esi: 0x90dc3128  ebp: 0xbfffd0c8  esp: 0xbfffd0ac
   ss: 0x0000001f  efl: 0x00000282  eip: 0x922fde42   cs: 0x00000007
   ds: 0x0000001f   es: 0x0000001f   fs: 0x00000000   gs: 0x00000037
  cr2: 0xa028f8b0

Binary Images:
    0x1000 -   0x2cffc0 +supervisor ??? (???) /Applications/pfx/qube/sbin/supervisor
 0x1dcf000 -  0x1ee9ff3  libperl.dylib ??? (???) <f149a22f28ea94c69ce6f9a3586b9b06> /System/Library/Perl/lib/5.8/libperl.dylib
 0x1f16000 -  0x1f18fff  libutil.dylib ??? (???) <5ac8a5517aae408d0fdb6da13a2faf89> /usr/lib/libutil.dylib
0x8fe00000 - 0x8fe2db43  dyld 97.1 (???) <458eed38a009e5658a79579e7bc26603> /usr/lib/dyld
0x9036a000 - 0x90388fff  libresolv.9.dylib ??? (???) <0e26b308654f33fc94a0c010a50751f9> /usr/lib/libresolv.9.dylib
0x9039a000 - 0x903c9fe3  com.apple.AE 402.3 (402.3) <dba512e47f68eea1dd0ab35f596edb34> /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/AE.framework/Versions/A/AE
0x90652000 - 0x9092cff3  com.apple.CoreServices.CarbonCore 786.11 (786.14) <d5cceb2fe9551d345d40dd1ecf409ec2> /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/CarbonCore.framework/Versions/A/CarbonCore
0x90c4c000 - 0x90c70fff  libxslt.1.dylib ??? (???) <adfe90a3d564d824d5ae0fa6df8d6c3f> /usr/lib/libxslt.1.dylib
0x90d66000 - 0x90dc3ffb  libstdc++.6.dylib ??? (???) <04b812dcec670daa8b7d2852ab14be60> /usr/lib/libstdc++.6.dylib
0x90dc4000 - 0x90dfbfff  com.apple.SystemConfiguration 1.9.2 (1.9.2) <41d5aeffefc6d19d471f51ae0b15024f> /System/Library/Frameworks/SystemConfiguration.framework/Versions/A/SystemConfiguration
0x90e0b000 - 0x90f44ff7  libicucore.A.dylib ??? (???) <f2819243b278259b9a622ea111ea5fd6> /usr/lib/libicucore.A.dylib
0x91809000 - 0x91890ff7  libsqlite3.0.dylib ??? (???) <aaaf72c093e13f34b96e2688b95bdb4a> /usr/lib/libsqlite3.0.dylib
0x9228f000 - 0x923f6ff3  libSystem.B.dylib ??? (???) <c8f52e158bf540cc000146ca8a705958> /usr/lib/libSystem.B.dylib
0x9248d000 - 0x924b8fe7  libauto.dylib ??? (???) <4f3e58cb81da07a1662c1f647ce30225> /usr/lib/libauto.dylib
0x9283c000 - 0x92a0dff3  com.apple.security 5.0.6 (37592) <5d7ae92f2e52ee7ba5ae658399770602> /System/Library/Frameworks/Security.framework/Versions/A/Security
0x92a1f000 - 0x92a26ffe  libbsm.dylib ??? (???) <d25c63378a5029648ffd4b4669be31bf> /usr/lib/libbsm.dylib
0x92b09000 - 0x92b09ffa  com.apple.CoreServices 32 (32) <2fcc8f3bd5bbfc000b476cad8e6a3dd2> /System/Library/Frameworks/CoreServices.framework/Versions/A/CoreServices
0x92bf4000 - 0x92c73ff5  com.apple.SearchKit 1.2.2 (1.2.2) <3b5f3ab6a363a4d8a2bbbf74213ab0e5> /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/SearchKit.framework/Versions/A/SearchKit
0x92e7f000 - 0x92f60ff7  libxml2.2.dylib ??? (???) <b3bc0b280c36aa17ac477b4da56cd038> /usr/lib/libxml2.2.dylib
0x92f61000 - 0x92faafef  com.apple.Metadata 10.5.8 (398.26) <e4d268ea45379200f03cdc7c8bedae6f> /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/Metadata.framework/Versions/A/Metadata
0x94719000 - 0x9471dfff  libmathCommon.A.dylib ??? (???) /usr/lib/system/libmathCommon.A.dylib
0x94727000 - 0x9473dfff  com.apple.DictionaryServices 1.0.0 (1.0.0) <ad0aa0252e3323d182e17f50defe56fc> /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/DictionaryServices.framework/Versions/A/DictionaryServices
0x947dc000 - 0x947eaffd  libz.1.dylib ??? (???) <5ddd8539ae2ebfd8e7cc1c57525385c7> /usr/lib/libz.1.dylib
0x94839000 - 0x948e0fec  com.apple.CFNetwork 438.14 (438.14) <5f9ee0430b5f6319f18d9b23e777e0d2> /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/CFNetwork.framework/Versions/A/CFNetwork
0x94a5a000 - 0x94b8dfe7  com.apple.CoreFoundation 6.5.7 (476.19) <a332c8f45529ee26d2e9c36d0c723bad> /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
0x95209000 - 0x952e9fff  libobjc.A.dylib ??? (???) <3ca288b625a47bbcfe378158e4dc328f> /usr/lib/libobjc.A.dylib
0x975c3000 - 0x97650ff7  com.apple.framework.IOKit 1.5.2 (???) <7a3cc24f78f93931731203854ae0d891> /System/Library/Frameworks/IOKit.framework/Versions/A/IOKit
0x97651000 - 0x9770cfe3  com.apple.CoreServices.OSServices 228.1 (228.1) <ebdde14b3ea5db5fcacf39fcfda81294> /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/OSServices.framework/Versions/A/OSServices
0x97716000 - 0x9771efff  com.apple.DiskArbitration 2.2.1 (2.2.1) <ba64dd6ada417b5e7be736957f380bca> /System/Library/Frameworks/DiskArbitration.framework/Versions/A/DiskArbitration
0x97df9000 - 0x97e86ff7  com.apple.LaunchServices 292 (292) <a41286c7c1eb20ffd5cc796f791070f0> /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/LaunchServices.framework/Versions/A/LaunchServices
0x97e8a000 - 0x97e91fe9  libgcc_s.1.dylib ??? (???) <f53c808e87d1184c0f9df63aef53ce0b> /usr/lib/libgcc_s.1.dylib
0xfffe8000 - 0xfffebfff  libobjc.A.dylib ??? (???) /usr/lib/libobjc.A.dylib
0xffff0000 - 0xffff1780  libSystem.B.dylib ??? (???) /usr/lib/libSystem.B.dylib

shinya

  • Administrator
  • *****
  • Posts: 232
Re: Qube supe on os x 10.5.8 server keeps incompleting jobs
« Reply #2 on: September 22, 2010, 05:01:38 AM »
Hi there,

I haven't seen this before, so it could be something particular to your site.

Would you be able to send us the supelog from your supervisor machine, as well
as the job log folder from a job that went thru this issue? Please zip and send them
to our support@pipelinefx.com address.  If the zipped files are bigger than a few MBs,
then please upload it to our ftp server, into the /pub/incoming folder, and let us know.

FYI, included below is where to find the supelog/joblog and send it to us.

Please make sure to include a descriptive subject to your email, and also
mention this forum thread (http://www.pipelinefx.com/forum/index.php?topic=946.0) in the body.

Thanks!
-shinya.

----
In order to address your problem more completely, please send us the Supervisor log.

You can locate the log file by logging into your Supervisor, and looking for supelogs in the following folder (depending upon your Supervisor platform):

Windows XP
\Program Files\pfx\qube\logs

Windows 2008 / Vista / Windows 7
\ProgramData\Pfx\Qube\logs\job

Linux, OS X
/var/log

In that folder, you will find a series of supelogs, each numbered for the week of the year.

Zip up the the most current supelog and reply to this email with the zipped file.

Caution: Supelogs can grow very large! If the zipped supelog is larger than 7MB, DO NOT SEND IT as it will delay our ability to respond to your problem.

Instead, excerpt only the parts of the log that correspond to the job ID or day that you observed the problem. Zip up the excerpt and reply to the email message with the smaller file.

----
In order to address your problem more completely, please send us the job log directory for the job in question.

You can locate the directory by logging into your Supervisor, and looking for the job log folder in the following location (depending upon your Supervisor platform):

Windows XP:
-----------------------------------
\Program Files\pfx\qube\logs\job


Windows 2008 / Vista / Window7:
-----------------------------------
\ProgramData\Pfx\Qube\logs\job


Linux, OS X:
-----------------------------------
/var/spool/qube/job

In that folder, you will find a numbered directory that corresponds to the number of thousands in the job ID. (ID < 1000 = 0) Search in one of these folders for the one that corresponds to the correct job ID.

Zip up the entire job ID folder and reply to this email message with the zipped file.

If the zipped job ID folder turns out to be larger than 7MB, don't send it, but let us know and we will help you address the problem in an alternative fashion.