| |
|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
  |
|
| 2087 error, automatic cluster sender channel missing |
« View previous topic :: View next topic » |
| Author |
Message
|
| amit_talpade_star |
 Posted: Thu Sep 01, 2005 7:27 am Post subject: 2087 error, automatic cluster sender channel missing |
 |
|
Apprentice
Joined: 14 Dec 2004
Posts: 39
|
We see a problem with server 1 (WBIMB) replying to a dynamically created queue on another server.
The error seen is:
Node failed to open WebSphere Business Integration queue 'AMQ.4316243520002B08' owned by queue manager 'XXXXXXX': completion code 2; reason code 2087.
On further investigation, saw
AMQ6119: An internal WebSphere MQ error has occurred (Rc=28 from mkdir)
EXPLANATION:
MQ detected an unexpected error when calling the operating system. The MQ error recording routine has been called.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM support
center. Do not discard these files until the problem has been resolve
AMQ9421: Invalid cluster record action code detected
EXPLANATION: An invalid record was read from the SYSTEM.CLUSTER.REPOSITORY.QUEUE. An FFST record has been generated containing the invalid record.
We have an MQ Cluster with two repository queue managers and 4 partial repository queue managers. After this, the second repository queue manager (server 1) does not seem to have the automatic cluster sender channels and is not able to communicate with the partial repositories.
However we see that the messages sent to the clustered queues from the partial repository queue managers reach the local queues on the full repository queue manager.
Can you please advise on how this queue manager can be restored to initial state |
|
| Back to top |
|
 |
| wschutz |
| Posted: Thu Sep 01, 2005 8:58 am Post subject: |
|
|
Jedi Knight
Joined: 02 Jun 2005
Posts: 3316
Location: IBM (retired)
|
i would say that you should understand what the problem is before trying to restore the qmgr, because if you do restore, you might encounter the same problem again. Is there an FFST (*.FDC) file that you can post here?
_________________
-wayne |
|
| Back to top |
|
|
| amit_talpade_star |
| Posted: Thu Sep 01, 2005 9:06 am Post subject: |
|
|
Apprentice
Joined: 14 Dec 2004
Posts: 39
|
Didn't know how to post as an attachment so posted inline
-------------------------------------------------------------------------------
08/31/05 12:27:09
AMQ6119: An internal WebSphere MQ error has occurred (Rc=28 from mkdir)
EXPLANATION:
MQ detected an unexpected error when calling the operating system. The MQ error
recording routine has been called.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM support
center. Do not discard these files until the problem has been resolved.
----- amqxfdcx.c : 686 --------------------------------------------------------
08/31/05 12:27:09
AMQ6184: An internal WebSphere MQ error has occurred on queue manager
STAR_BRK_QM2.
EXPLANATION:
An error has been detected, and the WebSphere MQ error recording routine has
been called. The failing process is process 14423.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM support
center. Do not discard these files until the problem has been resolved.
----- amqxfdcx.c : 720 --------------------------------------------------------
08/31/05 12:27:09
AMQ6125: An internal WebSphere MQ error has occurred.
EXPLANATION:
An internal error has occurred with identifier 20807417. This message is
issued in association with other messages.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM supp08/31/05 12:47:13
AMQ9421: Invalid cluster record action code detected
EXPLANATION:
An invalid record was read from the SYSTEM.CLUSTER.REPOSITORY.QUEUE. An FFST
record has been generated containing the invalid record. was
ACTION:
Collect the items listed in the Problem Determination section of the System
Administration manual and contact your IBM support center.
----- amqxfdcx.c : 686 --------------------------------------------------------
08/31/05 12:47:13
AMQ6184: An internal WebSphere MQ error has occurred on queue manager
STAR_BRK_QM2.
EXPLANATION:
An error has been detected, and the WebSphere MQ error recording routine has
been called. The failing process is process 32168.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM support
center. Do not discard these files until the problem has been resolved.
----- amqxfdcx.c : 720 --------------------------------------------------------
08/31/05 12:47:15
AMQ6119: An internal WebSphere MQ error has occurred ('13 - Permission denied'
from open.)
EXPLANATION:
MQ detected an unexpected error when calling the operating system. The MQ error
recording routine has been called.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM support
center. Do not discard these files until the problem has been resolved.
----- amqxfdcx.c : 686 --------------------------------------------------------
08/31/05 12:47:15
AMQ6183: An internal WebSphere MQ error has occurred.
EXPLANATION:
An error has been detected, and the WebSphere MQ error recording routine has
been called. The failing process is process 32268.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM support
center. Do not discard these files until the problem has been resolved.
----- amqxfdcx.c : 726 --------------------------------------------------------
08/31/05 12:47:16
AMQ6119: An internal WebSphere MQ error has occurred ('13 - Permission denied'
from open.)
EXPLANATION:
MQ detected an unexpected error when calling the operating system. The MQ error
recording routine has been called.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM support
center. Do not discard these files until the problem has been resolved.
----- amqxfdcx.c : 686 --------------------------------------------------------
08/31/05 12:47:16
AMQ6183: An internal WebSphere MQ error has occurred.
EXPLANATION:
An error has been detected, and the WebSphere MQ error recording routine has
been called. The failing process is process 32284.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM support
center. Do not discard these files until the problem has been resolved.
----- amqxfdcx.c : 726 --------------------------------------------------------
08/31/05 12:47:21
AMQ6119: An internal WebSphere MQ error has occurred ('13 - Permission denied'
from open.)
EXPLANATION:
MQ detected an unexpected error when calling the operating system. The MQ error
recording routine has been called.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM support
center. Do not discard these files until the problem has been resolved.
----- amqxfdcx.c : 686 --------------------------------------------------------
08/31/05 12:47:21
AMQ6183: An internal WebSphere MQ error has occurred.
EXPLANATION:
An error has been detected, and the WebSphere MQ error recording routine has
been called. The failing process is process 32438.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM support
center. Do not discard these files until the problem has been resolved.
----- amqxfdcx.c : 726 --------------------------------------------------------
08/31/05 12:47:21
AMQ6119: An internal WebSphere MQ error has occurred ('13 - Permission denied'
from open.)
EXPLANATION:
MQ detected an unexpected error when calling the operating system. The MQ error
recording routine has been called.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM support
center. Do not discard these files until the problem has been resolved.
----- amqxfdcx.c : 686 --------------------------------------------------------
08/31/05 12:47:21
AMQ6183: An internal WebSphere MQ error has occurred.
EXPLANATION:
An error has been detected, and the WebSphere MQ error recording routine has
been called. The failing process is process 32439.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM support
center. Do not discard these files until the problem has been resolved.
----- amqxfdcx.c : 726 --------------------------------------------------------
08/31/05 12:47:25
AMQ6119: An internal WebSphere MQ error has occurred ('13 - Permission denied'
from open.)
EXPLANATION:
MQ detected an unexpected error when calling the operating system. The MQ error
recording routine has been called.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM support
center. Do not discard these files until the problem has been resolved.
----- amqxfdcx.c : 686 --------------------------------------------------------
08/31/05 12:47:25
AMQ6183: An internal WebSphere MQ error has occurred.
EXPLANATION:
An error has been detected, and the WebSphere MQ error recording routine has
been called. The failing process is process 32440.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM support
center. Do not discard these files until the problem has been resolved.
----- amqxfdcx.c : 726 --------------------------------------------------------
+-----------------------------------------------------------------------------+
| |
| WebSphere MQ First Failure Symptom Report |
| ========================================= |
| |
| Date/Time :- Wednesday August 31 12:47:13 UTC 2005 |
| Host Name :- shswmb02 (Linux 2.4.21-138-smp) |
| PIDS :- 5724B4104 |
| LVLS :- 530.8 CSD08 |
| Product Long Name :- WebSphere MQ for Linux for Intel |
| Vendor :- IBM |
| Probe Id :- ZX054034 |
| Application Name :- MQM |
| Component :- zxcRestoreObject |
| Build Date :- Sep 21 2004 |
| CMVC level :- p530-08-L040921 |
| Build Type :- IKAP - (Production) |
| UserID :- 00000510 (mqsi) |
| Program Name :- amqzxma0 |
| Thread-Process :- 00032168 |
| Thread :- 00000001 |
| QueueManager :- STAR_BRK_QM2 |
| ThreadingModel :- LinuxThreads |
| LD_ASSUME_KERNEL :- 2.4.19 |
| Major Errorcode :- rrcE_INVALID_ACTION_CODE |
| Minor Errorcode :- OK |
| Probe Type :- MSGAMQ9421 |
| Probe Severity :- 2 |
| Probe Description :- AMQ9421: Invalid cluster record action code detected |
| FDCSequenceNumber :- 0 |
| |
+-----------------------------------------------------------------------------+
MQM Function Stack
zxcPostInitialiseSetup
zxcCreateRepositoryCache
zxcRestoreCache
zxcRestoreObject
xcsFFST
MQM Trace History
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxSETLINK
-----} rfxSETLINK rc=OK
-----{ rfxSETLINK
-----} rfxSETLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxLINK
-----} rfxLINK rc=OK
-----{ rfxSETLINK
-----} rfxSETLINK rc=OK
-----{ rfxSETLINK
-----} rfxSETLINK rc=OK
-----{ xcsReleaseMutexSem
-----} xcsReleaseMutexSem rc=OK
----} rfxAddCLQMGR rc=OK
----{ xcsFreeMem
----} xcsFreeMem rc=OK
---} zxcRestoreObject rc=OK
---{ zxcRestoreObject
----{ xcsBuildDumpPtr
-----{ xcsGetMem
-----} xcsGetMem rc=OK
----} xcsBuildDumpPtr rc=OK
----{ xcsFFST
Invalid action code
0x8088490 00000000 00000000 00000000 00000000 ................
0x80884a0 to 0x8088540 suppressed, 11 lines same as above
0x8088550 00000000 00000000 ........
Process Control Block
0x403300e0 58494850 3C280000 A87D0000 06000000 XIHP<(...}......
0x403300f0 E8F50608 18F70708 00000000 00000000 ................
0x40330100 00000000 00000000 00000000 00000000 ................
0x40330110 to 0x40330120 suppressed, 2 lines same as above
0x40330130 00000000 01000000 00000000 00000000 ................
0x40330140 00000000 00000000 00000000 00000000 ................
0x40330150 to 0x40330190 suppressed, 5 lines same as above
0x403301a0 00000000 00000000 00000000 01000000 ................
0x403301b0 00000E00 00000000 00204F40 2F766172 ......... O@/var
0x403301c0 2F6D716D 2F747261 63652F41 4D513332 /mqm/trace/AMQ32
0x403301d0 3136382E 54524300 00000000 00000000 168.TRC.........
0x403301e0 00000000 00000000 00000000 00000000 ................
0x403301f0 to 0x403311a0 suppressed, 252 lines same as above
0x403311b0 00000000 00000000 00000000 05000000 ................
0x403311c0 FFFF7C00 80902029 00000000 00000000 ..|... )........
0x403311d0 01000000 01000000 00000000 00000000 ................
0x403311e0 504F2340 00000000 00000000 00000000 PO#@............
0x403311f0 00000000 00000000 00000000 00000000 ................
0x40331200 to 0x40331250 suppressed, 6 lines same as above
0x40331260 00000000 04000000 00000000 504F2340 ............PO#@
0x40331270 00000000 00000000 00000000 00000000 ................
0x40331280 to 0x403312e0 suppressed, 7 lines same as above
0x403312f0 04000000 00000000 504F2340 00000000 ........PO#@....
0x40331300 00000000 00000000 00000000 00000000 ................
0x40331310 to 0x40331360 suppressed, 6 lines same as above
0x40331370 00000000 00000000 00000000 04000000 ................
0x40331380 00000000 00000000 00000000 00000000 ................
0x40331390 to 0x40331400 suppressed, 8 lines same as above
0x40331410 504F2340 00000000 00000000 00000000 PO#@............
0x40331420 00000000 00000000 00000000 00000000 ................
0x40331430 to 0x40331480 suppressed, 6 lines same as above
0x40331490 00000000 04000000 00000000 504F2340 ............PO#@
0x403314a0 00000000 00000000 00000000 00000000 ................
0x403314b0 to 0x40331510 suppressed, 7 lines same as above
0x40331520 04000000 00000000 00000000 01000000 ................
0x40331530 00000000 00000000 00000000 00000000 ................
0x40331540 to 0x403315a0 suppressed, 7 lines same as above
0x403315b0 00000000 00000000 00000004 C87D5340 .............}S@
0x403315c0 00000000 00000000 00000000 00000000 ................
0x403315d0 to 0x403316c0 suppressed, 16 lines same as above
0x403316d0 00000004 C87D5340 00000000 00000000 .....}S@........
0x403316e0 00000000 00000000 00000000 00000000 ................
0x403316f0 to 0x403317d0 suppressed, 15 lines same as above
0x403317e0 00000000 00000000 00000004 C87D5340 .............}S@
0x403317f0 00000000 00000000 00000000 00000000 ................
0x40331800 to 0x40331860 suppressed, 7 lines same as above
0x40331870 00000000 00000004 C87D5340 04000000 .........}S@....
0x40331880 A8290708 00000000 01000000 A0080708 .)..............
0x40331890 00000000 00000000 00000000 00000000 ................
0x403318a0 00000000 00000000 01000000 01000000 ................
0x403318b0 00000000 00000000 00000000 00000000 ................
0x403318c0 00000000 00000000 00000000 00000000 ................
0x403318d0 00000000 C0F50608 656E5F55 53000000 ........en_US...
0x403318e0 00000000 00000000 00000000 00000000 ................
0x403318f0 to 0x40332900 suppressed, 258 lines same as above
0x40332910 00000000 00000000 00000000 ............
Common Services Control Block
0x8074b30 58494820 AC200000 01000000 06000000 XIH . ..........
0x8074b40 00000000 00000000 00000000 6D717369 ............mqsi
0x8074b50 00780000 0A030000 33030000 00000000 .x......3.......
0x8074b60 00000000 488C0708 602E0708 282F0708 ....H...`...(/..
0x8074b70 F82D0708 00000000 09800F00 2F766172 .-........../var
0x8074b80 2F6D716D 00000000 00000000 00000000 /mqm............
0x8074b90 00000000 00000000 00000000 00000000 ................
0x8074ba0 to 0x8076b90 suppressed, 512 lines same as above
0x8076ba0 00000000 00000000 78E60708 F06B0708 ........x....k..
0x8076bb0 68160808 00000000 00000000 00000000 h...............
0x8076bc0 00000000 00000000 00000000 00000000 ................
0x8076bd0 00000000 00000000 488C0708 ........H...
Thread Control Block
0x806f5e0 58494854 5C0F0000 XIHT\...
0x806f5f0 01000000 00000000 00000000 00000000 ................
0x806f600 C8080708 00000000 00000000 00000000 ................
0x806f610 00000000 00000000 00000000 01000000 ................
0x806f620 03000000 01000000 00000000 C8D03240 ..............2@
0x806f630 0C000000 707DFFBF 887BFFBF 607BFFBF ....p}...{..`{..
0x806f640 25782940 00000000 00000000 00000000 %x)@............
0x806f650 00000000 00000000 00000000 00000000 ................
0x806f660 to 0x806f6b0 suppressed, 6 lines same as above
0x806f6c0 00000000 00000000 D8CF0608 00000000 ................
0x806f6d0 00000000 18E2FFBF 10BFFFBF 71BD0408 ............q...
0x806f6e0 00000000 00000000 00000000 00000000 ................
0x806f6f0 to 0x806f750 suppressed, 7 lines same as above
0x806f760 00000000 C8D03240 88FEEB40 05804747 ......2@...@..GG
0x806f770 787BFFBF 9069FFBF 3C942440 00000000 x{...i..<.$@....
0x806f780 A87D0000 01000000 0B000000 15000000 .}..............
0x806f790 2E552940 E0003340 1D000000 0B000000 .U)@..3@........
0x806f7a0 C8D03240 1D000000 17000000 387CFFBF ..2@........8|..
0x806f7b0 46912440 E8F50608 00000000 387CFFBF F.$@........8|..
0x806f7c0 D8962440 69000000 00000000 00000000 ..$@i...........
0x806f7d0 00000000 00000000 00000000 00000000 ................
0x806f7e0 006C6140 00000000 01000000 00000000 .la@............
0x806f7f0 00000000 01000000 00007830 00000000 ..........x0....
0x806f800 C8D03240 883E6640 03804647 C881FFBF ..2@.>f@..FG....
0x806f810 E06FFFBF 3C942440 00000000 00000000 .o..<.$@........
0x806f820 01000000 9D882B40 0871FFBF 02000000 ......+@.q......
0x806f830 06000000 0477FFBF B875FFBF C4882B40 .....w...u....+@
0x806f840 4E000000 FFFFFFFF 00000000 00000000 N...............
0x806f850 17FAB1FF FEFFFFFF 00000000 00000000 ................
0x806f860 00000000 00000000 00000000 00000000 ................
0x806f870 00000000 00000000 00000000 00000000 ................
0x806f880 00000000 00000000 00000000 0E8C5740 ..............W@
0x806f890 00000000 00000000 00000000 00000000 ................
0x806f8a0 to 0x806fc30 suppressed, 58 lines same as above
0x806fc40 00000000 14000000 20000000 20000000 ........ ... ...
0x806fc50 00000000 00000000 00000000 00000000 ................
0x806fc60 00000000 00000000 00000000 00000000 ................
0x806fc70 00000000 00000000 01000000 00000000 ................
0x806fc80 00000000 00000000 00000000 00000000 ................
0x806fc90 D1A61543 02000020 00040000 00000000 ...C... ........
0x806fca0 00000000 00000000 00000000 17FAB1FF ................
0x806fcb0 FEFFFFFF 00000000 00000000 00000000 ................
0x806fcc0 00000000 00000000 00000000 00000000 ................
0x806fcd0 to 0x806fd10 suppressed, 5 lines same as above
0x806fd20 00000000 00000000 00000000 01000000 ................
0x806fd30 00000000 7CFFEB40 7C3F6640 7C2F7341 ....|..@|?f@|/sA
0x806fd40 00000000 00000000 00000000 00000000 ................
0x806fd50 to 0x806fd60 suppressed, 2 lines same as above
0x806fd70 D1A61543 E42A0500 A87D0000 00000000 ...C.*...}......
0x806fd80 00000000 00000000 00000000 00000000 ................
0x806fd90 00000000 00000000 04000000 00000000 ................
0x806fda0 00000000 800A2D40 78E60708 F06B0708 ......-@x....k..
0x806fdb0 68160808 00000000 00000000 00000000 h...............
0x806fdc0 01000000 02000000 01000000 00000000 ................
0x806fdd0 00000000 00000000 00000000 00000000 ................
0x806fde0 01000000 00000000 E4D60700 02000000 ................
0x806fdf0 00000000 E4D60700 03000000 00000000 ................
0x806fe00 E4D60700 00000000 00000000 00000000 ................
0x806fe10 00000000 00000000 00000000 00000000 ................
0x806fe20 E496F340 E4D66D40 E4C67A41 00000000 ...@..m@..zA....
0x806fe30 00000000 00000000 02000000 02000000 ................
0x806fe40 02000000 00000000 00000000 00000000 ................
0x806fe50 00000000 00000000 00000000 00000000 ................
0x806fe60 00000000 00000000 78320808 10300808 ........x2...0..
0x806fe70 20340708 00000000 00000000 FFFFFFFF 4..............
0x806fe80 FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF ................
0x806fe90 FFFFFFFF 00000000 00000000 00000000 ................
0x806fea0 00000000 00000000 00000000 00000000 ................
0x806feb0 to 0x806fed0 suppressed, 3 lines same as above
0x806fee0 00000000 00000000 00000000 53544152 ............STAR
0x806fef0 5F42524B 5F514D32 00000000 00000000 _BRK_QM2........
0x806ff00 00000000 00000000 00000000 00000000 ................
0x806ff10 to 0x806ff40 suppressed, 4 lines same as above
0x806ff50 53544152 5F42524B 5F514D32 00000000 STAR_BRK_QM2....
0x806ff60 00000000 00000000 00000000 00000000 ................
0x806ff70 to 0x806ffa0 suppressed, 4 lines same as above
0x806ffb0 00000000 98CC0908 00000000 00000000 ................
0x806ffc0 00000000 00000000 00000000 00000000 ................
0x806ffd0 to 0x806fff0 suppressed, 3 lines same as above
0x8070000 00000000 00000000 2A8800F0 318800F0 ........*...1...
0x8070010 338800F0 368800F0 035C00F0 155C00F0 3...6....\...\..
0x8070020 175C00F0 065C00F0 175C00F0 2F5D00F0 .\...\...\../]..
0x8070030 695D00F0 1D5C00F0 236000F0 B35C00F0 i]...\..#`...\..
0x8070040 1E0400F0 1E0400F0 1C0400F0 055C00F0 .............\..
0x8070050 00000000 00000000 00000000 00000000 ................
0x8070060 to 0x80700c0 suppressed, 7 lines same as above
0x80700d0 9D510000 9D5100F0 9D510000 9D5100F0 .Q...Q...Q...Q..
0x80700e0 to 0x8070130 suppressed, 6 lines same as above
0x8070140 9D510000 9D5100F0 9D510000 9E5100F0 .Q...Q...Q...Q..
0x8070150 9E510000 9E5100F0 9E510000 9D5100F0 .Q...Q...Q...Q..
0x8070160 9D510000 9D5100F0 9D510000 9D5100F0 .Q...Q...Q...Q..
0x8070170 to 0x8070180 suppressed, 2 lines same as above
0x8070190 9D510000 9E5100F0 9E510000 9E5100F0 .Q...Q...Q...Q..
0x80701a0 9E510000 1C5C00F0 1C5C0000 01510000 .Q...\...\...Q..
0x80701b0 065C00F0 065C0000 36880000 368800F0 .\...\..6...6...
0x80701c0 025C00F0 055C00F0 055C0000 025C0000 .\...\...\...\..
0x80701d0 035C00F0 B36000F0 B3600000 7D5D00F0 .\...`...`..}]..
0x80701e0 595D00F0 595D0000 165C00F0 055C00F0 Y]..Y]...\...\..
0x80701f0 055C0000 4C5C00F0 2B5C00F0 2B5C0000 .\..L\..+\..+\..
0x8070200 175C00F0 175C0000 4C5C0000 735C00F0 .\...\..L\..s\..
0x8070210 F66000F0 F6600000 735C0000 B36000F0 .`...`..s\...`..
0x8070220 B3600000 4C5C00F0 2B5C00F0 2B5C0000 .`..L\..+\..+\..
0x8070230 175C00F0 175C0000 4C5C0000 4C5C00F0 .\...\..L\..L\..
0x8070240 2B5C00F0 2B5C0000 175C00F0 175C0000 +\..+\...\...\..
0x8070250 4C5C0000 B46000F0 B4600000 065C00F0 L\...`...`...\..
0x8070260 065C0000 165C0000 7D5D0000 7D5D00F0 .\...\..}]..}]..
0x8070270 595D00F0 595D0000 165C00F0 055C00F0 Y]..Y]...\...\..
0x8070280 055C0000 4C5C00F0 2B5C00F0 2B5C0000 .\..L\..+\..+\..
0x8070290 175C00F0 175C0000 4C5C0000 735C00F0 .\...\..L\..s\..
0x80702a0 F66000F0 F6600000 735C0000 B36000F0 .`...`..s\...`..
0x80702b0 B3600000 4C5C00F0 2B5C00F0 2B5C0000 .`..L\..+\..+\..
0x80702c0 175C00F0 175C0000 4C5C0000 4C5C00F0 .\...\..L\..L\..
0x80702d0 2B5C00F0 2B5C0000 175C00F0 175C0000 +\..+\...\...\..
0x80702e0 4C5C0000 B46000F0 B4600000 065C00F0 L\...`...`...\..
0x80702f0 065C0000 165C0000 7D5D0000 4C5C00F0 .\...\..}]..L\..
0x8070300 2B5C00F0 2B5C0000 175C00F0 175C0000 +\..+\...\...\..
0x8070310 4C5C0000 055C00F0 055C0000 F66000F0 L\...\...\...`..
0x8070320 F6600000 135C00F0 135C0000 135C00F0 .`...\...\...\..
0x8070330 135C0000 135C00F0 135C0000 135C00F0 .\...\...\...\..
0x8070340 135C0000 135C00F0 135C0000 025C00F0 .\...\...\...\..
0x8070350 025C0000 025C00F0 025C0000 025C00F0 .\...\...\...\..
0x8070360 025C0000 155C00F0 155C0000 155C00F0 .\...\...\...\..
0x8070370 155C0000 155C00F0 155C0000 155C00F0 .\...\...\...\..
0x8070380 155C0000 9D5100F0 9D510000 9D5100F0 .\...Q...Q...Q..
0x8070390 9D510000 9D5100F0 9D510000 9D5100F0 .Q...Q...Q...Q..
0x80703a0 to 0x80704a0 suppressed, 17 lines same as above
0x80704b0 9D510000 9D5100F0 01000000 01000000 .Q...Q..........
0x80704c0 01000000 AD000000 19000000 00000000 ................
0x80704d0 1800F600 00000000 907C0708 00000000 .........|......
0x80704e0 00000000 00000000 00000000 E8300808 .............0..
0x80704f0 D0AE2D43 88330808 D0370808 00000000 ..-C.3...7......
0x8070500 00000000 01000000 10910740 01000000 ...........@....
0x8070510 205A3B40 00000000 00000000 01000000 Z;@............
0x8070520 30321540 01000000 301B1040 00000000 02.@....0..@....
0x8070530 00000000 00000000 00000000 00000000 ................
0x8070540 00000000 ....
Component Dumps (Thread 00000001)
----------< K "Kernel" >----------
KAB
{
ConnectionId: 00000001 00000001
Options: 1
TickleHash: 0
}
Conn.ConnectionId: 00000001 00000000
Conn.ApplPid: 0
Conn.ApplTid: 0
Conn.PrivilegeOptions: 1
Conn.MaxMsgLength: 104857600
Conn.ApplName:
Conn.ApplType: 6
Conn.UserContext.UserId
-----< AO "Object Catalogue" >-----
SessionAnchor
{
Flags: 0X20F
Location: /var/mqm/qmgrs/STAR_BRK_QM2
ObjCatRecoveryFlags: NONE
OCCB.StrucId AOCB
hmtxObjCat.RequestCount 8
hmtxObjCatX.RequestCount 5
hmtxObjCatX.WaitCount 1
hmtxObjCatX.DepthHWM 1
LogFileBytes: 4194304
ATM.StartedFlag: 0X1
ATM.NextTranNum: 0.2
ATM.RMidGenerator: 3
ATM.LowLSN: 0.1.52038.55439
ATM.HighLSN: 0.1.52038.55651
ATM.CRecLSN: 0.0.0.0
ATM.CRecFlags: NONE
ATM.TRecFlags: NONE
NONE
hmtxTranTable.RequestCount 13
}
alipGData
{
ALM.Flags: HLGSTARTED
ALM.ChkPtOwner 32184
ALM.ChkPtOpCount 50
ALM.ChkPtOpMax 10000
ALM.ChkPtOpMin 100
ALM.ChkPtByteCount 1352
ALM.ChkPtByteLimit 37748736
ALM.ChkPtCompleteIndex 1
ALM.CrashRecRestartLSN 0.1.52038.52337
}
aiiThread->StructID: "AIIT"
AgentFlags: 7
apipThread
{
LockFlags 0
QLockCount 0
ThreadFlags 0
atm.pLDatatm.pLData
{
RMState : 0X1FFFFFFF
RMid : 2
Association : 0
TranDataState : 0
}
}
Currently attached object: SYSTEM.CLUSTER.REPOSITORY.QUEUE 0
Currently attached object type: QLOCAL
Attributes
{
MaxQDepth 999999999
ProcessName
MaxMsgLength 4194304
BackoutThreshold 0
Shareability MQQA_SHAREABLE
DefInputOpenOption MQOO_INPUT_SHARED
HardenGetBackout MQQA_BACKOUT_HARDENED
MsgDeliverySequence MQMDS_PRIORITY
RetentionInterval 999999999
DefinitionType MQQDT_PREDEFINED
Usage MQUS_NORMAL
OpenInputCount 0
OpenOutputCount 0
CurrentQDepth 2
CreationDate 2005-06-23
CreationTime 10.26.39
InitiationQName
TriggerControl MQTC_OFF
TriggerType MQTT_FIRST
TriggerDepth 1
TriggerData
QDepthHiLimit 80
QDepthLoLimit 20
QDepthMaxEvent MQEVR_ENABLED
QDepthHiEvent MQEVR_DISABLED
QDepthLoEvent MQEVR_DISABLED
QServiceInterval 999999999
QServiceIntervalEvent MQQSIE_NONE
DistListSupport MQDL_NOT_SUPPORTED
NonPersMessageClass FALSE
Internal.InDoubtActions 0
Internal.TriggerDepth 2
Internal.TotalEnqueues 0
Internal.TotalDequeues 0
Internal.HighWaterDepth 2
Internal.ResetDateTime 262.-1
Internal.QAvoidCount 0
hmtx.RequestCount 5
}
LiveQ
{
OpenCount 1
ChangeCount 0
Deleted FALSE
InputOpenOption NONE
OpenBrowseCount 1
DeleteOnLastClose FALSE
MessagesLoaded TRUE
WaiterStatus OK
BrowseWaitCount 0
SpecWaiterCount 0
GenlWaiterCount 0
WaiterFlags NONE
DeferredPostCount 0
TickleCount 0
WaitCount 0
DispatchedEarly 0
AsyncToChild 0
AbandonedChild 0
WaitingPutCount 0
AbandonedWaitingPuts 0
}
aqi.pLData.Init 1
aqi.pLData.InTran 0
aqi.pLData.Logged 0
-----< H "Logger" >-----
Global Data
{
InitCount: 2
StateFlags: 1
LogThresholdPercentage: 80
LogThreshold: 66747200
LogPacePercentage: 90
LogPacePerFile: 3754530
LogPaceTotal: 75090600
hmtxObjCatX.RequestCount: 6
}
dbcb
{
logstate: 0
partialFlags: 2
tailPingPongCount: 5
NextAppendBuf: 5
logBufSz; 64
softmax: 100
logprimary: 10
logsecond: 10
commitCnt: 0
LastBufferLsn: 0.0.0.0
lastdisklsn: 0.1.52038.56334
LastRecLsn: 0.1.52038.56334
TailIndex: 0
TailPage: 109
TotalLogSpace: 16699410
LogBytesInUse: 448031
LogBytesInUseHWM: 16699410
LogReserveCushion 835174
logFull: FALSE
NextFormatExtNum: 0
DeletePendingLow: 0
DeletePendingHigh: 0
currentIOLsn: 0.1.52038.56334
WriteToLsn: 0.1.52038.56334
totalIOCount[1]: 5
mqlp_dbcb_sem.RequestCount: 82
LastDiskLsnSem.RequestCount: 41
IOTaskSem.RequestCount: 8
ReadBufSem.RequestCount: 7
AppendSem.RequestCount: 14
transsem.RequestCount: 5
BufSem[0].RequestCount: 7
BufSem[1].RequestCount: 4
BufSem[2].RequestCount: 4
BufSem[3].RequestCount: 4
BufSem[4].RequestCount: 7
BufSem[5].RequestCount: 3
}
-------< R "Remote - LQM" >-------
InSignalHandler:0
HighDetail: 0
ThreadState: 0
Component: 34
Function: 54
Work Control Block
0x80837d0 5257524B 00000000 00000000 00000000 RWRK............
0x80837e0 00000000 00000000 E8F50608 20202020 ............
0x80837f0 20202020 20202020 20202020 20202020
0x8083800 20202020 20202020 20202020 20202020
0x8083810 20202020 20202020 20202020 00000000 ....
0x8083820 00000000 00000000 00000000 00000000 ................
0x8083830 to 0x8083c40 suppressed, 66 lines same as above
0x8083c50 00000000 00000000 00000000 FFFFFFFF ................
0x8083c60 04000000 00000000 00000000 00000000 ................
0x8083c70 00000000 00000000 00000000 00000000 ................
0x8083c80 00000000 00000000 FFFFFFFF FFFFFFFF ................
0x8083c90 FFFFFFFF FFFFFFFF 00000000 FFFFFFFF ................
0x8083ca0 01000000 FFFFFFFF FFFFFFFF FFFFFFFF ................
0x8083cb0 FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF ................
0x8083cc0 to 0x8083cd0 suppressed, 2 lines same as above
0x8083ce0 00000000 00000000 00000000 00000000 ................
0x8083cf0 01000000 00000000 00000000 00000000 ................
0x8083d00 00000000 00000000 00000000 00000000 ................
0x8083d10 to 0x8083da0 suppressed, 10 lines same as above
0x8083db0 00000000 00000000 ........
-------------------------------------
+-----------------------------------------------------------------------------+
| |
| WebSphere MQ First Failure Symptom Report |
| ========================================= |
| |
| Date/Time :- Wednesday August 31 12:47:21 UTC 2005 |
| Host Name :- shswmb02 (Linux 2.4.21-138-smp) |
| PIDS :- 5724B4104 |
| LVLS :- 530.8 CSD08 |
| Product Long Name :- WebSphere MQ for Linux for Intel |
| Vendor :- IBM |
| Probe Id :- XY082050 |
| Application Name :- MQM |
| Component :- xtrOpenTraceFile |
| Build Date :- Sep 21 2004 |
| CMVC level :- p530-08-L040921 |
| Build Type :- IKAP - (Production) |
| UserID :- 00000801 (contact admin) |
| Program Name :- nsqpub |
| Thread-Process :- 00032439 |
| Major Errorcode :- xecF_E_UNEXPECTED_SYSTEM_RC |
| Minor Errorcode :- OK |
| Probe Type :- MSGAMQ6119 |
| Probe Severity :- 2 |
| Probe Description :- AMQ6119: An internal WebSphere MQ error has occurred |
| ('13 - Permission denied' from open.) |
| FDCSequenceNumber :- 0 |
| Arith1 :- 13 d |
| Comment1 :- '13 - Permission denied' from open. |
| |
| |
+-----------------------------------------------------------------------------+
MQM Function Stack
zstMQConnect
xcsFFST
MQM Trace History
{ xppInitialiseDestructorRegistrations
} xppInitialiseDestructorRegistrations rc=OK
{ InitProcessInitialisation
{ xcsLoadFunction
-{ xcsQueryValueForSubpool
-} xcsQueryValueForSubpool rc=OK
} xcsLoadFunction rc=OK
} InitProcessInitialisation rc=OK
} xcsInitialize rc=OK
{ zstMQConnect
{ zutBlankPad
} zutBlankPad rc=OK
{ zutIsItBlank
} zutIsItBlank rc=OK
{ zutCheckQMName
{ zutCheckValidName
} zutCheckValidName rc=OK
} zutCheckQMName rc=OK
{ zutCvtMQName2Str
} zutCvtMQName2Str rc=OK
{ zstGetPCDbyTID
} zstGetPCDbyTID rc=OK
{ zstInitCS
{ xcsInitialize
-{ InitPrivateServices
--{ xcsGetpwuid
--} xcsGetpwuid rc=OK
-} InitPrivateServices rc=OK
-{ xcsConnectSharedSubpool
--{ xcsAttachSharedSubpool
---{ xcsGetMem
---} xcsGetMem rc=OK
---{ xcsGetMem
---} xcsGetMem rc=OK
---{ xcsConnectSharedMemSet
----{ xstAttachSharedMemSet
-----{ xstConnectExtent
-----} xstConnectExtent rc=OK
-----{ xcsGetMem
-----} xcsGetMem rc=OK
-----{ xcsGetMem
-----} xcsGetMem rc=OK
----} xstAttachSharedMemSet rc=OK
---} xcsConnectSharedMemSet rc=OK
---{ xcsDestroySubpoolIfInvalid
----{ xcsGetSetConnectCount
-----{ xstGetExtentConnectCount
-----} xstGetExtentConnectCount rc=OK
----} xcsGetSetConnectCount rc=OK
---} xcsDestroySubpoolIfInvalid rc=OK
---{ xcsAllocateQuickCell
---} xcsAllocateQuickCell rc=OK
---{ xlsThreadInitialization
----{ xcsAllocateQuickCell
----} xcsAllocateQuickCell rc=OK
---} xlsThreadInitialization rc=OK
---{ xcsAttachSetExtents
---} xcsAttachSetExtents rc=OK
--} xcsAttachSharedSubpool rc=OK
-} xcsConnectSharedSubpool rc=OK
-{ xihIsSubpoolConn
-} xihIsSubpoolConn rc=OK
-{ xcsStrerror
-} xcsStrerror rc=OK
-{ xcsFFST
Process Control Block
0x4030a0c0 58494850 F0270000 B77E0000 01000000 XIHP.'...~......
0x4030a0d0 701C0908 701C0908 00000000 00000000 p...p...........
0x4030a0e0 00000000 00000000 00000000 00000000 ................
0x4030a0f0 to 0x4030a140 suppressed, 6 lines same as above
0x4030a150 00000000 00000000 00000000 01000000 ................
0x4030a160 00000E00 00000000 00F00640 2F766172 ...........@/var
0x4030a170 2F6D716D 2F747261 63652F41 4D513332 /mqm/trace/AMQ32
0x4030a180 3433392E 54524300 00000000 00000000 439.TRC.........
0x4030a190 00000000 00000000 00000000 00000000 ................
0x4030a1a0 to 0x4030b150 suppressed, 252 lines same as above
0x4030b160 00000000 00000000 00000000 FFFFFFFF ................
0x4030b170 00000000 00000000 00000000 00000000 ................
0x4030b180 01000000 00000000 01000000 00000000 ................
0x4030b190 E0592240 00000000 00000000 00000000 .Y"@............
0x4030b1a0 00000000 00000000 00000000 00000000 ................
0x4030b1b0 to 0x4030b200 suppressed, 6 lines same as above
0x4030b210 00000000 04000000 00000000 00000000 ................
0x4030b220 00000000 00000000 00000000 00000000 ................
0x4030b230 to 0x4030b290 suppressed, 7 lines same as above
0x4030b2a0 00000000 00000000 E0592240 00000000 .........Y"@....
0x4030b2b0 00000000 00000000 00000000 00000000 ................
0x4030b2c0 to 0x4030b310 suppressed, 6 lines same as above
0x4030b320 00000000 00000000 00000000 04000000 ................
0x4030b330 00000000 C0702440 FFFFFFFF FFFFFFFF .....p$@........
0x4030b340 FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF ................
0x4030b350 to 0x4030b3a0 suppressed, 6 lines same as above
0x4030b3b0 FFFFFFFF FFFFFFFF 04000000 00000000 ................
0x4030b3c0 E0592240 00000000 00000000 00000000 .Y"@............
0x4030b3d0 00000000 00000000 00000000 00000000 ................
0x4030b3e0 to 0x4030b430 suppressed, 6 lines same as above
0x4030b440 00000000 04000000 00000000 E0592240 .............Y"@
0x4030b450 00000000 00000000 00000000 00000000 ................
0x4030b460 to 0x4030b4c0 suppressed, 7 lines same as above
0x4030b4d0 04000000 00000000 00000000 01000000 ................
0x4030b4e0 01000000 00000000 00000000 00000000 ................
0x4030b4f0 00000000 01000000 3C6D2140 78362140 ........<m!@x6!@
0x4030b500 66850040 2B2F1940 BD672140 A8532140 f..@+/.@.g!@.S!@
0x4030b510 00000000 00000000 F07C2140 A8532140 .........|!@.S!@
0x4030b520 88242140 680C0440 0C000000 94D43040 .$!@h..@......0@
0x4030b530 EC300140 C0C0FFBF BD672140 40C1FFBF .0.@.....g!@@...
0x4030b540 13740040 00000000 AED77A0D 50C1FFBF .t.@......z.P...
0x4030b550 680C0440 80370140 08000000 B8910740 h..@.7.@.......@
0x4030b560 28080440 01000000 00000000 C8CD0B40 (..@...........@
0x4030b570 00000000 00000000 00000000 00000000 ................
0x4030b580 to 0x4030b5f0 suppressed, 8 lines same as above
0x4030b600 00000000 00000000 00000000 01000000 ................
0x4030b610 3C6D2140 78362140 66850040 2B2F1940 <m!@x6!@f..@+/.@
0x4030b620 BD672140 A8532140 00000000 00000000 .g!@.S!@........
0x4030b630 F07C2140 A8532140 88242140 680C0440 .|!@.S!@.$!@h..@
0x4030b640 0C000000 94D43040 EC300140 C0C0FFBF ......0@.0.@....
0x4030b650 BD672140 40C1FFBF 13740040 00000000 .g!@@....t.@....
0x4030b660 AED77A0D 50C1FFBF 680C0440 80370140 ..z.P...h..@.7.@
0x4030b670 08000000 B8910740 28080440 01000000 .......@(..@....
0x4030b680 00000000 C8CD0B40 00000000 00000000 .......@........
0x4030b690 00000000 00000000 01000000 F07C2140 .............|!@
0x4030b6a0 A8532140 88242140 680C0440 0C000000 .S!@.$!@h..@....
0x4030b6b0 94D43040 EC300140 C0C0FFBF BD672140 ..0@.0.@.....g!@
0x4030b6c0 40C1FFBF 13740040 00000000 AED77A0D @....t.@......z.
0x4030b6d0 50C1FFBF 680C0440 E0C0FFBF 08000000 P...h..@........
0x4030b6e0 B8910740 28080440 00000000 14A6060D ...@(..@........
0x4030b6f0 70C1FFBF 680C0440 C0AD0940 00000000 p...h..@...@....
0x4030b700 E88E0740 28080440 00000000 00000000 ...@(..@........
0x4030b710 C82D0840 00000000 00000000 00000000 .-.@............
0x4030b720 00000000 01000000 3C6D2140 78362140 ........<m!@x6!@
0x4030b730 66850040 2B2F1940 BD672140 A8532140 f..@+/.@.g!@.S!@
0x4030b740 00000000 00000000 F07C2140 A8532140 .........|!@.S!@
0x4030b750 88242140 680C0440 0C000000 94D43040 .$!@h..@......0@
0x4030b760 EC300140 C0C0FFBF BD672140 40C1FFBF .0.@.....g!@@...
0x4030b770 13740040 00000000 AED77A0D 50C1FFBF .t.@......z.P...
0x4030b780 680C0440 80370140 08000000 B8910740 h..@.7.@.......@
0x4030b790 28080440 01000000 00000000 C8CD0B40 (..@...........@
0x4030b7a0 00000000 00000000 00000000 00000000 ................
0x4030b7b0 01000000 3C6D2140 78362140 66850040 ....<m!@x6!@f..@
0x4030b7c0 2B2F1940 BD672140 A8532140 00000000 +/.@.g!@.S!@....
0x4030b7d0 00000000 F07C2140 A8532140 88242140 .....|!@.S!@.$!@
0x4030b7e0 680C0440 0C000000 94D43040 EC300140 h..@......0@.0.@
0x4030b7f0 C0C0FFBF BD672140 40C1FFBF 13740040 .....g!@@....t.@
0x4030b800 00000000 AED77A0D 50C1FFBF 680C0440 ......z.P...h..@
0x4030b810 80370140 08000000 B8910740 28080440 .7.@.......@(..@
0x4030b820 01000000 00000000 C8CD0B40 00000000 ...........@....
0x4030b830 00000000 00000000 00000000 00000000 ................
0x4030b840 to 0x4030b850 suppressed, 2 lines same as above
0x4030b860 00000000 00000000 00000000 656E5F55 ............en_U
0x4030b870 53000000 00000000 00000000 00000000 S...............
0x4030b880 00000000 00000000 00000000 00000000 ................
0x4030b890 to 0x4030c8a0 suppressed, 258 lines same as above
Common Services Control Block
0x8092e60 58494820 A8200000 01000000 01000000 XIH . ..........
0x8092e70 00000000 00000000 00000000 6E617374 ............contact admin
0x8092e80 656C0078 21030000 00000000 00000000 el.x!...........
0x8092e90 00000000 00000000 00000000 00000000 ................
0x8092ea0 00000000 09800F00 2F766172 2F6D716D ......../var/mqm
0x8092eb0 00000000 00000000 00000000 00000000 ................
0x8092ec0 to 0x8094ec0 suppressed, 513 lines same as above
0x8094ed0 00000000 204F0908 00000000 00000000 .... O..........
0x8094ee0 00000000 00000000 00000000 00000000 ................
0x8094ef0 00000000 00000000 00000000 00000000 ................
0x8094f00 00000000 00000000 ........
Thread Control Block
0x8091c70 58494854 9C0E0000 01000000 00000000 XIHT............
0x8091c80 00000000 00000000 00000000 00000000 ................
0x8091c90 00000000 00000000 40000000 00000000 ........@.......
0x8091ca0 00000000 01000000 01000000 01000000 ................
0x8091cb0 00000000 407D3040 08000000 70A9FFBF ....@}0@....p...
0x8091cc0 88A7FFBF 60A7FFBF 61532740 00000000 ....`...aS'@....
0x8091cd0 00000000 00000000 00000000 00000000 ................
0x8091ce0 to 0x80922e0 suppressed, 97 lines same as above
0x80922f0 FFFFFFFF 00000000 00000000 00000000 ................
0x8092300 00000000 00000000 00000000 00000000 ................
0x8092310 00000000 00000000 00000000 00000000 ................
0x8092320 00000000 01000000 00000000 7C7E3140 ............|~1@
0x8092330 00000000 00000000 00000000 00000000 ................
0x8092340 to 0x8092360 suppressed, 3 lines same as above
0x8092370 B77E0000 00000000 00000000 00000000 .~..............
0x8092380 00000000 00000000 00000000 00000000 ................
0x8092390 01000000 00000000 00000000 00B72A40 ..............*@
0x80923a0 204F0908 00000000 00000000 00000000 O..............
0x80923b0 00000000 00000000 01000000 00000000 ................
0x80923c0 00000000 00000000 00000000 00000000 ................
0x80923d0 00000000 00000000 01000000 00000000 ................
0x80923e0 48DA0700 00000000 00000000 00000000 H...............
0x80923f0 00000000 00000000 00000000 00000000 ................
0x8092400 00000000 00000000 00000000 00000000 ................
0x8092410 00000000 00000000 480A3940 00000000 ........H.9@....
0x8092420 00000000 00000000 00000000 00000000 ................
0x8092430 31000000 00000000 00000000 00000000 1...............
0x8092440 00000000 00000000 00000000 00000000 ................
0x8092450 00000000 00000000 00000000 00000000 ................
0x8092460 C8610908 00000000 00000000 00000000 .a..............
0x8092470 00000000 FFFFFFFF FFFFFFFF FFFFFFFF ................
0x8092480 FFFFFFFF FFFFFFFF FFFFFFFF 00000000 ................
0x8092490 00000000 00000000 00000000 00000000 ................
0x80924a0 to 0x8092560 suppressed, 13 lines same as above
0x8092570 00000000 00000000 00000000 10620908 .............b..
0x8092580 00000000 00000000 00000000 00000000 ................
0x8092590 to 0x80925c0 suppressed, 4 lines same as above
0x80925d0 138100F0 035C00F0 155C00F0 055C00F0 .....\...\...\..
0x80925e0 065C00F0 2B5C00F0 00000000 00000000 .\..+\..........
0x80925f0 00000000 00000000 00000000 00000000 ................
0x8092600 to 0x8092680 suppressed, 9 lines same as above
0x8092690 00000000 00000000 045D00F0 045D0000 .........]...]..
0x80926a0 4F6100F0 B06000F0 595D00F0 595D0000 Oa...`..Y]..Y]..
0x80926b0 B0600000 4F610000 015C0000 138100F0 .`..Oa...\......
0x80926c0 208400F0 20840000 1E8400F0 1E840000 ... ...........
0x80926d0 018400F0 1F8400F0 1F840000 01840000 ................
0x80926e0 138400F0 13840000 E18000F0 E1800000 ................
0x80926f0 DF8000F0 015C00F0 336000F0 F16000F0 .....\..3`...`..
0x8092700 F1600000 33600000 7C6100F0 7D6100F0 .`..3`..|a..}a..
0x8092710 055C00F0 055C0000 055C00F0 055C0000 .\...\...\...\..
0x8092720 846100F0 856100F0 816000F0 81600000 .a...a...`...`..
0x8092730 055C00F0 055C0000 055C00F0 055C0000 .\...\...\...\..
0x8092740 85610000 84610000 816100F0 B66100F0 .a...a...a...a..
0x8092750 926100F0 92610000 B6610000 81610000 .a...a...a...a..
0x8092760 0E5C00F0 0E5C0000 2D5D00F0 0E5C00F0 .\...\..-]...\..
0x8092770 0E5C0000 2D5D0000 A56100F0 A5610000 .\..-]...a...a..
0x8092780 7D610000 7C610000 6A6000F0 6A600000 }a..|a..j`..j`..
0x8092790 F36000F0 F3600000 035C00F0 7D5D00F0 .`...`...\..}]..
0x80927a0 595D00F0 595D0000 165C00F0 055C00F0 Y]..Y]...\...\..
0x80927b0 055C0000 4C5C00F0 2B5C00F0 2B5C5860 .\..L\..+\..+\X`
0x80927c0 4C5C0000 735C00F0 F66000F0 F6600000 L\..s\...`...`..
0x80927d0 735C0000 4C5C00F0 2B5C00F0 2B5C5860 s\..L\..+\..+\X`
0x80927e0 4C5C0000 4C5C00F0 2B5C00F0 2B5C5860 L\..L\..+\..+\X`
0x80927f0 4C5C0000 065C00F0 065C0000 165C0000 L\...\...\...\..
0x8092800 7D5D0000 7D5D00F0 595D00F0 595D0000 }]..}]..Y]..Y]..
0x8092810 165C00F0 055C00F0 055C0000 4C5C00F0 .\...\...\..L\..
0x8092820 2B5C00F0 2B5C5860 4C5C0000 735C00F0 +\..+\X`L\..s\..
0x8092830 F66000F0 F6600000 735C0000 4C5C00F0 .`...`..s\..L\..
0x8092840 2B5C00F0 2B5C5860 4C5C0000 4C5C00F0 +\..+\X`L\..L\..
0x8092850 2B5C00F0 2B5C5860 4C5C0000 065C00F0 +\..+\X`L\...\..
0x8092860 065C0000 165C0000 7D5D0000 4C5C00F0 .\...\..}]..L\..
0x8092870 2B5C00F0 2B5C5860 4C5C0000 F66000F0 +\..+\X`L\...`..
0x8092880 F6600000 135C00F0 135C0000 135C00F0 .`...\...\...\..
0x8092890 135C0000 135C00F0 135C0000 135C00F0 .\...\...\...\..
0x80928a0 135C0000 135C00F0 135C0000 025C00F0 .\...\...\...\..
0x80928b0 055C00F0 055C0000 025C0000 025C00F0 .\...\...\...\..
0x80928c0 025C0000 025C00F0 025C0000 155C00F0 .\...\...\...\..
0x80928d0 155C0000 155C00F0 155C0000 155C00F0 .\...\...\...\..
0x80928e0 155C0000 00000000 00000000 00000000 .\..............
0x80928f0 00000000 00000000 00000000 00000000 ................
0x8092900 to 0x8092a70 suppressed, 24 lines same as above
0x8092a80 00000000 00000000 00000000 93000000 ................
0x8092a90 16000000 00000000 00000000 00000000 ................
0x8092aa0 00000000 00000000 00000000 00000000 ................
0x8092ab0 to 0x8092af0 suppressed, 5 lines same as above
0x8092b00 00000000 00000000 00000000 ............
Component Dumps (Thread 00000001)
------------------------------------- |
|
| Back to top |
|
|
| csmith28 |
| Posted: Thu Sep 01, 2005 9:18 am Post subject: |
|
|
Grand Master
Joined: 15 Jul 2003
Posts: 1196
Location: Arizona
|
After searching both Google and the IBM Support Web Site on both of the Probe ID's in the FFST file you posted I didn't find anything that seems to apply to this particular sort of problem.
However here is what the WMQ Messages Guide has to say about the return code 2087:
| Code: |
2087 X’0827’ MQRC_UNKNOWN_REMOTE_Q_MGR
On an MQOPEN or MQPUT1 call, an error occurred with the queue-name resolution, for one of the following reasons:
v ObjectQMgrName is blank or the name of the local queue manager, ObjectName is the name of a local definition of a remote queue (or an alias to one), and one of the following is true:
– RemoteQMgrName is blank or the name of the local queue manager. Note that this error occurs even if XmitQName is not blank.
– XmitQName is blank, but there is no transmission queue defined with the name of RemoteQMgrName, and the DefXmitQName queue-manager attribute is blank.
– RemoteQMgrName and RemoteQName specify a cluster queue that cannot be resolved successfully, and the DefXmitQName queue-manager attribute is blank.
v ObjectQMgrName is the name of a local definition of a remote queue (containing a queue-manager alias definition), and one of the following is true:
– RemoteQName is not blank.
– XmitQName is blank, but there is no transmission queue defined with the name of RemoteQMgrName, and the DefXmitQName queue-manager attribute is blank.
v ObjectQMgrName is not:
– Blank
– The name of the local queue manager
– The name of a transmission queue
– The name of a queue-manager alias definition (that is, a local definition of a remote queue with a blank RemoteQName) but the DefXmitQName queue-manager attribute is blank.
v ObjectQMgrName is the name of a model queue.
v The queue name is resolved through a cell directory. However, there is no queue defined with the same name as the remote queue manager name obtained from the cell directory, and the DefXmitQName queue-manager attribute is blank.
Corrective action: Check the values specified for ObjectQMgrName and ObjectName. If these are correct, check the queue definitions. |
If this does not help, I reccomend calling IBM WMQ Support and opening a Problem Ticket with them.
_________________
Yes, I am an agent of Satan but my duties are largely ceremonial. |
|
| Back to top |
|
|
| kevinf2349 |
| Posted: Thu Sep 01, 2005 9:23 am Post subject: |
|
|
Grand Master
Joined: 28 Feb 2003
Posts: 1311
Location: USA
|
| Quote: |
| ('13 - Permission denied' from open.) |
I am no LINUX expert...in fact I know Jack about it, but this kind of makes me think it may be a LINUX permissions problem.
I could well be wrong, and this may be a red herring, but it may be worth checking in to.
Other than that....I would do as CRSMITH recommends.  |
|
| Back to top |
|
|
| amit_talpade_star |
| Posted: Thu Sep 01, 2005 9:49 am Post subject: |
|
|
Apprentice
Joined: 14 Dec 2004
Posts: 39
|
We checked the reply to queue and reply 2 queue manager settings and found them OK.
Based on the current situation what is recommended. Dropping Queue Manager and recreating it or running MQ Scripts again for creating all MQ definitions or something like strmqm -c to create all default objects or refresh cluster from the problematic queue manager? |
|
| Back to top |
|
|
| jefflowrey |
| Posted: Thu Sep 01, 2005 9:53 am Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
| amit_talpade_star wrote: |
| Based on the current situation what is recommended. |
According to the error message,
| Messages wrote: |
AMQ9421Invalid cluster record action code detected
Severity:
30 : Severe error
Explanation:
An invalid record was read from the SYSTEM.CLUSTER.REPOSITORY.QUEUE. An FFST record has been generated containing the invalid record. was
Response:
Collect the items listed in the Problem Determination section of the System Administration manual and contact your IBM support center.
|
My emphasis.
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
| JT |
| Posted: Thu Sep 01, 2005 9:59 am Post subject: |
|
|
Padawan
Joined: 27 Mar 2003
Posts: 1564
Location: Hartford, CT.
|
| By chance, are there any v5.2 queue managers involved in this cluster ? |
|
| Back to top |
|
|
| amit_talpade_star |
| Posted: Thu Sep 01, 2005 10:01 am Post subject: |
|
|
Apprentice
Joined: 14 Dec 2004
Posts: 39
|
| Thanks for the valuable inputs. Will raise a PMR |
|
| Back to top |
|
|
| amit_talpade_star |
| Posted: Thu Sep 01, 2005 10:07 am Post subject: |
|
|
Apprentice
Joined: 14 Dec 2004
Posts: 39
|
|
| Back to top |
|
|
| hopsala |
| Posted: Thu Sep 01, 2005 10:33 am Post subject: |
|
|
Guardian
Joined: 24 Sep 2004
Posts: 960
|
| kevinf2349 wrote: |
| Quote: |
| ('13 - Permission denied' from open.) |
I am no LINUX expert...in fact I know Jack about it, but this kind of makes me think it may be a LINUX permissions problem.
I could well be wrong, and this may be a red herring, but it may be worth checking in to. |
I don't think that's it, note that this is in the second part of the FDC, where it says:
| Quote: |
| Component :- xtrOpenTraceFile |
| Program Name :- nsqpub |
| Major Errorcode :- xecF_E_UNEXPECTED_SYSTEM_RC |
| Probe Description :- AMQ6119: An internal WebSphere MQ error has occurred |
| ('13 - Permission denied' from open.) | |
I think permission was denied for OpenTraceFile, not for the queue operation... Although this is suspicious, this is possibly not the main problem here; what happened is that first there was an invalid queue operation, and then when trying to trace it there was a problem with the trace. Also note that it keeps retrying for a while... The cause of 2087 must be something to do with SYSTEM.CLUSTER.REPOSITORY.QUEUE, see further down my post for details.
Anyway, looking at
| Quote: |
| Component :- zxcRestoreObject |
| UserID :- 00000510 (mqsi) |
| Program Name :- amqzxma0 |
| Thread-Process :- 00032168 |
| Major Errorcode :- rrcE_INVALID_ACTION_CODE |
| Probe Description :- AMQ9421: Invalid cluster record action code detected | |
And in AMQERR01 (summary from several consecutive places):
| Quote: |
AMQ6119: An internal WebSphere MQ error has occurred (Rc=28 from mkdir)
An error has been detected, and the WebSphere MQ error recording routine has
been called. The failing process is process 14423.
AMQ9421: Invalid cluster record action code detected
An invalid record was read from the SYSTEM.CLUSTER.REPOSITORY.QUEUE. An FFST
record has been generated containing the invalid record. was |
Possibly we are looking at the wrong FDC file or entry, what you're looking for is the problem that occured with process 14423(at 12:27:09 no 12:47), not 32168 and associates; or conversly, these are two seperate probs.
I just wonder what does amqzxma0 (process controller) have to do with clustering, possibly it tried raising process 14423, and that process crashed returning AMQ9421 to amqzxma0...
Also odd is the interruption in "generated containing the invalid record. was " - that's the end of the sentence, "was" what ?
Anyway, the fastest solution will probably be something simple like: refreshing the cluster, clearing SYSTEM.CLUSTER.REPOSITORY.QUEUE, recreating the qm etc. But if you want to know what happened, dig deeper!
P.S Is this a new qm? a new cluster? a new dynamic queue? Is there any chance that SYSTEM.CLUSTER.REPOSITORY.QUEUE does not have a queue file? (i'm saying this based on the error with mkdir(rc=28 ), possibly your processes lack permissions for mq libraries) |
|
| Back to top |
|
|
| hopsala |
| Posted: Thu Sep 01, 2005 10:38 am Post subject: |
|
|
Guardian
Joined: 24 Sep 2004
Posts: 960
|
Another p.s: I find it odd that you give IBM so much credit; in my 7 years working with WMQ and other IBM products, I have opened dozens of PMRs, and never - not once - gotten an appropriate and on-time reply. I always had to solve it myself. (at great psychological cost  )
I'm not trying to diss IBM or anything, this simply has been my personal experience (and of many others I know) - always solve things yourself, coz IBM won't help you...
As they say - just my 0.02$ |
|
| Back to top |
|
|
| PeterPotkay |
| Posted: Thu Sep 01, 2005 12:37 pm Post subject: |
|
|
Poobah
Joined: 15 May 2001
Posts: 7723
|
| hopsala wrote: |
Another p.s: I find it odd that you give IBM so much credit; in my 7 years working with WMQ and other IBM products, I have opened dozens of PMRs, and never - not once - gotten an appropriate and on-time reply. I always had to solve it myself. (at great psychological cost )
|
Yikes! I wouldn't say its that bad. although when the S hits the fan, I post here and to the list serve first and then open the PMR. If its during the week, I have a solution here b4 the PMR is acknowledged even, though it is good to get official confirmation. Eventually.
And I am happy to say I have never even used the word URGENT!!!!! in a post!
_________________
Peter Potkay
Keep Calm and MQ On |
|
| Back to top |
|
|
|
|
|
| |
|
Page 1 of 1 |
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
|
|
