| Author | 
		  Message
		 | 
		
		  | lyntongrice | 
		  
		    
			  
				 Posted: Wed Oct 12, 2011 9:16 am    Post subject: zcpCreateMessage - "AMQ6125: An internal WebSphere MQ e | 
				     | 
			   
			 
		   | 
		
		
		   Acolyte
 
 Joined: 26 Sep 2010 Posts: 70
  
  | 
		  
		    
			  
				Hi there,
 
 
I have a C program running on Solaris SPARC 8 and I received the following very AD HOC error that I have never seen before.
 
 
We run Websphere MQ 6 on the box....
 
 
This is what the FFS said:
 
 
   
	| Code: | 
   
  
	WebSphere MQ First Failure Symptom Report                                   |
 
| =========================================                                   |
 
|                                                                             |
 
| Date/Time         :- Wednesday October 12 11:44:28 GMT 2011                 |
 
| Host Name         :- dczcrm04 (SunOS 5.8)                                   |
 
| PIDS              :- 5724H7203                                              |
 
| LVLS              :- 6.0.2.3                                                |
 
| Product Long Name :- WebSphere MQ for Solaris (SPARC platform)              |
 
| Vendor            :- IBM                                                    |
 
| Probe Id          :- ZC004062                                               |
 
| Application Name  :- MQM                                                    |
 
| Component         :- zcpCreateMessage                                       |
 
| SCCS Info         :- lib/zc/amqzcpb0.c, 1.70.1.5                            |
 
| Line Number       :- 894                                                    |
 
| Build Date        :- Feb  4 2008                                            |
 
| CMVC level        :- p600-203-080204                                        |
 
| Build Type        :- IKAP - (Production)                                    |
 
| UserID            :- 00001007 (smq)                                         |
 
| Program Name      :- test                                        |
 
| Addressing mode   :- 64-bit                                                 |
 
| Process           :- 11111                                                  |
 
| Thread            :- 1                                                      |
 
| QueueManager      :- QM01                                               |
 
| ConnId(1) IPCC    :- 260                                                    |
 
| Last HQC          :- 1.0.0-12440                                            |
 
| Last HSHMEMB      :- 0.0.0-0                                                |
 
| Major Errorcode   :- OK                                                     |
 
| Minor Errorcode   :- OK                                                     |
 
| Probe Type        :- INCORROUT                                              |
 
| Probe Severity    :- 4                                                      |
 
| Probe Description :- AMQ6125: An internal WebSphere MQ error has occurred.  |
 
| FDCSequenceNumber :- 0                                                      |  | 
   
 
 
 
Just to give you an idea what the "test" program does...it simple reads messages from a queue and posts them to another application.....and has been working 100% on other system like Linux and Solaris SPARC 10...with no issues.....
 
 
Does anyone have any idea what could have caused this? I have see other errors similar to this (http://www-01.ibm.com/support/docview.wss?uid=swg1IZ72115) for Linux systems and am just curious is we need to apply a patch or something?
 
 
Thanks for the help  
 
 
Lynton | 
			   
			 
		   | 
		
		
		  | Back to top | 
		  
		  	
		   | 
		
		
		    | 
		
		
		  | mqjeff | 
		  
		    
			  
				 Posted: Wed Oct 12, 2011 9:33 am    Post subject:  | 
				     | 
			   
			 
		   | 
		
		
		   Grand Master
 
 Joined: 25 Jun 2008 Posts: 17447
  
  | 
		  
		    
			  
				Did the application receive an MQRC coincident with the throwing of the FDC?
 
 
Did the MQ error log indicate additional information related to the throwing of the FDC? | 
			   
			 
		   | 
		
		
		  | Back to top | 
		  
		  	
		   | 
		
		
		    | 
		
		
		  | lyntongrice | 
		  
		    
			  
				 Posted: Wed Oct 12, 2011 9:49 am    Post subject:  | 
				     | 
			   
			 
		   | 
		
		
		   Acolyte
 
 Joined: 26 Sep 2010 Posts: 70
  
  | 
		  
		    
			  
				Hi there,
 
 
Thanks for the quick response, all I saw what that the running application in the console stopped running, and I was alerted from the MQ admin that the following error had occurred. I will try get more details from him tomorrow on this as I have no access to the box....
 
 
But any ideas off the top of your head?
 
 
Thanks again
 
 
Lynton | 
			   
			 
		   | 
		
		
		  | Back to top | 
		  
		  	
		   | 
		
		
		    | 
		
		
		  | mqjeff | 
		  
		    
			  
				 Posted: Wed Oct 12, 2011 9:59 am    Post subject:  | 
				     | 
			   
			 
		   | 
		
		
		   Grand Master
 
 Joined: 25 Jun 2008 Posts: 17447
  
  | 
		  
		    
			  
				
   
	| lyntongrice wrote: | 
   
  
	| any ideas off the top of your head? | 
   
 
 
Not for that probe id with that component.
 
 
What's the top of the stack trace? | 
			   
			 
		   | 
		
		
		  | Back to top | 
		  
		  	
		   | 
		
		
		    | 
		
		
		  | lyntongrice | 
		  
		    
			  
				 Posted: Wed Oct 12, 2011 10:01 am    Post subject:  | 
				     | 
			   
			 
		   | 
		
		
		   Acolyte
 
 Joined: 26 Sep 2010 Posts: 70
  
  | 
		  
		    
			  
				| I will need to get you that detail tomorrow.....and will post it to this thread then.....thnx again l-) | 
			   
			 
		   | 
		
		
		  | Back to top | 
		  
		  	
		   | 
		
		
		    | 
		
		
		  | mvic | 
		  
		    
			  
				 Posted: Wed Oct 12, 2011 4:19 pm    Post subject: Re: zcpCreateMessage - "AMQ6125: An internal WebSphere  | 
				     | 
			   
			 
		   | 
		
		
		    Jedi
 
 Joined: 09 Mar 2004 Posts: 2080
  
  | 
		  
		    
			  
				Well, you could try getting to 6.0.2.9 at least, so as to get a fix for IC62566.
 
 
Better still, go to 6.0.2.11 just to benefit from the maximum fixes.
 
 
Better still, go to 7.0.1.6. | 
			   
			 
		   | 
		
		
		  | Back to top | 
		  
		  	
		   | 
		
		
		    | 
		
		
		  | lyntongrice | 
		  
		    
			  
				 Posted: Thu Oct 13, 2011 3:17 am    Post subject:  | 
				     | 
			   
			 
		   | 
		
		
		   Acolyte
 
 Joined: 26 Sep 2010 Posts: 70
  
  | 
		  
		    
			  
				Hi there,
 
 
I now have some more of the stack trace....any ideas what could have caused the issue?
 
 
Here is the error report again to put all into perspective....and the application starts a transaction, GETs a message from the queue and then either rollsback or commits the transaction.....
 
 
   
	| Code: | 
   
  
	WebSphere MQ First Failure Symptom Report                                   | 
 
| =========================================                                   | 
 
|                                                                             | 
 
| Date/Time         :- Wednesday October 12 11:44:28 GMT 2011                 | 
 
| Host Name         :- dczcrm04 (SunOS 5.8)                                   | 
 
| PIDS              :- 5724H7203                                              | 
 
| LVLS              :- 6.0.2.3                                                | 
 
| Product Long Name :- WebSphere MQ for Solaris (SPARC platform)              | 
 
| Vendor            :- IBM                                                    | 
 
| Probe Id          :- ZC004062                                               | 
 
| Application Name  :- MQM                                                    | 
 
| Component         :- zcpCreateMessage                                       | 
 
| SCCS Info         :- lib/zc/amqzcpb0.c, 1.70.1.5                            | 
 
| Line Number       :- 894                                                    | 
 
| Build Date        :- Feb  4 2008                                            | 
 
| CMVC level        :- p600-203-080204                                        | 
 
| Build Type        :- IKAP - (Production)                                    | 
 
| UserID            :- 00001007 (smq)                                         | 
 
| Program Name      :- test                                        | 
 
| Addressing mode   :- 64-bit                                                 | 
 
| Process           :- 11111                                                  | 
 
| Thread            :- 1                                                      | 
 
| QueueManager      :- QM01                                               | 
 
| ConnId(1) IPCC    :- 260                                                    | 
 
| Last HQC          :- 1.0.0-12440                                            | 
 
| Last HSHMEMB      :- 0.0.0-0                                                | 
 
| Major Errorcode   :- OK                                                     | 
 
| Minor Errorcode   :- OK                                                     | 
 
| Probe Type        :- INCORROUT                                              | 
 
| Probe Severity    :- 4                                                      | 
 
| Probe Description :- AMQ6125: An internal WebSphere MQ error has occurred.  | 
 
| FDCSequenceNumber :- 0   | 
   
 
 
MQM Function Stack
 
MQBACK
 
zstMQBACK
 
ziiMQBACK
 
ziiCreateIPCCMessage
 
zcpCreateMessage
 
xcsFFST
 
 
 
MQM Trace History
 
-------} xcsReleaseThreadMutexSem rc=OK
 
-------{ xstAttachSharedMemSet
 
--------{ xstConnectExtent
 
---------{ xllSpinLockRequest
 
---------} xllSpinLockRequest rc=OK
 
---------{ xllSpinLockRelease
 
---------} xllSpinLockRelease rc=OK
 
---------{ xcsRequestThreadMutexSem
 
---------} xcsRequestThreadMutexSem rc=OK
 
---------{ xcsReleaseThreadMutexSem
 
---------} xcsReleaseThreadMutexSem rc=OK
 
--------} xstConnectExtent rc=OK
 
--------{ xcsGetMem
 
--------} xcsGetMem rc=OK
 
--------{ xcsGetMem
 
--------} xcsGetMem rc=OK
 
-------} xstAttachSharedMemSet rc=OK
 
-------{ xcsReleaseThreadMutexSem
 
-------} xcsReleaseThreadMutexSem rc=OK
 
------} xcsConnectSharedMemSet rc=OK
 
------{ xcsRegisterDestructor
 
------} xcsRegisterDestructor rc=OK
 
-----} zcpAttachPipe rc=OK
 
----} ziiConnectToAgent rc=OK
 
----{ ziiStartAllPlugServices
 
-----{ xcsConnectSharedMemSet
 
------{ xllSpinLockRequest
 
------} xllSpinLockRequest rc=OK
 
------{ xllSpinLockRelease
 
------} xllSpinLockRelease rc=OK
 
------{ xcsRequestThreadMutexSem
 
------} xcsRequestThreadMutexSem rc=OK
 
------{ xcsRequestThreadMutexSem
 
------} xcsRequestThreadMutexSem rc=OK
 
------{ xcsReleaseThreadMutexSem
 
------} xcsReleaseThreadMutexSem rc=OK
 
------{ xstConnectSubSet
 
-------{ xcsGetMem
 
-------} xcsGetMem rc=OK
 
-------{ xcsGetMem
 
-------} xcsGetMem rc=OK
 
-------{ xcsRequestThreadMutexSem
 
-------} xcsRequestThreadMutexSem rc=OK
 
-------{ xcsReleaseThreadMutexSem
 
-------} xcsReleaseThreadMutexSem rc=OK
 
-------{ xcsRequestThreadMutexSem
 
-------} xcsRequestThreadMutexSem rc=OK
 
-------{ xcsReleaseThreadMutexSem
 
-------} xcsReleaseThreadMutexSem rc=OK
 
------} xstConnectSubSet rc=OK
 
------{ xcsReleaseThreadMutexSem
 
------} xcsReleaseThreadMutexSem rc=OK
 
-----} xcsConnectSharedMemSet rc=OK
 
----} ziiStartAllPlugServices rc=OK
 
----{ ziiCreateIPCCMessage
 
-----{ zcpCreateMessage
 
-----} zcpCreateMessage rc=OK
 
----} ziiCreateIPCCMessage rc=OK
 
----{ ziiSendReceiveAgent
 
-----{ zcpSendOnPipe
 
------{ xcsResetEventSem
 
------} xcsResetEventSem rc=OK
 
------{ xcsPostEventSem
 
------} xcsPostEventSem rc=OK
 
-----} zcpSendOnPipe rc=OK
 
-----{ zcpReceiveOnPipe
 
------{ xcsWaitEventSem
 
------} xcsWaitEventSem rc=OK
 
-----} zcpReceiveOnPipe rc=OK
 
----} ziiSendReceiveAgent rc=OK
 
----{ zcpDeleteMessage
 
----} zcpDeleteMessage rc=OK
 
---} ziiMQCONN rc=OK
 
---{ zutDisconnectConfig
 
----{ xcsFreeMem
 
----} xcsFreeMem rc=OK
 
---} zutDisconnectConfig rc=OK
 
--} zstMQConnect rc=OK
 
-} zstMQCONNX rc=OK
 
} MQCONNX rc=OK
 
{ MQCONNX
 
-{ zstMQCONNX
 
--{ xcsInitialize
 
---{ xcsRequestThreadMutexSem
 
---} xcsRequestThreadMutexSem rc=OK
 
---{ xcsReleaseThreadMutexSem
 
---} xcsReleaseThreadMutexSem rc=OK
 
--} xcsInitialize rc=OK
 
--{ zstMQConnect
 
---{ zstMQConnect_CheckParameters
 
---} zstMQConnect_CheckParameters rc=OK
 
---{ zutBlankPad
 
---} zutBlankPad rc=OK
 
---{ zutLockLocalThreads
 
----{ xcsRequestThreadMutexSem
 
----} xcsRequestThreadMutexSem rc=OK
 
---} zutLockLocalThreads rc=OK
 
---{ zutIsItBlank
 
---} zutIsItBlank rc=OK
 
---{ zutCheckQMName
 
----{ zutCheckValidName
 
----} zutCheckValidName rc=OK
 
---} zutCheckQMName rc=OK
 
---{ zutCvtMQName2Str
 
---} zutCvtMQName2Str rc=OK
 
---{ zstGetPCDbyTID
 
---} zstGetPCDbyTID rc=OK
 
---{ zutUnlockLocalThreads
 
----{ xcsReleaseThreadMutexSem
 
----} xcsReleaseThreadMutexSem rc=OK
 
---} zutUnlockLocalThreads rc=OK
 
--} zstMQConnect rc=lrcW_ALREADY_CONNECTED
 
-} zstMQCONNX rc=lrcW_ALREADY_CONNECTED
 
} MQCONNX rc=lrcW_ALREADY_CONNECTED
 
{ MQOPEN
 
-{ zstMQOPEN
 
--{ zstVerifyPCD
 
--} zstVerifyPCD rc=OK
 
--{ zstCheckODAddressability
 
---{ xcsCheckPointer
 
---} xcsCheckPointer rc=OK
 
--} zstCheckODAddressability rc=OK
 
--{ ziiMQOPEN
 
---{ ziiCreateIPCCMessage
 
----{ zcpCreateMessage
 
----} zcpCreateMessage rc=OK
 
---} ziiCreateIPCCMessage rc=OK
 
---{ ziiSendReceiveAgent
 
----{ zcpSendOnPipe
 
-----{ xcsResetEventSem
 
-----} xcsResetEventSem rc=OK
 
-----{ xcsPostEventSem
 
-----} xcsPostEventSem rc=OK
 
----} zcpSendOnPipe rc=OK
 
----{ zcpReceiveOnPipe
 
-----{ xcsWaitEventSem
 
-----} xcsWaitEventSem rc=OK
 
----} zcpReceiveOnPipe rc=OK
 
---} ziiSendReceiveAgent rc=OK
 
---{ zcpDeleteMessage
 
---} zcpDeleteMessage rc=OK
 
--} ziiMQOPEN rc=OK
 
-} zstMQOPEN rc=OK
 
} MQOPEN rc=OK
 
{ MQBEGIN
 
-{ zstMQBEGIN
 
--{ zstVerifyPCD
 
--} zstVerifyPCD rc=OK
 
--{ zstSetMQModel
 
--} zstSetMQModel rc=OK
 
--{ xcsCheckPointer
 
--} xcsCheckPointer rc=OK
 
--{ ziiMQBEGIN
 
---{ ztmBeginInitialise
 
---} ztmBeginInitialise rc=zrcM_W_NO_RESOURCE_MGRS
 
---{ ziiCreateIPCCMessage
 
----{ zcpCreateMessage
 
----} zcpCreateMessage rc=OK
 
---} ziiCreateIPCCMessage rc=OK
 
---{ ziiSendReceiveAgent
 
----{ zcpSendOnPipe
 
-----{ xcsResetEventSem
 
-----} xcsResetEventSem rc=OK
 
-----{ xcsPostEventSem
 
-----} xcsPostEventSem rc=OK
 
----} zcpSendOnPipe rc=OK
 
----{ zcpReceiveOnPipe
 
-----{ xcsWaitEventSem
 
-----} xcsWaitEventSem rc=OK
 
----} zcpReceiveOnPipe rc=OK
 
---} ziiSendReceiveAgent rc=lrcW_NO_EXTERNAL_PARTICIPANTS
 
---{ zcpDeleteMessage
 
---} zcpDeleteMessage rc=OK
 
---{ ztmAssociateParticipants
 
---} ztmAssociateParticipants rc=zrcM_W_NO_RESOURCE_MGRS
 
--} ziiMQBEGIN rc=zrcM_W_NO_RESOURCE_MGRS
 
-} zstMQBEGIN rc=lrcW_NO_EXTERNAL_PARTICIPANTS
 
} MQBEGIN rc=lrcW_NO_EXTERNAL_PARTICIPANTS
 
{ MQGET
 
-{ zstMQGET
 
--{ zstVerifyPCD
 
--} zstVerifyPCD rc=OK
 
--{ zstMQGET_CheckParms
 
--} zstMQGET_CheckParms rc=OK
 
--{ ziiMQGET
 
---{ ziiCreateIPCCMessage
 
----{ zcpCreateMessage
 
----} zcpCreateMessage rc=OK
 
---} ziiCreateIPCCMessage rc=OK
 
---{ ziiSendReceiveAgent
 
----{ zcpSendOnPipe
 
-----{ xcsResetEventSem
 
-----} xcsResetEventSem rc=OK
 
-----{ xcsPostEventSem
 
-----} xcsPostEventSem rc=OK
 
----} zcpSendOnPipe rc=OK
 
----{ zcpReceiveOnPipe
 
-----{ xcsWaitEventSem
 
-----} xcsWaitEventSem rc=OK
 
----} zcpReceiveOnPipe rc=OK
 
---} ziiSendReceiveAgent rc=arcW_TRUNCATED_MSG_FAILED
 
---{ zcpDeleteMessage
 
---} zcpDeleteMessage rc=OK
 
--} ziiMQGET rc=OK
 
-} zstMQGET rc=arcW_TRUNCATED_MSG_FAILED
 
} MQGET rc=arcW_TRUNCATED_MSG_FAILED
 
{ MQGET
 
-{ zstMQGET
 
--{ zstVerifyPCD
 
--} zstVerifyPCD rc=OK
 
--{ zstMQGET_CheckParms
 
--} zstMQGET_CheckParms rc=OK
 
--{ ziiMQGET
 
---{ ziiCreateIPCCMessage
 
----{ zcpCreateMessage
 
----} zcpCreateMessage rc=OK
 
---} ziiCreateIPCCMessage rc=OK
 
---{ ziiSendReceiveAgent
 
----{ zcpSendOnPipe
 
-----{ xcsResetEventSem
 
-----} xcsResetEventSem rc=OK
 
-----{ xcsPostEventSem
 
-----} xcsPostEventSem rc=OK
 
----} zcpSendOnPipe rc=OK
 
----{ zcpReceiveOnPipe
 
-----{ xcsWaitEventSem
 
-----} xcsWaitEventSem rc=OK
 
----} zcpReceiveOnPipe rc=OK
 
---} ziiSendReceiveAgent rc=OK
 
---{ zcpDeleteMessage
 
---} zcpDeleteMessage rc=OK
 
--} ziiMQGET rc=OK
 
--{ vpiConvertData
 
--} vpiConvertData rc=OK
 
-} zstMQGET rc=OK
 
} MQGET rc=OK
 
{ MQBACK
 
-{ zstMQBACK
 
--{ zstVerifyPCD
 
--} zstVerifyPCD rc=OK
 
--{ ztmDissociateParticipants
 
--} ztmDissociateParticipants rc=zrcM_W_NO_RESOURCE_MGRS
 
--{ ziiMQBACK
 
---{ ziiCreateIPCCMessage
 
----{ zcpCreateMessage
 
-----{ xcsBuildDumpPtr
 
------{ xcsGetMem
 
------} xcsGetMem rc=OK
 
-----} xcsBuildDumpPtr rc=OK
 
-----{ xcsFFST | 
			   
			 
		   | 
		
		
		  | Back to top | 
		  
		  	
		   | 
		
		
		    | 
		
		
		  | mqjeff | 
		  
		    
			  
				 Posted: Thu Oct 13, 2011 5:14 am    Post subject:  | 
				     | 
			   
			 
		   | 
		
		
		   Grand Master
 
 Joined: 25 Jun 2008 Posts: 17447
  
  | 
		  
		    
			  
				So it failed while trying to back out a message...
 
 
         
 
 
Does it also fail when you try to commit? 
 
 
An issue with the file system maybe?
 
 
Anything in the AMQERR log that sheds more light? Or just a report of an FDC thrown? | 
			   
			 
		   | 
		
		
		  | Back to top | 
		  
		  	
		   | 
		
		
		    | 
		
		
		  | mvic | 
		  
		    
			  
				 Posted: Thu Oct 13, 2011 5:54 am    Post subject:  | 
				     | 
			   
			 
		   | 
		
		
		    Jedi
 
 Joined: 09 Mar 2004 Posts: 2080
  
  | 
		  
		    
			  
				
   
	| lyntongrice wrote: | 
   
  
	| any ideas what could have caused the issue? | 
   
 
 
I had an idea - I posted it in my previous post on this thread. | 
			   
			 
		   | 
		
		
		  | Back to top | 
		  
		  	
		   | 
		
		
		    | 
		
		
		  | bruce2359 | 
		  
		    
			  
				 Posted: Thu Oct 13, 2011 5:58 am    Post subject:  | 
				     | 
			   
			 
		   | 
		
		
		    Poobah
 
 Joined: 05 Jan 2008 Posts: 9486 Location: US: west coast, almost. Otherwise, enroute. 
  | 
		  
		    
			  
				Has this qmgr been running (production) without error until recently?  If so, what has changed? _________________ I like deadlines. I like to wave as they pass by.
 
ב''ה
 
Lex Orandi, Lex Credendi, Lex Vivendi. As we Worship, So we Believe, So we Live. | 
			   
			 
		   | 
		
		
		  | Back to top | 
		  
		  	
		   | 
		
		
		    | 
		
		
		  | lyntongrice | 
		  
		    
			  
				 Posted: Thu Oct 13, 2011 8:53 am    Post subject:  | 
				     | 
			   
			 
		   | 
		
		
		   Acolyte
 
 Joined: 26 Sep 2010 Posts: 70
  
  | 
		  
		    
			  
				Hi there,
 
 
The commit works file.....and in fact we sent 30000 messages over the C code today with no issues at all...
 
 
No other real error stuff in the AMQ err....
 
 
Perhaps we just need a higher version to be installed...
 
 
The queue manager has been running for ages...very strange...
 
 
Thanks anyway   | 
			   
			 
		   | 
		
		
		  | Back to top | 
		  
		  	
		   | 
		
		
		    | 
		
		
		  | 
		    
		   |