| |
|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
  |
|
| mqseries logs problem |
« View previous topic :: View next topic » |
| Author |
Message
|
| jacky.bright |
 Posted: Tue Aug 15, 2006 6:31 am Post subject: mqseries logs problem |
 |
|
Newbie
Joined: 15 Aug 2006
Posts: 2
|
I faced prob. in production today ... We got error at around 12.20 that MQ 2 of 8 active logs full.
Thereafter, operator had replied the message and the console was asking to mount tape in 780 tape drive. However operator kept the message un-attended and left for lunch.
Later application ppl complained tht they are not able to view mq objects. During tht period even we couldn't cancel TSO users accessing mq objects.
Once logs were taken into tape, all users got terminated. and thereafter they could view MQ Objects.
Can anyone explain, even though 6 logs were pending why the problem occurred ?
logs appended below...
Jacky....
LOGS :
12.21.57 STC01132 IKJ56221I DATA SET CSQFTA1.B0000002 NOT ALLOCATED, VOLUME NOT AVAILABLE+
12.21.57 STC01132 IKJ56221I VOLUME NECESSARY TO SATISFY YOUR REQUEST NOT ON SYSTEM, AND CANNOT BE MOUNTED
12.21.57 STC01132 CSQJ008E -MPFT 2 OF 8 ACTIVE LOGS ARE FULL. MPFT NEEDS ARCHIVE SCRATCH
12.21.57 STC01132 *11 CSQJ021D -MPFT REPLY Y WHEN DEVICE READY OR N TO CANCEL
12.21.57 STC01132 CSQP018I -MPFT CSQPBCKW CHECKPOINT STARTED FOR ALL BUFFER POOLS
12.21.57 STC01132 CSQP019I -MPFT CSQP1DWP CHECKPOINT COMPLETED FOR
BUFFER POOL 0, 0 PAGES WRITTEN
12.21.57 STC01132 -MPFT DISPLAY THREAD(*) TYPE(INDOUBT)
12.21.57 STC01132 CSQP019I -MPFT CSQP1DWP CHECKPOINT COMPLETED FOR
BUFFER POOL 1, 0 PAGES WRITTEN
12.21.57 STC01132 CSQP019I -MPFT CSQP1DWP CHECKPOINT COMPLETED FOR
BUFFER POOL 2, 0 PAGES WRITTEN
12.21.57 STC01132 CSQP019I -MPFT CSQP1DWP CHECKPOINT COMPLETED FOR
BUFFER POOL 3, 0 PAGES WRITTEN
12.21.57 STC01132 CSQV401I -MPFT DISPLAY THREAD REPORT FOLLOWS -
12.21.57 STC01132 CSQV420I -MPFT NO INDOUBT THREADS FOUND
12.21.57 STC01132 CSQ9022I -MPFT CSQVDT ' DISPLAY THREAD' NORMAL COMPLETION
12.21.57 STC01132 CSQP021I -MPFT Page set 0 new media recovery
RBA=0000105F773E, checkpoint RBA=0000105F773E
12.21.57 STC01132 CSQP021I -MPFT Page set 1 new media recovery
RBA=0000105F7DB8, checkpoint RBA=0000105F7DB8
12.21.57 STC01132 CSQP021I -MPFT Page set 2 new media recovery
RBA=00001060973B, checkpoint RBA=00001060973B
12.21.57 STC01132 CSQP021I -MPFT Page set 3 new media recovery
RBA=000012CDBA82, checkpoint RBA=000012CDBA82
13.34.17 STC01132 R 11,Y
13.34.17 STC01132 *IEF233D M 0780,PRIVAT,SL,MPFTMSTR,MPFTMSTR,CSQFTA1.B0000002,
OR RESPOND TO IEF455D MESSAGE
13.34.17 STC01132 *12 IEF455D MOUNT PRIVAT ON 0780 FOR MPFTMSTR MPFTMSTR OR REPLY 'NO'
14.07.02 STC01132 CSQ3201E -MPFT ABNORMAL EOT IN PROGRESS FOR
USER=RTIAP5 CONNECTION-ID=RTIAP5 THREAD-XREF=000000000000000000000000
14.21.09 STC01132 CSQ3201E -MPFT ABNORMAL EOT IN PROGRESS FOR
USER=RTIAP2 CONNECTION-ID=RTIAP2 THREAD-XREF=000000000000000000000000
14.25.01 STC01132 CSQ3201E -MPFT ABNORMAL EOT IN PROGRESS FOR
USER=RTIAP3 CONNECTION-ID=RTIAP3 THREAD-XREF=000000000000000000000000
14.37.45 STC01132 CSQ3201E -MPFT ABNORMAL EOT IN PROGRESS FOR
USER=RTIAP1 CONNECTION-ID=RTIAP1 THREAD-XREF=000000000000000000000000
14.37.45 STC01132 CSQ3201E -MPFT ABNORMAL EOT IN PROGRESS FOR
USER=RTIAP4 CONNECTION-ID=RTIAP4 THREAD-XREF=000000000000000000000000
14.37.45 STC01132 CSQ3201E -MPFT ABNORMAL EOT IN PROGRESS FOR
USER=RTIASAJ CONNECTION-ID=RTIASAJ
THREAD-XREF=000000000000000000000000
14.37.45 STC01132 CSQN207I -MPFT COMMAND SERVER UNABLE TO OPEN REPLY TO QUEUE
14.37.45 STC01132 CSQN203I -MPFT API COMPLETION CODE=2, REASON CODE=2085
14.37.45 STC01132 CSQN207I -MPFT COMMAND SERVER UNABLE TO OPEN REPLY TO QUEUE
14.37.45 STC01132 CSQN203I -MPFT API COMPLETION CODE=2, REASON CODE=2085
14.37.45 STC01132 CSQN207I -MPFT COMMAND SERVER UNABLE TO OPEN REPLY TO QUEUE
14.37.46 STC01132 CSQN203I -MPFT API COMPLETION CODE=2, REASON CODE=2085
14.37.46 STC01132 CSQN207I -MPFT COMMAND SERVER UNABLE TO OPEN REPLY TO QUEUE
14.37.46 STC01132 CSQN203I -MPFT API COMPLETION CODE=2, REASON CODE=2085
14.37.46 STC01132 CSQN207I -MPFT COMMAND SERVER UNABLE TO OPEN REPLY TO QUEUE
14.37.46 STC01132 CSQN203I -MPFT API COMPLETION CODE=2, REASON CODE=2085
14.37.46 STC01132 CSQN207I -MPFT COMMAND SERVER UNABLE TO OPEN REPLY TO QUEUE
14.37.46 STC01132 CSQN203I -MPFT API COMPLETION CODE=2, REASON CODE=2085
14.37.46 STC01132 CSQN207I -MPFT COMMAND SERVER UNABLE TO OPEN REPLY TO QUEUE
14.37.46 STC01132 CSQN203I -MPFT API COMPLETION CODE=2, REASON CODE=2085
14.37.47 STC01132 IEC705I TAPE ON 0780,MPFT01,SL,NOCOMP,MPFTMSTR,MPFTMSTR,CSQFTA1.B0000002
14.37.52 STC01132 IEC205I SYS00010,MPFTMSTR,MPFTMSTR,FILESEQ=0001, COMPLETE VOLUME LIST,
DSN=CSQFTA1.B0000002 ,VOLS=MPFT01,TOTALBLOCKS=19
14.37.53 STC01132 IKJ56221I DATA SET CSQFTA2.B0000002 NOT ALLOCATED, VOLUME NOT AVAILABLE+
14.37.53 STC01132 IKJ56221I VOLUME NECESSARY TO SATISFY YOUR REQUEST NOT ON SYSTEM, AND CANNOT BE MOUNTED
14.37.53 STC01132 CSQJ008E -MPFT 2 OF 8 ACTIVE LOGS ARE FULL. MPFT NEEDS ARCHIVE SCRATCH
14.37.53 STC01132 *15 CSQJ021D -MPFT REPLY Y WHEN DEVICE READY OR N TO CANCEL
14.37.58 STC01132 R 15,Y
14.37.59 STC01132 *IEF233D M 0680,PRIVAT,SL,MPFTMSTR,MPFTMSTR,CSQFTA2.B0000002,
OR RESPOND TO IEF455D MESSAGE
14.37.59 STC01132 *16 IEF455D MOUNT PRIVAT ON 0680 FOR MPFTMSTR MPFTMSTR OR REPLY 'NO'
14.38.58 STC01132 IEC705I TAPE ON 0680,MPFT02,SL,NOCOMP,MPFTMSTR,MPFTMSTR,CSQFTA2.B0000002
14.39.03 STC01132 IEC205I SYS00012,MPFTMSTR,MPFTMSTR ,FILESEQ=0001, COMPLETE VOLUME LIST,
DSN= CSQFTA2.B0000002 ,VOLS=MPFT02,TOTALBLOCKS=19
14.39.43 STC01132 IEC205I SYS00010,MPFTMSTR,MPFTMSTR,FILESEQ=0002, COMPLETE VOLUME LIST,
DSN=CSQFTA1.A0000002,VOLS=MPFT01,TOTALBLOCKS=12024
14.39.55 STC01132 IEF234E K 0780,MPFT01,PVT,MPFTMSTR,MPFTMSTR
14.39.55 STC01132 CSQJ003I -MPFT FULL ARCHIVE LOG VOLUME
DSNAME=CSQFTA1.A0000002, STARTRBA=000004203000, ENDRBA=000012CDAFFF,
UNIT=3590, COPY1VOL=MPFT01, VOLSPAN=00, CATLG=NO
14.39.59 STC01132 IEC205I SYS00012,MPFTMSTR,MPFTMSTR,FILESEQ=0002, COMPLETE VOLUME LIST,
DSN=CSQFTA2.A0000002,VOLS=MPFT02,TOTALBLOCKS=12024
14.40.12 STC01132 IEF234E K 0680,MPFT02,PVT,MPFTMSTR,MPFTMSTR
14.40.12 STC01132 CSQJ003I -MPFT FULL ARCHIVE LOG VOLUME
DSNAME=CSQFTA2.A0000002, STARTRBA=000004203000, ENDRBA=000012CDAFFF,
UNIT=3590, COPY2VOL=MPFT02, VOLSPAN=00, CATLG=NO
14.40.12 STC01132 CSQJ139I -MPFT LOG OFFLOAD TASK ENDED
14.46.06 STC01132 CSQ3201E -MPFT ABNORMAL EOT IN PROGRESS FOR
USER=TFPUSR CONNECTION-ID=CICSTFP THREAD-XREF=
14.46.06 STC01132 CSQ3201E -MPFT ABNORMAL EOT IN PROGRESS FOR
USER=TFPUSR CONNECTION-ID=CICSTFP THREAD-XREF=
14.46.06 STC01132 CSQ3201E -MPFT ABNORMAL EOT IN PROGRESS FOR
USER=TFPUSR CONNECTION-ID=CICSTFP THREAD-XREF=
14.46.06 STC01132 CSQ3201E -MPFT ABNORMAL EOT IN PROGRESS FOR
USER=TFPUSR CONNECTION-ID=CICSTFP THREAD-XREF=
14.46.06 STC01132 CSQ3201E -MPFT ABNORMAL EOT IN PROGRESS FOR
USER=TFPUSR CONNECTION-ID=CICSTFP THREAD-XREF=
14.46.06 STC01132 CSQ3201E -MPFT ABNORMAL EOT IN PROGRESS FOR
USER=TFPUSR CONNECTION-ID=CICSTFP THREAD-XREF=
14.46.06 STC01132 CSQ3201E -MPFT ABNORMAL EOT IN PROGRESS FOR
USER=TFPUSR CONNECTION-ID=CICSTFP THREAD-XREF=
14.46.06 STC01132 CSQ3201E -MPFT ABNORMAL EOT IN PROGRESS FOR
USER=TFPUSR CONNECTION-ID=CICSTFP THREAD-XREF=
14.46.10 STC01132 CSQ3201E -MPFT ABNORMAL EOT IN PROGRESS FOR
USER=TFPUSR CONNECTION-ID=CICSTFP THREAD-XREF=
15.21.38 STC01132 CSQ3201E -MPFT ABNORMAL EOT IN PROGRESS FOR
STMT NO. MESSAGE
2 IEFC001I PROCEDURE MPFTMSTR WAS EXPANDED USING SYSTEM LIBRARY SYS1.PROCLIB
IEF695I START MPFTMSTR WITH JOBNAME MPFTMSTR IS ASSIGNED TO USER MPFTUSR , GROUP PTFM
IEF236I ALLOC. FOR MPFTMSTR MPFTMSTR
IEF237I F331 ALLOCATED TO STEPLIB
IEF237I F327 ALLOCATED TO
IEF237I F331 ALLOCATED TO
IEF237I F329 ALLOCATED TO BSDS1
IEF237I F328 ALLOCATED TO BSDS2
IEF237I F327 ALLOCATED TO CSQINP1
IEF237I F327 ALLOCATED TO CSQINP2
IEF237I F327 ALLOCATED TO
IEF237I F327 ALLOCATED TO
IEF237I F327 ALLOCATED TO
IEF237I F327 ALLOCATED TO
IEF237I F327 ALLOCATED TO
IEF237I JES2 ALLOCATED TO CSQOUT1
IEF237I JES2 ALLOCATED TO CSQOUT2
IEF237I F327 ALLOCATED TO CSQP0000
IEF237I F327 ALLOCATED TO CSQP0001
IEF237I F327 ALLOCATED TO CSQP0002
IEF237I F327 ALLOCATED TO CSQP0003
IKJ56221I DATA SET CSQFTA1.B0000002 NOT ALLOCATED, VOLUME NOT AVAILABLE+
IKJ56221I VOLUME NECESSARY TO SATISFY YOUR REQUEST NOT ON SYSTEM, AND CANNOT BE MOUNTED
IEC205I SYS00010,MPFTMSTR,MPFTMSTR,FILESEQ=0001, COMPLETE VOLUME LIST,
DSN=CSQFTA1.B0000002,VOLS=MPFT01,TOTALBLOCKS=19
IKJ56221I DATA SET CSQFTA2.B0000002 NOT ALLOCATED, VOLUME NOT AVAILABLE+
IKJ56221I VOLUME NECESSARY TO SATISFY YOUR REQUEST NOT ON SYSTEM, AND CANNOT BE MOUNTED
IEC205I SYS00012,MPFTMSTR,MPFTMSTR,FILESEQ=0001, COMPLETE VOLUME LIST,
DSN=CSQFTA2.B0000002,VOLS=MPFT02,TOTALBLOCKS=19
IEC205I SYS00010,MPFTMSTR,MPFTMSTR,FILESEQ=0002, COMPLETE VOLUME LIST,
DSN=CSQFTA1.A0000002,VOLS=MPFT01,TOTALBLOCKS=12024
IEF285I CSQFTA1.A0000002 KEPT
IEF285I VOL SER NOS= MPFT01.
IEC205I SYS00012,MPFTMSTR,MPFTMSTR,FILESEQ=0002, COMPLETE VOLUME LIST,
DSN=CSQFTA2.A0000002,VOLS=MPFT02,TOTALBLOCKS=12024
IEF285I CSQFTA2.A0000002 KEPT
IEF285I VOL SER NOS= MPFT02. |
|
| Back to top |
|
 |
| Mr Butcher |
| Posted: Tue Aug 15, 2006 9:20 pm Post subject: |
|
|
Padawan
Joined: 23 May 2005
Posts: 1716
|
i would also expect MQ to continue to run untill all active logs are full. maybe you should report to IBM.
_________________
Regards, Butcher |
|
| Back to top |
|
|
| jefflowrey |
| Posted: Wed Aug 16, 2006 2:21 am Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
| Mr Butcher wrote: |
| i would also expect MQ to continue to run untill all active logs are full. |
Unless the next log file has been moved off to tape.
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
| Vitor |
| Posted: Wed Aug 16, 2006 2:30 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| jefflowrey wrote: |
| Mr Butcher wrote: |
| i would also expect MQ to continue to run untill all active logs are full. |
Unless the next log file has been moved off to tape. |
But wouldn't it ask for the specific volume to be mounted, rather than a scratch tape? 
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| jefflowrey |
| Posted: Wed Aug 16, 2006 3:01 am Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
| Vitor wrote: |
| jefflowrey wrote: |
| Mr Butcher wrote: |
| i would also expect MQ to continue to run untill all active logs are full. |
Unless the next log file has been moved off to tape. |
But wouldn't it ask for the specific volume to be mounted, rather than a scratch tape? |
I don't know. I'm not a mainframer.
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
| Vitor |
| Posted: Wed Aug 16, 2006 3:08 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| jefflowrey wrote: |
| Vitor wrote: |
| jefflowrey wrote: |
| Mr Butcher wrote: |
| i would also expect MQ to continue to run untill all active logs are full. |
Unless the next log file has been moved off to tape. |
But wouldn't it ask for the specific volume to be mounted, rather than a scratch tape? |
I don't know. I'm not a mainframer. |
IIRC if the next active log has been migrated off to tape due to lack of use (SMS migration or similar) the attempt to use it would trigger a mount request for the volume it was migrated to by tape number. This one seems to be asking for a scratch tape and I can't think of a obvious reason why.
But in most shops the log files are exempt from migration (like most system or sub-system files) because MQ will hang until the file is available like any other application. This is clearly as desireable as DB2 sitting waiting for a table to be retrieved! 
Mind you, it's been a while. It could all be different now, but that's how it worked back in my day..... 
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| Mr Butcher |
| Posted: Wed Aug 16, 2006 4:02 am Post subject: |
|
|
Padawan
Joined: 23 May 2005
Posts: 1716
|
| Quote: |
Mr Butcher wrote:
i would also expect MQ to continue to run untill all active logs are full.
Unless the next log file has been moved off to tape. |
the next log file is an active log file. and this one should not reside on tape. 2 of 8 active logs are used, so 6 are free (i assume this is dual logging so "logically"there are 3 active logs free). Because offloading an active log to archive log is asynchronous MQ continues to run with the next free active log dataset.
you can check with the csqju??? (see administration guide) utility to verify in the BSDS that the other active logs are free and ready for use. if they needed offloading too you would see different messages in the MSTR log (xxx percent of active log full and so on).
if mq is stuck during offload then this is not a normal behaviour. what version is that?
_________________
Regards, Butcher |
|
| Back to top |
|
|
| kevinf2349 |
| Posted: Wed Aug 16, 2006 8:46 am Post subject: |
|
|
Grand Master
Joined: 28 Feb 2003
Posts: 1311
Location: USA
|
| Quote: |
CSQJ021D REPLY Y WHEN DEVICE READY OR N TO CANCEL
Explanation: An archive log data set needs allocating, as indicated in the preceding CSQJ008E or CSQJ009E message.
System Action: The log service task waits for the operator's reply.
|
Wait a minute.....just checked again.....for message CSQJ008E and it says...
| Quote: |
| Defer giving a response. This causes offload to wait before processing. However, because offload is a separate service task, the wait does not affect MQ performance. |
Looks like it is time to call IBM
What does a listcat all on CSQFTA1.B0000002 show? |
|
| Back to top |
|
|
| frankdk |
| Posted: Tue Sep 19, 2006 2:43 pm Post subject: |
|
|
Novice
Joined: 10 Jun 2004
Posts: 20
Location: Copenhagen, Denmark
|
Can't see the version your running but...
In the old days the numbers of the CSQJ008 message was recorded when offload started. This means that your other 6 logs did almost certain fill up while this offload was waiting. I guess you would see a new offload shortly after this one finished with 6 out of 8 full datasets.
_________________
Regards,
Frank |
|
| Back to top |
|
|
|
|
|
| |
|
Page 1 of 1 |
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
|
|
