| Author |
Message
|
| Challenger |
 Posted: Thu Jan 29, 2009 5:58 am Post subject: |
 |
|
Centurion
Joined: 31 Mar 2008
Posts: 115
|
OK, time to close out the challenge and award the necessary kudos...
The error was induced by 'someone' defining an explicit CLUSSDR from a Full Repository to a Partial Repository within the same cluster - and I'm pretty sure that the namelists had a bearing too. I took a sub-set of the clusters (6 queue managers within 4 different clusters) by backing up the required objects, and built that sub-set in a controlled environment - my laptop (I thought it would be a nice intellectual challenge). All went well until joining the last queue manager (the FR that had the explicit CLUSSDR to a PR in it) to the fourth cluster, at which point the Repository Manager failed almost instantly. Subsequent tear down of the queue managers and rebuild again with separated cluster CLUSSDR/CLUSRCVR channels solved the issue - no surprises there!
I should point out that the problem determination and its resolution was not found by me, but by some clever chappies whom were on-site before me. The cunning plan to prevent it ever happening again was to build new 'Super Repositories' which would be FR's for all the clusters and migrate queue manager connections to them by defining discrete CLUSSDR/CLUSRCVR channels per cluster.
So on to the winner and honourable mentions etc...
Winner
I'm going to declare zax the winner as he correctly stated how to manually restart the failed Repository Manager process, and very impressive as a first post.
Honourable Mentions
These go to dgolding for identifying the poison message issue, and fjb_saper for getting very close to identifying the root cause and also for sharing his 'educational' post with us.
Kudos
To all those who gave it a go - thank you!
And lastly...there is probably another mug in it for anyone who can identify me  |
|
| Back to top |
|
 |
| mqjeff |
| Posted: Thu Jan 29, 2009 6:01 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
| Challenger wrote: |
| And lastly...there is probably another mug in it for anyone who can identify me |
I don't need the mug,but the use of the word "chappies" is a fair bet you're not from North America. |
|
| Back to top |
|
|
| Challenger |
| Posted: Thu Jan 29, 2009 4:31 pm Post subject: |
|
|
Centurion
Joined: 31 Mar 2008
Posts: 115
|
| mqjeff wrote: |
| I don't need the mug,but the use of the word "chappies" is a fair bet you're not from North America. |
Correct! Also, my current work location is not my country of origin... |
|
| Back to top |
|
|
| fjb_saper |
| Posted: Fri Jan 30, 2009 4:48 am Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20729
Location: LI,NY
|
Now I get it:
The name list on the defined cluster sender even though matching the name list on the cluster receiver does not match the name list/cluster name on the destination repository.
In other words you have a defined cluster sender that goes to a full repository for some of the clusters you participate in and a partial repository for others and you did not adjust your defined cluster senders or the namelists accordingly.... 
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| Challenger |
| Posted: Fri Jan 30, 2009 10:01 am Post subject: |
|
|
Centurion
Joined: 31 Mar 2008
Posts: 115
|
| Believe me, if you'd seen it you'd see how easy it was to get confused... |
|
| Back to top |
|
|
| dgolding |
| Posted: Sun Feb 01, 2009 1:41 am Post subject: |
|
|
Yatiri
Joined: 16 May 2001
Posts: 668
Location: Switzerland
|
I saw a trout reference early on, so I'm guessing it's Vitor, who seems to have a thing about trouts  |
|
| Back to top |
|
|
| Challenger |
| Posted: Sun Feb 01, 2009 3:47 am Post subject: |
|
|
Centurion
Joined: 31 Mar 2008
Posts: 115
|
| dgolding wrote: |
| I saw a trout reference early on, so I'm guessing it's Vitor, who seems to have a thing about trouts |
Nice try Mr. Golding - but again no dice! It is not my master...(BIG hint). |
|
| Back to top |
|
|
| Vitor |
| Posted: Sun Feb 01, 2009 5:16 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| dgolding wrote: |
| I'm guessing it's Vitor, who seems to have a thing about trouts |
Hey, it's just a hobby, I could stop any time I wanted if I wanted..... 
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| Vitor |
| Posted: Sun Feb 01, 2009 5:19 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| Challenger wrote: |
| Nice try Mr. Golding - but again no dice! It is not my master...(BIG hint). |
So THIS is where you've been going! 
Get back to the dungeon, oil the switch and take your hump medicine. 
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| Challenger |
| Posted: Sun Feb 01, 2009 6:55 am Post subject: |
|
|
Centurion
Joined: 31 Mar 2008
Posts: 115
|
| Vitor wrote: |
So THIS is where you've been going!
Get back to the dungeon, oil the switch and take your hump medicine. |
Dungeon cleaned, thwitth oiled, and hump medithine taken mathter - itth working wonderth, the humpth getting much bigger!  |
|
| Back to top |
|
|
| AkankshA |
| Posted: Sun Feb 01, 2009 8:18 pm Post subject: |
|
|
Grand Master
Joined: 12 Jan 2006
Posts: 1494
Location: Singapore
|
are you exerk ??
_________________
Cheers |
|
| Back to top |
|
|
| SAFraser |
| Posted: Sun Feb 01, 2009 9:42 pm Post subject: |
|
|
Shaman
Joined: 22 Oct 2003
Posts: 742
Location: Austin, Texas, USA
|
| I vote with AkankshA. It's totally exerk. |
|
| Back to top |
|
|
| exerk |
| Posted: Mon Feb 02, 2009 1:49 am Post subject: |
|
|
Jedi Council
Joined: 02 Nov 2006
Posts: 6339
|
AkankshA and SAFraser...how are you going to share that mug?
_________________
It's puzzling, I don't think I've ever seen anything quite like this before...and it's hard to soar like an eagle when you're surrounded by turkeys. |
|
| Back to top |
|
|
| Vitor |
| Posted: Mon Feb 02, 2009 2:12 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| exerk wrote: |
| AkankshA and SAFraser...how are you going to share that mug? |
We either need a ruling on mug availability, or a lot of caution and no hot drinks...... 
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| exerk |
| Posted: Mon Feb 02, 2009 2:18 am Post subject: |
|
|
Jedi Council
Joined: 02 Nov 2006
Posts: 6339
|
Did I pleathe my mathter? 
_________________
It's puzzling, I don't think I've ever seen anything quite like this before...and it's hard to soar like an eagle when you're surrounded by turkeys. |
|
| Back to top |
|
|
|
|
