IBM Software Group

WebSphere MQ Basic Queue Manager Clusters

Tim Elwood WebSphere MQ Level 2 Customer Support

WebSphere Support Technical Exchange

IBM Software Group

Agenda
Terminology Benefits How queue manager clusters work Setting up a basic MQ cluster Display commands What's new in WebSphere MQ V7.0 Troubleshooting Tips References

WebSphere Support Technical Exchange

2 of 40

IBM Software Group

Terminology
Cluster - A cluster is a network of queue managers that are
logically associated in some way

Cluster queue manager - A cluster queue manager is a

queue manager that is a member of a cluster

Cluster queue A cluster queue is a queue that is hosted by

a cluster queue manager and made available to other queue managers in the cluster

Repository A repository is a collection of information about

the queue managers that are members of a cluster

WebSphere Support Technical Exchange

3 of 40

IBM Software Group

Terminology - cont. 1
Repository queue manager A repository queue manager is a
cluster queue manager that holds a full repository

Full repository A queue manager that hosts a complete set of

information about every queue manager in the cluster is referred to as having a full repository for the cluster.

Partial repository is a queue manager that contains partial set

of cluster information that includes knowledge about full repositories as well as other partial repository that it previously interacted with.

WebSphere Support Technical Exchange

4 of 40

IBM Software Group

Terminology - cont. 2
Cluster-receiver channel A cluster-receiver (CLUSRCVR)
channel definition provides the receiving end of a channel on which a cluster queue manager can receive messages from other queue managers in the cluster

Cluster-sender channel A cluster-sender (CLUSSDR)

channel definition provides the sending end of a channel on which a cluster queue manager can send cluster information as well as application messages to other clustered queue managers.

WebSphere Support Technical Exchange

5 of 40

IBM Software Group

Terminology - cont. 3
SYSTEM.CLUSTER.TRANSMIT.QUEUE is used to
transmit cluster and application messages.

SYSTEM.CLUSTER.COMMAND.QUEUE is used to
process internal cluster information messages.

SYSTEM.CLUSTER.REPOSITORY.QUEUE is used to
store cluster information.

WebSphere Support Technical Exchange

6 of 40

IBM Software Group

Cluster Overview

WebSphere Support Technical Exchange

7 of 40

IBM Software Group

Benefits
There are two reasons for using clusters: 1. Reduced system administration. A network of queue managers in a cluster involves fewer definitions Set up or change your network more quickly and easily with fewer definitions to make, and reduce the risk of making an error in your definitions. 2. Increased availability and workload balancing. Easier system administration Improved scalability workload can be distributed

WebSphere Support Technical Exchange

8 of 40

IBM Software Group

How queue manager clusters work?

Figure 7: A cluster of queue managers, showing manual and
auto-defined channels

WebSphere Support Technical Exchange

9 of 40

IBM Software Group

How queue manager clusters work? cont. 1

AMQRRMFA is the repository manager process
which governs all cluster activity for a queue manager.

Every cluster has at least one (preferably two)

queue managers holding full repositories of information about the queue managers, queues, and channels in a cluster

WebSphere Support Technical Exchange

10 of 40

IBM Software Group

How queue manager clusters work? cont. 2

Queue managers need a cluster-receiver and a
cluster-sender channel definitions in order to join a cluster.

Each queue manager that joins a cluster will need to

have a manually defined cluster-sender (CLUSSDR) channel to one of the full repositories.

A full repository is updated when it receives new

information from a queue manager that is trying to join a cluster.
WebSphere Support Technical Exchange 11 of 40

IBM Software Group

How queue manager clusters work? cont. 3

Queue managers build up their partial repositories
by making inquiries to full repository when they first need to access another queue or queue manager within a cluster.

Based on the information that a queue manager

receives from a full repository, it automatically creates a cluster-sender channel to the partial repository to send data across.

WebSphere Support Technical Exchange

12 of 40

IBM Software Group

How queue manager clusters work? cont. 4

Full repository queue managers will each need to
have manually defined cluster sender and cluster receiver channels made on the full repository queue managers

These channels are used exclusively by the full

repositories to send user data as well as resync cluster information to reflect changes in the cluster.

WebSphere Support Technical Exchange

13 of 40

IBM Software Group

Setting up a basic MQ cluster

Figure 5: The INVENTORY cluster with two queue managers

WebSphere Support Technical Exchange

14 of 40

IBM Software Group

Setting up a basic MQ cluster - cont. 1

Decide on the organization of the cluster and its
name Determine which queue managers should hold full repositories Alter the queue-manager definitions to add repository definitions ALTER QMGR REPOS(INVENTORY) AMQ8005: Websphere MQ queue manager changed.

WebSphere Support Technical Exchange

15 of 40

IBM Software Group

Setting up a basic MQ cluster - cont. 2

Define the CLUSRCVR channels
DEFINE CHANNEL(TO.LONDON) CHLTYPE(CLUSRCVR) TRPTYPE(TCP) CONNAME(LONDON.CHSTORE.COM) CLUSTER(INVENTORY) DESCR(TCP Cluster-receiver channel for queue manager LONDON) AMQ8014: Websphere MQ channel created. 07/09/98 12:56:35 No repositories for cluster INVENTORY

WebSphere Support Technical Exchange

16 of 40

IBM Software Group

Setting up a basic MQ cluster - cont. 3

Define the CLUSSDR channels
DEFINE CHANNEL(TO.NEWYORK) CHLTYPE(CLUSSDR) TRPTYPE(TCP) CONNAME(NEWYORK.CHSTORE.COM) CLUSTER(INVENTORY) DESCR(TCP Cluster-sender channel from LONDON to repository at NEWYORK) AMQ8014: Websphere MQ channel created. 07/09/98 13:00:18 Channel program started.

WebSphere Support Technical Exchange

17 of 40

IBM Software Group

Setting up a basic MQ cluster - cont. 4

Define the cluster queue
DEFINE QLOCAL(INVENTQ) CLUSTER(INVENTORY) AMQ8006: Websphere MQ queue created. The CLUSTER keyword causes the queue to be advertised to the cluster. As soon as the queue is defined it becomes available to the other queue managers in the cluster. Messages can be sent without having to make a remote-queue definition

WebSphere Support Technical Exchange

18 of 40

IBM Software Group

Setting up a basic MQ cluster - cont. 5

Verify and test the cluster
dis clusqmgr(*) AMQ8441: Display Cluster Queue Manager details. CLUSQMGR(NEWYORK) CLUSTER(INVENTORY) CHANNEL(TO.NEWYORK) AMQ8441: Display Cluster Queue Manager details. CLUSQMGR(LONDON) CLUSTER(INVENTORY) CHANNEL(TO.LONDON)

WebSphere Support Technical Exchange

19 of 40

IBM Software Group

Setting up a basic MQ cluster - cont. 6

DISPLAY CHANNEL STATUS command:
dis chstatus(*) AMQ8417: Display Channel Status details. CHANNEL(TO.NEWYORK) XMITQ( ) CONNAME(9.20.40.24) CURRENT CHLTYPE(CLUSRCVR) STATUS(RUNNING) RQMNAME(LONDON) AMQ8417: Display Channel Status details. CHANNEL(TO.LONDON) XMITQ(SYSTEM.CLUSTER.TRANSMIT.QUEUE) CONNAME(9.20.51.25) CURRENT CHLTYPE(CLUSSDR) STATUS(RUNNING) RQMNAME(LONDON)
WebSphere Support Technical Exchange 20 of 40

IBM Software Group

Setting up a basic MQ cluster - cont. 7

amqsput sample program within MQ used to put sample
messages amqsget sample program within MQ used to get sample messages On LONDON issue the command: amqsput INVENTQ LONDON. Type some messages 3. On NEW YORK issue the command: amqsget INVENTQ NEW YORK. You should now see the messages you entered on LONDON
WebSphere Support Technical Exchange 21 of 40

IBM Software Group

Setting up a basic MQ cluster - cont. 8

Define a cluster queue.
DEFINE QLOCAL(INVENTQ) CLUSTER(INVENTORY)

Other queue managers in the cluster can send

message to it without making remote-queue definitions for it.

You can only GET from a local cluster queue, but

you can PUT to any queue in a cluster.

WebSphere Support Technical Exchange

22 of 40

IBM Software Group

Multiple full repositories

Multiple full repositories require that each full
repository has a manually defined cluster sender channel to every other full repository in the cluster

WebSphere Support Technical Exchange

23 of 40

IBM Software Group

Display Commands
DISPLAY QUEUE(*) CLUSINFO DISPLAY QCLUSTER(*) ALL
Display Queue details. to display information about clustered queues

DISPLAY CHSTATUS(*) ALL

Display Channel Status details. Display Cluster Queue Manager details. Display Queue Manager details.

DISPLAY CLUSQMGR(*) ALL

DISPLAY QMGR REPOS REPOSNL QMID DISPLAY CLUSQMGR(qm name) DISPLAY CHSTATUS(channel name)
To see the auto-defined channels

WebSphere Support Technical Exchange

24 of 40

IBM Software Group

Clustered Topics new in WebSphere MQ V7.0

MQ cluster topics are MQ objects that
identifies what a publication is about.

When you define a cluster topic, the cluster

topic is published to the full repositories.

The queue manager on which you create a

cluster topic is known as a cluster topic host

WebSphere Support Technical Exchange

25 of 40

IBM Software Group

Clustered Topics scenario

Cluster Name: NEWCLUSTER QM1 - full repository QM2 - full repository QM3 - partial repository Clustered Topic Object: Name: TESTTOPIC Topic String: PUBSUBV7 Local to QMgr: QM1

WebSphere Support Technical Exchange

26 of 40

IBM Software Group

Clustered Topics scenario 1

runmqsc QM1 define topic(TESTTOPIC) topicstr(PUBSUBV7) cluster(NEWCLUSTER) display topic(TESTTOPIC) 2 : display topic(TESTTOPIC) AMQ8633: Display topic details. TOPIC(TESTTOPIC) TOPICSTR(PUBSUBV7) CLUSTER(NEWCLUSTER) PUB(ASPARENT) DEFPSIST(ASPARENT) DEFPRESP(ASPARENT) ALTTIME(13.54.04) NPMSGDLV(ASPARENT) SUBSCOPE(ASPARENT) WILDCARD(PASSTHRU) MNDURMDL( )

TYPE(LOCAL) DESCR( ) DURSUB(ASPARENT) SUB(ASPARENT) DEFPRTY(ASPARENT) ALTDATE(2009-06-26) PMSGDLV(ASPARENT) PUBSCOPE(ASPARENT) PROXYSUB(FIRSTUSE) MDURMDL( )

WebSphere Support Technical Exchange

27 of 40

IBM Software Group

Clustered Topics scenario 2

In QM2, we need to provide an additional qualifier:
TYPE(CLUSTER)
display topic(TESTTOPIC) TYPE(CLUSTER) 2 : display topic(TESTTOPIC) TYPE(CLUSTER) AMQ8633: Display topic details. TOPIC(TESTTOPIC) TYPE(CLUSTER) TOPICSTR(PUBSUBV7) DESCR( ) CLUSTER(NEWCLUSTER) CLUSQMGR(QM1) QMID(QM1_2008-06-16_14.26.07) DURSUB(ASPARENT) PUB(ASPARENT) SUB(ASPARENT) DEFPSIST(ASPARENT) DEFPRTY(ASPARENT) DEFPRESP(ASPARENT) CLUSDATE(2009-06-26) CLUSTIME(13.54.04) ALTDATE(2009-06-26) ALTTIME(13.54.04) PMSGDLV(ASPARENT) NPMSGDLV(ASPARENT) PUBSCOPE(ASPARENT) SUBSCOPE(ASPARENT) PROXYSUB(FIRSTUSE) WILDCARD(PASSTHRU) MDURMDL( ) MNDURMDL( )

WebSphere Support Technical Exchange

28 of 40

IBM Software Group

Clustered Topics References

Sample scenarios to show Pub/Sub of Clustered
Topics in MQ V7: 7016146
http://www-01.ibm.com/support/docview.wss?rs=171&uid=swg27016146

Authorizations needed for non-mqm users to

publish and subscribe to Topics in MQ V7
http://www-01.ibm.com/support/docview.wss?rs=171&uid=swg27016153

WebSphere Support Technical Exchange

29 of 40

IBM Software Group

Troubleshooting Tips
Is the repository manager still running?
ps ef | grep amqrrmfa for UNIX look for amqrrmfa process in Task manager on W indows

Are channels able to run in both directions?

Display CHSTATUS information.

Are the SYSTEM.CLUSTER.* queues PUT/GET enabled?

Issue DISPLAY QUEUE(SYSTEM.C*) ALL

Are there messages on

SYSTEM.CLUSTER.COMMAND.QUEUE or SYSTEM.CLUSTER.TRANSMIT.QUEUE? DISPLAY QL(Queue name) curdepth

WebSphere Support Technical Exchange

30 of 40

IBM Software Group

Troubleshooting Tips Cont 1

Are there duplicate QMIDs for a given QMGR?
Issue DISPLAY CLUSQMGR(*) QMID

Are any of the queue managers suspended from the cluster

DISPLAY CLUSQMGR(*) suspend

A cluster sender channel is in retry state. 1 : display chs(*)

AMQ8417: Display Channel Status details. CHANNEL(TO.QM2) XMITQ (SYSTEM.CLUSTER.TRANSMIT.QUEUE) CONNAME(computer.ibm.com(1414)) CURRENT CHLTYPE(CLUSSDR) STATUS(RETRYING)

WebSphere Support Technical Exchange

31 of 40

IBM Software Group

Troubleshooting Tips Cont 2

RC=2035 MQRC_NOT_AUTHORIZED RC=2085 MQRC_UNKNOWN_OBJECT_NAME RC=2189 MQRC_CLUSTER_RESOLUTION_ERROR
display clusqmgr(*) qmtype status

WebSphere Support Technical Exchange

32 of 40

IBM Software Group

Troubleshooting Tips Cont 3

Chapter 4 Troubleshooting of the W ebSphere MQ Queue
Managers Cluster guide

Understanding First-failure support technology (FFST)

records How to determine if the FFST is the result of a known defect, or a user error. http://www.ibm.com/support/docview.wss? acss=wmq091808&rs=171&uid=swg21304647

Technote:1229905 W ebSphere MQ Clustering - Cluster

hints and tips

WebSphere Support Technical Exchange

33 of 40

IBM Software Group

References Manuals
For more complex operations, See Chapter 4 of the
of the Queue Manager Clusters manual for more advanced topics on how to use queue-manager aliases, reply-to queue aliases, and queue aliases.
http://www-01.ibm.com/software/integration/wmq/library/ http://publib.boulder.ibm.com/infocenter/wmqv7/v7r0/ index.jsp?topic=/com.ibm.mq.amqnar.doc/ps10120_.htm

WebSphere MQ All versions and platforms MQ v7.0 Publish/Subscribe User's Guide

WebSphere Support Technical Exchange

34 of 40

IBM Software Group

References: cont. 1 Best Practices

The top 15 WebSphere MQ best practices
This article describes the most common best practices in designing, building, running, and maintaining W ebSphere MQ solutions in order to achieve the full benefits of W ebSphere MQ. http://www.ibm.com/developerworks/websphere/library/ techarticles/0807_hsieh/0807_hsieh.html?ca=dnbwmq091808 W ebSphere MQ Family SupportPacs provide you with a wide range of downloads (code) and documentation that complements the W ebSphere MQ family of products. The majority of SupportPacs are available at no charge to users. http://www.ibm.com/support/docview.wss? acss=wmq091808&rs=171&uid=swg27007197#1

WebSphere MQ SupportPacs

WebSphere Support Technical Exchange

35 of 40

IBM Software Group

References: cont. 2 MustGather

MustGather: Read first for WebSphere MQ
http://www.ibm.com/support/docview.wss? acss=wmq091808&rs=171&uid=swg21229861

MustGather documents aid in problem determination and save time resolving W ebSphere MQ Problem Management Records (PMRs).

MustGather: MQ cluster problems (All platforms)

http://www-01.ibm.com/support/docview.wss? rs=171&context=SSFKSJ&context=SSEP7X&dc=DA420&dc=DA480&dc=DA490&dc=DA 430&dc=DA410&dc=DB600&dc=DA400&dc=D600&dc=D700&dc=DB520&dc=DB510&d c=DA500&dc=DA470&dc=DA4A20&dc=DA460&dc=DA440&dc=DB550&dc=DB560&dc= DB700&dc=DB530&dc=DA4A10&dc=DA4A30&dc=DB540&q1=1229861&uid=swg21229 861&loc=en_US&cs=utf-8&lang=en

amqrfdm. This program is shipped with W ebSphere MQ and is

used to dump information about the cluster. A typical command for amqrfdm is as follows:
amqrfdm -m myqmgr < /tmp/respfile.unix.txt > myqmgr.out

WebSphere Support Technical Exchange

36 of 40

IBM Software Group

References: cont. 3 Planned maintenance

Recommended fixes for WebSphere MQ
This provides links to the latest available maintenance for the W ebSphere MQ family products. http://www.ibm.com/support/docview.wss? acss=wmq091808&rs=171&uid=swg27006037

Fixes by version for WebSphere MQ

Fixes by version for W ebSphere MQ summarizes the maintenance organized by Version, Release and Modification (VRM) and operating system. http://www.ibm.com/support/docview.wss? acss=wmq091808&rs=171&uid=swg21254675

WebSphere Support Technical Exchange

37 of 40

IBM Software Group

References: cont. 4 Education

Support Page
Primary support resources for WebSphere MQ. http://www.ibm.com/software/integration/wmq/support/?acss=wmq091808 Find out how online software support tools and resources can save you time, keep you informed, provide training, and help streamline your support experience! http://www.ibm.com/software/websphere/support/d2w.html?acss=wmq091808 Take full advantage of your product. Join us as technical experts share their knowledge and then answer your questions. Visit this site often to see upcoming topics and to review previously recorded webcasts. http://www.ibm.com/software/websphere/support/supp_tech.html?acss=wmq091808 Select a course for description, schedule, and enrollment information, or see a list of all course categories. http://www.ibm.com/software/websphere/education/curriculum/appint/wmq/? acss=wmq091808 This series of five tutorials can help you get ready for the IBM certification tests. http:// www.ibm.com/developerworks/offers/lp/wescert/wes-cert996.html?ca=dnb-wmq091808

Self-Assist Resources and Tools

Technical Exchange Webcasts

Course list: WebSphere MQ

WebSphere MQ certification prep series

WebSphere Support Technical Exchange

38 of 40

IBM Software Group

Summary
Use the WebSphere MQ Queue Manager Clusters
manual as guidance for configuration, administration, and troubleshooting Search the support database for fixes and solutions Reference Best Practices, Troubleshooting, & MustGather for additional help guidance Be sure to stay up-to-date with latest maintenance fix packs

WebSphere Support Technical Exchange

39 of 40

IBM Software Group

Questions and Answers

WebSphere Support Technical Exchange

40 of 40