| Author |
Message
|
| giorginus80 |
 Posted: Wed Apr 22, 2009 6:51 am Post subject: Failed to allocate memory anyone solved? |
 |
|
Centurion
Joined: 08 Jul 2008
Posts: 124
Location: Rome, Italy
|
Hi,
I have big message in my flows, and sometime my broker crash giving me Dequeud failed, and I have an abend file:
| Code: |
+-----------------------------------------------------------------------------+
| |
| |
| First Failure Symptom Report |
| ======================== |
| |
| |
| |
| |
| |
| |
| |
| |
| Proc start time :- Wed Apr 22 16:49:46 2009 |
| |
| Product Details |
| +++++++++++++++ |
| |
| |
| |
| |
| |
| |
| |
| Vendor :- IBM |
| Product Name :- WebSphere Message Brokers |
| Program ID :- 5724-J04 |
| Version :- 6103 |
| |
| OS Information |
| ++++++++++++++ |
| |
| |
| |
| |
| |
| |
| |
| Operating System :- Linux |
| Version :- #1 SMP Fri Jan 26 14:15:21 EST 2007 |
| Release :- 2.6.18-8.el5 |
| Node Name :- SRV-PA-CDR-2 |
| Machine ID :- i686 |
| |
| Environment |
| +++++++++++ |
| |
| |
| |
| |
| |
| |
| |
| Installation Path :- /opt/ibm/mqsi/6.1 |
| Service User ID :- UID 512 |
| Work Path :- /var/mqsi |
| Executable Name :- DataFlowEngine |
| Process ID :- 6327 |
| |
| Deployment |
| ++++++++++ |
| |
| |
| |
| |
| |
| |
| |
| Component Name :- BROKER |
| Component UUID :- bf6243ce-2001-0000-0080-d3b66278f4eb |
| Queue Manager :- BROKER_QM |
| Data Source Name :- BROKERDB |
| DB User ID :- broker |
| Execution Group :- sir |
| EG UUID :- 5e7b43ce-2001-0000-0080-e86d54209d1a |
| Main EG :- yes |
| User trace :- 0 |
| Service trace :- 0 |
| Trace size :- 0 |
| |
| Build Information |
| +++++++++++++++++ |
| |
| |
| |
| |
| |
| |
| |
| Backing build :- |
| Sandbox :- /build/S610_P |
| CMVC Level :- S610-FP03 |
| Build type :- Production |
| 64 Bit Build :- no |
| |
| Failure Location |
| ++++++++++++++++ |
| |
| |
| |
| |
| |
| |
| |
| Time of Report :- secs since 1/1/1970: 1240412374 |
| Message Flow :- it.capgemini.emsg.EMessageFlow |
| Thread ID :- 0x0000000D |
| |
+-----------------------------------------------------------------------------+
abend record for pid 6327 tid 13 time in seconds since 01/01/1970: 1240412374
File: /build/S610_P/src/CommonServices/Unix/ImbAbend.cpp
Line: 2016
Function: ImbAbend::newHandler
---- Inserts ----
Failed to allocate memory
-----------------
----------------------------- Stack dump for current thread ( 13)
/opt/ibm/mqsi/6.1/lib/libCommonServices.so(_ZN8ImbAbend26printStackForCurrentThreadEibPKvPv+0x31)[0xa78721]
/opt/ibm/mqsi/6.1/lib/libCommonServices.so(_ZN8ImbAbend23dumpCurrentStacksToFileEPKvi+0x11a)[0x84a81a]
/opt/ibm/mqsi/6.1/lib/libCommonServices.so(_ZN8ImbAbend10dumpToFileEPcPKciS2_RKNS_6InsertES5_S5_S5_S5_S5_PKv+0x253)[0x84b373]
/opt/ibm/mqsi/6.1/lib/libCommonServices.so(_ZN8ImbAbend22logSystemErrorInternalEPKciS1_RKNS_6InsertES4_S4_S4_S4_S4_PKvb+0x29a)[0x84c27a]
/opt/ibm/mqsi/6.1/lib/libCommonServices.so(_ZN8ImbAbend41logSystemErrorAndTerminateProcessInternalEPKciS1_RKNS_6InsertES4_S4_S4_S4_S4_PKvb+0x8b)[0x84cc6b]
/opt/ibm/mqsi/6.1/lib/libCommonServices.so(_ZN8ImbAbend10newHandlerEv+0xa5)[0x84cdf5]
/usr/lib/libstdc++.so.5(_Znwj+0x4e)[0x21d64e]
/usr/lib/libstdc++.so.5(_Znaj+0x1f)[0x21d77f]
/opt/ibm/mqsi/6.1/lib/libPersonality.so(_ZN10ImbWstring7reserveEj+0xe8)[0x5b1218]
/opt/ibm/mqsi/6.1/lib/libCommonServices.so(_ZN9ImbBase6412base64encodeEPKci+0xa4)[0x857754]
/opt/ibm/mqsi/6.1/lib/libCommonServices.so(_ZN9ImbBase6412base64encodeEPKhi+0x30)[0x857940]
/opt/ibm/mqsi/6.1/lil/imbgxml4.lil(_ZN15ImbXMLNSCWriter22xmlStringFromByteArrayERK8ImbValuei+0x19c)[0x2699f4c]
/opt/ibm/mqsi/6.1/lil/imbgxml4.lil(_ZN15ImbXMLNSCWriter17getCharacterValueEP16ImbSyntaxElement+0x252)[0x269e482]
/opt/ibm/mqsi/6.1/lil/imbgxml4.lil(_ZN15ImbXMLNSCWriter12writeElementEP16ImbSyntaxElement+0x1dd7)[0x26a49b7]
/opt/ibm/mqsi/6.1/lil/imbgxml4.lil(_ZN15ImbXMLNSCWriter20writeElementChildrenEP16ImbSyntaxElement+0x3c)[0x26a535c]
/opt/ibm/mqsi/6.1/lil/imbgxml4.lil(_ZN15ImbXMLNSCWriter12writeElementEP16ImbSyntaxElement+0x1e9d)[0x26a4a7d]
/opt/ibm/mqsi/6.1/lil/imbgxml4.lil(_ZN15ImbXMLNSCWriter11writeBufferEP14ImbWriteBufferP16ImbSyntaxElementllb+0x4fc)[0x26a58ac]
/opt/ibm/mqsi/6.1/lil/imbgxml4.lil(_ZN15ImbXMLNSCParser34refreshBitStreamFromElementsCommonERK17ImbMessageOptionsR14ImbWriteBufferP16ImbSyntaxElementiiRK10ImbWstringS9_S9_b+0xd3)[0x26842d3]
/opt/ibm/mqsi/6.1/lil/imbgxml4.lil(_ZN15ImbXMLNSCParser28refreshBitStreamFromElementsERK17ImbMessageOptionsR14ImbWriteBufferP16ImbSyntaxElementiiRK10ImbWstringS9_S9_+0x119)[0x2684b99]
/opt/ibm/mqsi/6.1/lib/libMessageServices.so(_ZN16ImbSyntaxElement17asBitStreamBufferERK17ImbMessageOptionsR15ImbCommonBufferiiRK10ImbWstringS7_S7_+0x75)[0xc1a305]
/opt/ibm/mqsi/6.1/lil/imbdfbas.lil(_ZNK10ImbMessage10ReadCursor17asBitStreamBufferERK17ImbMessageOptionsR15ImbCommonBufferiiRK10ImbWstringS8_S8_+0x16c)[0x98af5ec]
/opt/ibm/mqsi/6.1/lil/imbdfbas.lil(_ZN23ImbResetContentDescNode8evaluateERK18ImbMessageAssemblyPK19ImbDataFlowTerminal+0xafa)[0x98a346a]
/opt/ibm/mqsi/6.1/lib/libMessageServices.so(_ZN19ImbDataFlowTerminal8evaluateERK18ImbMessageAssembly+0x187)[0xd9d377]
/opt/ibm/mqsi/6.1/lib/libMessageServices.so(_ZN19ImbDataFlowTerminal14propagateInnerERK18ImbMessageAssemblyPS_+0x92)[0xd9d722]
/opt/ibm/mqsi/6.1/lib/libMessageServices.so(_ZN19ImbDataFlowTerminal9propagateERK18ImbMessageAssembly+0x59f)[0xda1d6f]
/opt/ibm/mqsi/6.1/lil/imbdfsql.lil(_ZN14ImbComputeNode19propagateToTerminalERK8ImbValueiRK18ImbMessageAssemblyS5_+0x351)[0x97f6031]
/opt/ibm/mqsi/6.1/lib/libImbRdl.so(_ZNK19SqlComputeInterface19propagateToTerminalERK8ImbValueiRK18ImbMessageAssemblyRS3_+0x64)[0x8126c34]
/opt/ibm/mqsi/6.1/lib/libImbRdl.so(_ZNK21SqlPropagateStatement7executeER18SqlStatementResult+0xfc8)[0x834a878]
/opt/ibm/mqsi/6.1/lib/libImbRdl.so(_ZNK17SqlStatementGroup7executeER18SqlStatementResult+0x6c)[0x846f0ac]
/opt/ibm/mqsi/6.1/lib/libImbRdl.so(_ZNK15SqlCompoundStmt7executeER18SqlStatementResult+0x2cf)[0x811f15f]
/opt/ibm/mqsi/6.1/lib/libImbRdl.so(_ZNK10SqlRoutine6invokeER18SqlStatementResultRK15auto_ptr_vectorI17SqlExpressionNodeERKN4_STL8auto_ptrIS3_EESB_b+0x250)[0x8441fb0]
/opt/ibm/mqsi/6.1/lib/libImbRdl.so(_ZNK25SqlCallableFunctionFnCall8evaluateER9SqlResult+0x16b)[0x8119efb]
/opt/ibm/mqsi/6.1/lib/libImbRdl.so(_ZNK17SqlExpressionNode8evaluateER14SqlEvalEnvironR8ImbValue+0x40)[0x81a3230]
/opt/ibm/mqsi/6.1/lib/libImbRdl.so(_ZNK13SqlAssignment7executeER18SqlStatementResult+0xc55)[0x80ecf45]
/opt/ibm/mqsi/6.1/lib/libImbRdl.so(_ZNK17SqlStatementGroup7executeER18SqlStatementResult+0x6c)[0x846f0ac]
/opt/ibm/mqsi/6.1/lib/libImbRdl.so(_ZNK15SqlCompoundStmt7executeER18SqlStatementResult+0x2cf)[0x811f15f]
/opt/ibm/mqsi/6.1/lib/libImbRdl.so(_ZNK10SqlRoutine7executeER18SqlStatementResult+0x52a)[0x8441aba]
/opt/ibm/mqsi/6.1/lib/libImbRdl.so(_ZNK9SqlModule7executeER18SqlStatementResult+0x10b)[0x82b93bb]
/opt/ibm/mqsi/6.1/lib/libImbRdl.so(_ZNK9SqlSchema7executeER18SqlStatementResult+0x22)[0x8450552]
/opt/ibm/mqsi/6.1/lib/libImbRdl.so(_ZN19SqlComputeInterface8evaluateERK18ImbMessageAssemblyRS0_+0x4f7)[0x812a8e7]
/opt/ibm/mqsi/6.1/lil/imbdfsql.lil(_ZN14ImbComputeNode8evaluateERK18ImbMessageAssemblyPK19ImbDataFlowTerminal+0x486)[0x97f80c6]
/opt/ibm/mqsi/6.1/lib/libMessageServices.so(_ZN19ImbDataFlowTerminal8evaluateERK18ImbMessageAssembly+0x187)[0xd9d377]
/opt/ibm/mqsi/6.1/lib/libMessageServices.so(_ZN19ImbDataFlowTerminal14propagateInnerERK18ImbMessageAssemblyPS_+0x92)[0xd9d722]
/opt/ibm/mqsi/6.1/lib/libMessageServices.so(_ZN19ImbDataFlowTerminal9propagateERK18ImbMessageAssembly+0x59f)[0xda1d6f]
/opt/ibm/mqsi/6.1/lil/imbdfsql.lil(_ZN14ImbComputeNode8evaluateERK18ImbMessageAssemblyPK19ImbDataFlowTerminal+0xd3e)[0x97f897e]
/opt/ibm/mqsi/6.1/lib/libMessageServices.so(_ZN19ImbDataFlowTerminal8evaluateERK18ImbMessageAssembly+0x187)[0xd9d377]
/opt/ibm/mqsi/6.1/lib/libMessageServices.so(_ZN19ImbDataFlowTerminal14propagateInnerERK18ImbMessageAssemblyPS_+0x92)[0xd9d722]
/opt/ibm/mqsi/6.1/lib/libMessageServices.so(_ZN19ImbDataFlowTerminal9propagateERK18ImbMessageAssembly+0x59f)[0xda1d6f]
/opt/ibm/mqsi/6.1/lib/libimbjplg.so(Java_com_ibm_broker_plugin_MbOutputTerminal__1propagate+0x122)[0x5edcb62]
/opt/ibm/mqsi/6.1/jre15/bin/libj9vm23.so[0x775fda]
/opt/ibm/mqsi/6.1/jre15/bin/libj9vm23.so[0x78a1b6]
/opt/ibm/mqsi/6.1/lib/libMessageServices.so(_ZN7JNIEnv_14CallVoidMethodEP8_jobjectP10_jmethodIDz+0x29)[0xdb8679]
/opt/ibm/mqsi/6.1/lib/libimbjplg.so(_ZN10ImbJniNode8evaluateERK18ImbMessageAssemblyPK19ImbDataFlowTerminal+0x378)[0x5f31a18]
/opt/ibm/mqsi/6.1/lib/libMessageServices.so(_ZN19ImbDataFlowTerminal8evaluateERK18ImbMessageAssembly+0x187)[0xd9d377]
/opt/ibm/mqsi/6.1/lib/libMessageServices.so(_ZN19ImbDataFlowTerminal14propagateInnerERK18ImbMessageAssemblyPS_+0x92)[0xd9d722]
/opt/ibm/mqsi/6.1/lib/libMessageServices.so(_ZN19ImbDataFlowTerminal9propagateERK18ImbMessageAssembly+0x59f)[0xda1d6f]
/opt/ibm/mqsi/6.1/lil/imbdfbas.lil(_ZN12ImbLabelNode8evaluateERK18ImbMessageAssemblyPK19ImbDataFlowTerminal+0x53)[0x98d4613]
/opt/ibm/mqsi/6.1/lib/libimbjplg.so(Java_com_ibm_broker_plugin_MbRoute__1propagate+0xfe)[0x5edd66e]
/opt/ibm/mqsi/6.1/jre15/bin/libj9vm23.so[0x775fda]
/opt/ibm/mqsi/6.1/jre15/bin/libj9vm23.so[0x78b9e2]
/opt/ibm/mqsi/6.1/jre15/bin/libj9vm23.so[0x78d377]
/opt/ibm/mqsi/6.1/jre15/bin/libj9prt23.so[0x2373200]
/opt/ibm/mqsi/6.1/jre15/bin/libj9vm23.so[0x78bba5]
/opt/ibm/mqsi/6.1/jre15/bin/libj9vm23.so[0x78bef2]
/opt/ibm/mqsi/6.1/jre15/bin/libj9vm23.so[0x78a1d7]
/opt/ibm/mqsi/6.1/lib/libMessageServices.so(_ZN7JNIEnv_14CallVoidMethodEP8_jobjectP10_jmethodIDz+0x29)[0xdb8679]
/opt/ibm/mqsi/6.1/lib/libimbjplg.so(_ZN10ImbJniNode8evaluateERK18ImbMessageAssemblyPK19ImbDataFlowTerminal+0x378)[0x5f31a18]
/opt/ibm/mqsi/6.1/lib/libMessageServices.so(_ZN19ImbDataFlowTerminal8evaluateERK18ImbMessageAssembly+0x187)[0xd9d377]
/opt/ibm/mqsi/6.1/lib/libMessageServices.so(_ZN19ImbDataFlowTerminal14propagateInnerERK18ImbMessageAssemblyPS_+0x92)[0xd9d722]
/opt/ibm/mqsi/6.1/lib/libMessageServices.so(_ZN19ImbDataFlowTerminal9propagateERK18ImbMessageAssembly+0x59f)[0xda1d6f]
/opt/ibm/mqsi/6.1/lib/libTemplateNodes.so(_ZN23ImbCallableTemplateNode14processMessageERNS_17ExecutionInstanceEbR18ImbMessageAssemblyRNS_10OrderTokenE+0x659)[0x6844049]
/opt/ibm/mqsi/6.1/lib/libTemplateNodes.so(_ZN20ImbInputTemplateNode3runEP11ImbOsThread+0x11bd)[0x682374d]
/opt/ibm/mqsi/6.1/lib/libTemplateNodes.so(_ZN20ImbInputTemplateNode10Parameters3runEP11ImbOsThread+0x43)[0x6825643]
/opt/ibm/mqsi/6.1/lib/libCommonServices.so(_ZN27ImbThreadPoolThreadFunction3runEP11ImbOsThread+0x46)[0xa11876]
/opt/ibm/mqsi/6.1/lib/libCommonServices.so(_ZN11ImbOsThread9threadRunEv+0x65)[0x9fe9e5]
/opt/ibm/mqsi/6.1/lib/libCommonServices.so(_ZN11ImbOsThread15threadBootStrapEPv+0x8e)[0x9fea9e]
/lib/libpthread.so.0[0x4a7dd2db]
/lib/libc.so.6(clone+0x5e)[0x4a73714e]
----------------------------------------------------------------------
Process Environment Variables
****************************
ACLOCAL_FLAGS='-I /opt/gnome/share/aclocal'
BASH=/bin/sh
BASH_ARGC=()
BASH_ARGV=()
BASH_EXECUTION_STRING=set
BASH_LINENO=()
BASH_SOURCE=()
BASH_VERSINFO=([0]="3" [1]="1" [2]="17" [3]="1" [4]="release" [5]="i686-redhat-linux-gnu")
BASH_VERSION='3.1.17(1)-release'
CLASSPATH=/opt/ibm/mqsi/6.1/classes/derby.jar:/opt/ibm/mqsi/6.1/classes/ConfigManagerProxy.jar:/opt/ibm/mqsi/6.1/classes/configutil.jar:/opt/mqm/java/lib/com.ibm.mq.jar:/opt/mqm/java/lib/connector.jar:/opt/ibm/mqsi/6.1/messages:/var/mqsi/common/wsrr:/home/db2inst1/sqllib/java/db2java.zip:/home/db2inst1/sqllib/java/db2jcc.jar:/home/db2inst1/sqllib/java/sqlj.zip:/home/db2inst1/sqllib/function:/home/db2inst1/sqllib/java/db2jcc_license_cu.jar:.
CVS_RSH=ssh
DB2INSTANCE=db2inst1
DIRSTACK=()
DISTHUB_PATH=/opt/ibm/mqsi/6.1
DTX_HOME_DIR=/opt/ibm/wsdtx
EUID=512
GNOME2_PATH=/usr/local:/opt/gnome:/usr
GROUPS=()
G_BROKEN_FILENAMES=1
HISTSIZE=1000
HOME=/home/broker
HOSTNAME=SRV-PA-CDR-2
HOSTTYPE=i686
IBM_JVM_SR_SIGNUM=64
IFS='
'
INFOPATH=/opt/gnome/share/info
INPUTRC=/etc/inputrc
KDEDIR=/usr
KDE_IS_PRELINKED=1
KDE_NO_IPV6=1
LANG=en_US
LDR_CNTRL=MAXDATA=0x60000000
LD_LIBRARY_PATH=/u01/app/oracle/product/10.2.0/db_1/lib:usr/lib:/opt/ibm/mqsi/6.1/jre15/bin/classic:/opt/ibm/mqsi/6.1/jre15/bin:/opt/mqm/java/lib:/opt/ibm/mqsi/6.1/xml4c/lib:/opt/ibm/mqsi/6.1/lib:/opt/ibm/mqsi/6.1/bin:/opt/ibm/mqsi/6.1/ODBC32/V5.3/lib:/opt/ibm/mqsi/6.1/xlxpc/lib:/home/db2inst1/sqllib/lib32:/opt/ibm/wsdtx/libs
LESSOPEN='|/usr/bin/lesspipe.sh %s'
LOGNAME=broker
LS_COLORS='no=00:fi=00:di=00;34:ln=00;36:pi=40;33:so=00;35:bd=40;33;01:cd=40;33;01:or=01;05;37;41:mi=01;05;37;41:ex=00;32:*.cmd=00;32:*.exe=00;32:*.com=00;32:*.btm=00;32:*.bat=00;32:*.sh=00;32:*.csh=00;32:*.tar=00;31:*.tgz=00;31:*.arj=00;31:*.taz=00;31:*.lzh=00;31:*.zip=00;31:*.z=00;31:*.Z=00;31:*.gz=00;31:*.bz2=00;31:*.bz=00;31:*.tz=00;31:*.rpm=00;31:*.cpio=00;31:*.jpg=00;35:*.gif=00;35:*.bmp=00;35:*.xbm=00;35:*.xpm=00;35:*.png=00;35:*.tif=00;35:'
MACHTYPE=i686-redhat-linux-gnu
MAIL=/var/spool/mail/broker
MQSI_CATALINA_HOME=/opt/ibm/mqsi/6.1/catalina
MQSI_DEVELOPMENT=/var/mqsi/registry
MQSI_EXMLTCONFIGPATH=/opt/ibm/mqsi/6.1/exmltConfig
MQSI_FAD=4
MQSI_FILEPATH=/opt/ibm/mqsi/6.1
MQSI_JARPATH=/opt/ibm/mqsi/6.1/classes:/opt/ibm/mqsi/6.1/messages
MQSI_JREPATH=/opt/ibm/mqsi/6.1/jre15
MQSI_LIBPATH32=/opt/mqm/java/lib::/opt/ibm/wsdtx/libs
MQSI_LILPATH=
MQSI_LILPATH32=/opt/ibm/mqsi/6.1/lil:/opt/ibm/mqsi/6.1/jplugin:/opt/ibm/wsdtx/wmqi
MQSI_REGISTRY=/var/mqsi
MQSI_SECURITY_PROVIDER_PATH32=/opt/ibm/mqsi/6.1/SecurityProviders
MQSI_THREAD_STACK_SIZE=16777216
MQSI_VERSION=6.1.0.3
MQSI_VERSION_F=3
MQSI_VERSION_M=0
MQSI_VERSION_R=1
MQSI_VERSION_V=6
MQSI_WORKPATH=/var/mqsi
MQS_APPL_HANDLE_SIGNALS=1
MQS_NO_SYNC_SIGNAL_HANDLING=1
NLSPATH=/opt/ibm/mqsi/6.1/messages/%L/%N:/opt/ibm/mqsi/6.1/messages/En_US/%N:
NLS_LANG=AMERICAN_AMERICA.WE8ISO8859P1
ODBCINI=/home/broker/odbc.ini
ODBCINI_DEFAULT=/home/broker/odbc_default.ini
OPTERR=1
OPTIND=1
ORACLE_HOME=/u01/app/oracle/product/10.2.0/db_1
OSTYPE=linux-gnu
PATH=/opt/ibm/mqsi/6.1/jre15/bin:/opt/ibm/mqsi/6.1/bin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/home/broker/bin:/home/db2inst1/sqllib/bin:/home/db2inst1/sqllib/adm:/home/db2inst1/sqllib/misc
PKG_CONFIG_PATH=/opt/gnome/lib/pkgconfig
POSIXLY_CORRECT=y
PPID=6327
PS4='+ '
PWD=/home/broker/script
SHELL=/bin/bash
SHELLOPTS=braceexpand:hashall:interactive-comments:posix
SHLVL=4
SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass
TERM=xterm
UID=512
USER=broker
_=/opt/ibm/mqsi/6.1/bin/mqsistart.bin
--->------------------------------<ABEND FILE END>------------------------------<---
|
I use Red Hat linux on test broker, and AIX 5.3 environment on production broker, my broker version is 6.1.0.3 I tried with MQSI_THREAD_STACK_SIZE=16777216 and LDR_CNTRL=MAXDATA=0x60000000 and optimizing flows deleting all resources unuseful, how can I turn around this problem? |
|
| Back to top |
|
 |
| WMBDEV1 |
| Posted: Wed Apr 22, 2009 6:56 am Post subject: |
|
|
Sentinel
Joined: 05 Mar 2009
Posts: 888
Location: UK
|
|
| Back to top |
|
|
| giorginus80 |
| Posted: Wed Apr 22, 2009 6:57 am Post subject: |
|
|
Centurion
Joined: 08 Jul 2008
Posts: 124
Location: Rome, Italy
|
I saw it, I did it in my message flows. I still have this error |
|
| Back to top |
|
|
| WMBDEV1 |
| Posted: Wed Apr 22, 2009 7:01 am Post subject: |
|
|
Sentinel
Joined: 05 Mar 2009
Posts: 888
Location: UK
|
How big is your message?
What domain are you using?
Do you do any immediate parses?
Can you descirbe what your flow does? |
|
| Back to top |
|
|
| giorginus80 |
| Posted: Wed Apr 22, 2009 7:19 am Post subject: |
|
|
Centurion
Joined: 08 Jul 2008
Posts: 124
Location: Rome, Italy
|
| WMBDEV1 wrote: |
How big is your message?
What domain are you using?
Do you do any immediate parses?
Can you descirbe what your flow does? |
Domain is XMLNSC, and the xml have a body and thousands of children. I use aggregation for this children, I explain: I split the main xml with the link you provided Deleting the previous sibiling (Reducing memory usage), and I put the children in the queue request aggregation, then the Aggregate reply does the work to rebuild the message. In this point of flow, on the reaggregation I have the error. The AggregateReply node receive thousand of children, and all works good with smaller xml. The original file size (I put the message through MQ queue or Soap) is an xml of 15mb. With 11mb test xml file is working. |
|
| Back to top |
|
|
| mqjeff |
| Posted: Wed Apr 22, 2009 7:30 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
I'm confused. You show an environment that has LDR_CNTRL, which should be only valid on AIX (I think?). And you show an FDC file from your Linux test system...
If you are seeing out of memory errors on the same message on different platforms, you need to do *different* things on each platform to enhance the memory available to the broker.
How much RAM is the broker DataFlowEngine process using? What system level limits do individual processes have on your two systems? Have you, for example, enabled EXTSHM on the AIX system? How much RAM is actually available?
How large is the message you are trying to process, in particular how large is the base64 encoded portion of the XMLNSC message that you've passed to the ResetContentDescriptor node? |
|
| Back to top |
|
|
| giorginus80 |
| Posted: Wed Apr 22, 2009 7:35 am Post subject: |
|
|
Centurion
Joined: 08 Jul 2008
Posts: 124
Location: Rome, Italy
|
| mqjeff wrote: |
I'm confused. You show an environment that has LDR_CNTRL, which should be only valid on AIX (I think?). And you show an FDC file from your Linux test system...
If you are seeing out of memory errors on the same message on different platforms, you need to do *different* things on each platform to enhance the memory available to the broker.
How much RAM is the broker DataFlowEngine process using? What system level limits do individual processes have on your two systems? Have you, for example, enabled EXTSHM on the AIX system? How much RAM is actually available?
How large is the message you are trying to process, in particular how large is the base64 encoded portion of the XMLNSC message that you've passed to the ResetContentDescriptor node? |
For now I can test it only on linux machine, I didn't know that the LDR_CNTRL varianble works only on aix. The original xml is 15mb, I don't know how get dimension passed to ResetContentDescriptor node. In a linux environment how can I around the problem of memory? The Machine has 4gb of ram. |
|
| Back to top |
|
|
| WMBDEV1 |
| Posted: Wed Apr 22, 2009 7:54 am Post subject: |
|
|
Sentinel
Joined: 05 Mar 2009
Posts: 888
Location: UK
|
Any chance you can remove/breakup the long lines from your trace?
So.... You have some code that breaks up XML into small pieces and outputs this. Then you have another bit that builds them all back up into one big xml lump again? I think the idea of the link is to then work on the smaller xml chunks.
The xml lump that is rebuilt is gonna blow your memory again when you rebuild it.
Do you just need to do a transform in the broker? or are you doing more? If you are building a big output document then you need to take additional steps to ensure this is done correctly also (ie not just handle the input nicely but do similar stuff for the output also wrt to memory usage).
If you do this you shouldnt need the aggregate node.
I have a nice document on this if you want to PM me your email address
i'll send it to you. |
|
| Back to top |
|
|
| giorginus80 |
| Posted: Wed Apr 22, 2009 8:00 am Post subject: |
|
|
Centurion
Joined: 08 Jul 2008
Posts: 124
Location: Rome, Italy
|
| WMBDEV1 wrote: |
Any chance you can remove/breakup the long lines from your trace?
So.... You have some code that breaks up XML into small pieces and outputs this. Then you have another bit that builds them all back up into one big xml lump again? I think the idea of the link is to then work on the smaller xml chunks.
The xml lump that is rebuilt is gonna blow your memory again when you rebuild it.
Do you just need to do a transform in the broker? or are you doing more? If you are building a big output document then you need to take additional steps to ensure this is done correctly also (ie not just handle the input nicely but do similar stuff for the output also wrt to memory usage).
If you do this you shouldnt need the aggregate node.
I have a nice document on this if you want to PM me your email address
i'll send it to you. |
I need the aggregate because in the aggregate that the AggregateReply node rebuild, because in the next steps, I have to send it by an email node. the children are modified (ther are inserted into db and I have one more field in the children that let me know the primary keys), so I need to get them again. I thought that there was some trick to turn around this problem |
|
| Back to top |
|
|
|
|
