Author |
Message
|
adars1 |
Posted: Thu Jul 17, 2014 4:04 pm Post subject: to process large xml file record by record |
|
|
Apprentice
Joined: 13 Jun 2010 Posts: 39
|
Hi
I have large xml file and i want to read record(<data>) by record to create one msg for every record.
<Test>
<head>
<\data>
<\data>
<\data>
</Test>
Is there a way in fileinput node to read xml file using delimiter xpath. |
|
Back to top |
|
 |
smdavies99 |
Posted: Thu Jul 17, 2014 9:33 pm Post subject: |
|
|
 Jedi Council
Joined: 10 Feb 2003 Posts: 6076 Location: Somewhere over the Rainbow this side of Never-never land.
|
Have you looked at the various properties of the FileInput Node?
What options have you tried? _________________ WMQ User since 1999
MQSI/WBI/WMB/'Thingy' User since 2002
Linux user since 1995
Every time you reinvent the wheel the more square it gets (anon). If in doubt think and investigate before you ask silly questions. |
|
Back to top |
|
 |
adars1 |
Posted: Thu Jul 17, 2014 10:07 pm Post subject: |
|
|
Apprentice
Joined: 13 Jun 2010 Posts: 39
|
for xml file i tried both whole file and parsed record sequence but both options load entire file. |
|
Back to top |
|
 |
ghoshly |
Posted: Thu Jul 17, 2014 10:49 pm Post subject: record delimiter |
|
|
Partisan
Joined: 10 Jan 2008 Posts: 333
|
How are you marking each record ?
What parameter you are providing as record delimiter? |
|
Back to top |
|
 |
fjb_saper |
Posted: Fri Jul 18, 2014 4:39 am Post subject: |
|
|
 Grand High Poobah
Joined: 18 Nov 2003 Posts: 20763 Location: LI,NY
|
If your file is less than 2 GB you can use whole file and Large message technique.... If your file is > 2GB you will have to decide how you are going to cut the XML....
Have fun  _________________ MQ & Broker admin |
|
Back to top |
|
 |
adars1 |
Posted: Fri Jul 18, 2014 9:20 am Post subject: |
|
|
Apprentice
Joined: 13 Jun 2010 Posts: 39
|
the problem I have is custom delimiter(xml element name) is more than the max length 32 hexadecimal digits allowed. is the option is read as blob and read each record out of blob ? or is there any built in option to read xml record by its repeating element. |
|
Back to top |
|
 |
Vitor |
Posted: Fri Jul 18, 2014 9:29 am Post subject: |
|
|
 Grand High Poobah
Joined: 11 Nov 2005 Posts: 26093 Location: Texas, USA
|
adars1 wrote: |
or is there any built in option to read xml record by its repeating element. |
Yes - the Large Message technque my worthy associate mentioned. It's not an "option" in the sense of "I can do my job by simply ticking this check box" but it's not a lot of coding & it's well explained in the documentation. _________________ Honesty is the best policy.
Insanity is the best defence. |
|
Back to top |
|
 |
|