Subject: Re: coping with huge xml-saxon
From: Paul Tremblay <phthenry@xxxxxxxxxxxxx>
Date: Tue, 17 Jun 2003 17:04:00 -0400
|
On Mon, Jun 16, 2003 at 06:01:15PM +0200, Johannes Döbler wrote:
>
> 600 MB will most probably kill every classic XSLT processor, since they all
> try to load the document into memory.
> You can do the following:
So what exactly is the memory limit for XSLT transformations? I know
that Michale Kay in his book mentions that documents larger than 1 or 2
MB cannot be processed by an XSLT processor, because, as you say, the
processor loads them into memory.
However, why his this limit so low? On my box I have 256 MB of memory.
It is not uncommon for a new machine to have 500 MB of memory--or even
double that amount.
It seem that if you have 256 MB of memory, you ought to be able to
handle a document of around 50 MB. (I think the processor actually
requires something like 4 times the size of the document--or was it 10?)
I see the memory as the only drawback for xslt transformations. After
all, I have documents that are around 1 MB in size, and I can easily see
real documents being many times that size
thanks
Paul
>
> Write a SAX-ContentHandler to transform your document
>
> Use STX (Streaming Transformations: http://stx.sourceforge.net/) instead of
> XSLT
>
> Try jd.bigxml (http://www.aztecrider.com/bigxml/): It is a XPath model
> implementation for huge XML documents and can be used with the
> XSLT Processor jd.xslt to transform such documents. If you give it at try
> then please let me know whether it worked.
>
> regards,
> Johannes
>
>
> >Dear all,
> >I have a problem which i cant figure out how to get round. I have an XML
> >that is as big as 600 Mg and everything fails!!!
> >I am using saxon and running this under win2k Machine. It reports of memory
> >out of stack and i tried increasing the memory to the JVM with the JVM
> >parameter and apparently we can not increase the memory to more than a
> >certain limit.I would appreciate if someone can please let me know how we
> >can solve this
> >Thanks
> >
> >
> > XSL-List info and archive: http://www.mulberrytech.com/xsl/xsl-list
>
>
> XSL-List info and archive: http://www.mulberrytech.com/xsl/xsl-list
--
************************
*Paul Tremblay *
*phthenry@xxxxxxxxxxxxx*
************************
XSL-List info and archive: http://www.mulberrytech.com/xsl/xsl-list
| Current Thread |
- RE: more elegant way to process element with default value?, (continued)
- Passin, Tom - Mon, 16 Jun 2003 11:04:16 -0400 (EDT)
- XSL Chatr - Mon, 16 Jun 2003 11:21:21 -0400 (EDT)
- Johannes Döbler - Mon, 16 Jun 2003 12:01:43 -0400 (EDT)
- Paul Tremblay - Tue, 17 Jun 2003 17:01:57 -0400 (EDT) <=
- david_n_bertoni - Tue, 17 Jun 2003 17:43:21 -0400 (EDT)
- Michael Kay - Tue, 17 Jun 2003 18:31:37 -0400 (EDT)
- Paul Tremblay - Tue, 17 Jun 2003 22:30:15 -0400 (EDT)
- Michael Kay - Wed, 18 Jun 2003 06:52:07 -0400 (EDT)
|
|