xslt-based web-crawler - great idea

what about distributed search system? since eXist contain Lucene - it
can be easy implemented

most pages in WWW not well-formed XML? Tidy can help - is here
possibility to implement tidy as buillt-in function to XSLT?

With best wishes,
Slav

p.s. Thank you Michael Kay for Saxon-SA in Oxygenxml editor 10 version
- useful for evaluation XUpdate and other features and thanks for
Saxon in OpenOffice 3.0 - big step forward. Love you. Hope your next
book you can write in OO 3.0 instead M$ Word.

On 11/10/08, Michael Kay <mike@xxxxxxxxxxxx> wrote:
>> Is the equivalent of saxon:discard-document() being
>> considered for 2.1?
>>
>
> Yes, we're looking at a wide range of things that will give more control
> over the reading of input documents, and controlling whether the document
> should be retained in memory after use is one of them.
>
> Michael Kay
> http://www.saxonica.com/