• To: "J.Pietschmann" <j3322ptm@y...>,<xml-dev@l...>
• Subject: RE: ANN: XQEngine 0.61
• From: "Howard Katz" <howardk@f...>
• Date: Sun, 7 Dec 2003 14:39:53 -0800
• Importance: Normal
• In-reply-to: <3FD2FA34.3020308@y...>

I'd looked at BreakIterator way back when it was still at Taligent. I can't
recall why I chose not to go with it at the time (efficiency concerns?), but
it looks worth revisiting. Thanks for the suggestion.
Howard

-----Original Message-----
From: J.Pietschmann [mailto:j3322ptm@y...]
Sent: Sunday, December 07, 2003 2:00 AM
To: Howard Katz; xml-dev@l...
Subject: Re:  ANN: XQEngine 0.61


Howard Katz wrote:
> All my word breaking is delegated to a class called (surprise)
WordBreaker,
> which implements a very simple algorithm that uses Java's
> Character.isLetterOrDigit() function to determine where words begin and
end.
> This works well for Western languages. If you want to optimize for a
> non-Western language, you can override WordBreaker and implement word
> breaking in whatever way makes sense for your particular language or
> languages of interest. That's the theory at any rate ...

Have a look at java.text.BreakIterator, which helps to implement
line and word breaking along the Unicode standards (most notably
UTR14).

J.Pietschmann


-----------------------------------------------------------------
The xml-dev list is sponsored by XML.org <http://www.xml.org>, an
initiative of OASIS <http://www.oasis-open.org>

The list archives are at http://lists.xml.org/archives/xml-dev/

To subscribe or unsubscribe from this list use the subscription
manager: <http://lists.xml.org/ob/adm.pl>

• References:
  • Re: ANN: XQEngine 0.61
    • From: "J.Pietschmann" <j3322ptm@y...>

• Prev by Date: References in XSD/XML
• Next by Date: Re: Expert's advice needed about XML Schema and defining some kind of relation
• Previous by thread: Re: ANN: XQEngine 0.61
• Next by thread: When Empty is Everything
• Index(es):
  • Date
  • Thread