• To: Howard Katz <howardk@f...>, xml-dev@l...
• Subject: Re: ANN: XQEngine 0.61
• From: "J.Pietschmann" <j3322ptm@y...>
• Date: Sun, 07 Dec 2003 11:00:20 +0100
• In-reply-to: <LPEHIJLPEHAEPAKAPGDJGEPGCHAA.howardk@f...>
• References: <LPEHIJLPEHAEPAKAPGDJGEPGCHAA.howardk@f...>
• User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.5) Gecko/20031007

Howard Katz wrote:
> All my word breaking is delegated to a class called (surprise) WordBreaker,
> which implements a very simple algorithm that uses Java's
> Character.isLetterOrDigit() function to determine where words begin and end.
> This works well for Western languages. If you want to optimize for a
> non-Western language, you can override WordBreaker and implement word
> breaking in whatever way makes sense for your particular language or
> languages of interest. That's the theory at any rate ...

Have a look at java.text.BreakIterator, which helps to implement
line and word breaking along the Unicode standards (most notably
UTR14).

J.Pietschmann

• Follow-Ups:
  • RE: ANN: XQEngine 0.61
    • From: "Howard Katz" <howardk@f...>

• References:
  • RE: ANN: XQEngine 0.61
    • From: "Howard Katz" <howardk@f...>

• Prev by Date: RE: ANN: XQEngine 0.61
• Next by Date: References in XSD/XML
• Previous by thread: RE: ANN: XQEngine 0.61
• Next by thread: RE: ANN: XQEngine 0.61
• Index(es):
  • Date
  • Thread