Checkout
Robert Muir
committed
on 04 Aug 11
LUCENE-3358: StandardTokenizer wrongly discarded combining marks attached to Han/Hiragana