modnlp.idx.inverted.jpsegmenter

Class TinySegmenter

java.lang.Object

modnlp.idx.inverted.jpsegmenter.TinySegmenter

public class TinySegmenter
extends java.lang.Object

TinySegmenter?Java????

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TinySegmenter.CharInfo

Field Summary

Fields

Modifier and Type	Field and Description
static int	DEFAULT_BUFFER_SIZE
static int	DEFAULT_MAX_TOKEN_SIZE

Constructor Summary

Constructors

Constructor and Description
TinySegmenter(CodePointReader reader)
TinySegmenter(CodePointReader reader, int bufferSize, int maxTokenSize) ???????

Method Summary

Methods

Modifier and Type	Method and Description
static void	main(java.lang.String[] args)
Token	next()
TinySegmenter.CharInfo	readChar()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_BUFFER_SIZE

public static final int DEFAULT_BUFFER_SIZE

See Also:

Constant Field Values

DEFAULT_MAX_TOKEN_SIZE

public static final int DEFAULT_MAX_TOKEN_SIZE

See Also:

Constant Field Values

Constructor Detail

TinySegmenter

public TinySegmenter(CodePointReader reader)

TinySegmenter

public TinySegmenter(CodePointReader reader,
             int bufferSize,
             int maxTokenSize)

???????

Parameters:

reader - CodePointReader???????

bufferSize - ?????????7????????????

maxTokenSize - ???????????2????????????

Method Detail

readChar

public TinySegmenter.CharInfo readChar()
                                throws java.io.IOException

Throws:

java.io.IOException

next

public Token next()
           throws java.io.IOException

Throws:

java.io.IOException

main

public static void main(java.lang.String[] args)