Package opennlp.tools.tokenize
Class WhitespaceTokenStream
java.lang.Object
opennlp.tools.util.FilterObjectStream<TokenSample,String>
opennlp.tools.tokenize.WhitespaceTokenStream
- All Implemented Interfaces:
AutoCloseable,ObjectStream<String>
This stream formats
ObjectStream of samples into whitespace
separated token strings.-
Constructor Summary
ConstructorsConstructorDescriptionWhitespaceTokenStream(ObjectStream<TokenSample> tokens) Initializes aWhitespaceTokenStream. -
Method Summary
Methods inherited from class opennlp.tools.util.FilterObjectStream
close, reset
-
Constructor Details
-
WhitespaceTokenStream
Initializes aWhitespaceTokenStream.- Parameters:
tokens- Thestreamof tokens to be separated.
-
-
Method Details
-
read
Description copied from interface:ObjectStreamReturns the nextObjectStreamobject. Calling this method repeatedly until it returnsnullwill return each object from the underlying source exactly once.- Returns:
- The next object or
nullto signal that the stream is exhausted. - Throws:
IOException- Thrown if there is an error during reading.
-