Uses of Class
scone.util.tokenstream.TokenInputStream

Packages that use TokenInputStream

scone.util	Contains utility classes.
scone.util.tokenstream	This package provides means for convenient tokenizing of documents.

Uses of TokenInputStream in scone.util

Methods in scone.util with parameters of type TokenInputStream

void	DocumentParser.parse(TokenInputStream in, TokenOutputStream out) Parse document and collect data for NetNode and HtmlNode objects: number of links, number of images, language etc.

Uses of TokenInputStream in scone.util.tokenstream

Subclasses of TokenInputStream in scone.util.tokenstream

class	TokenInputStreamBufferImpl reads Tokens from the TokenBuffer a TokenOutputStream writes to.
class	TokenInputStreamTokenizerImpl converts a Reader into a TokenInputStream.

Fields in scone.util.tokenstream declared as TokenInputStream

protected TokenInputStream

SconePipe.in

Methods in scone.util.tokenstream that return TokenInputStream

static TokenInputStream	TokenInputStream.create(RequestEvent e) Returns a TokenInputStream that allows to acces the input data provided by the RequestEvent as Tokens.
static TokenInputStream	TokenInputStream.create(RequestEvent e, java.lang.String tokenizer) Returns a TokenInputStream that allows to acces the input data provided by the RequestEvent as Tokens.
TokenInputStream	SconePipe.getTokenInputStream() returns the TokenInputStream of this SconePipe.