What is meant by Stream Tokenizer?
- The StreamTokenizer class takes an input stream and parses it into "tokens", allowing the tokens to be read one at a time.
- The parsing process is controlled by a table and a number of flags that can be set to various states.
- The stream tokenizer can recognize identifiers, numbers, quoted strings, and various comment styles.
Declaration of SteamTokenizer:public class StreamTokenizer
extends Object
- It tokenizes the stream into distinct word and allows to read one by one.
