Modules

lexer to break text up into user-defined tokens
reusable lexer for token-stream scanning
role for token-stream classes
class to model scanned tokens
types used by Text::TokenStream et al