| tok.hfile | source file |
| Classes Summary | Functions Summary Details | Macros Summary Details | Enums Summary Details | Templates Summary Details |
This header defines some macros for the standard tokenizer class.
Summary of Classes
Summary of Global Functions
Summary of Macros
getTokOrig
getTokType
getTokVal
tokRuleName
tokRulePat
tokRuleTest
tokRuleType
tokRuleVal
Summary of Enums
Summary of Templates
Global Functions
Macros
getTokOrig (tok) | tok.h[40] |
((tok)[3])Get the token's original text. This is the original text matched from the tokenized string.
getTokType (tok) | tok.h[34] |
((tok)[2])Get the token type. This is a token enum value describing the type of the token.
getTokVal (tok) | tok.h[28] |
((tok)[1])Get the token value. This is the parsed representation of the token; in most cases, this is simply the text of the original token, although it might be converted in some way (words are usually converted to lower-case, for example).
tokRuleName (rule) | tok.h[48] |
(rule[1])Some internal convenience macros. (These are meant for internal use within the tokenizer class, rather than for client code, but we define them here because they're also useful for subclasses of the standard tokenizer.)
tokRulePat (rule) | tok.h[49] |
(rule[2])no description available
tokRuleTest (rule) | tok.h[52] |
(rule[5])no description available
tokRuleType (rule) | tok.h[50] |
(rule[3])no description available
tokRuleVal (rule) | tok.h[51] |
(rule[4])no description available
Enums
Templates
(none)
TADS 3 Library Manual
Generated on 5/16/2013 from TADS version 3.1.3
Generated on 5/16/2013 from TADS version 3.1.3