This extension is EXPERIMENTAL. The behaviour of this extension -- including the names of its functions and anything else documented about this extension -- may change without notice in a future release of PHP. Use this extension at your own risk.
See also the appendix about tokens.
The behaviour of these functions is affected by settings in php.ini.
Table 1. Tokenizer Configuration Options
The constants below are defined by this extension, and will only be available when the extension has either been compiled into PHP or dynamically loaded at runtime.