since v5.3.1 you the tokenizer seems not to buildin as documentated.
You need to specify the --enable-tokenizer within the configure string and you have it.
Installation
Beginning with PHP 4.3.0 these functions are enabled by default. For older versions you have to configure and compile PHP with --enable-tokenizer. You can disable tokenizer support with --disable-tokenizer.
The Windows version of PHP has built-in support for this extension. You do not need to load any additional extensions in order to use these functions.
Note: Built-in support for tokenizer is available as of PHP 4.3.0.
Installation
lars.plessmann(at)gmx(dot)de
10-Jan-2010 10:58
10-Jan-2010 10:58
