Code
Tokenizer in C++ - by hackervalley - Thursday 5th AugustTokenizer in C++
Tokenize string in C++ is a usual task in coding. For example to read an input file.
My self, I intend to tokenize a geometrical gmsh file. It looks like :
Point(2) = (1,0,0,0.1);
I use a C++ STL String Tokenizer from http://codeproject.com/cpp/stringtok.asp
The class and example are attached.
Author : hackervalley@free.fr http://hackervalley.free.fr
Copyright (c) 2003 hackervalley Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license is included in the section entitled "GNU Free Documentation License".
C++Tokenizer.tar.bz2
BZip - 1.5 kb