[webkit-dev] about "token" in JavaScriptCore

[Darin Adler]

On Mar 12, 2009, at 8:46 PM, zhenghe zhang wrote:

> I use gdb to track the lexer::lex(void *p1,void *p2), I don't know  
> where the "token" stored.

The token is the return value of that function. It’s used by the bison- 
generated parser. The yacc family of parser generators, including  
bison, require a lex function that returns a token. This is something  
standard to yacc-style parsers, not specific to JavaScriptCore. A  
starting point to read up on this is <http:// 
dinosaur.compilertools.net/>.

     -- Darin