python LEX

[jozo]

I have to work on python lexical definition in Lex. I spent lots of my
time to find regular expresions written for Lex of Python language but
nothing.
Can somebody help me?

I nEED hELP

 

[Tim Daneliuk]

I have to work on python lexical definition in Lex. I spent lots of my
time to find regular expresions written for Lex of Python language but
nothing.
Can somebody help me?

I nEED hELP

http://systems.cs.uchicago.edu/ply/

 

[Tim Daneliuk]

http://systems.cs.uchicago.edu/ply/

Whoops - I did not read your question carefully enough ... sorry, cannot
help with what you actually asked.

<Slinks off ...>

 

[Miki Tebeka]

Hello jozo,

I have to work on python lexical definition in Lex. I spent lots of my
time to find regular expresions written for Lex of Python language but
nothing.
Can somebody help me?

http://www.antlr.org/grammar/list (search for Python)

You can search in projects like Pyrex and Parrot for their parser
implementation.

HTH.
--
------------------------------------------------------------------------
Miki Tebeka <[email protected]>
http://tebeka.bizhat.com
The only difference between children and adults is the price of the toys

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.0 (Cygwin)

iD8DBQFCZ4ln8jAdENsUuJsRAvKpAKCNzBlmhqRA9gtx+wdBdrK1S1FwEwCguN75
Ju9j7b7ud+STGimTrYsFpyc=
=Cizb
-----END PGP SIGNATURE-----

 

[Maurice LING]

I have to work on python lexical definition in Lex. I spent lots of my
time to find regular expresions written for Lex of Python language but
nothing.
Can somebody help me?

I nEED hELP

Jython has a Python language lexer written using JavaCC.

 

[Mike Meyer]

Hello jozo,

http://www.antlr.org/grammar/list (search for Python)

You can search in projects like Pyrex and Parrot for their parser
implementation.

The python grammar is included with the Python sources, and is used
to build the compiler.

HTH.

Trouble is, he wants a lexer, not a parser. The lexer in the sources
is an ad-hoc package, contained in Parser/tokenizer.c.

<mike

 

[Michael Spencer]

Mike Meyer wrote:

....

Trouble is, he wants a lexer, not a parser. The lexer in the sources
is an ad-hoc package, contained in Parser/tokenizer.c.

<mike

There is also tokenize.py in the standard library, which might be an easier
reference

"""
....
It is designed to match the working of the Python tokenizer exactly, except
that it produces COMMENT tokens for comments and gives type OP for all
operators
....
"""

Michael