Successfully reported this slideshow.

About Tokens and Lexemes

9

Share

Upcoming SlideShare
Token, Pattern and Lexeme
Token, Pattern and Lexeme
Loading in …3
×
1 of 28
1 of 28

About Tokens and Lexemes

9

Share

Download to read offline

A Parser is an integral part when building a Domain Specific Language or file format parser, such as our example usage case: the Ical format. This session will cover the general concept about tokenizing and parsing into a datastructure, as well as going into depth about how to keep the memory footprint and runtime low with the help of a stream-tokenizer.

A Parser is an integral part when building a Domain Specific Language or file format parser, such as our example usage case: the Ical format. This session will cover the general concept about tokenizing and parsing into a datastructure, as well as going into depth about how to keep the memory footprint and runtime low with the help of a stream-tokenizer.

More Related Content

Related Books

Free with a 30 day trial from Scribd

See all

×