[whatwg] Tokenizor PseudoCode

[Mohammad Al Houssami (Alumni)]

I'm trying to build an HTML5 Parser in Smalltalk and as a first step I'm implementing the tokenizer and everything happens there. I think this is the case only when we have scripts that add characters to the HTML document which is out of the scope of the project I am working on at the moment. Is this true or not ?
Thanks
Mohammad


-----Original Message-----
From: Bjoern Hoehrmann [mailto:derhoermi at gmx.net] 
Sent: Friday, March 15, 2013 11:30 PM
To: Mohammad Al Houssami (Alumni)
Cc: whatwg at lists.whatwg.org
Subject: Re: [whatwg] Tokenizor PseudoCode

* Mohammad Al Houssami (Alumni) wrote:
>I just want to make sure that in places where no state change is called 
>it means we stay in the same state right?

You missed "When a token is emitted, it must immediately be handled by the tree construction stage. The tree construction stage can affect the state of the tokenization stage ..." but if that does not result in a change of state either, then yes, as far as I am aware.
--
Björn Höhrmann · mailto:bjoern at hoehrmann.de · http://bjoern.hoehrmann.de Am Badedeich 7 · Telefon: +49(0)160/4415681 · http://www.bjoernsworld.de
25899 Dagebüll · PGP Pub. KeyID: 0xA4357E78 · http://www.websitedev.de/