hyperhello · 3 days ago

Okay, it’s a compiled tokenizer that reads everything with no state. Is it especially fast as this? Because this part of parsing is pretty trivial.