Skip to content

Feature/token stream

thebirdsdontsing requested to merge feature/token-stream into main

Created by: ecoulson

What?

Implement a token stream struct to encapsulate the vector containing the tokens.

Why?

This provides a clean API for the parser to call when processing tokens. This way, the parser does not need to know which index it is currently at and can simply query for the next token.

How?

The simplest way to provide this API was to wrap the tokens vector in a struct and return the vector's iterator.

closes #3 (closed)

Merge request reports