TokenRange

struct TokenRange

Canonical tokens owned by one half-open source extent.

Token ranges still index the accompanying original or virtual source. Parser category entry points consume this value directly and never re-lex rendered text, which preserves macro provenance and exact boundaries.

Properties

let tokens: [Token]

Canonical tokens wholly contained by span.

let span: Range<Int>

The byte range occupied in the source.