Token:
| { type: "Bool"; value: boolean }
| { type: "BraceOpen" }
| { type: "BraceClose" }
| { type: "BracketOpen" }
| { type: "BracketClose" }
| { type: "ParenthesisOpen" }
| { type: "ParenthesisClose" }
| { type: "Colon" }
| { type: "Comma" }
| { type: "Null" }
| { type: "NaN" }
| { type: "Infinity" }
| { type: "NegInfinity" }
| { type: "ByteStringHex"; value: Uint8Array }
| { type: "ByteStringBase64"; value: Uint8Array }
| { type: "DateLiteral"; value: CborDate }
| { type: "Number"; value: number }
| { type: "String"; value: string }
| { type: "TagValue"; value: number }
| { type: "TagName"; value: string }
| { type: "KnownValueNumber"; value: number }
| { type: "KnownValueName"; value: string }
| { type: "Unit" }
| { type: "UR"; value: UR }
Token types produced by the lexer.
Corresponds to the Rust
Tokenenum in token.rs