lexer_rust

Katz 0.105

Hand-written Rust lexer that ports reqlan-token-builder.ts:
structural vs prose `{` / `}`, fence opacity, quote-aware comments, `@` only at line start, glob `/**/` not a block comment.
Linear in document size with sparse brace-depth lookup ( context_sensitive_lexer_scaling ).
Owned by `reqlan-parse`; consumed by parser_rust and by language_server_rust.
The Langium token builder remains only for the transitional `node` engine fallback and dual-parser tests.

status

done

tests

lexer.rs:structural_braces_around_named_block, lexer.rs:prose_braces_stay_other, lexer.rs:glob_star_star_is_not_a_block_comment, lexer.rs:at_only_at_line_start, lexer.rs:url_slashes_are_not_line_comments, lexer.rs:mid_line_triple_backticks_are_not_a_code_fence, lexer.rs:line_start_triple_backticks_are_a_code_fence, lexer.rs:middle_dot_before_brace_does_not_panic

Interactive page: lexer_rust