mirror
/
rustc-dev-guide
mirror of https://github.com/rust-lang/rustc-dev-guide.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

mention token stream as an IR

This commit is contained in:
mark 2020-04-04 12:52:55 -05:00 committed by Who? Me?!
parent cc49d816bc
commit 1424834cd1
1 changed files with 4 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
src/overview.md
View File

@ -149,8 +149,11 @@ Instead most compilers, including `rustc`, build some sort of IR out of the
source code which is easier to analyze. `rustc` has a few IRs, each optimized source code which is easier to analyze. `rustc` has a few IRs, each optimized
for different purposes: for different purposes:
- Token stream: the lexer produces a stream of tokens directly from the source
code. This stream of tokens is easier for the parser to deal with than raw
text.
- Abstract Syntax Tree (AST): the abstract syntax tree is built from the stream - Abstract Syntax Tree (AST): the abstract syntax tree is built from the stream
of tokens produced by the lexer directly from the source code. It represents of tokens produced by the lexer. It represents
pretty much exactly what the user wrote. It helps to do some syntactic sanity pretty much exactly what the user wrote. It helps to do some syntactic sanity
checking (e.g. checking that a type is expected where the user wrote one). checking (e.g. checking that a type is expected where the user wrote one).
- High-level IR (HIR): This is a sort of desugared AST. It's still close - High-level IR (HIR): This is a sort of desugared AST. It's still close