Skip to content

WIP: Started working on the Parser #21

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Jan 25, 2018
Merged

WIP: Started working on the Parser #21

Changes from 1 commit
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
3c98b0f
Started working on the parser chapter
Michael-F-Bryan Jan 20, 2018
b2a850f
Mentioned the main players in the parser
Michael-F-Bryan Jan 24, 2018
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 14 additions & 1 deletion src/the-parser.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1 +1,14 @@
# The parser
# The Parser

The parser is responsible for converting raw Rust source code into a structured
form which is easier for the compiler to work with, usually called an *Abstract
Syntax Tree*. The bulk of the parser lives in the [libsyntax] crate.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Link to wikipedia? Maybe pointless?


The parsing process is made up of roughly 3 stages,

- lexical analysis - turn a stream of characters into a stream of token trees
- macro expansion - run `proc-macros` and expand `macro_rules` macros
- parsing - turn the token trees into an AST
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here I think I would link to the relevant chapter of the guide -- oh, wait, do we not have a chapter for the AST? We should add one =)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was thinking the AST would fall under the parser section, maybe as a short sub-chapter.



[libsyntax]: https://github.com/rust-lang/rust/tree/master/src/libsyntax