Skip to content

Latest commit

 

History

History
30 lines (28 loc) · 1.19 KB

changes.md

File metadata and controls

30 lines (28 loc) · 1.19 KB

Jan. 07, 2025

  • parser grammar update for Python 3.13.1

  • added ENCODING token

  • complete rewrite of fstring tokenizer in lexer grammar and PythonLexerBase class
    • now correctly tokenizes the followings in fstring:
      • escape sequences
      • walrus operator
      • dictionary comprehension
      • set comprehension

  • soft keywords changes:
    • no embedded code (semantic predicates) in parser grammar for soft keywords
    • no need for PythonParserBase class
    • no need for transformGrammar.py
    • BREAKING CHANGES:
      • dedicated tokens for soft keywords instead of NAME token:
        • NAME_OR_TYPE
        • NAME_OR_MATCH
        • NAME_OR_CASE
        • NAME_OR_WILDCARD

Oct. 18, 2024

  • Fix that case [a, *_] if a == 0: throws error rule soft_kw__not__wildcard failed predicate: {this.isnotEqualToCurrentTokenText("_")}?

Sept. 05, 2024

  • Type comment tokens are no longer generated.
    Type comments will now be tokenized as plain comment tokens.


  • Line continuation for string literals (backslash followed by a newline) is no longer resolved.
    (backslash+newline is no longer removed from string literals)