• Yury Selivanov's avatar
    Issue #24619: Simplify async/await tokenization. · 96ec934e
    Yury Selivanov yazdı
    This commit simplifies async/await tokenization in tokenizer.c,
    tokenize.py & lib2to3/tokenize.py.  Previous solution was to keep
    a stack of async-def & def blocks, whereas the new approach is just
    to remember position of the outermost async-def block.
    
    This change won't bring any parsing performance improvements, but
    it makes the code much easier to read and validate.
    96ec934e
tokenizer.h 3.77 KB