• Albert-Jan Nijburg's avatar
    bpo-25324: copy tok_name before changing it (#1608) · fc354f07
    Albert-Jan Nijburg yazdı
    * add test to check if were modifying token
    
    * copy list so import tokenize doesnt have side effects on token
    
    * shorten line
    
    * add tokenize tokens to token.h to get them to show up in token
    
    * move ERRORTOKEN back to its previous location, and fix nitpick
    
    * copy comments from token.h automatically
    
    * fix whitespace and make more pythonic
    
    * change to fix comments from @haypo
    
    * update token.rst and Misc/NEWS
    
    * change wording
    
    * some more wording changes
    fc354f07
tokenize.py 28 KB