1. 23 Tem, 2015 1 kayıt (commit)
    • Yury Selivanov's avatar
      Issue #24619: Simplify async/await tokenization. · 96ec934e
      Yury Selivanov yazdı
      This commit simplifies async/await tokenization in tokenizer.c,
      tokenize.py & lib2to3/tokenize.py.  Previous solution was to keep
      a stack of async-def & def blocks, whereas the new approach is just
      to remember position of the outermost async-def block.
      
      This change won't bring any parsing performance improvements, but
      it makes the code much easier to read and validate.
      96ec934e
  2. 22 Tem, 2015 1 kayıt (commit)
    • Yury Selivanov's avatar
      Issue #24619: New approach for tokenizing async/await. · 8fb307cd
      Yury Selivanov yazdı
      This commit fixes how one-line async-defs and defs are tracked
      by tokenizer.  It allows to correctly parse invalid code such
      as:
      
      >>> async def f():
      ...     def g(): pass
      ...     async = 10
      
      and valid code such as:
      
      >>> async def f():
      ...     async def g(): pass
      ...     await z
      
      As a consequence, is is now possible to have one-line
      'async def foo(): await ..' functions:
      
      >>> async def foo(): return await bar()
      8fb307cd
  3. 22 Haz, 2015 1 kayıt (commit)
  4. 25 May, 2015 1 kayıt (commit)
  5. 12 May, 2015 1 kayıt (commit)
  6. 11 Mar, 2015 1 kayıt (commit)
  7. 11 Ock, 2015 1 kayıt (commit)
  8. 05 Ara, 2014 1 kayıt (commit)
    • Victor Stinner's avatar
      Issue #22599: Enhance tokenize.open() to be able to call it during Python · 96917509
      Victor Stinner yazdı
      finalization.
      
      Before the module kept a reference to the builtins module, but the module
      attributes are cleared during Python finalization. Instead, keep directly a
      reference to the open() function.
      
      This enhancement is not perfect, calling tokenize.open() can still fail if
      called very late during Python finalization.  Usually, the function is called
      by the linecache module which is called to display a traceback or emit a
      warning.
      96917509
  9. 10 Nis, 2014 1 kayıt (commit)
  10. 24 Şub, 2014 2 kayıt (commit)
  11. 18 Şub, 2014 1 kayıt (commit)
  12. 17 Şub, 2014 1 kayıt (commit)
  13. 09 Ock, 2014 1 kayıt (commit)
    • Serhiy Storchaka's avatar
      Issue #18960: Fix bugs with Python source code encoding in the second line. · 768c16ce
      Serhiy Storchaka yazdı
      * The first line of Python script could be executed twice when the source
      encoding (not equal to 'utf-8') was specified on the second line.
      
      * Now the source encoding declaration on the second line isn't effective if
      the first line contains anything except a comment.
      
      * As a consequence, 'python -x' works now again with files with the source
      encoding declarations specified on the second file, and can be used again
      to make Python batch files on Windows.
      
      * The tokenize module now ignore the source encoding declaration on the second
      line if the first line contains anything except a comment.
      
      * IDLE now ignores the source encoding declaration on the second line if the
      first line contains anything except a comment.
      
      * 2to3 and the findnocoding.py script now ignore the source encoding
      declaration on the second line if the first line contains anything except
      a comment.
      768c16ce
  14. 25 Kas, 2013 1 kayıt (commit)
  15. 16 Eyl, 2013 1 kayıt (commit)
  16. 25 Ara, 2012 1 kayıt (commit)
  17. 03 Kas, 2012 2 kayıt (commit)
  18. 07 Tem, 2012 1 kayıt (commit)
  19. 20 Haz, 2012 1 kayıt (commit)
  20. 17 Haz, 2012 2 kayıt (commit)
  21. 20 Nis, 2012 2 kayıt (commit)
  22. 04 Mar, 2012 2 kayıt (commit)
  23. 19 Ock, 2012 1 kayıt (commit)
  24. 11 Eki, 2011 1 kayıt (commit)
  25. 07 Eki, 2011 1 kayıt (commit)
  26. 22 Şub, 2011 2 kayıt (commit)
    • Brett Cannon's avatar
      Merged revisions 88498 via svnmerge from · 45b96d37
      Brett Cannon yazdı
      svn+ssh://pythondev@svn.python.org/python/branches/py3k
      
      ........
        r88498 | brett.cannon | 2011-02-21 19:25:12 -0800 (Mon, 21 Feb 2011) | 8 lines
      
        Issue #11074: Make 'tokenize' so it can be reloaded.
      
        The module stored away the 'open' object as found in the global namespace
        (which fell through to the built-in namespace) since it defined its own 'open'.
        Problem is that if you reloaded the module it then grabbed the 'open' defined
        in the previous load, leading to code that infinite recursed. Switched to
        simply call builtins.open directly.
      ........
      45b96d37
    • Brett Cannon's avatar
      Issue #11074: Make 'tokenize' so it can be reloaded. · f3042782
      Brett Cannon yazdı
      The module stored away the 'open' object as found in the global namespace
      (which fell through to the built-in namespace) since it defined its own 'open'.
      Problem is that if you reloaded the module it then grabbed the 'open' defined
      in the previous load, leading to code that infinite recursed. Switched to
      simply call builtins.open directly.
      f3042782
  27. 11 Kas, 2010 1 kayıt (commit)
  28. 09 Kas, 2010 1 kayıt (commit)
  29. 09 Eyl, 2010 3 kayıt (commit)
  30. 03 Eyl, 2010 1 kayıt (commit)
  31. 30 Agu, 2010 2 kayıt (commit)