- 23 Tem, 2015 1 kayıt (commit)
-
-
Yury Selivanov yazdı
This commit simplifies async/await tokenization in tokenizer.c, tokenize.py & lib2to3/tokenize.py. Previous solution was to keep a stack of async-def & def blocks, whereas the new approach is just to remember position of the outermost async-def block. This change won't bring any parsing performance improvements, but it makes the code much easier to read and validate.
-
- 22 Tem, 2015 1 kayıt (commit)
-
-
Yury Selivanov yazdı
This commit fixes how one-line async-defs and defs are tracked by tokenizer. It allows to correctly parse invalid code such as: >>> async def f(): ... def g(): pass ... async = 10 and valid code such as: >>> async def f(): ... async def g(): pass ... await z As a consequence, is is now possible to have one-line 'async def foo(): await ..' functions: >>> async def foo(): return await bar()
-
- 22 Haz, 2015 1 kayıt (commit)
-
-
Dingyuan Wang yazdı
-
- 25 May, 2015 1 kayıt (commit)
-
-
Victor Stinner yazdı
fix a resource warning.
-
- 12 May, 2015 1 kayıt (commit)
-
-
Yury Selivanov yazdı
-
- 11 Mar, 2015 1 kayıt (commit)
-
-
Serhiy Storchaka yazdı
imp.reload(). Patch by Thomas Kluyver.
-
- 11 Ock, 2015 1 kayıt (commit)
-
-
Serhiy Storchaka yazdı
-
- 05 Ara, 2014 1 kayıt (commit)
-
-
Victor Stinner yazdı
finalization. Before the module kept a reference to the builtins module, but the module attributes are cleared during Python finalization. Instead, keep directly a reference to the open() function. This enhancement is not perfect, calling tokenize.open() can still fail if called very late during Python finalization. Usually, the function is called by the linecache module which is called to display a traceback or emit a warning.
-
- 10 Nis, 2014 1 kayıt (commit)
-
-
Benjamin Peterson yazdı
-
- 24 Şub, 2014 2 kayıt (commit)
-
-
Terry Jan Reedy yazdı
-
Terry Jan Reedy yazdı
Original patches by A. Kuchling and G. Rees (#12691).
-
- 18 Şub, 2014 1 kayıt (commit)
-
-
Terry Jan Reedy yazdı
Patch based on lines from Georg Brandl, Eric Snow, and Gareth Rees.
-
- 17 Şub, 2014 1 kayıt (commit)
-
-
Terry Jan Reedy yazdı
Replace it with correct logic that raises ValueError for bad input. Issues #8478 and #12691 reported the incorrect logic. Add an Untokenize test case and an initial test method.
-
- 09 Ock, 2014 1 kayıt (commit)
-
-
Serhiy Storchaka yazdı
* The first line of Python script could be executed twice when the source encoding (not equal to 'utf-8') was specified on the second line. * Now the source encoding declaration on the second line isn't effective if the first line contains anything except a comment. * As a consequence, 'python -x' works now again with files with the source encoding declarations specified on the second file, and can be used again to make Python batch files on Windows. * The tokenize module now ignore the source encoding declaration on the second line if the first line contains anything except a comment. * IDLE now ignores the source encoding declaration on the second line if the first line contains anything except a comment. * 2to3 and the findnocoding.py script now ignore the source encoding declaration on the second line if the first line contains anything except a comment.
-
- 25 Kas, 2013 1 kayıt (commit)
-
-
Ezio Melotti yazdı
-
- 16 Eyl, 2013 1 kayıt (commit)
-
-
Serhiy Storchaka yazdı
now detect Python source code encoding only in comment lines.
-
- 25 Ara, 2012 1 kayıt (commit)
-
-
Andrew Svetlov yazdı
-
- 03 Kas, 2012 2 kayıt (commit)
-
-
Ezio Melotti yazdı
#16152: fix tokenize to ignore whitespace at the end of the code when no newline is found. Patch by Ned Batchelder.
-
Ezio Melotti yazdı
#16152: fix tokenize to ignore whitespace at the end of the code when no newline is found. Patch by Ned Batchelder.
-
- 07 Tem, 2012 1 kayıt (commit)
-
-
Florent Xicluna yazdı
-
- 20 Haz, 2012 1 kayıt (commit)
-
-
Christian Heimes yazdı
-
- 17 Haz, 2012 2 kayıt (commit)
-
-
Meador Inge yazdı
Patch by Serhiy Storchaka.
-
Meador Inge yazdı
Patch by Serhiy Storchaka.
-
- 20 Nis, 2012 2 kayıt (commit)
-
-
Brett Cannon yazdı
tokenizer.detect_encoding() (when available).
-
Martin v. Löwis yazdı
if the first two lines have non-UTF-8 characters without an encoding declaration.
-
- 04 Mar, 2012 2 kayıt (commit)
-
-
Armin Ronacher yazdı
-
Armin Ronacher yazdı
-
- 19 Ock, 2012 1 kayıt (commit)
-
-
Meador Inge yazdı
-
- 11 Eki, 2011 1 kayıt (commit)
-
-
Antoine Pitrou yazdı
Instead, the re module's standard caching does its work.
-
- 07 Eki, 2011 1 kayıt (commit)
-
-
Meador Inge yazdı
-
- 22 Şub, 2011 2 kayıt (commit)
-
-
Brett Cannon yazdı
svn+ssh://pythondev@svn.python.org/python/branches/py3k ........ r88498 | brett.cannon | 2011-02-21 19:25:12 -0800 (Mon, 21 Feb 2011) | 8 lines Issue #11074: Make 'tokenize' so it can be reloaded. The module stored away the 'open' object as found in the global namespace (which fell through to the built-in namespace) since it defined its own 'open'. Problem is that if you reloaded the module it then grabbed the 'open' defined in the previous load, leading to code that infinite recursed. Switched to simply call builtins.open directly. ........
-
Brett Cannon yazdı
The module stored away the 'open' object as found in the global namespace (which fell through to the built-in namespace) since it defined its own 'open'. Problem is that if you reloaded the module it then grabbed the 'open' defined in the previous load, leading to code that infinite recursed. Switched to simply call builtins.open directly.
-
- 11 Kas, 2010 1 kayıt (commit)
-
-
Alexander Belopolsky yazdı
in tokenize module and prevents leaking of private names through import *.
-
- 09 Kas, 2010 1 kayıt (commit)
-
-
Victor Stinner yazdı
tokenize.detect_encoding() and open it in read only mode.
-
- 09 Eyl, 2010 3 kayıt (commit)
-
-
Raymond Hettinger yazdı
-
Raymond Hettinger yazdı
Experiment: Let collections.namedtuple() do the work. This should work now that _collections is pre-built. The buildbots will tell us shortly.
-
Raymond Hettinger yazdı
-
- 03 Eyl, 2010 1 kayıt (commit)
-
-
Florent Xicluna yazdı
-
- 30 Agu, 2010 2 kayıt (commit)
-
-
Benjamin Peterson yazdı
svn+ssh://pythondev@svn.python.org/python/branches/py3k ........ r84364 | benjamin.peterson | 2010-08-30 09:41:20 -0500 (Mon, 30 Aug 2010) | 1 line handle names starting with non-ascii characters correctly #9712 ........
-
Benjamin Peterson yazdı
-