Using the system and place-dependent default encoding for open()
is a bad idea for IDLE's system and location-independent files.
(cherry picked from commit 688722ce)
Co-authored-by: Terry Jan Reedy <tjreedy@udel.edu>

GUI test test_file_buttons() only looks at initial ascii-only lines,
but failed on systems where open() defaults to 'ascii' because
readline() internally reads and decodes far enough ahead to encounter
a non-ascii character in CREDITS.txt.
(cherry picked from commit f34e03ec)
Co-authored-by: Terry Jan Reedy <tjreedy@udel.edu>

The PrintNameOffset field of the reparse data buffer
was treated as a number of characters instead of bytes.

(cherry picked from commit 3c34aad4)
Co-authored-by: SSE4 <tomskside@gmail.com>

`arg_name` and `element_index` are defined as `digit`+ instead of `integer`.
(cherry picked from commit 7a561afd)
Co-authored-by: Mariatta <Mariatta@users.noreply.github.com>

It now reads: ...be aware that Python has no control over...
(cherry picked from commit 517da1e5)
Co-authored-by: Alexey <forestbiiird@gmail.com>

(cherry picked from commit 6ea20fc7)

(cherry picked from commit 28607e0d)

The new link is given in a red box on the old page.
(cherry picked from commit 8d1f2f40)
Co-authored-by: sblondon <sblondon@users.noreply.github.com>

Co-authored-by: Jake Davis <jcdavis@awedge.net>.
(cherry picked from commit 2411292b)

(cherry picked from commit 5bb0005f)
Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>

Fix bug in travis configuration where it did not run the tests when
a change includes both code and doc changes.
(cherry picked from commit 32921f90)
Co-authored-by: Stéphane Wirtel <stephane@wirtel.be>

Fixes the documentation for `subprocess.check_output()` not mentioning that the encoding and errors parameters were added in 3.6.
(cherry picked from commit fc1ce810)
Co-authored-by: Brice Gros <brice-gros@users.noreply.github.com>

Fix a rare but potential pre-exec child process deadlock in subprocess on POSIX systems when marking file descriptors inheritable on exec in the child process.  This bug appears to have been introduced in 3.4 with the inheritable file descriptors support.

This also changes Python/fileutils.c `set_inheritable` to use the "slow" two `fcntl` syscall path instead of the "fast" single `ioctl` syscall path when asked to be async signal safe (by way of being asked not to raise exceptions).  `ioctl` is not a POSIX async-signal-safe approved function.

ref: http://pubs.opengroup.org/onlinepubs/9699919799/functions/V2_chap02.html
(cherry picked from commit c1e46e94)
Co-authored-by: Alexey Izbyshev <izbyshev@users.noreply.github.com>

Add entry for uniform lower context; add 'since' to be explicit.
(cherry picked from commit 05e80676)

When `__getattr__` is implemented, attribute lookup will always fall back to that,
even if the initial failure comes from `__getattribute__` or a descriptor's `__get__`
method (including property methods).
(cherry picked from commit d1f31810)
Co-authored-by: Cheryl Sabella <cheryl.sabella@gmail.com>

Add new entries to the widget list.
(cherry picked from commit 845d8648)
Co-authored-by: Cheryl Sabella <cheryl.sabella@gmail.com>

bpo-32720: Fixed the definition for width and precision in format mini-language doc (GH-5482) (GH-5525)

Changed the definition of width and precision from "integer" to "digit+" in format mini-language doc.
(cherry picked from commit 8b5fa289)
Co-authored-by: nathankerr96 <nathankerr96@gmail.com>

 Fix typos found by codespell in docs, docstrings, and comments.
Fixes for the following files were in post-3.6 code and not backported:
Lib/ctypes/_aix.py (new), Lib/test/test_concurrent_futures.py,
Modules/_asynciomodule.c, Modules/_pickle.c, Objects/obmalloc.c.

(cherry picked from commit c3d9508f)

(cherry picked from commit 589c718a)
Co-authored-by: Raymond Hettinger <rhettinger@users.noreply.github.com>

Add 3.6.4 and 3.6.5 headers; move 3.6.3 header below 3.6.4 entries; fix dates.

* Make sure ``__spec__.loader`` matches ``__loader__`` for namespace packages.
* Make sure ``__spec__.origin` matches ``__file__`` for namespace packages.

https://bugs.python.org/issue32303
https://bugs.python.org/issue32305.
(cherry picked from commit bbbcf869)
Co-authored-by: Barry Warsaw <barry@python.org>

(cherry picked from commit d41e9e0952393e64f2f9756d778553d704191086)

Modify RE examples in documentation to use raw strings to prevent DeprecationWarning.
Add text to REGEX HOWTO to highlight the deprecation.  Approved by Serhiy Storchaka.

(cherry picked from commit 66771422)

Clarify that the level argument is used to determine whether to
perform absolute or relative imports: 0 is absolute, while a positive number
is the number of parent directories to search relative to the current module.
(cherry picked from commit 461d225b)
Co-authored-by: oldk <oldk1331@users.noreply.github.com>

bpo-31106: Fix handling of erros in posix_fallocate() and posix_fadvise() (GH-3000) (GH-3000) (#4101)

(cherry picked from commit d4b93e21)

(cherry picked from commit 12e7cd8a)
Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>

instead of crashing due to a stack overflow.

This perhaps will fix similar problems in other extension types.
(cherry picked from commit 1fb72d2a)

The f-string example for using datetime format specifier does not match the given output.
Changed the format from %b to %B so it matches the output of "January".
(cherry picked from commit b299393c)
Co-authored-by: Cheryl Sabella <cheryl.sabella@gmail.com>

bpo-32727: smtplib's SMTP.send_message behaves differently with from_addr and to_addrs (GH-5451) (#5455)

Do not pass the name field in the 'from' address in the SMTP envelope.
(cherry picked from commit 8d83e4ba)
Co-authored-by: Stéphane Wirtel <stephane@wirtel.be>

When using customized decode error handlers, it is possible for builtin decoders
to write out-of-bounds and then crash..
(cherry picked from commit 2c7fd46e)

Co-authored-by: Benjamin Peterson <benjamin@python.org>

Fix two (in my opinion) spurious failure conditions in the lib2to3.tests.test_parser.TestParserIdempotency test_parser test.

    Use the same encoding found in the initial file to write a temp file for a diff. This retains the BOM if the encoding was initially utf-8-sig.

    If the file cannot be parsed using the normal grammar, try again with no print statement which should succeed for valid files using future print_function

For case (1), the driver was correctly handling a BOM in a utf-8 file, but then the test was not writing a comparison file using 'utf-8-sig' to diff against, so the BOM got removed. I don't think that is the fault of the parser, and lib2to3 will retain the BOM.

For case (2), lib2to3 pre-detects the use of from __future__ import print_function or allows the user to force this interpretation with a -p flag, and then selects a different grammar with the print statement removed. That makes the test cases unfair to this test as the driver itself doesn't know which grammar to use. As a minimal fix, the test will try using a grammar with the print statement, and if that fails fall back on a grammar without it. A more thorough handling of the idempotency test would to be to parse all files using both grammars and ignore if one of the two failed but otherwise check both. I didn't think this was necessary but can change..
(cherry picked from commit 14e976e0)

(cherry picked from commit 95441809)
Co-authored-by: Benjamin Peterson <benjamin@python.org>

(cherry picked from commit 77526f05)

This reverts commit 9105879b
in order to keep the behaviour of locals() consistent between
3.6.4 and 3.6.5+.

(cherry picked from commit 9424dcbb)
Co-authored-by: Julien Palard <julien@palard.fr>

Correctly handle addresses whose username is an empty quoted string.
(cherry picked from commit aa218d16)
Co-authored-by: jayyyin <jayyin11043@hotmail.com>

Document the error return of PyLong_As* APIs.

A frequent Python C API usage error is neglecting to check the return
value and/or PyErr_Occurred().
(cherry picked from commit f5b04a36)