cpython/Modules/_io
Petr Viktorin 9769b7ae06
[3.13] gh-113993: Allow interned strings to be mortal, and fix related issues (GH-120520) (GH-120945)
* Add an InternalDocs file describing how interning should work and how to use it.

* Add internal functions to *explicitly* request what kind of interning is done:
  - `_PyUnicode_InternMortal`
  - `_PyUnicode_InternImmortal`
  - `_PyUnicode_InternStatic`

* Switch uses of `PyUnicode_InternInPlace` to those.

* Disallow using `_Py_SetImmortal` on strings directly.
  You should use `_PyUnicode_InternImmortal` instead:
  - Strings should be interned before immortalization, otherwise you're possibly
    interning a immortalizing copy.
  - `_Py_SetImmortal` doesn't handle the `SSTATE_INTERNED_MORTAL` to
    `SSTATE_INTERNED_IMMORTAL` update, and those flags can't be changed in
    backports, as they are now part of public API and version-specific ABI.

* Add private `_only_immortal` argument for `sys.getunicodeinternedsize`, used in refleak test machinery.

* Make sure the statically allocated string singletons are unique. This means these sets are now disjoint:
  - `_Py_ID`
  - `_Py_STR` (including the empty string)
  - one-character latin-1 singletons

  Now, when you intern a singleton, that exact singleton will be interned.

* Add a `_Py_LATIN1_CHR` macro, use it instead of `_Py_ID`/`_Py_STR` for one-character latin-1 singletons everywhere (including Clinic).

* Intern `_Py_STR` singletons at startup.

* For free-threaded builds, intern `_Py_LATIN1_CHR` singletons at startup.

* Beef up the tests. Cover internal details (marked with `@cpython_only`).

* Add lots of assertions

Co-authored-by: Eric Snow <ericsnowcurrently@gmail.com>
2024-06-24 20:24:19 +02:00
..
clinic [3.13] gh-119661: Add _Py_SINGLETON() include in Argumenet Clinic (#119712) (#119716) 2024-05-29 10:32:00 +00:00
_iomodule.c gh-116322: Add Py_mod_gil module slot (#116882) 2024-05-03 11:30:55 -04:00
_iomodule.h gh-101819: Isolate `_io` (#101948) 2023-05-15 09:26:27 +00:00
bufferedio.c gh-117151: optimize BufferedWriter(), do not buffer writes that are the buffer size (GH-118037) 2024-04-23 18:51:20 +03:00
bytesio.c gh-117068: Remove useless code in bytesio.c:resize_buffer() (GH-117069) 2024-03-22 11:25:38 +00:00
fileio.c gh-117764: Add signatures for __reduce__ and __reduce_ex__ in the _io module (GH-117773) 2024-04-12 12:22:17 +03:00
iobase.c Fix an incorrect comment in iobase_is_closed (GH-102952) 2024-01-16 18:27:17 +02:00
stringio.c [3.13] gh-113993: Allow interned strings to be mortal, and fix related issues (GH-120520) (GH-120945) 2024-06-24 20:24:19 +02:00
textio.c [3.13] gh-119506: fix `_io.TextIOWrapper.write()` write during flush (GH-119507) (#119964) 2024-06-19 10:11:07 +00:00
winconsoleio.c gh-115538: Emit warning when use bool as fd in _io.WindowsConsoleIO (GH-116925) 2024-03-18 11:48:50 +00:00