cpython/Tools/clinic/libclinic
Petr Viktorin 9769b7ae06
[3.13] gh-113993: Allow interned strings to be mortal, and fix related issues (GH-120520) (GH-120945)
* Add an InternalDocs file describing how interning should work and how to use it.

* Add internal functions to *explicitly* request what kind of interning is done:
  - `_PyUnicode_InternMortal`
  - `_PyUnicode_InternImmortal`
  - `_PyUnicode_InternStatic`

* Switch uses of `PyUnicode_InternInPlace` to those.

* Disallow using `_Py_SetImmortal` on strings directly.
  You should use `_PyUnicode_InternImmortal` instead:
  - Strings should be interned before immortalization, otherwise you're possibly
    interning a immortalizing copy.
  - `_Py_SetImmortal` doesn't handle the `SSTATE_INTERNED_MORTAL` to
    `SSTATE_INTERNED_IMMORTAL` update, and those flags can't be changed in
    backports, as they are now part of public API and version-specific ABI.

* Add private `_only_immortal` argument for `sys.getunicodeinternedsize`, used in refleak test machinery.

* Make sure the statically allocated string singletons are unique. This means these sets are now disjoint:
  - `_Py_ID`
  - `_Py_STR` (including the empty string)
  - one-character latin-1 singletons

  Now, when you intern a singleton, that exact singleton will be interned.

* Add a `_Py_LATIN1_CHR` macro, use it instead of `_Py_ID`/`_Py_STR` for one-character latin-1 singletons everywhere (including Clinic).

* Intern `_Py_STR` singletons at startup.

* For free-threaded builds, intern `_Py_LATIN1_CHR` singletons at startup.

* Beef up the tests. Cover internal details (marked with `@cpython_only`).

* Add lots of assertions

Co-authored-by: Eric Snow <ericsnowcurrently@gmail.com>
2024-06-24 20:24:19 +02:00
..
__init__.py gh-113317: Argument Clinic: Add libclinic.converters module (#117315) 2024-04-02 10:09:53 +00:00
app.py gh-113317: Add ParseArgsCodeGen class (#117707) 2024-04-11 13:49:07 +00:00
block_parser.py gh-113317, AC: Add libclinic.block_parser module (#116819) 2024-03-14 16:11:39 +00:00
clanguage.py [3.13] gh-113993: Allow interned strings to be mortal, and fix related issues (GH-120520) (GH-120945) 2024-06-24 20:24:19 +02:00
cli.py gh-113317: Finish splitting Argument Clinic into sub-files (#117513) 2024-04-04 11:09:40 +02:00
codegen.py gh-113317: Add ParseArgsCodeGen class (#117707) 2024-04-11 13:49:07 +00:00
converter.py gh-113317: Add Codegen class to Argument Clinic (#117626) 2024-04-11 12:15:48 +02:00
converters.py gh-113317: Add Codegen class to Argument Clinic (#117626) 2024-04-11 12:15:48 +02:00
cpp.py gh-113299: Move cpp.py into libclinic (#113526) 2023-12-28 00:20:57 +01:00
dsl_parser.py gh-117613: Argument Clinic: disallow defining class parameter at module level (#117950) 2024-04-17 22:43:29 +02:00
errors.py gh-113317, AC: Move warn() and fail() to libclinic.errors (#116770) 2024-03-14 08:07:01 +00:00
formatting.py gh-113317: Argument Clinic: move linear_format into libclinic (#115518) 2024-02-15 23:52:20 +01:00
function.py gh-117431: Argument Clinic: copy forced text signature when cloning (#117591) 2024-04-10 10:12:05 +02:00
identifiers.py gh-113317: Argument Clinic: move C/Py identifier helpers into libclinic (#115520) 2024-02-16 07:42:15 +01:00
language.py gh-113317: Finish splitting Argument Clinic into sub-files (#117513) 2024-04-04 11:09:40 +02:00
parse_args.py [3.13] gh-119661: Add _Py_SINGLETON() include in Argumenet Clinic (#119712) (#119716) 2024-05-29 10:32:00 +00:00
parser.py gh-113317: Finish splitting Argument Clinic into sub-files (#117513) 2024-04-04 11:09:40 +02:00
return_converters.py gh-113317: Add Codegen class to Argument Clinic (#117626) 2024-04-11 12:15:48 +02:00
utils.py gh-113317: Argument Clinic: Add libclinic.converters module (#117315) 2024-04-02 10:09:53 +00:00