cd0ff9bd14
GH-93911: Fix `LOAD_ATTR_PROPERTY` caches (GH-96519)
2022-09-06 12:11:38 +01:00
4c72517cad
gh-93554: Conditional jump opcodes only jump forward (GH-96318)
2022-09-01 21:36:47 +01:00
4a6fa89465
Remove dead code in _PyDict_GetItemHint and rename to _PyDict_LookupIndex (GH-95948)
2022-08-18 10:19:21 +01:00
7276ca25f5
GH-93911: Specialize `LOAD_ATTR` for custom `__getattribute__` (GH-93988)
2022-08-17 12:37:07 +01:00
de388c0a7b
GH-95245: Store object values and dict pointers in single tagged pointer. (GH-95278)
2022-08-01 14:34:54 +01:00
e402b26b7f
GH-95113: Don't use EXTENDED_ARG_QUICK in unquickened code (GH-95121)
2022-07-22 11:04:20 -07:00
daf68ba92f
GH-94822: Don't specialize when metaclasses are involved (GH-94892)
2022-07-18 10:10:22 -07:00
c0453a40fa
GH-94163: Add BINARY_SLICE and STORE_SLICE instructions. (GH-94168)
2022-06-27 12:24:23 +01:00
6f8875eba3
GH-93841: Allow stats to be turned on and off, cleared and dumped at runtime. (GH-93843)
2022-06-21 15:40:54 +01:00
5fcfdd87c9
GH-91432: Specialize FOR_ITER (GH-91713)
...
* Adds FOR_ITER_LIST and FOR_ITER_RANGE specializations.
* Adds _PyLong_AssignValue() internal function to avoid temporary boxing of ints.
2022-06-21 11:19:26 +01:00
77c839c98f
gh-94021: Address unreachable code warning in specialize code (GH-94022)
2022-06-20 23:34:11 -07:00
a51742ab82
gh-93911: Specialize `LOAD_ATTR_PROPERTY` (GH-93912)
2022-06-17 23:13:17 +08:00
ab45c1dde0
Fix BINARY_SUBSCR_GETITEM stats (GH-93903)
2022-06-16 15:02:07 +01:00
6b330002b1
Rename 'LOAD_METHOD' specialization stat consts to 'ATTR'. (GH-93812)
2022-06-14 16:44:01 +01:00
ef6e44d392
Remove LOAD_METHOD stats. (GH-93807)
2022-06-14 15:03:15 +01:00
b083450f88
GH-93429: Merge `LOAD_METHOD` back into `LOAD_ATTR` (GH-93430)
2022-06-14 11:36:22 +01:00
c5d0517ea4
Add more FOR_ITER specialization stats (GH-32151)
2022-06-13 01:40:54 -04:00
f012df706c
Shrink the LOAD_METHOD cache by one codeunit. ( #93537 )
2022-06-07 10:28:53 +01:00
eb618d5ff0
GH-93354: Use exponential backoff to avoid excessive specialization attempts. (GH-93355)
2022-05-31 11:58:26 +01:00
bbcf42449e
GH-90230: Add stats to breakdown the origin of calls to `PyEval_EvalFrame` (GH-93284)
2022-05-27 16:31:41 +01:00
5e6e5b98a8
gh-92777: Add LOAD_METHOD_LAZY_DICT (GH-92778)
2022-05-25 14:06:15 +01:00
e48ac9c100
GH-90690: Remove `PRECALL` instruction (GH-92925)
2022-05-19 11:05:26 +01:00
a4460f2eb8
Split refcount stats into 'interpreter' and 'non-interpreter' (GH-92919)
2022-05-18 14:38:43 +01:00
fa2b8b75eb
Improve object stats ( #92845 )
...
* Add incref/decref stats
* Show ratios for allocation in summary
2022-05-16 14:35:11 +01:00
f8a2fab212
GH-92239: Make sure that PEP 523 is supported, even when specializing first. (GH-92245)
2022-05-04 09:31:21 -06:00
836b17c9c3
Add more stats for freelist use and allocations. (GH-92211)
2022-05-03 16:40:24 -06:00
64a54e511d
gh-91719: Add pycore_opcode.h internal header file ( #91906 )
...
Move the following API from Include/opcode.h (public C API) to a new
Include/internal/pycore_opcode.h header file (internal C API):
* EXTRA_CASES
* _PyOpcode_Caches
* _PyOpcode_Deopt
* _PyOpcode_Jump
* _PyOpcode_OpName
* _PyOpcode_RelativeJump
2022-04-26 00:14:30 +02:00
dd207a6ac5
bpo-47120: make POP_JUMP_IF_TRUE/FALSE/NONE/NOT_NONE relative (GH-32400)
2022-04-11 10:40:24 +01:00
6c6e0408a6
bpo-47009: Let PRECALL_NO_KW_LIST_APPEND do its own POP_TOP (GH-32239)
2022-04-05 11:18:30 +01:00
a00518d9ad
bpo-47120: Replace the JUMP_ABSOLUTE opcode by the relative JUMP_BACKWARD (GH-32115)
2022-03-31 14:14:15 +01:00
04acfa94bb
Merge deoptimization blocks in interpreter (GH-32155)
2022-03-30 13:11:33 +01:00
58448cbd96
bpo-47127: Specialize calls for fastcall c methods with keywords (GH-32125)
...
* add PRECALL_METHOD_DESCRIPTOR_FAST_WITH_KEYWORDS
2022-03-28 03:53:25 +08:00
cca43b7d64
bpo-47053: Reduce deoptimization in BINARY_OP_INPLACE_ADD_UNICODE (GH-31318)
...
* Don't deopt if refcounts are too big
* Detect more at specialization time
2022-03-25 16:13:19 +00:00
2bde6827ea
bpo-46841: Quicken code in-place (GH-31888)
...
* Moves the bytecode to the end of the corresponding PyCodeObject, and quickens it in-place.
* Removes the almost-always-unused co_varnames, co_freevars, and co_cellvars member caches
* _PyOpcode_Deopt is a new mapping from all opcodes to their un-quickened forms.
* _PyOpcode_InlineCacheEntries is renamed to _PyOpcode_Caches
* _Py_IncrementCountAndMaybeQuicken is renamed to _PyCode_Warmup
* _Py_Quicken is renamed to _PyCode_Quicken
* _co_quickened is renamed to _co_code_adaptive (and is now a read-only memoryview).
* Do not emit unused nonzero opargs anymore in the compiler.
2022-03-21 11:11:17 +00:00
a89c29fbcc
bpo-46841: Add a _Py_SET_OPCODE macro (GH-31780)
2022-03-11 16:31:50 -08:00
5498a61c7c
bpo-46841: Don't use an oparg counter for `STORE_SUBSCR` (GH-31742)
2022-03-08 15:53:22 +00:00
f193631387
bpo-46841: Use inline caching for calls (GH-31709)
2022-03-07 11:45:00 -08:00
6927632492
Remove trailing spaces (GH-31695)
2022-03-05 17:47:00 +02:00
c4d2d57eef
bpo-46841: Fix BINARY_OP's handling of inline caches (GH-31671)
2022-03-04 10:51:27 -08:00
03c2a36b2b
bpo-46903: Handle str-subclasses in virtual instance dictionaries. (GH-31658)
2022-03-04 11:31:29 +00:00
05a8bc1c94
bpo-46841: Use inline caching for attribute accesses (GH-31640)
2022-03-03 15:31:00 -08:00
127797f572
bpo-46841: Improve the failure stats for COMPARE_OP (GH-31663)
2022-03-03 11:28:47 -08:00
b35603532b
Move check for str-only keys in LOAD_GLOBAL specializations to specialization time. (GH-31659)
2022-03-03 15:17:18 +00:00
3b0f1c5a71
bpo-46841: Use inline cache for `BINARY_SUBSCR`. (GH-31618)
2022-03-01 16:00:34 +00:00
7820a5897e
bpo-46841: Use inline caching for `COMPARE_OP` (GH-31622)
2022-03-01 13:53:13 +00:00
4558af5a8f
bpo-46841: Move the cache for `LOAD_GLOBAL` inline. (GH-31575)
2022-02-28 12:56:29 +00:00
424ecab494
bpo-46841: Use inline caching for `UNPACK_SEQUENCE` (GH-31591)
2022-02-28 11:54:14 +00:00
8f2a337a80
bpo-45316: Move private functions to internal C API (GH-31579)
...
Move the unexported private functions to the internal C API:
* pycore_frame.h: _PyFrame_New_NoTrack()
* pycore_function.h: _PyFunction_GetVersionForCurrentState()
* pycore_genobject.h: _PyAsyncGenValueWrapperNew()
* pycore_genobject.h: _PyCoro_GetAwaitableIter()
* pycore_genobject.h: _PyGen_yf()
2022-02-25 16:07:14 +01:00
0f41aac109
bpo-46841: Use *inline* caching for `BINARY_OP` (GH-31543)
2022-02-25 12:11:34 +00:00
2a6ece572c
bpo-45107: Specialize `LOAD_METHOD` for instances with dict. (GH-31531)
2022-02-24 19:34:57 +00:00
a52d2528a4
bpo-46823: Implement LOAD_FAST__LOAD_ATTR_INSTANCE_VALUE superinstruction (GH-31484)
2022-02-24 14:55:59 +00:00
281ea9c391
bpo-44337: Shrink the LOAD_ATTR/STORE_ATTR caches (GH-31517)
2022-02-23 10:53:24 -08:00
375a56bd40
bpo-45885: Don't un-adapt `COMPARE_OP` when collecting stats (GH-31516)
2022-02-23 11:06:25 +00:00
424023efee
bpo-46329: Fix test failure when `Py_STATS` is enabled (GH-31511)
2022-02-23 11:00:28 +00:00
9058a35558
Move call specializations from CALL to PRECALL. (GH-31496)
2022-02-22 14:57:01 +00:00
cf345e945f
bpo-46329: Change calling sequence (again) (GH-31373)
...
* Change calling sequence: Add PUSH_NULL. Merge PRECALL_FUNCTION and PRECALL_METHOD into PRECALL.
2022-02-18 17:19:08 +00:00
580cd9ab29
bpo-46072: Add detailed failure stats for BINARY_OP (GH-31289)
2022-02-16 08:49:58 -08:00
a9da085015
bpo-46702: Specialize UNPACK_SEQUENCE (GH-31240)
2022-02-16 08:48:16 -08:00
0ade875ebe
Add pair counts to stats output and summary. (GH-31324)
2022-02-14 15:53:38 +00:00
15ee55528e
Include length in stats for UNPACK_SEQUENCE. (GH-31254)
2022-02-14 10:01:31 +00:00
e0bcfd0e4d
bpo-45490: Rename static inline functions (GH-31217)
...
When a static inline function is wrapped by a macro which casts its
arguments to the expected type, there is no need that the function
has a different name than the macro. Use the same name for the macro
and the function to avoid confusion.
Rename _PyUnicode_get_wstr_length() to PyUnicode_WSTR_LENGTH().
Don't rename static inline _Py_NewRef() and _Py_XNewRef() functions,
since the C API exports Py_NewRef() and Py_XNewRef() functions as
regular functions. The name cannot be reused in this case.
2022-02-11 17:01:10 +01:00
d7a5aca982
bpo-45923: Add `RESUME_QUICK` (GH-31244)
2022-02-10 17:50:02 +00:00
1a6411f573
Gather stats for PRECALL_METHOD. (GH-31259)
2022-02-10 15:55:52 +00:00
b0662ae5c8
Add stats for PRECALL_FUNCTION. (GH-31250)
2022-02-10 11:47:52 +00:00
f71a69aa92
bpo-46072: Output stats as markdown with collapsible sections. (GH-31228)
2022-02-09 12:30:26 +00:00
81c72044a1
bpo-46541: Replace core use of _Py_IDENTIFIER() with statically initialized global objects. (gh-30928)
...
We're no longer using _Py_IDENTIFIER() (or _Py_static_string()) in any core CPython code. It is still used in a number of non-builtin stdlib modules.
The replacement is: PyUnicodeObject (not pointer) fields under _PyRuntimeState, statically initialized as part of _PyRuntime. A new _Py_GET_GLOBAL_IDENTIFIER() macro facilitates lookup of the fields (along with _Py_GET_GLOBAL_STRING() for non-identifier strings).
https://bugs.python.org/issue46541#msg411799 explains the rationale for this change.
The core of the change is in:
* (new) Include/internal/pycore_global_strings.h - the declarations for the global strings, along with the macros
* Include/internal/pycore_runtime_init.h - added the static initializers for the global strings
* Include/internal/pycore_global_objects.h - where the struct in pycore_global_strings.h is hooked into _PyRuntimeState
* Tools/scripts/generate_global_objects.py - added generation of the global string declarations and static initializers
I've also added a --check flag to generate_global_objects.py (along with make check-global-objects) to check for unused global strings. That check is added to the PR CI config.
The remainder of this change updates the core code to use _Py_GET_GLOBAL_IDENTIFIER() instead of _Py_IDENTIFIER() and the related _Py*Id functions (likewise for _Py_GET_GLOBAL_STRING() instead of _Py_static_string()). This includes adding a few functions where there wasn't already an alternative to _Py*Id(), replacing the _Py_Identifier * parameter with PyObject *.
The following are not changed (yet):
* stop using _Py_IDENTIFIER() in the stdlib modules
* (maybe) get rid of _Py_IDENTIFIER(), etc. entirely -- this may not be doable as at least one package on PyPI using this (private) API
* (maybe) intern the strings during runtime init
https://bugs.python.org/issue46541
2022-02-08 13:39:07 -07:00
062460e8fd
bpo-46072: Improve LOAD_METHOD stats (GH-31104)
2022-02-07 14:30:34 +00:00
832876b992
Add miss stats for specialized instructions. (GH-31108)
2022-02-04 09:56:46 +00:00
a0401d8372
Collect stats for UNPACK_SEQUENCE. (GH-31105)
2022-02-03 18:40:56 +00:00
674ab66ebd
bpo-45885: Add more stats for COMPARE_OP in specialize.c (GH-31040)
2022-02-03 13:32:52 +00:00
0d05da1fbf
Add specialization stats for FOR_ITER. (GH-31079)
2022-02-02 15:56:47 +00:00
187930f74c
bpo-46072: Add some frame stats. (GH-31060)
2022-02-02 11:01:33 +00:00
48be46ec1f
bpo-46072: Add some object layout and allocation stats (GH-31051)
2022-02-01 15:05:18 +00:00
90ab138bbd
bpo-46072: Add simple stats for Python calls. (GH-30989)
2022-01-28 15:20:33 +00:00
89fd7c3452
bpo-46329: Split calls into precall and call instructions. (GH-30855)
...
* Add PRECALL_FUNCTION opcode.
* Move 'call shape' varaibles into struct.
* Replace CALL_NO_KW and CALL_KW with KW_NAMES and CALL instructions.
* Specialize for builtin methods taking using the METH_FASTCALL | METH_KEYWORDS protocol.
* Allow kwnames for specialized calls to builtin types.
* Specialize calls to tuple(arg) and str(arg).
2022-01-28 12:42:30 +00:00
d1beb241d9
bpo-46486: Fixed misspelled name DesciptorClassification
2022-01-23 16:03:50 -06:00
7835cbf949
bpo-46417: Use _PyType_CAST() in Python directory (GH-30769)
2022-01-21 23:30:17 +01:00
b04dfbbe4b
bpo-46409: Make generators in bytecode (GH-30633)
...
* Add RETURN_GENERATOR and JUMP_NO_INTERRUPT opcodes.
* Trim frame and generator by word each.
* Minor refactor of frame.c
* Update test.test_sys to account for smaller frames.
* Treat generator functions as normal functions when evaluating and specializing.
2022-01-20 11:46:39 +00:00
a4bc2218d2
bpo-46405: fix msvc compiler warnings (GH-30627)
2022-01-17 16:30:10 +00:00
7537f60087
bpo-45609: More specialization stats for STORE_SUBSCR (GH-30193)
2022-01-04 18:05:09 +00:00
efd6236d36
bpo-46072: Add top level stats struct (GH-30169)
2021-12-17 14:48:01 +00:00
86f42851c0
Better randomization of stats filenames. (GH-30145)
2021-12-16 15:56:01 +00:00
62a8a0c522
bpo-45829: Check `__getitem__`'s version for overflow before specializing (GH-30129)
...
* Check __getitem__'s version for overflow.
* Use SPEC_FAIL_OUT_OF_VERSIONS instead
2021-12-16 11:08:20 +00:00
342b93f9f2
bpo-46072: Add --with-pystats configure option to simplify gathering of VM stats (GH-30116)
...
* Simplify specialization stats collection macros.
* Add --enable-pystats option to configure.
* Update specialization summary script to handle larger number of kinds
2021-12-15 15:32:32 +00:00
3a60bfef49
bpo-44525: Specialize for calls to type and other builtin classes with 1 argument. (GH-29942)
2021-12-15 15:03:42 +00:00
9f8f45144b
bpo-44525: Split calls into PRECALL and CALL (GH-30011)
...
* Add 3 new opcodes for calls: PRECALL_METHOD, CALL_NO_KW, CALL_KW.
* Update specialization to handle new CALL opcodes.
* Specialize call to method descriptors.
* Remove old CALL opcodes: CALL_FUNCTION, CALL_METHOD, CALL_METHOD_KW, CALL_FUNCTION_KW.
2021-12-14 18:22:44 +00:00
5de39f4b41
bpo-45510: Check both types when specializing subtraction (GH-29995)
2021-12-09 10:17:16 +09:00
8319114fee
bpo-45947: Place dict and values pointer at fixed (negative) offset just before GC header. (GH-29879)
...
* Place __dict__ immediately before GC header for plain Python objects.
* Fix up lazy dict creation logic to use managed dict pointers.
* Manage values pointer, placing them directly before managed dict pointers.
* Convert hint-based load/store attr specialization target managed dict classes.
* Specialize LOAD_METHOD for managed dict objects.
* Remove unsafe _PyObject_GC_Calloc function.
* Remove unsafe _PyObject_GC_Malloc() function.
* Add comment explaning use of Py_TPFLAGS_MANAGED_DICT.
2021-12-07 16:02:53 +00:00
03768c4d13
bpo-45885: Specialize COMPARE_OP (GH-29734)
...
* Add COMPARE_OP_ADAPTIVE adaptive instruction.
* Add COMPARE_OP_FLOAT_JUMP, COMPARE_OP_INT_JUMP and COMPARE_OP_STR_JUMP specialized instructions.
* Introduce and use _PyUnicode_Equal
2021-12-03 11:29:12 +00:00
135cabd328
bpo-44525: Copy free variables in bytecode to allow calls to inner functions to be specialized (GH-29595)
...
* Make internal APIs that take PyFrameConstructor take a PyFunctionObject instead.
* Add reference to function to frame, borrow references to builtins and globals.
* Add COPY_FREE_VARS instruction to allow specialization of calls to inner functions.
2021-11-23 09:53:24 +00:00
036fead695
bpo-45609: Specialize STORE_SUBSCR (GH-29242)
...
* Specialize STORE_SUBSCR for list[int], and dict[object]
* Adds _PyDict_SetItem_Take2 which consumes references to the key and values.
2021-11-19 10:30:37 +00:00
21fa7a3e8f
bpo-45829: Specialize BINARY_SUBSCR for __getitem__ implemented in Python. (GH-29592)
2021-11-18 11:02:14 +00:00
345ba3f080
bpo-45510: Specialize BINARY_SUBTRACT (GH-29523)
2021-11-18 09:19:58 +00:00
ec382fac0d
bpo-45636: Remove the old %-formatting fast-path (GH-29532)
2021-11-15 08:58:23 -08:00
9178f533ff
bpo-45636: Merge all numeric operators (GH-29482)
2021-11-10 22:56:22 -08:00
bc85eb7a4f
bpo-45527: Don't count cache hits, just misses. (GH-29092)
2021-10-20 20:53:48 +02:00
8863a0fcc5
bpo-44525: Specialize simple Python calls. (GH-29033)
2021-10-20 16:08:28 +01:00
3163e68c34
bpo-44525: Specialize ``CALL_FUNCTION`` for C function calls (GH-26934)
2021-10-20 00:16:36 +01:00
fd03917786
bpo-45434: Include stdlib.h for specialize stat (GH-29015)
2021-10-18 17:31:18 +09:00
3b3d30e8f7
bpo-45367: Specialize BINARY_MULTIPLY (GH-28727)
2021-10-14 15:56:33 +01:00
Brandt Bucher
Irit Katriel
Matthias Görgens
Ken Jin
Mark Shannon
Dennis Sweeney
Christian Heimes
Ken Jin
Ken Jin
Victor Stinner
Kumar Aditya
Serhiy Storchaka
Eric Snow
Brandt Bucher
Dong-hee Na