Skip to content

regrtest: Don't list tests expected to be skipped #161430

New issue
New issue
Closed
Closed
regrtest: Don't list tests expected to be skipped#161430
Labels
testsTests in the Lib/test dirtype-refactorCode refactoring (with no changes in behavior)

Description

@vstinner
vstinner
opened on Nov 5, 2026

At the end of running the Python test suite, the report has a long list of skipped tests. It makes the output hard to read, especially on buildbot where only the last 40 lines are displayed by default.

I propose to omit listing tests which are expected to be skipped.

Example on Windows:

76 tests skipped:
    test.test_asyncio.test_windows_events
    test.test_asyncio.test_windows_utils
    test.test_free_threading.test_async_generators
    test.test_free_threading.test_bisect
    test.test_free_threading.test_bytes_object
    test.test_free_threading.test_bz2
    test.test_free_threading.test_capi
    test.test_free_threading.test_code
    test.test_free_threading.test_collections
    test.test_free_threading.test_context
    test.test_free_threading.test_cprofile
    test.test_free_threading.test_csv
    test.test_free_threading.test_datetime
    test.test_free_threading.test_dbm_gnu
    test.test_free_threading.test_dict
    test.test_free_threading.test_dict_watcher
    test.test_free_threading.test_enumerate
    test.test_free_threading.test_exceptions
    test.test_free_threading.test_frame
    test.test_free_threading.test_func_annotations
    test.test_free_threading.test_functions
    test.test_free_threading.test_functools
    test.test_free_threading.test_gc
    test.test_free_threading.test_gc_get_stats_race
    test.test_free_threading.test_generators
    test.test_free_threading.test_grp
    test.test_free_threading.test_heapq
    test.test_free_threading.test_interpreters
    test.test_free_threading.test_io
    test.test_free_threading.test_iteration
    test.test_free_threading.test_itertools
    test.test_free_threading.test_itertools_combinatoric
    test.test_free_threading.test_json
    test.test_free_threading.test_list
    test.test_free_threading.test_lzma
    test.test_free_threading.test_memoryview
    test.test_free_threading.test_methodcaller
    test.test_free_threading.test_mmap
    test.test_free_threading.test_monitoring
    test.test_free_threading.test_os
    test.test_free_threading.test_pickle
    test.test_free_threading.test_pwd
    test.test_free_threading.test_races
    test.test_free_threading.test_re
    test.test_free_threading.test_readline
    test.test_free_threading.test_resource
    test.test_free_threading.test_reversed
    test.test_free_threading.test_set
    test.test_free_threading.test_slots
    test.test_free_threading.test_sqlite3
    test.test_free_threading.test_str
    test.test_free_threading.test_string_template_race
    test.test_free_threading.test_suggestions
    test.test_free_threading.test_sys
    test.test_free_threading.test_syslog
    test.test_free_threading.test_threading
    test.test_free_threading.test_tokenize
    test.test_free_threading.test_type
    test.test_free_threading.test_types
    test.test_free_threading.test_uuid
    test.test_free_threading.test_weakref
    test.test_free_threading.test_zip
    test.test_free_threading.test_zlib test.test_os.test_windows
    test_android test_apple test_devpoll test_dtrace test_kqueue
    test_msvcrt test_startfile test_winapi test_winconsoleio
    test_winreg test_winsound test_wmi

Example on Linux:

76 tests skipped:
    test.test_asyncio.test_windows_events
    test.test_asyncio.test_windows_utils
    test.test_free_threading.test_async_generators
    test.test_free_threading.test_bisect
    test.test_free_threading.test_bytes_object
    test.test_free_threading.test_bz2
    test.test_free_threading.test_capi
    test.test_free_threading.test_code
    test.test_free_threading.test_collections
    test.test_free_threading.test_context
    test.test_free_threading.test_cprofile
    test.test_free_threading.test_csv
    test.test_free_threading.test_datetime
    test.test_free_threading.test_dbm_gnu
    test.test_free_threading.test_dict
    test.test_free_threading.test_dict_watcher
    test.test_free_threading.test_enumerate
    test.test_free_threading.test_exceptions
    test.test_free_threading.test_frame
    test.test_free_threading.test_func_annotations
    test.test_free_threading.test_functions
    test.test_free_threading.test_functools
    test.test_free_threading.test_gc
    test.test_free_threading.test_gc_get_stats_race
    test.test_free_threading.test_generators
    test.test_free_threading.test_grp
    test.test_free_threading.test_heapq
    test.test_free_threading.test_interpreters
    test.test_free_threading.test_io
    test.test_free_threading.test_iteration
    test.test_free_threading.test_itertools
    test.test_free_threading.test_itertools_combinatoric
    test.test_free_threading.test_json
    test.test_free_threading.test_list
    test.test_free_threading.test_lzma
    test.test_free_threading.test_memoryview
    test.test_free_threading.test_methodcaller
    test.test_free_threading.test_mmap
    test.test_free_threading.test_monitoring
    test.test_free_threading.test_os
    test.test_free_threading.test_pickle
    test.test_free_threading.test_pwd
    test.test_free_threading.test_races
    test.test_free_threading.test_re
    test.test_free_threading.test_readline
    test.test_free_threading.test_resource
    test.test_free_threading.test_reversed
    test.test_free_threading.test_set
    test.test_free_threading.test_slots
    test.test_free_threading.test_sqlite3
    test.test_free_threading.test_str
    test.test_free_threading.test_string_template_race
    test.test_free_threading.test_suggestions
    test.test_free_threading.test_sys
    test.test_free_threading.test_syslog
    test.test_free_threading.test_threading
    test.test_free_threading.test_tokenize
    test.test_free_threading.test_type
    test.test_free_threading.test_types
    test.test_free_threading.test_uuid
    test.test_free_threading.test_weakref
    test.test_free_threading.test_zip
    test.test_free_threading.test_zlib test.test_os.test_windows
    test_android test_apple test_devpoll test_dtrace test_kqueue
    test_msvcrt test_startfile test_winapi test_winconsoleio
    test_winreg test_winsound test_wmi

It's way worse (way longer list) on Emscripten an WASI.

Linked PRs

Activity

  1. vstinner
    added
    testsTests in the Lib/test dir
    type-refactorCode refactoring (with no changes in behavior)
    on Nov 5, 2026

  2. cmaloney commented on Nov 5, 2026

    @cmaloney
    cmaloney
    on Nov 5, 2026
    Contributor

    My main worry here is on bots where there is little skipped we don't have a way of detecting "on this platform more was skipped than we expected". I think the output is needed so I can hand-solve for that but could definitely be located elsewhere or hidden by default.

    For github actions we can use: https://docs.github.com/en/actions/reference/workflows-and-actions/workflow-commands#grouping-log-lines. I haven't found an equivalent feature in buildbot yet though :/.

  3. vstinner commented on Nov 7, 2026

    @vstinner
    vstinner
    on Nov 7, 2026
    MemberAuthor

    Status before. Sorry, these tests are quite long 😁

    Emscripten:

    209 tests skipped:
    test.test_asyncio.test_base_events
    test.test_asyncio.test_buffered_proto
    test.test_asyncio.test_context
    test.test_asyncio.test_eager_task_factory
    test.test_asyncio.test_events
    test.test_asyncio.test_free_threading
    test.test_asyncio.test_futures test.test_asyncio.test_futures2
    test.test_asyncio.test_graph test.test_asyncio.test_locks
    test.test_asyncio.test_pep492
    test.test_asyncio.test_proactor_events
    test.test_asyncio.test_protocols test.test_asyncio.test_queues
    test.test_asyncio.test_runners
    test.test_asyncio.test_selector_events
    test.test_asyncio.test_sendfile test.test_asyncio.test_server
    test.test_asyncio.test_server_context
    test.test_asyncio.test_sock_lowlevel test.test_asyncio.test_ssl
    test.test_asyncio.test_sslproto test.test_asyncio.test_staggered
    test.test_asyncio.test_streams test.test_asyncio.test_subprocess
    test.test_asyncio.test_taskgroups test.test_asyncio.test_tasks
    test.test_asyncio.test_threads test.test_asyncio.test_timeouts
    test.test_asyncio.test_tools test.test_asyncio.test_transports
    test.test_asyncio.test_unix_events test.test_asyncio.test_waitfor
    test.test_asyncio.test_windows_events
    test.test_asyncio.test_windows_utils
    test.test_concurrent_futures.test_as_completed
    test.test_concurrent_futures.test_deadlock
    test.test_concurrent_futures.test_future
    test.test_concurrent_futures.test_init
    test.test_concurrent_futures.test_interpreter_pool
    test.test_concurrent_futures.test_process_pool
    test.test_concurrent_futures.test_shutdown
    test.test_concurrent_futures.test_thread_pool
    test.test_concurrent_futures.test_wait
    test.test_free_threading.test_async_generators
    test.test_free_threading.test_bisect
    test.test_free_threading.test_bytes_object
    test.test_free_threading.test_bz2
    test.test_free_threading.test_capi
    test.test_free_threading.test_code
    test.test_free_threading.test_collections
    test.test_free_threading.test_context
    test.test_free_threading.test_cprofile
    test.test_free_threading.test_csv
    test.test_free_threading.test_datetime
    test.test_free_threading.test_dbm_gnu
    test.test_free_threading.test_dict
    test.test_free_threading.test_dict_watcher
    test.test_free_threading.test_enumerate
    test.test_free_threading.test_exceptions
    test.test_free_threading.test_frame
    test.test_free_threading.test_func_annotations
    test.test_free_threading.test_functions
    test.test_free_threading.test_functools
    test.test_free_threading.test_gc
    test.test_free_threading.test_gc_get_stats_race
    test.test_free_threading.test_generators
    test.test_free_threading.test_grp
    test.test_free_threading.test_heapq
    test.test_free_threading.test_interpreters
    test.test_free_threading.test_iteration
    test.test_free_threading.test_itertools
    test.test_free_threading.test_itertools_combinatoric
    test.test_free_threading.test_json
    test.test_free_threading.test_list
    test.test_free_threading.test_lzma
    test.test_free_threading.test_memoryview
    test.test_free_threading.test_methodcaller
    test.test_free_threading.test_mmap
    test.test_free_threading.test_monitoring
    test.test_free_threading.test_os
    test.test_free_threading.test_pickle
    test.test_free_threading.test_pwd
    test.test_free_threading.test_races
    test.test_free_threading.test_re
    test.test_free_threading.test_readline
    test.test_free_threading.test_resource
    test.test_free_threading.test_reversed
    test.test_free_threading.test_set
    test.test_free_threading.test_slots
    test.test_free_threading.test_sqlite3
    test.test_free_threading.test_str
    test.test_free_threading.test_string_template_race
    test.test_free_threading.test_suggestions
    test.test_free_threading.test_sys
    test.test_free_threading.test_syslog
    test.test_free_threading.test_threading
    test.test_free_threading.test_tokenize
    test.test_free_threading.test_type
    test.test_free_threading.test_types
    test.test_free_threading.test_uuid
    test.test_free_threading.test_weakref
    test.test_free_threading.test_zip
    test.test_free_threading.test_zlib test.test_gdb.test_backtrace
    test.test_gdb.test_cfunction test.test_gdb.test_cfunction_full
    test.test_gdb.test_jit test.test_gdb.test_misc
    test.test_gdb.test_pretty_print test.test_io.test_file_eintr
    test.test_io.test_free_threading test.test_io.test_winconsoleio
    test.test_multiprocessing_fork.test_manager
    test.test_multiprocessing_fork.test_misc
    test.test_multiprocessing_fork.test_processes
    test.test_multiprocessing_fork.test_threads
    test.test_multiprocessing_forkserver.test_manager
    test.test_multiprocessing_forkserver.test_misc
    test.test_multiprocessing_forkserver.test_preload
    test.test_multiprocessing_forkserver.test_processes
    test.test_multiprocessing_forkserver.test_threads
    test.test_multiprocessing_spawn.test_manager
    test.test_multiprocessing_spawn.test_misc
    test.test_multiprocessing_spawn.test_processes
    test.test_multiprocessing_spawn.test_threads
    test.test_os.test_windows test__interpchannels test__interpreters
    test_android test_apple test_argparse test_asyncgen
    test_c_stack_unwind test_cext test_clinic test_cmd_line
    test_crossinterp test_curses test_dbm_gnu test_dbm_ndbm
    test_devpoll test_docxmlrpc test_dtrace test_embed test_epoll
    test_faulthandler test_fork1 test_ftplib test_generated_cases
    test_getopt test_grp test_httplib test_httpservers test_idle
    test_imaplib test_kqueue test_lzma test_mmap test_msvcrt
    test_multiprocessing_main_handling test_openpty test_optparse
    test_perf_profiler test_perfmaps test_poll test_poplib test_pty
    test_pwd test_queue test_readline test_regrtest test_remote_pdb
    test_repl test_resource test_samply_profiler test_select
    test_selectors test_smtplib test_smtpnet test_socket test_ssl
    test_startfile test_subprocess test_syslog test_tcl test_thread
    test_threadedtempfile test_threading test_threading_local
    test_tkinter test_tools test_ttk test_ttk_textonly test_turtle
    test_urllib2 test_urllib2_localnet test_venv test_wait3 test_wait4
    test_webbrowser test_winapi test_winreg test_winsound test_wmi
    test_wsgiref test_xml_dom_xmlbuilder test_xmlrpc test_zstd

    WASI:

    232 tests skipped:
    test.test_asyncio.test_base_events
    test.test_asyncio.test_buffered_proto
    test.test_asyncio.test_context
    test.test_asyncio.test_eager_task_factory
    test.test_asyncio.test_events
    test.test_asyncio.test_free_threading
    test.test_asyncio.test_futures test.test_asyncio.test_futures2
    test.test_asyncio.test_graph test.test_asyncio.test_locks
    test.test_asyncio.test_pep492
    test.test_asyncio.test_proactor_events
    test.test_asyncio.test_protocols test.test_asyncio.test_queues
    test.test_asyncio.test_runners
    test.test_asyncio.test_selector_events
    test.test_asyncio.test_sendfile test.test_asyncio.test_server
    test.test_asyncio.test_server_context
    test.test_asyncio.test_sock_lowlevel test.test_asyncio.test_ssl
    test.test_asyncio.test_sslproto test.test_asyncio.test_staggered
    test.test_asyncio.test_streams test.test_asyncio.test_subprocess
    test.test_asyncio.test_taskgroups test.test_asyncio.test_tasks
    test.test_asyncio.test_threads test.test_asyncio.test_timeouts
    test.test_asyncio.test_tools test.test_asyncio.test_transports
    test.test_asyncio.test_unix_events test.test_asyncio.test_waitfor
    test.test_asyncio.test_windows_events
    test.test_asyncio.test_windows_utils
    test.test_concurrent_futures.test_as_completed
    test.test_concurrent_futures.test_deadlock
    test.test_concurrent_futures.test_future
    test.test_concurrent_futures.test_init
    test.test_concurrent_futures.test_interpreter_pool
    test.test_concurrent_futures.test_process_pool
    test.test_concurrent_futures.test_shutdown
    test.test_concurrent_futures.test_thread_pool
    test.test_concurrent_futures.test_wait
    test.test_free_threading.test_async_generators
    test.test_free_threading.test_bisect
    test.test_free_threading.test_bytes_object
    test.test_free_threading.test_bz2
    test.test_free_threading.test_capi
    test.test_free_threading.test_code
    test.test_free_threading.test_collections
    test.test_free_threading.test_context
    test.test_free_threading.test_cprofile
    test.test_free_threading.test_csv
    test.test_free_threading.test_datetime
    test.test_free_threading.test_dbm_gnu
    test.test_free_threading.test_dict
    test.test_free_threading.test_dict_watcher
    test.test_free_threading.test_enumerate
    test.test_free_threading.test_exceptions
    test.test_free_threading.test_frame
    test.test_free_threading.test_func_annotations
    test.test_free_threading.test_functions
    test.test_free_threading.test_functools
    test.test_free_threading.test_gc
    test.test_free_threading.test_gc_get_stats_race
    test.test_free_threading.test_generators
    test.test_free_threading.test_grp
    test.test_free_threading.test_heapq
    test.test_free_threading.test_interpreters
    test.test_free_threading.test_iteration
    test.test_free_threading.test_itertools
    test.test_free_threading.test_itertools_combinatoric
    test.test_free_threading.test_json
    test.test_free_threading.test_list
    test.test_free_threading.test_lzma
    test.test_free_threading.test_memoryview
    test.test_free_threading.test_methodcaller
    test.test_free_threading.test_mmap
    test.test_free_threading.test_monitoring
    test.test_free_threading.test_os
    test.test_free_threading.test_pickle
    test.test_free_threading.test_pwd
    test.test_free_threading.test_races
    test.test_free_threading.test_re
    test.test_free_threading.test_readline
    test.test_free_threading.test_resource
    test.test_free_threading.test_reversed
    test.test_free_threading.test_set
    test.test_free_threading.test_slots
    test.test_free_threading.test_sqlite3
    test.test_free_threading.test_str
    test.test_free_threading.test_string_template_race
    test.test_free_threading.test_suggestions
    test.test_free_threading.test_sys
    test.test_free_threading.test_syslog
    test.test_free_threading.test_threading
    test.test_free_threading.test_tokenize
    test.test_free_threading.test_type
    test.test_free_threading.test_types
    test.test_free_threading.test_uuid
    test.test_free_threading.test_weakref
    test.test_free_threading.test_zip
    test.test_free_threading.test_zlib test.test_gdb.test_backtrace
    test.test_gdb.test_cfunction test.test_gdb.test_cfunction_full
    test.test_gdb.test_jit test.test_gdb.test_misc
    test.test_gdb.test_pretty_print test.test_io.test_file_eintr
    test.test_io.test_free_threading test.test_io.test_winconsoleio
    test.test_multiprocessing_fork.test_manager
    test.test_multiprocessing_fork.test_misc
    test.test_multiprocessing_fork.test_processes
    test.test_multiprocessing_fork.test_threads
    test.test_multiprocessing_forkserver.test_manager
    test.test_multiprocessing_forkserver.test_misc
    test.test_multiprocessing_forkserver.test_preload
    test.test_multiprocessing_forkserver.test_processes
    test.test_multiprocessing_forkserver.test_threads
    test.test_multiprocessing_spawn.test_manager
    test.test_multiprocessing_spawn.test_misc
    test.test_multiprocessing_spawn.test_processes
    test.test_multiprocessing_spawn.test_threads
    test.test_os.test_windows test__interpchannels test__interpreters
    test_android test_apple test_argparse test_asyncgen test_bz2
    test_c_stack_unwind test_cext test_clinic test_cmd_line
    test_compileall test_crossinterp test_ctypes test_curses
    test_dbm_gnu test_dbm_ndbm test_dbm_sqlite3 test_devpoll
    test_docxmlrpc test_dtrace test_embed test_epoll
    test_external_inspection test_faulthandler test_fcntl test_fork1
    test_ftplib test_gc_stats test_generated_cases test_getopt
    test_grp test_gzip test_httplib test_httpservers test_idle
    test_imaplib test_import test_ioctl test_kqueue test_lzma
    test_mailbox test_mmap test_msvcrt
    test_multiprocessing_main_handling test_openpty test_optparse
    test_perf_profiler test_perfmaps test_pkgutil test_poll
    test_poplib test_pty test_pwd test_pyclbr test_pyrepl test_queue
    test_readline test_regrtest test_remote_pdb test_repl
    test_resource test_runpy test_samply_profiler test_select
    test_selectors test_smtplib test_smtpnet test_socket test_sqlite3
    test_ssl test_stable_abi_ctypes test_startfile test_subprocess
    test_syslog test_tcl test_termios test_thread
    test_threadedtempfile test_threading test_threading_local
    test_tkinter test_tools test_ttk test_ttk_textonly test_tty
    test_turtle test_urllib test_urllib2 test_urllib2_localnet
    test_urllib_response test_venv test_wait3 test_wait4
    test_webbrowser test_winapi test_winreg test_winsound test_wmi
    test_wsgiref test_xml_dom_xmlbuilder test_xmlrpc test_xxlimited
    test_zlib test_zstd

    iOS:

      133 tests skipped:
      test.test_asyncio.test_subprocess
      test.test_asyncio.test_windows_events
      test.test_asyncio.test_windows_utils
      test.test_free_threading.test_async_generators
      test.test_free_threading.test_bisect
      test.test_free_threading.test_bytes_object
      test.test_free_threading.test_bz2
      test.test_free_threading.test_capi
      test.test_free_threading.test_code
      test.test_free_threading.test_collections
      test.test_free_threading.test_context
      test.test_free_threading.test_cprofile
      test.test_free_threading.test_csv
      test.test_free_threading.test_datetime
      test.test_free_threading.test_dbm_gnu
      test.test_free_threading.test_dict
      test.test_free_threading.test_dict_watcher
      test.test_free_threading.test_enumerate
      test.test_free_threading.test_exceptions
      test.test_free_threading.test_frame
      test.test_free_threading.test_func_annotations
      test.test_free_threading.test_functions
      test.test_free_threading.test_functools
      test.test_free_threading.test_gc
      test.test_free_threading.test_gc_get_stats_race
      test.test_free_threading.test_generators
      test.test_free_threading.test_grp
      test.test_free_threading.test_heapq
      test.test_free_threading.test_interpreters
      test.test_free_threading.test_iteration
      test.test_free_threading.test_itertools
      test.test_free_threading.test_itertools_combinatoric
      test.test_free_threading.test_json
      test.test_free_threading.test_list
      test.test_free_threading.test_lzma
      test.test_free_threading.test_memoryview
      test.test_free_threading.test_methodcaller
      test.test_free_threading.test_mmap
      test.test_free_threading.test_monitoring
      test.test_free_threading.test_os
      test.test_free_threading.test_pickle
      test.test_free_threading.test_pwd
      test.test_free_threading.test_races
      test.test_free_threading.test_re
      test.test_free_threading.test_readline
      test.test_free_threading.test_resource
      test.test_free_threading.test_reversed
      test.test_free_threading.test_set
      test.test_free_threading.test_slots
      test.test_free_threading.test_sqlite3
      test.test_free_threading.test_str
      test.test_free_threading.test_string_template_race
      test.test_free_threading.test_suggestions
      test.test_free_threading.test_sys
      test.test_free_threading.test_syslog
      test.test_free_threading.test_threading
      test.test_free_threading.test_tokenize
      test.test_free_threading.test_type
      test.test_free_threading.test_types
      test.test_free_threading.test_uuid
      test.test_free_threading.test_weakref
      test.test_free_threading.test_zip
      test.test_free_threading.test_zlib test.test_gdb.test_backtrace
      test.test_gdb.test_cfunction test.test_gdb.test_cfunction_full
      test.test_gdb.test_jit test.test_gdb.test_misc
      test.test_gdb.test_pretty_print test.test_io.test_file_eintr
      test.test_io.test_free_threading test.test_io.test_winconsoleio
      test.test_multiprocessing_fork.test_manager
      test.test_multiprocessing_fork.test_misc
      test.test_multiprocessing_fork.test_processes
      test.test_multiprocessing_fork.test_threads
      test.test_multiprocessing_forkserver.test_manager
      test.test_multiprocessing_forkserver.test_misc
      test.test_multiprocessing_forkserver.test_preload
      test.test_multiprocessing_forkserver.test_processes
      test.test_multiprocessing_forkserver.test_threads
      test.test_multiprocessing_spawn.test_manager
      test.test_multiprocessing_spawn.test_misc
      test.test_multiprocessing_spawn.test_processes
      test.test_multiprocessing_spawn.test_threads
      test.test_os.test_windows test_android test_argparse
      test_asdl_parser test_c_stack_unwind test_cext test_clinic
      test_cmd_line test_curses test_dbm_gnu test_devpoll test_dtrace
      test_embed test_epoll test_faulthandler test_fork1
      test_generated_cases test_getopt test_grp test_idle test_msvcrt
      test_multiprocessing_main_handling test_optparse
      test_perf_profiler test_perfmaps test_pty test_pwd test_readline
      test_regrtest test_remote_pdb test_repl test_samply_profiler
      test_startfile test_subprocess test_syslog test_tcl test_tkinter
      test_tools test_ttk test_ttk_textonly test_turtle test_venv
      test_wait3 test_wait4 test_winapi test_winreg test_winsound
      test_wmi

    macOS:

    85 tests skipped:
    test.test_asyncio.test_windows_events
    test.test_asyncio.test_windows_utils
    test.test_free_threading.test_async_generators
    test.test_free_threading.test_bisect
    test.test_free_threading.test_bytes_object
    test.test_free_threading.test_bz2
    test.test_free_threading.test_capi
    test.test_free_threading.test_code
    test.test_free_threading.test_collections
    test.test_free_threading.test_context
    test.test_free_threading.test_cprofile
    test.test_free_threading.test_csv
    test.test_free_threading.test_datetime
    test.test_free_threading.test_dbm_gnu
    test.test_free_threading.test_dict
    test.test_free_threading.test_dict_watcher
    test.test_free_threading.test_enumerate
    test.test_free_threading.test_exceptions
    test.test_free_threading.test_frame
    test.test_free_threading.test_func_annotations
    test.test_free_threading.test_functions
    test.test_free_threading.test_functools
    test.test_free_threading.test_gc
    test.test_free_threading.test_gc_get_stats_race
    test.test_free_threading.test_generators
    test.test_free_threading.test_grp
    test.test_free_threading.test_heapq
    test.test_free_threading.test_interpreters
    test.test_free_threading.test_iteration
    test.test_free_threading.test_itertools
    test.test_free_threading.test_itertools_combinatoric
    test.test_free_threading.test_json
    test.test_free_threading.test_list
    test.test_free_threading.test_lzma
    test.test_free_threading.test_memoryview
    test.test_free_threading.test_methodcaller
    test.test_free_threading.test_mmap
    test.test_free_threading.test_monitoring
    test.test_free_threading.test_os
    test.test_free_threading.test_pickle
    test.test_free_threading.test_pwd
    test.test_free_threading.test_races
    test.test_free_threading.test_re
    test.test_free_threading.test_readline
    test.test_free_threading.test_resource
    test.test_free_threading.test_reversed
    test.test_free_threading.test_set
    test.test_free_threading.test_slots
    test.test_free_threading.test_sqlite3
    test.test_free_threading.test_str
    test.test_free_threading.test_string_template_race
    test.test_free_threading.test_suggestions
    test.test_free_threading.test_sys
    test.test_free_threading.test_syslog
    test.test_free_threading.test_threading
    test.test_free_threading.test_tokenize
    test.test_free_threading.test_type
    test.test_free_threading.test_types
    test.test_free_threading.test_uuid
    test.test_free_threading.test_weakref
    test.test_free_threading.test_zip
    test.test_free_threading.test_zlib test.test_gdb.test_backtrace
    test.test_gdb.test_cfunction test.test_gdb.test_cfunction_full
    test.test_gdb.test_jit test.test_gdb.test_misc
    test.test_gdb.test_pretty_print test.test_io.test_free_threading
    test.test_io.test_winconsoleio
    test.test_multiprocessing_fork.test_manager
    test.test_multiprocessing_fork.test_misc
    test.test_multiprocessing_fork.test_processes
    test.test_multiprocessing_fork.test_threads
    test.test_os.test_windows test_android test_devpoll test_dtrace
    test_epoll test_msvcrt test_startfile test_winapi test_winreg
    test_winsound test_wmi

    ASan:

    102 tests skipped:
    test.test_asyncio.test_subprocess
    test.test_asyncio.test_windows_events
    test.test_asyncio.test_windows_utils
    test.test_concurrent_futures.test_as_completed
    test.test_concurrent_futures.test_deadlock
    test.test_concurrent_futures.test_future
    test.test_concurrent_futures.test_init
    test.test_concurrent_futures.test_interpreter_pool
    test.test_concurrent_futures.test_process_pool
    test.test_concurrent_futures.test_shutdown
    test.test_concurrent_futures.test_thread_pool
    test.test_concurrent_futures.test_wait
    test.test_free_threading.test_async_generators
    test.test_free_threading.test_bisect
    test.test_free_threading.test_bytes_object
    test.test_free_threading.test_bz2
    test.test_free_threading.test_capi
    test.test_free_threading.test_code
    test.test_free_threading.test_collections
    test.test_free_threading.test_context
    test.test_free_threading.test_cprofile
    test.test_free_threading.test_csv
    test.test_free_threading.test_datetime
    test.test_free_threading.test_dbm_gnu
    test.test_free_threading.test_dict
    test.test_free_threading.test_dict_watcher
    test.test_free_threading.test_enumerate
    test.test_free_threading.test_exceptions
    test.test_free_threading.test_frame
    test.test_free_threading.test_func_annotations
    test.test_free_threading.test_functions
    test.test_free_threading.test_functools
    test.test_free_threading.test_gc
    test.test_free_threading.test_gc_get_stats_race
    test.test_free_threading.test_generators
    test.test_free_threading.test_grp
    test.test_free_threading.test_heapq
    test.test_free_threading.test_interpreters
    test.test_free_threading.test_iteration
    test.test_free_threading.test_itertools
    test.test_free_threading.test_itertools_combinatoric
    test.test_free_threading.test_json
    test.test_free_threading.test_list
    test.test_free_threading.test_lzma
    test.test_free_threading.test_memoryview
    test.test_free_threading.test_methodcaller
    test.test_free_threading.test_mmap
    test.test_free_threading.test_monitoring
    test.test_free_threading.test_os
    test.test_free_threading.test_pickle
    test.test_free_threading.test_pwd
    test.test_free_threading.test_races
    test.test_free_threading.test_re
    test.test_free_threading.test_readline
    test.test_free_threading.test_resource
    test.test_free_threading.test_reversed
    test.test_free_threading.test_set
    test.test_free_threading.test_slots
    test.test_free_threading.test_sqlite3
    test.test_free_threading.test_str
    test.test_free_threading.test_string_template_race
    test.test_free_threading.test_suggestions
    test.test_free_threading.test_sys
    test.test_free_threading.test_syslog
    test.test_free_threading.test_threading
    test.test_free_threading.test_tokenize
    test.test_free_threading.test_type
    test.test_free_threading.test_types
    test.test_free_threading.test_uuid
    test.test_free_threading.test_weakref
    test.test_free_threading.test_zip
    test.test_free_threading.test_zlib
    test.test_io.test_free_threading test.test_io.test_winconsoleio
    test.test_multiprocessing_fork.test_manager
    test.test_multiprocessing_fork.test_misc
    test.test_multiprocessing_fork.test_processes
    test.test_multiprocessing_fork.test_threads
    test.test_multiprocessing_forkserver.test_manager
    test.test_multiprocessing_forkserver.test_misc
    test.test_multiprocessing_forkserver.test_processes
    test.test_multiprocessing_forkserver.test_threads
    test.test_multiprocessing_spawn.test_manager
    test.test_multiprocessing_spawn.test_misc
    test.test_multiprocessing_spawn.test_processes
    test.test_multiprocessing_spawn.test_threads
    test.test_os.test_windows test_android test_apple test_devpoll
    test_dtrace test_idle test_kqueue test_msvcrt test_perf_profiler
    test_samply_profiler test_startfile test_tkinter test_ttk
    test_winapi test_winreg test_wmi

  4. vstinner commented on Nov 7, 2026

    @vstinner
    vstinner
    on Nov 7, 2026
    MemberAuthor

    My main worry here is on bots where there is little skipped we don't have a way of detecting "on this platform more was skipped than we expected".

    That's exactly the purpose of my change! Hide tests which are expected to be skipped on a platform, but list tests which are not expected to be skipped on this platform.

    I think the output is needed so I can hand-solve for that but could definitely be located elsewhere or hidden by default.

    Anyway, the list of skipped tests is always in the output. For example on Linux, you can still see test_msvcrt skipped -- windows related tests in the logs. My change only impacts the final report at the end of the output. So you can still check manually the full output to see if some tests are skipped whereas they should not be skipped.

  5. vstinner
    added 2 commits that reference this issue on Nov 7, 2026

    gh-161430: Omit tests expected to be skipped in regrtest (#161432)

    3de6d3a

    gh-161430: Cleanup tests name in regrtest TestResults.display_result() (

    d7684fb

  6. vstinner commented on Nov 7, 2026

    @vstinner
    vstinner
    on Nov 7, 2026
    MemberAuthor

    Status after (the two commits).

    Oh, test_io.test_free_threading and test_io.test_winconsoleio were just added in the meanwhile, I will make a follow-up change to take them in account.

    Ubuntu / build and test (ubuntu-26.04):

    74 tests expected to be skipped (not listed)

2 tests skipped:
    test_io.test_free_threading test_io.test_winconsoleio

    Windows / Build and test (x64, switch-case):

    103 tests expected to be skipped (not listed)

4 tests skipped:
    test_curses test_io.test_free_threading test_xxlimited
    test_xxtestfuzz

    macOS / build and test (macos-26):

    83 tests expected to be skipped (not listed)

2 tests skipped:
    test_io.test_free_threading test_io.test_winconsoleio

    Android (x86_64):

      108 tests expected to be skipped (not listed)
   
  23 tests skipped:
      test_curses test_dbm_gnu test_dbm_ndbm test_grp test_idle
      test_io.test_file_eintr test_io.test_free_threading
      test_io.test_winconsoleio test_multiprocessing_fork.test_manager
      test_multiprocessing_fork.test_misc
      test_multiprocessing_fork.test_processes
      test_multiprocessing_fork.test_threads
      test_multiprocessing_main_handling
      test_multiprocessing_spawn.test_manager
      test_multiprocessing_spawn.test_misc
      test_multiprocessing_spawn.test_processes
      test_multiprocessing_spawn.test_threads test_readline test_tcl
      test_tkinter test_ttk test_ttk_textonly test_turtle

    iOS:

      130 tests expected to be skipped (not listed)
  
  3 tests skipped:
      test_io.test_file_eintr test_io.test_free_threading
      test_io.test_winconsoleio

    Emscripten:

    196 tests expected to be skipped (not listed)

13 tests skipped:
    test_idle test_io.test_file_eintr test_io.test_free_threading
    test_io.test_winconsoleio test_lzma test_smtpnet test_ssl test_tcl
    test_tkinter test_ttk test_ttk_textonly test_turtle test_zstd

    WASI:

    211 tests expected to be skipped (not listed)

21 tests skipped:
    test_bz2 test_ctypes test_dbm_sqlite3 test_gzip test_idle
    test_io.test_file_eintr test_io.test_free_threading
    test_io.test_winconsoleio test_lzma test_readline test_smtpnet
    test_sqlite3 test_ssl test_stable_abi_ctypes test_tcl test_tkinter
    test_ttk test_ttk_textonly test_turtle test_zlib test_zstd

    ASan:

    73 tests expected to be skipped (not listed)

29 tests skipped:
    test_asyncio.test_subprocess
    test_concurrent_futures.test_as_completed
    test_concurrent_futures.test_deadlock
    test_concurrent_futures.test_future
    test_concurrent_futures.test_init
    test_concurrent_futures.test_interpreter_pool
    test_concurrent_futures.test_process_pool
    test_concurrent_futures.test_shutdown
    test_concurrent_futures.test_thread_pool
    test_concurrent_futures.test_wait test_idle
    test_io.test_free_threading test_io.test_winconsoleio
    test_multiprocessing_fork.test_manager
    test_multiprocessing_fork.test_misc
    test_multiprocessing_fork.test_processes
    test_multiprocessing_fork.test_threads
    test_multiprocessing_forkserver.test_manager
    test_multiprocessing_forkserver.test_misc
    test_multiprocessing_forkserver.test_processes
    test_multiprocessing_forkserver.test_threads
    test_multiprocessing_spawn.test_manager
    test_multiprocessing_spawn.test_misc
    test_multiprocessing_spawn.test_processes
    test_multiprocessing_spawn.test_threads test_perf_profiler
    test_samply_profiler test_tkinter test_ttk

  7. cmaloney commented on Nov 7, 2026

    @cmaloney
    cmaloney
    on Nov 7, 2026
    Contributor

    Nice! Definitely a lot better to me. A little extra maintenance but helps us avoid losing features on platforms unintentionally.

  8. vstinner
    added 2 commits that reference this issue on Nov 7, 2026

    gh-161430: Update skipped tests filter in regrtest (#161572)

    989ece6

    pythongh-161430: Update skipped tests filter in regrtest (python#161572)

    e2b366d
  9. vstinner
    closed this as completedon Nov 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    testsTests in the Lib/test dirtype-refactorCode refactoring (with no changes in behavior)

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions