Repository navigation
Build and test conda packages and wheels - #294
Open
jharlow-intel wants to merge 1 commit into
Open
jharlow-intel wants to merge 1 commit into
jharlow-intel wants to merge 1 commit into
Conversation
jharlow-intel
marked this pull request as ready for review
October 23, 2026 20:42
jharlow-intel
requested review from
antonwolfy,
ndgrigorian,
vlad-perevezentsev and
xaleryb
as code owners
October 23, 2026 20:42
jharlow-intel
force-pushed
the
ci/intel-python-ci
branch
12 times, most recently
from
November 3, 2026 18:00
02315bd to
f53b1ce
Compare
jharlow-intel
changed the title
jharlow-intel
force-pushed
the
ci/intel-python-ci
branch
3 times, most recently
from
November 9, 2026 17:59
fdbb15f to
d7e1dc3
Compare
Adds a ci/ directory and .github/workflows/intel-ci.yml. The workflow builds conda-recipe/ with conda-build and the wheels with cibuildwheel, for every platform and Python version the recipe and pyproject.toml declare, and tests each package in a clean environment with ci/test.py. conda-recipe/ is now the only recipe, the conda-forge one that was conda-recipe-cf/; the Intel-channel recipe, conda-package.yml, which copied wheels out through WHEELS_OUTPUT_FOLDER, and conda-package-cf.yml are removed, as intel-ci.yml builds and tests the same recipe, running the test jobs for each package that built even when another build failed. conda_build_config.yaml now lists the Python versions. The wheels link MKL's layers, the Intel OpenMP runtime and icx's runtime. [build-system] requires mkl-devel, and [tool.gh-ci] pin-compatible maps mkl to it: ci/build.py adds Requires-Dist mkl >= the mkl-devel version python -m build installed, < its next major, the way conda's run_exports pin it, and fails a build that logs no version. intel-openmp and intel-cmplr-lib-rt come from [tool.gh-ci] wheel-requires: in [project] they would fail the recipe's pip check, as conda-forge's packages have no pip metadata. ci/build.py takes METADATA's line ending from the headers. The repair commands leave MKL's and the compiler runtime's libraries out, and the Linux wheels are tagged manylinux_2_28 only, like the mkl wheel. icx already links the Linux libraries with full RELRO and a stack protector, so the wheels need no extra flags. ci/build.py refuses a wheel whose ELF files lack full RELRO. It keeps an RPATH or RUNPATH entry only when it is $ORIGIN or a directory under it, as meson-python keeps the isolated build env's absolute lib directory, and refuses a file left with none. It rewrites the wheels in scratch, so a refused wheel never reaches --output, and refuses two built packages with the same file name, which would overwrite each other there. conda-build gets --extra-meta remote_url=... sha=... when GitHub Actions sets GITHUB_SERVER_URL, GITHUB_REPOSITORY and GITHUB_SHA, so each conda package records the commit it was built from in info/about.json. ci/hooks.py tests each wheel in a venv made from conda-forge's Python, as pip users install it. Every python: entry in conda_build_config.yaml names its ABI, which ci/matrix.py requires. ci/matrix.py reads x86 as any x86 CPU and osx64 as undefined, as conda-build does, and refuses a conda-build skip that uses osx64. A pull request also builds and tests the newest free-threaded version, and every push and tag run gets a concurrency group of its own.
jharlow-intel
force-pushed
the
ci/intel-python-ci
branch
from
November 9, 2026 21:50
d7e1dc3 to
96e092f
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds
ci/and.github/workflows/intel-ci.yml, which build the conda packages and the wheels for Linux and Windows, on every declared Python, and test each in a clean environment. The recipe skips macOS, asconda-forge/mkl_umath-feedstockdoes.conda-recipe/is now the only recipe: the conda-forge one that wasconda-recipe-cf/.conda-package.ymlandconda-package-cf.ymlare removed, asintel-ci.ymlbuilds and tests the recipe.python:list inconda_build_config.yaml. The wheels follow thepyproject.tomlclassifiers: 3.10 to 3.15 plus 3.14t and 3.15t.dpcpp_win-64, whichci/install_icx.pyinstalls. They leave MKL and the compiler runtime out.ci/build.pyadds their requirements to each wheel:mklfrom the mkl-devel version they were built with up to its next major, through[tool.gh-ci] pin-compatible, andintel-openmpandintel-cmplr-lib-rt>=2026.2,<2027, throughwheel-requires. icx links the Linux libraries with full RELRO, whichci/build.pychecks, along with a library search path inside$ORIGIN.meson.buildaddsLibraryto CMake's search path on Windows, where mkl-devel puts its CMake config.ci/test.pyrunspytest --pyargs mkl_umathon the installed package.mainand tags build them all.info/about.json.ci/benchmark.pyruns the asv suite inbenchmarks/against the installed package: one quick sample of each benchmark on a pull request, a full measurement on a tag.Miniforge is pinned to 26.7.2-0, as 26.9.4-0 makes
setup-miniconda'sconda initfail on Windows runners.Validation: run 42669879582 on
d7e1dc3builds and tests the reduced pull request matrix on Linux and Windows. Not run yet: the full matrix, which onlymainand tags build.