python dev #20318
Merged
python dev #20318
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
At this point most things should use the py/pip-build-install pipeline and generally look like py3-pyyaml Also: * rename cython.yaml, numpy.yaml to py3-<name> These are python packages and present in pypi, for consistency, name them like other python packages. Co-authored-by: Dimitri John Ledkov <dimitri.ledkov@chainguard.dev>
flit-core has bootstrap_install.py to handle this, so we use it. pip doesn't stricktly depend on wheel, although buidling many projects assumes that it is there.
hahhah just kidding This reverts commit 3a96413.
Requires chainguard-dev/melange#1166 Drop pybins, instead build all packages with commands in /usr/bin. Set replaces, replaces-priority to ensure they are apk installable. Also set provider-priority such that `apk add py3-pip` transparently installs py3.12-pip alone. This is all great, however not at all supported by apko. But imho should be supported. As one simply has to sort packages in replaces priority order prior to streaming. And allow overriding files between packages that have replaces declared. ```console ... (13/25) Installing python-3.10-base (3.10.14-r1) (14/25) Installing py3.10-flit-core (3.9.0-r2) (15/25) Installing py3.10-setuptools (69.5.1-r1) (16/25) Installing py3.10-pip (24.0-r2) (17/25) Installing python-3.11-base (3.11.9-r1) (18/25) Installing py3.11-flit-core (3.9.0-r2) (19/25) Installing py3.11-setuptools (69.5.1-r1) (20/25) Installing py3.11-pip (24.0-r2) (21/25) Installing python-3.12-base (3.12.3-r1) (22/25) Installing py3.12-flit-core (3.9.0-r2) (23/25) Installing py3.12-setuptools (69.5.1-r1) (24/25) Installing py3.12-pip (24.0-r2) (25/25) Installing py3-supported-pip (24.0-r2) OK: 197 MiB in 40 packages -rwxrwxr-x 1 root root 946 Apr 26 22:22 /usr/bin/pip3.12 -rwxrwxr-x 1 root root 946 Apr 26 22:22 /usr/bin/pip3.11 -rwxrwxr-x 1 root root 946 Apr 26 22:22 /usr/bin/pip3.10 -rwxrwxr-x 1 root root 940 Apr 26 22:22 /usr/bin/pip3 -rwxrwxr-x 1 root root 938 Apr 26 22:22 /usr/bin/pip ```
At this point most things should use the py/pip-build-install pipeline and generally look like py3-pyyaml Also: * rename cython.yaml, numpy.yaml to py3-<name> These are python packages and present in pypi, for consistency, name them like other python packages. Co-authored-by: Dimitri John Ledkov <dimitri.ledkov@chainguard.dev>
flit-core has bootstrap_install.py to handle this, so we use it. pip doesn't stricktly depend on wheel, although buidling many projects assumes that it is there.
You can get started with:
make package/pip-zipapp \
package/py3-{supported-python,setuptools,installer,wheel,pip}
Then most of core deps are built.
Signed-off-by: Dimitri John Ledkov <dimitri.ledkov@chainguard.dev>
Signed-off-by: Dimitri John Ledkov <dimitri.ledkov@chainguard.dev>
Signed-off-by: Dimitri John Ledkov <dimitri.ledkov@chainguard.dev>
Signed-off-by: Dimitri John Ledkov <dimitri.ledkov@chainguard.dev>
Signed-off-by: Dimitri John Ledkov <dimitri.ledkov@chainguard.dev>
Signed-off-by: Dimitri John Ledkov <dimitri.ledkov@chainguard.dev>
Signed-off-by: Dimitri John Ledkov <dimitri.ledkov@chainguard.dev>
Signed-off-by: Pris Nasrat <pris.nasrat@chainguard.dev>
Signed-off-by: Pris Nasrat <pris.nasrat@chainguard.dev>
Signed-off-by: Pris Nasrat <pris.nasrat@chainguard.dev>
|
Was going to test the cython deps moving to py3-cython however getting depsolving issues. @xnox am I missing something I need locally (melange seems current) to fix this |
|
Ah looks like I was pulling in a transient dep to the old world running this first fixes:
|
pnasrat
reviewed
Jun 17, 2024
Signed-off-by: Pris Nasrat <pris.nasrat@chainguard.dev>
Signed-off-by: Pris Nasrat <pris.nasrat@chainguard.dev>
This reverts commit 634fa93. Various packages still depend on `cython~0` Signed-off-by: Pris Nasrat <pris.nasrat@chainguard.dev>
|
clean before build to ensure versioned cpython libs created for all py versions Signed-off-by: Pris Nasrat <pris.nasrat@chainguard.dev>
build-base pulls in wolfi-baselayout and transitively ca-certificates-bundle Signed-off-by: Pris Nasrat <pris.nasrat@chainguard.dev>
2 tasks
|
Depends on split out |
Signed-off-by: Pris Nasrat <pris.nasrat@chainguard.dev>
Need to use explicit py version in import test See chainguard-dev/melange#1299 Signed-off-by: Pris Nasrat <pris.nasrat@chainguard.dev>
Signed-off-by: Pris Nasrat <pris.nasrat@chainguard.dev>
|
Scan package for CVES is reporting CVE-2018-20225 which has been previously nak'd |
|
New package name: https://github.com/wolfi-dev/advisories/blob/main/py3.12-pip.advisories.yaml Have draft PR for that here wolfi-dev/advisories#5849 |
This was referenced Jun 17, 2024
vaikas
approved these changes
Jun 18, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Make several core python packages build for mulitple python versions.
At this point most things should use the py/pip-build-install pipeline
and generally look like py3-pyyaml
Also:
rename cython.yaml, numpy.yaml to py3-
These are python packages and present in pypi, for
consistency, name them like other python packages.
Co-authored-by: Dimitri John Ledkov dimitri.ledkov@chainguard.dev
Resolve the dependency loop.
flit-core has bootstrap_install.py to handle this, so we use it.
pip doesn't stricktly depend on wheel, although buidling many projects
assumes that it is there.
Fun stuff
Signed-off-by: Dimitri John Ledkov dimitri.ledkov@chainguard.dev
Revert "Fun stuff"
hahhah just kidding
This reverts commit 3a96413.
Drop pybins and allow to install them all
Requires Replaces priority chainguard-dev/melange#1166
Drop pybins, instead build all packages with commands in /usr/bin.
Set replaces, replaces-priority to ensure they are apk installable.
Also set provider-priority such that
apk add py3-piptransparentlyinstalls py3.12-pip alone.
This is all great, however not at all supported by apko. But imho
should be supported. As one simply has to sort packages in replaces
priority order prior to streaming. And allow overriding files between
packages that have replaces declared.
wip
Make several core python packages build for mulitple python versions.
At this point most things should use the py/pip-build-install pipeline
and generally look like py3-pyyaml
Also:
rename cython.yaml, numpy.yaml to py3-
These are python packages and present in pypi, for
consistency, name them like other python packages.
Co-authored-by: Dimitri John Ledkov dimitri.ledkov@chainguard.dev
Resolve the dependency loop.
flit-core has bootstrap_install.py to handle this, so we use it.
pip doesn't stricktly depend on wheel, although buidling many projects
assumes that it is there.
Some cleanups of things. pip-build-install-bootstrap simplifies.
You can get started with:
make package/pip-zipapp
package/py3-{supported-python,setuptools,installer,wheel,pip}
Then most of core deps are built.
Upgrade setuptools
Signed-off-by: Dimitri John Ledkov dimitri.ledkov@chainguard.dev
Test setuptools
Signed-off-by: Dimitri John Ledkov dimitri.ledkov@chainguard.dev
fixes
tomli
Signed-off-by: Dimitri John Ledkov dimitri.ledkov@chainguard.dev
foo
Add pip-zipapp.yaml file.
Remove no longer needed cython-0
Signed-off-by: Dimitri John Ledkov dimitri.ledkov@chainguard.dev
Split wheel binary into -bin subpackage
Signed-off-by: Dimitri John Ledkov dimitri.ledkov@chainguard.dev
Make py3-pip coinstallable
Signed-off-by: Dimitri John Ledkov dimitri.ledkov@chainguard.dev
py3-supported-cython is not coinstallable, and not needed
Signed-off-by: Dimitri John Ledkov dimitri.ledkov@chainguard.dev
Fix py3-tomli priorities
Signed-off-by: Dimitri John Ledkov dimitri.ledkov@chainguard.dev
py3-six fix up environment
Fix up py3-numpy