Clarifications needed re packaging flow from the perspective of a build backend
Maintainer antworten meist innerhalb von 2 Tagen
Dieses Issue hat noch niemand übernommen.
Bewertung
- Schwierigkeit
- 5/5
- Geschätzter Aufwand
- Über eine Woche
- Anfängerfreundlichkeit
- 25/100
- Issue-Typ
- Dokumentation
- Klarheit
- Muss geklärt werden
- Aktivitätsstatus
- Veraltet
- Tech-Stack
- python
- Bereich
- documentation
Rechercherichtung
Beginne mit der Überprüfung der Verweise des Issues auf pyproject.toml, PKG-INFO, wheel METADATA und PEP 725. Vergleiche die genannten Fragen zu sdist und wheel mit den relevanten Packaging-Spezifikationen. Ermittle anschließend, welche Dokumentations- oder Spezifikationstexte einer Klarstellung bedürfen, und fasse die offenen Punkte für Maintainer zusammen.
Vom Indexierungsmodell aus dem Issue-Text verfasst.
Beschreibung
Issue Description
I'm writing a build backend which aims to deliver these key features relevant to the discussion (among others):
- Sdists will only contain static metadata;
- The code for sdist-building and wheel-building is separable, such that, when an sdist is downloaded and installed automatically (e.g. by Pip), only the wheel-building code is needed as a build dependency;
- There is no legacy support - sdists contain a
PKG-INFOspecifying a core metadata version of 2.2 or higher (most likely 2.4) and apyproject.toml.
There are several confusing points I've encountered in the description of pyproject.toml and of the core metadata format, and how they are used in source trees (pyproject.toml only), sdists (both) and wheels (core metadata only). My goal here is to verify that I can accomplish my goals while remaining standards compliant.
The main conceptual problem I'm having is that pyproject.toml and core metadata are described as canonical metadata formats, yet a non-legacy sdist is expected to contain both. I have many questions as a result.
First, regarding sdist creation: my understanding is that in this process, the build backend:
- MUST faithfully represent static metadata (if any) from the source tree's
pyproject.tomlin thePKG-INFO; - MAY compute values for dynamic metadata and include these in the
PKG-INFOas well.
The question is, what happens to the version of pyproject.toml that ends up in the sdist?
It seems to me that it cannot in general be an exact copy of the source tree's pyproject.toml, because if I compute dynamic metadata then there is a conflict - the field is marked dynamic in pyproject.toml but provided statically in PKG-INFO.
Am I at liberty to create an entirely new pyproject.toml, as long as it follows the spec? For example, can I remove the [project] table (since in general this table isn't required to be present, and I've already fully "compiled" its information into PKG-INFO)? Can I change the [build-system] table, such that a different build backend will be used to create the wheel? (One implementation idea I had was to incorporate an in-tree, wheel-specific backend into the sdist.) Should [project] at least be edited to reflect the dynamic metadata values that were calculated (e.g. add the computed values as static keys, and remove the corresponding names from project.dynamic)?
Then, regarding wheel building. Regarding core metadata, it says that "Fields defined in the following specification should be considered valid, complete and not subject to change."
Does that imply that the wheel's METADATA MUST be a copy of the sdist's PKG-INFO?
Doesn't that prevent computing metadata values at wheel creation time? (Not applicable to me, but still worth raising the question.)
Doesn't that in turn imply that non-legacy sdists need to have all the dynamic metadata values computed, and they can't be deferred to wheel-building? (I think this is intentional, so that e.g. installers can figure out basic information about the package without building it. But as of 24.3.1, Pip still does the build first anyway, even when PKG-INFO declares the latest metadata version.)
Doesn't that cause a problem for PEP 725 – Specifying external dependencies in pyproject.toml, since they propose to give semantics to Requires-External metadata whereby the wheel's version could differ? (In particular: the wheel-building process could use a tool like cibuildwheel to vendor a compiled shared C library whose source is not included in the sdist; by my reading of the PEP, the intent is that PKG-INFO would describe the library as an external requirement, but METADATA would not.)
Also: when building the wheel, is it required to look at pyproject.toml at all, or to validate it? My understanding is that the only mandatory purpose pyproject.toml actually serves at this point in the process is to tell an installer what build backend to use (and what its statically-known dependencies are); the backend itself is free to use other files for configuration (i.e. the config isn't required to be in [tool], and other tools simply won't be invoked at this point), and the [project] metadata is either redundant with PKG-INFO or erroneous.
Bonus round:
Given that PEP 725 isn't accepted yet, is there any circumstance in which it would make sense for a modern build backend to output Requires-External or Supported-Platform values in core metadata? I can't think of any.
Code of Conduct
- I am aware that participants in this repository must follow the PSF Code of Conduct.
- Vorherrschende Sprache
- Python
- Sterne
- 1.7k
- Forks
- 1.7k
- Ø Merge
- 8 T. 3 Std.
- Gemergte PRs (30 T.)
- 5
Entwicklungsumgebung
Dieses Projekt bietet weder Dev-Container noch Dockerfile noch Beitragsleitfaden – die Einrichtung liegt bei Ihnen. Beginnen Sie mit der README; die allgemeinen Schritte stehen in unserem Leitfaden für den ersten Beitrag.
Erste Schritte
- Lesen Sie das ganze Issue und danach den Beitragsleitfaden des Projekts.
- Schreiben Sie ins Issue, dass Sie es übernehmen — das erspart doppelte Arbeit.
- Forken Sie das Repository und arbeiten Sie in einem Branch.
- Öffnen Sie einen Pull Request, der die Issue-Nummer nennt.
Mehr aus pypa/packaging.python.org
-
Note greediness of PEP 723 reference parserEvtl. vergeben @jw9829 hat das vor 9 Tagen übernommen. Offen
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 68/100
pypa/packaging.python.org#1960 · 4 Kommentare ·
Maintainer antworten meist innerhalb von 2 Tagen
-
Document that sparse identifiers with whitespace are valid if quotedEvtl. vergeben @Herrtian hat das vor 149 Tagen übernommen. Offencomponent: specifications good first issue type: enhancement
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 68/100
pypa/packaging.python.org#1226 · 3 Kommentare · 1 Reaktion ·
Maintainer antworten meist innerhalb von 2 Tagen
-
`test` vs. `tests`Evtl. wieder frei Ein Pull Request dazu wurde ohne Merge geschlossen. Offencomponent: guides component: tutorials type: enhancement type: task
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 64/100
pypa/packaging.python.org#1165 · 5 Kommentare ·
Maintainer antworten meist innerhalb von 2 Tagen
-
type: task
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 62/100
pypa/packaging.python.org#792 · 2 Kommentare · 1 Reaktion ·
Maintainer antworten meist innerhalb von 2 Tagen
-
Add pip.conf heads-up to PyPI.org migration guideEvtl. vergeben @harshitethic hat das vor 37 Tagen übernommen. Offengood first issue help wanted type: bug
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 78/100
pypa/packaging.python.org#463 · 5 Kommentare ·
Maintainer antworten meist innerhalb von 2 Tagen
Alle Issues in pypa/packaging.python.org
Ähnliche Issues
-
Schwierigkeit 1/5 Unter einer Stunde Anfängerfreundlichkeit 85/100
-
Schwierigkeit 1/5 Unter einer Stunde Anfängerfreundlichkeit 75/100
-
Schwierigkeit 1/5 Unter einer Stunde Anfängerfreundlichkeit 85/100
-
Schwierigkeit 1/5 Unter einer Stunde Anfängerfreundlichkeit 85/100
data-umbrella/du-event-board#225 ·
-
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 75/100