Clarifications needed re packaging flow from the perspective of a build backend
メンテナーはふだん 2 日以内に返信
まだ誰も着手していません。
評価
- 難易度
- 5/5
- 見積もり時間
- 1週間以上
- 初心者へのやさしさ
- 25/100
- issue の種類
- ドキュメント
- 明瞭さ
- 説明が足りない
- 活発さ
- 停滞
- 技術スタック
- python
調査の方向性
まず、pyproject.toml、PKG-INFO、wheel METADATA、PEP 725 に関する issue の参照を確認します。sdist と wheel について提示されている疑問を関連する packaging 仕様と比較し、そのうえで、どのドキュメントまたは仕様の記述に明確化が必要かを判断し、未解決の点を maintainers 向けにまとめます。
索引モデルが issue の本文から書いたものです。
説明
Issue Description
I'm writing a build backend which aims to deliver these key features relevant to the discussion (among others):
- Sdists will only contain static metadata;
- The code for sdist-building and wheel-building is separable, such that, when an sdist is downloaded and installed automatically (e.g. by Pip), only the wheel-building code is needed as a build dependency;
- There is no legacy support - sdists contain a
PKG-INFOspecifying a core metadata version of 2.2 or higher (most likely 2.4) and apyproject.toml.
There are several confusing points I've encountered in the description of pyproject.toml and of the core metadata format, and how they are used in source trees (pyproject.toml only), sdists (both) and wheels (core metadata only). My goal here is to verify that I can accomplish my goals while remaining standards compliant.
The main conceptual problem I'm having is that pyproject.toml and core metadata are described as canonical metadata formats, yet a non-legacy sdist is expected to contain both. I have many questions as a result.
First, regarding sdist creation: my understanding is that in this process, the build backend:
- MUST faithfully represent static metadata (if any) from the source tree's
pyproject.tomlin thePKG-INFO; - MAY compute values for dynamic metadata and include these in the
PKG-INFOas well.
The question is, what happens to the version of pyproject.toml that ends up in the sdist?
It seems to me that it cannot in general be an exact copy of the source tree's pyproject.toml, because if I compute dynamic metadata then there is a conflict - the field is marked dynamic in pyproject.toml but provided statically in PKG-INFO.
Am I at liberty to create an entirely new pyproject.toml, as long as it follows the spec? For example, can I remove the [project] table (since in general this table isn't required to be present, and I've already fully "compiled" its information into PKG-INFO)? Can I change the [build-system] table, such that a different build backend will be used to create the wheel? (One implementation idea I had was to incorporate an in-tree, wheel-specific backend into the sdist.) Should [project] at least be edited to reflect the dynamic metadata values that were calculated (e.g. add the computed values as static keys, and remove the corresponding names from project.dynamic)?
Then, regarding wheel building. Regarding core metadata, it says that "Fields defined in the following specification should be considered valid, complete and not subject to change."
Does that imply that the wheel's METADATA MUST be a copy of the sdist's PKG-INFO?
Doesn't that prevent computing metadata values at wheel creation time? (Not applicable to me, but still worth raising the question.)
Doesn't that in turn imply that non-legacy sdists need to have all the dynamic metadata values computed, and they can't be deferred to wheel-building? (I think this is intentional, so that e.g. installers can figure out basic information about the package without building it. But as of 24.3.1, Pip still does the build first anyway, even when PKG-INFO declares the latest metadata version.)
Doesn't that cause a problem for PEP 725 – Specifying external dependencies in pyproject.toml, since they propose to give semantics to Requires-External metadata whereby the wheel's version could differ? (In particular: the wheel-building process could use a tool like cibuildwheel to vendor a compiled shared C library whose source is not included in the sdist; by my reading of the PEP, the intent is that PKG-INFO would describe the library as an external requirement, but METADATA would not.)
Also: when building the wheel, is it required to look at pyproject.toml at all, or to validate it? My understanding is that the only mandatory purpose pyproject.toml actually serves at this point in the process is to tell an installer what build backend to use (and what its statically-known dependencies are); the backend itself is free to use other files for configuration (i.e. the config isn't required to be in [tool], and other tools simply won't be invoked at this point), and the [project] metadata is either redundant with PKG-INFO or erroneous.
Bonus round:
Given that PEP 725 isn't accepted yet, is there any circumstance in which it would make sense for a modern build backend to output Requires-External or Supported-Platform values in core metadata? I can't think of any.
Code of Conduct
- I am aware that participants in this repository must follow the PSF Code of Conduct.
- 主要言語
- Python
- スター
- 1.7k
- フォーク
- 1.7k
- 平均マージ
- 8日 3時間
- マージ済み PR(30日)
- 5
環境構築
このプロジェクトには開発コンテナ、Dockerfile、コントリビューションガイドがありません。まず README を読み、一般的な手順ははじめてのコントリビューションガイドを参照してください。
はじめの一歩
- issue を最後まで読み、次にプロジェクトのコントリビューションガイドを読みます。
- 着手することを issue にコメントします — 二人が同じ作業をするのを防げます。
- リポジトリをフォークし、ブランチを切って変更します。
- issue 番号を参照したプルリクエストを送ります。
pypa/packaging.python.org のほかの issue
-
Note greediness of PEP 723 reference parser対応中かも @jw9829 が 10 日前に担当しました。 オープン
難易度 2/5 1〜3時間 初心者へのやさしさ 68/100
pypa/packaging.python.org#1960 · コメント 4 件 ·
メンテナーはふだん 2 日以内に返信
-
Document that sparse identifiers with whitespace are valid if quoted対応中かも @Herrtian が 149 日前に担当しました。 オープンcomponent: specifications good first issue type: enhancement
難易度 2/5 1〜3時間 初心者へのやさしさ 68/100
pypa/packaging.python.org#1226 · コメント 3 件 · リアクション 1 件 ·
メンテナーはふだん 2 日以内に返信
-
`test` vs. `tests`再び着手できるかも このイシューのプルリクエストはマージされずにクローズされました。 オープンcomponent: guides component: tutorials type: enhancement type: task
難易度 2/5 1〜3時間 初心者へのやさしさ 64/100
pypa/packaging.python.org#1165 · コメント 5 件 ·
メンテナーはふだん 2 日以内に返信
-
type: task
難易度 2/5 1〜3時間 初心者へのやさしさ 62/100
pypa/packaging.python.org#792 · コメント 2 件 · リアクション 1 件 ·
メンテナーはふだん 2 日以内に返信
-
Add pip.conf heads-up to PyPI.org migration guide対応中かも @harshitethic が 38 日前に担当しました。 オープンgood first issue help wanted type: bug
難易度 2/5 1〜3時間 初心者へのやさしさ 78/100
pypa/packaging.python.org#463 · コメント 5 件 ·
メンテナーはふだん 2 日以内に返信
pypa/packaging.python.org の issue をすべて見る
似ている issue
-
難易度 1/5 1時間未満 初心者へのやさしさ 92/100
-
Harmony OPeNDAP SubSetter (HOSS) Geographic LARC_CLOUD PREFIRE_SAT2_AUX-SAT R01 production
難易度 2/5 1〜3時間 初心者へのやさしさ 68/100
nasa/harmony-autotester#245 ·
-
enhancement
難易度 2/5 1〜3時間 初心者へのやさしさ 68/100
Deltares/imod-python#1928 ·
-
難易度 1/5 1時間未満 初心者へのやさしさ 88/100
メンテナーはふだん 1 日以内に返信
-
feature
難易度 2/5 1〜3時間 初心者へのやさしさ 66/100