Define the top-level public API and deprecate redundant exports
维护者通常 1 天内回复
还没有人认领这个 Issue。
评估
- 难度
- 5/5
- 预计耗时
- 一周以上
- 新手友好度
- 35/100
- Issue 类型
- 重构
- 描述清晰度
- 描述清楚
- 活跃度
- 活跃
- 技术栈
- python
调研方向
Start with py/src/braintrust/__init__.py and the existing public export coverage in type_tests/test_public_exports.py; read the export definitions in workflow_eval.py and supporting modules named in the issue. Inventory retained exports, deprecated aliases with exact replacements, and implementation spillover, then establish canonical imports and compatibility warnings. Done means the explicit root API and __all__, migration guidance, runtime and type coverage, updated imports, and optional-provider behavior meet the acceptance criteria.
由索引模型根据 Issue 内容生成。
描述
Problem
The top-level braintrust namespace mixes primary SDK entry points, supporting types, specialized features, and implementation details. py/src/braintrust/__init__.py uses wildcard imports and has no package-level __all__. A fresh import in the inspected checkout exposed 490 non-underscore names, including imported libraries and submodules; that count describes the observed namespace, not an intentional public contract.
Examples of spillover include DiskCache, LogQueue, ProjectIdCache, global_, construct_logs3_data, os, json, Any, cast, tee, and SSEClient.
Import order also determines the meaning of several names. Project, Dataset, Experiment, and Prompt ultimately resolve to classes from logger.py, replacing earlier exports. In particular, braintrust.Project is a different class from the project returned by braintrust.projects.create().
We should define an explicit top-level API, deprecate selected existing import paths with clear replacements, and stop exposing implementation imports as part of the intended contract.
Proposed top-level API
Keep the entry points for common workflows:
| Workflow | Top-level exports |
|---|---|
| Evaluations | Eval, EvalAsync |
| Resource initialization | init, init_dataset, init_logger |
| Authentication | login |
| Tracing | traced, start_span, current_span, flush |
| Instrumentation | auto_instrument |
| Prompts and parameters | load_prompt, load_prompt_async, load_parameters |
| Hosted function invocation | invoke, invoke_async |
| Authoring and publishing | projects |
| Workflow evaluations | define_workflow_eval, WorkflowEval, and the existing public workflow task, scorer, submission, batching, store, and result helpers |
Workflow evaluations are a first-class top-level API. Keep the existing 25 names declared in workflow_eval.__all__; they are excluded from the proposed root-import deprecations. This includes the WorkflowTask*, WorkflowScorer*, WorkflowBatch*, WorkflowSubmission*, and WorkflowEval* families.
Supporting types can be imported from stable submodules. This is a focused root API, not a rule that prohibits all classes at the top level: the workflow evaluation family is intentionally retained.
A. Deprecations
Deprecate selected top-level aliases/import paths while retaining their underlying functionality:
| Candidate | Replacement |
|---|---|
init_experiment |
braintrust.init (it is currently an alias) |
Provider-specific wrap_* and setup_* helpers |
braintrust.integrations.<provider> |
BraintrustLogHandler |
braintrust.logs |
| Span customization APIs | braintrust.span_customizer |
| Dataset pipeline APIs | braintrust.dataset_pipeline |
| Sandbox registration APIs | braintrust.sandbox |
| Evaluation support types | braintrust.framework |
| Scoring objects and types | braintrust.score |
| Stream/chunk classes | braintrust.functions.stream |
| Generated schemas | braintrust.generated_types |
| Resource classes, attachments, summaries, and other supporting types | Establish and document stable submodule paths before issuing deprecations |
Do not assume braintrust.types already re-exports every supporting type. Choose permanent destinations before asking users to migrate, and avoid multiple successive import migrations. Resolve the Project ambiguity explicitly in migration guidance.
Treat global log and summarize as a separate decision: replacing them with methods on experiment/logger handles changes usage beyond an import-path migration. Audit their use and decide separately whether to deprecate them. Likewise, audit advanced helpers not covered by the table before making removal decisions.
Compatibility rollout:
- Establish and document canonical submodule imports.
- Update repository examples, documentation, and internal imports to use the intended API.
- Preserve deprecated root imports through compatibility aliases, with
DeprecationWarningmessages naming the exact replacement import. A module__getattr__compatibility layer is one option; avoid eagerly binding aliases if that prevents access warnings. - Remove deprecated aliases in a future breaking release under an explicit deprecation policy.
B. Export cleanup
- Replace wildcard imports in
braintrust/__init__.pywith explicit re-exports. - Add an explicit package-level
__all__for the supported root API, including the workflow evaluation family. - Preserve static type-checker visibility of intended re-exports, including the explicit
asaliasing pattern already covered bytype_tests/test_public_exports.pywhere needed. - Stop eagerly re-exporting third-party imports, typing utilities, internal caches/queues, serialization helpers, and mutable implementation state. Audit compatibility before removing names that downstream users may have adopted.
- Review the three explicitly imported
_internal_*hooks separately; they are private compatibility hooks, not part of the public export list. - Preserve optional-provider lazy loading and existing supported import-time behavior.
__all__ defines the intended public contract and wildcard-import behavior; it does not hide existing attributes or prevent Python from attaching imported submodules to the package. The goal is an explicit supported API, not a guarantee that dir(braintrust) contains only those names.
Acceptance criteria
- Check in an explicit inventory of retained exports, deprecated root aliases with exact replacements, and implementation spillover.
- Add explicit top-level re-exports and
__all__, retaining all existing public workflow evaluation exports. - Document canonical submodule imports and a deprecation/removal policy.
- Add runtime coverage for intended exports, deprecated aliases/warnings, and identity/behavior preservation.
- Extend public-export type tests to cover the retained API and supported replacement imports.
- Update examples and internal imports; verify optional providers remain optional.
- Run the relevant core and type-checking sessions from
py/noxfile.py.
Relevant files: py/src/braintrust/__init__.py, framework.py, framework2.py, logger.py, generated_types.py, workflow_eval.py, and type_tests/test_public_exports.py.
- 主要语言
- Python
- 星标
- 22
- 派生
- 27
- 平均合并
- 14 小时 49 分钟
- 30 天内合并 PR
- 126
环境准备
- 提供 Dockerfile 或 Docker Compose 文件
- 没有 Pull Request 模板
- 阅读贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
braintrustdata/braintrust-sdk-python 的其他 Issue
-
难度 2/5 1-3 小时 新手友好度 77/100
braintrustdata/braintrust-sdk-python#962 ·
维护者通常 1 天内回复
-
Temporal: add `workflow.Info.original_execution_run_id` to workflow span metadata可能已有人在做 @Ehsan-hash 于 2 天前认领。 未关闭feature python
难度 2/5 1-3 小时 新手友好度 76/100
braintrustdata/braintrust-sdk-python#868 ·
维护者通常 1 天内回复
-
难度 5/5 一周以上 新手友好度 20/100
braintrustdata/braintrust-sdk-python#957 ·
维护者通常 1 天内回复
-
python
braintrustdata/braintrust-sdk-python#839 ·
维护者通常 1 天内回复
-
new-integration
难度 4/5 3-5 天 新手友好度 68/100
braintrustdata/braintrust-sdk-python#808 ·
维护者通常 1 天内回复
查看 braintrustdata/braintrust-sdk-python 的全部 Issue
相似的 Issue
-
documentation
难度 2/5 1-3 小时 新手友好度 72/100
ianktoo/project-monitor#14 ·
-
security
难度 2/5 1-3 小时 新手友好度 84/100
btclib-org/btclib-wallet#478 ·
维护者通常 1 天内回复
-
security
难度 2/5 1-3 小时 新手友好度 75/100
btclib-org/btclib#2727 ·
维护者通常 1 天内回复
-
good first issue lead variant:container
难度 2/5 1-3 小时 新手友好度 76/100
radialmonster/orf-cleanroom#10 ·
维护者通常 1 天内回复
-
gdsa opencode: keep-alive cleanup trap fails with 'keepalive_pid: unbound variable'可能已有人在做 @darribas 今天认领。 未关闭
难度 2/5 1-3 小时 新手友好度 85/100