jxnl/instructor-classify

Add cross-provider cost tracking support

オープン

#2 opened on 2025/04/19

 (0 件のコメント) (0 件のリアクション) (0 人の担当者)Python (4 件のフォーク)auto 404
enhancementgood first issue

Repository metrics

Stars
 (37 個のスター)
PR merge metrics
 (PR metrics pending)

説明

Cost tracking currently only works for OpenAI and does not use the instructor usage tracking standard.

Description

Extend the cost tracking functionality to work with all providers supported by Instructor, not just OpenAI. This involves integrating with Instructor's standardized usage tracking system.

Tasks

  • Review Instructor's usage tracking standard implementation
  • Update cost analysis module to work with this standard format
  • Add provider-specific cost calculations for Anthropic, Google, etc.
  • Add tests for each provider's cost tracking
  • Update documentation to reflect cross-provider cost tracking

Expected Result

Users should be able to see accurate cost tracking regardless of which LLM provider they use. The evaluation framework should produce cost metrics for all supported providers.

Difficulty

Medium - requires understanding of Instructor's usage tracking system and multiple provider APIs

コントリビューターガイド