jxnl/instructor-classify

Add cross-provider cost tracking support

開放

#2 建立於 2025年4月19日

 (0 則留言) (0 個反應) (0 位負責人)Python (4 個分叉)auto 404
enhancementgood first issue

倉庫指標

星標
 (37 顆星)
PR 合併指標
 (PR 指標待抓取)

描述

Cost tracking currently only works for OpenAI and does not use the instructor usage tracking standard.

Description

Extend the cost tracking functionality to work with all providers supported by Instructor, not just OpenAI. This involves integrating with Instructor's standardized usage tracking system.

Tasks

  • Review Instructor's usage tracking standard implementation
  • Update cost analysis module to work with this standard format
  • Add provider-specific cost calculations for Anthropic, Google, etc.
  • Add tests for each provider's cost tracking
  • Update documentation to reflect cross-provider cost tracking

Expected Result

Users should be able to see accurate cost tracking regardless of which LLM provider they use. The evaluation framework should produce cost metrics for all supported providers.

Difficulty

Medium - requires understanding of Instructor's usage tracking system and multiple provider APIs

貢獻者指南