Hacktoberfest 2026: the issues maintainers tagged for October, open and beginner-friendly. Browse Hacktoberfest issues

[BOT ISSUE] langchainrb gem not instrumented

Open
  • Is something wrong?
#148 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
38/100
Issue type
Feature
Clarity
Mostly clear
Activity status
Quiet
Tech stack
ruby
Domain
observability

Research direction

Start by comparing the existing integrations under lib/braintrust/contrib/*/integration.rb, then inspect Appraisals and braintrust.gemspec for dependency and appraisal conventions. Review langchainrb's chat, completion, embedding, tool-calling, structured-output, and assistant APIs before narrowing the integration scope. Done means the agreed langchainrb execution surfaces are instrumented and covered by the repository's integration and dependency checks.

Written by the indexing model from the issue text.

Description

Summary

The langchainrb gem is the most widely adopted Ruby AI framework (~1.1M downloads, v0.19.5, May 2025) and is not instrumented by this SDK. It is the Ruby analog of Python's LangChain, providing chat completions, embeddings, tool calling, RAG, and assistant/agent patterns across multiple providers.

What is missing

No instrumentation exists for any langchainrb execution surface. Key APIs that should be instrumented:

Chat Completions
  • Langchain::LLM::*#chat(messages:, ...) — unified chat interface across all providers (OpenAI, Anthropic, Google Gemini, Ollama, AWS Bedrock, Azure OpenAI, Cohere, HuggingFace, Mistral, Replicate)
  • Langchain::LLM::*#complete(prompt:, ...) — text completion
Embeddings
  • Langchain::LLM::*#embed(text:, ...) — vector embeddings generation across providers
Tool / Function Calling
  • Tool definitions and automatic tool execution within chat flows
Structured Outputs
  • Langchain::OutputParsers::StructuredOutputParser — JSON schema-based structured extraction from LLM responses
Assistants / Agents
  • Langchain::Assistant — agent framework with tool execution, conversation management, and multi-turn interaction

Braintrust docs status

not_found — No mention of langchainrb as a Ruby integration anywhere in Braintrust documentation. The SDK integrations page at https://www.braintrust.dev/docs/integrations/sdk-integrations lists a general "LangChain" integration but it is not Ruby-specific and does not cover this gem.

Upstream sources

Local repo files inspected

  • lib/braintrust/contrib/*/integration.rb — only 4 integrations registered: OpenAI, RubyOpenAI, RubyLLM, Anthropic. No langchainrb integration.
  • lib/braintrust/contrib/ — no directory or files for langchainrb or langchain
  • Appraisals — no appraisal scenarios for langchainrb
  • braintrust.gemspec — no mention of langchainrb
  • Grep for langchain across lib/braintrust/ returns zero matches
Dominant language
Ruby
Stars
9
Forks
10
Avg merge
22h 10m
Merged PRs (30d)
6

Getting set up

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from braintrustdata/braintrust-sdk-ruby

All issues in braintrustdata/braintrust-sdk-ruby

Similar issues

More Ruby issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.