LLMObs annotationContext params are incorrect
Maintainers usually reply within 1 day
Assessment
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 48/100
- Issue type
- Documentation
- Clarity
- Mostly clear
- Activity status
- Stale
- Tech stack
- javascript, node.js
- Domain
- documentation
Research direction
Open the two linked documentation sections and compare annotationContext with index.d.ts at line 3356; then inspect the managed evaluations page for the hallucination heading. Done means the prompt field and allowed shape are documented accurately and the link resolves to the intended anchor.
Written by the indexing model from the issue text.
Description
Documentation Page
Issue Description
The document arguments do not include the prompt field.
Under prompt tracking, the field is included in the example, but the shape is incorrect, chat_template is not a allowed field
https://docs.datadoghq.com/llm_observability/instrumentation/sdk/?tab=nodejs#prompt-tracking
Also, the link to hallucination doesn't go to a specific anchor: https://docs.datadoghq.com/llm_observability/evaluations/managed_evaluations/?tab=openai#hallucination
@urseberry
- Dominant language
- JavaScript
- Stars
- 621
- Forks
- 1.3k
- Avg merge
- 2d 9h
- Merged PRs (30d)
- 441
Getting set up
- No Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from DataDog/documentation
-
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
DataDog/documentation#39746 · 1 reaction ·
Maintainers usually reply within 1 day
-
Difficulty 1/5 1-3 hours Newbie friendliness 86/100
DataDog/documentation#38651 · 1 comment ·
Maintainers usually reply within 1 day
-
Difficulty 1/5 Under an hour Newbie friendliness 85/100
DataDog/documentation#37078 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
DataDog/documentation#36762 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
DataDog/documentation#36300 · 1 comment ·
Maintainers usually reply within 1 day
All issues in DataDog/documentation
Similar issues
-
agent/scanner bug hive/hosted-available-lke648397-260827-5n31
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
rescript-lang/rescript#8765 ·
Maintainers usually reply within 1 day
-
feedback simulation workshop
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
githubnext/gh-aw-workshop#4417 ·
Maintainers usually reply within 1 day
-
Good First Issue hacktoberfest
Difficulty 2/5 1-3 hours Newbie friendliness 85/100
hiero-ledger/hiero-sdk-js#4489 ·
Maintainers usually reply within 1 day
-
Add: RiC FeedOpencheck:passed feeds:add
Difficulty 1/5 Under an hour Newbie friendliness 74/100
Maintainers usually reply within 9 days