AI observability enables `recordInputs` / `recordOutputs` by default

Open
#1,461 0 comments 0 reactions 0 assignees View on GitHub

Maintainers usually reply within 1 day

Nobody has claimed this yet.

Assessment

Difficulty
3/5
Estimated time
1-2 days
Newbie friendliness
45/100
Issue type
Bug
Clarity
Clearly specified
Activity status
Active
Tech stack
nextjs, typescript
Domain
observability

Research direction

The issue does not name files. Start by searching the wizard's source for where it writes the AI observability setup, specifically the recordInputs and recordOutputs options. Change both defaults to false, then check whether the wizard prompts the user before enabling capture. Done means the generated setup has both off by default, and any tests covering that generated code are updated to match. Because the issue asks for a product decision about prompting, confirm the approach with a maintainer before writing the prompt.

Written by the indexing model from the issue text.

Description

Setup: Next.js 16 app using the Vercel AI SDK. The wizard set up AI observability through OpenTelemetry and @posthog/ai.

What happened: Every model call got telemetry with recordInputs: true and recordOutputs: true. In our app the prompt holds a user's private uploaded document, so every document would have gone to PostHog without anyone deciding that.

Expected: default both to false, and ask before turning on input/output capture. The wizard can't know what the prompts contain or what the app has promised its users about that data.

Dominant language
TypeScript
Stars
204
Forks
54
Avg merge
1d 5h
Merged PRs (30d)
51

Getting set up

  • No Dockerfile or Docker Compose file
  • Has a pull request template
  • No contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from PostHog/wizard

All issues in PostHog/wizard

Similar issues

More TypeScript issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.