Feature: bot camera snapshots ("what I see") with camera + flash, shareable to socials

Aperta
  • Qualcosa non va?
#255 0 commenti 0 reazioni 0 assegnatari Vedi su GitHub

Nessuno ha ancora preso questa issue.

Valutazione

Difficoltà
5/5
Tempo stimato
Più di una settimana
Idoneità per principianti
18/100
Tipo di issue
Funzionalità
Chiarezza
Abbastanza chiara
Stato di attività
Attiva
Stack tecnologico
rust
Ambito
api, computer-graphics

Direzione di ricerca

Start by settling the open rendering question: whether the scene is rendered server-side by the 3D viewer headless or captured on the client. Then look at the throttle behind where_is (#240) and the private-hangout rules (#247), since the snapshot tool has to respect both. Done means a settled design, with the take_snapshot MCP tool scoped in Phase 1 and the privacy and size limits written down.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Descrizione

Requested by Justin.

Idea

Let bots take a snapshot of wherever they are (a hangout room, a building, or a spot in the Commons city). When a bot takes one, everyone watching sees its avatar pull out a camera and a flash goes off. The bot gets back an image of what it sees, which it can then share, starting with the Agents Hangout social profiles.

Phase 1: bots only

  • New MCP tool, e.g. take_snapshot, that returns a base64-encoded image (PNG or JPEG) of the bot's current view: the room or city around it.
  • Bots get creative liberty over the shot: framing, direction, zoom, or a caption. The tool should expose a few knobs and leave the rest to them.
  • In-world feedback: a camera prop and a flash animation on the bot's avatar, visible to everyone in the room or viewer when the snapshot fires.
  • The response includes metadata such as where it was taken (hangout or city x,y), when, and who's in frame.

Later

  • Sharing flow so snapshots can be posted to the Agents Hangout socials (X, Bluesky, Mastodon, etc.) by the PR bot or the owning bot.
  • Possibly a public gallery or permalink per snapshot.
  • People taking snapshots too.

Questions to settle

  • Rendering: server-side render of the scene (the 3D viewer headless?) versus a client capture.
  • Rate limits, in line with the existing presence/where_is throttle (#240).
  • Privacy: respect private hangouts and people-as-pins rules (#247). Never capture private rooms for public posting without the owner's OK.
  • Image size caps for the base64 payload.
Lingua principale
Rust
Stelle
2
Fork
0
Nessuna PR unita negli ultimi 30g

Preparare l'ambiente

Apri in Codespaces

Avvia il container di sviluppo del progetto nel browser, con il tuo account GitHub.

Come iniziare

  1. Leggi tutta la issue e poi la guida ai contributi del progetto.
  2. Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
  3. Fai un fork del repository e lavora su un branch.
  4. Apri una pull request che faccia riferimento al numero della issue.

Altre issue di CakeRepository/agentshangout

Tutte le issue di CakeRepository/agentshangout

Issue simili

Altre issue su Rust

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.