🎃 Import a HAR file (browser network capture) as REST tools
Maintainer antworten meist innerhalb von 1 Tag
Dieses Issue hat noch niemand übernommen.
Bewertung
- Schwierigkeit
- 4/5
- Geschätzter Aufwand
- 3-5 Tage
- Anfängerfreundlichkeit
- 55/100
- Issue-Typ
- Feature
- Klarheit
- Klar beschrieben
- Aktivitätsstatus
- Aktiv
- Tech-Stack
- typescript
- Bereich
- backend-api-design, documentation, frontend, security
Rechercherichtung
Start with curl.parser.ts, postman.parser.ts, and the ParsedTool shape in openapi.parser.ts; then trace parser registration and importTools() in the backend, and IMPORT_SOURCES/handleImportTools in the connector page. Build the HAR parser and cover it with har.parser.spec.ts, then verify additive imports, the file-upload flow, and the requested docs updates. Done means the listed security, parsing, UI, test, and documentation acceptance criteria pass.
Vom Indexierungsmodell aus dem Issue-Text verfasst.
Beschreibung
Part of the October Challenge #846.
Why
Many internal and legacy web apps have no OpenAPI spec and no Postman collection. What users can always do is open DevTools, click through the app and "Save all as HAR". Turning that capture into REST tools would make AnythingMCP useful for exactly the APIs nobody documented. Similar tools: Postman and Insomnia import HAR; mitmproxy2swagger turns captures into specs.
Self-hosted vs Cloud
- Self-hosted: available in Community and Business, no licence gate.
- Cloud (
DEPLOYMENT_MODE=cloud): same feature. The parser runs only on uploaded text and never makes outbound requests (unlike the OpenAPI/Postmanurloption), so there is no new SSRF surface. Captures are sensitive (session cookies, tokens, personal data in bodies), so nothing from the HAR may be stored except the endpoint shapes described below. - Who can use it: same as the other import sources.
POST /api/connectors/:id/importrequiresassertCanWrite(connector owner or ADMIN; VIEWER refused), and the connector belongs to the caller's organization.
What to build
- Parser
packages/backend/src/connectors/parsers/har.parser.ts(HarParser,@Injectable,parse(content: string, opts: { baseUrl: string }): ParsedTool[]), registered inPARSERSinconnectors.module.ts:- Validate the HAR 1.2 shape (
log.entries[]). Reject content over 10 MB (the JSON body limit inmain.ts:53) and stop after 2,000 entries, with a clear error. - Keep only entries whose origin equals the connector's
baseUrlorigin, and make each path relative to thebaseUrlpath. SkipOPTIONS,data:/blob:URLs, static assets (by extension and byresponse.content.mimeType: js, css, images, fonts, html) and non-2xx/3xx responses. - Path parameter inference: a segment that is numeric, a UUID, a hex/base64-ish id of 16 or more characters, or a date becomes
{name}, named from the preceding segment (/orders/123/items/9gives/orders/{order_id}/items/{item_id}). Use the{var}form thatcurl.parser.tsemits. - Dedupe by
METHOD + templated path. Merge query parameter names and JSON body keys across duplicates. - Parameters: query params become string params. A JSON request body becomes a body schema with types only, using the Postman parser's
inferJsonTypeapproach. Form-urlencoded fields become string params. - Never copy captured values into defaults, examples or descriptions. A login request's body contains a password.
- Headers: drop
Authorization,Proxy-Authorization,Cookie,Set-Cookie, any name whereisSecretName()is true, HTTP/2 pseudo-headers (:authority…), and browser noise (sec-*,user-agent,accept-encoding,referer,origin,host,content-length). Query params whose name is a secret (e.g.api_key,token) are dropped, and their names are returned as a warning ("configure auth on the connector instead"). - Ignore
response.content.text,cookies,postData.paramsfile contents, and_initiator/_securityDetails. - Tool names:
<method>_<path words>, passed throughcapToolName(), made unique.
- Validate the HAR 1.2 shape (
- Controller: add
'har'toImportToolsDto.sourceand acase 'har'inimportTools()(content only, nourl). Treat HAR likecurl/json: additive, so it does not retire existing tools (additiveflag). - Frontend: add "HAR file (browser capture)" to
IMPORT_SOURCESin the connector page, with a Choose file button (accept=".har,application/json"). Read the file withFileReader. Before upload, removeresponse.content.textandcookiesfrom each entry (less data sent, smaller upload). Warn above 10 MB. Add a one-line hint: "Only requests to are imported; cookies and auth headers are discarded."
Where to look
packages/backend/src/connectors/parsers/curl.parser.ts:20: closest pattern (header handling at:138,{var}paths at:225,generateToolNameat:318).packages/backend/src/connectors/parsers/postman.parser.ts:223: header skip list;:433inferJsonType.packages/backend/src/connectors/parsers/openapi.parser.ts:12: theParsedToolshape.packages/backend/src/connectors/parsers/tool-name.util.ts:23:capToolName.packages/backend/src/connectors/connector-secrets.util.ts:77:isSecretName.packages/backend/src/connectors/connectors.controller.ts:323:ImportToolsDto;:1489importTools();:1656theadditiverule.packages/backend/src/connectors/connectors.module.ts:36:PARSERS.packages/frontend/src/app/connectors/[id]/page.tsx:23:IMPORT_SOURCES;:450handleImportTools.
Acceptance criteria
-
har.parser.spec.tsnext to the parser, with a small fixture HAR. It covers: other-origin and static entries skipped;/users/42and/users/43collapse into oneGET /users/{user_id}tool;Authorization/Cookie/X-Api-Keyabsent from everyendpointMapping; no captured value (e.g. a password in a login body) appears anywhere in the output (JSON.stringify(result)check); over-size input rejected. Run withcd packages/backend && npx jest src/connectors/parsers/har. - Importing a HAR never disables existing tools.
- The UI option works end to end (Playwright spec under
packages/frontend/tests/e2e/). - Docs: mention HAR in the import list of
docs/connectors/rest.md(line 3), and add asource: "har"example next to the other/importexamples indocs/api-reference.md(around line 121). Include a privacy note: "captures contain cookies; we discard them, but sanitize before sharing the file".
Out of scope
- Inferring
outputSchemafrom captured responses (follow-up). - Auto-configuring connector auth from captured tokens.
- GraphQL/WebSocket entries in a HAR.
- Creating a new connector from a HAR (import into an existing REST connector only).
Size
M (1–2 days)
How to claim
Comment "I'd like to work on this" and we'll assign you. Rules in #846.
- Vorherrschende Sprache
- TypeScript
- Sterne
- 856
- Forks
- 82
- Ø Merge
- 5 Std. 18 Min.
- Gemergte PRs (30 T.)
- 162
Entwicklungsumgebung
Dieses Projekt bietet weder Dev-Container noch Dockerfile noch Beitragsleitfaden – die Einrichtung liegt bei Ihnen. Beginnen Sie mit der README; die allgemeinen Schritte stehen in unserem Leitfaden für den ersten Beitrag.
Erste Schritte
- Lesen Sie das ganze Issue und danach den Beitragsleitfaden des Projekts.
- Schreiben Sie ins Issue, dass Sie es übernehmen — das erspart doppelte Arbeit.
- Forken Sie das Repository und arbeiten Sie in einem Branch.
- Öffnen Sie einen Pull Request, der die Issue-Nummer nennt.
Mehr aus HelpCode-ai/anythingmcp
-
Docs: document all SMTP_* and other undocumented env vars for self-hostingEvtl. vergeben @notlakshitha hat das vor 1 Tag übernommen. Offenenhancement
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 82/100
HelpCode-ai/anythingmcp#1049 · 3 Kommentare ·
Maintainer antworten meist innerhalb von 1 Tag
-
good first issue hacktoberfest
Schwierigkeit 2/5 Ein halber Tag Anfängerfreundlichkeit 70/100
HelpCode-ai/anythingmcp#996 ·
Maintainer antworten meist innerhalb von 1 Tag
-
good first issue hacktoberfest
Schwierigkeit 2/5 Ein halber Tag Anfängerfreundlichkeit 72/100
HelpCode-ai/anythingmcp#995 ·
Maintainer antworten meist innerhalb von 1 Tag
-
enhancement good first issue hacktoberfest help wanted
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 78/100
HelpCode-ai/anythingmcp#982 ·
Maintainer antworten meist innerhalb von 1 Tag
-
Upload the new social previewEvtl. vergeben @helpcodeai hat das vor 1 Tag übernommen. Offen
HelpCode-ai/anythingmcp#1087 · 4 Kommentare · 1 zugewiesene Person ·
Maintainer antworten meist innerhalb von 1 Tag
Alle Issues in HelpCode-ai/anythingmcp
Ähnliche Issues
-
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 74/100
xdjs/MusicNerdWeb#1532 ·
Maintainer antworten meist innerhalb von 1 Tag
-
bug
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 72/100
sebastian-software/ardo#352 ·
Maintainer antworten meist innerhalb von 1 Tag
-
@react95/core good first issue
Schwierigkeit 1/5 Unter einer Stunde Anfängerfreundlichkeit 88/100
Maintainer antworten meist innerhalb von 3 Tagen
-
@shikijs/stream: `ShikiStreamTokenizer.clone()` shares its `tokensStable` array with the originalEvtl. vergeben @xyrolle hat das heute übernommen. Offen
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 82/100
Maintainer antworten meist innerhalb von 6 Tagen
-
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 72/100
Maintainer antworten meist innerhalb von 1 Tag