Request: Expose lang and noLinks options in @supadata/js web.scrape

Open Beginner friendly
#14 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
2/5
Estimated time
1-3 hours
Newbie friendliness
68/100
Issue type
Feature
Clarity
Mostly clear
Activity status
Active
Tech stack
typescript
Domain
api

Research direction

Start at the web.scrape(url: string) SDK entry point and compare its request shape with the existing transcripts options. Trace how HTTP query parameters are assembled, then verify that lang and noLinks can be supplied through the chosen API shape and reach the web-scraping request.

Written by the indexing model from the issue text.

Description

We’re trying out @supadata/js for web scraping to pair with Video Transcripts and noticed the HTTP API supports lang and noLinks query params, but the SDK web.scrape(url: string) signature doesn’t allow passing these options.

Request:

  • Expose optional params on web.scrape, e.g.
  const result = await supadata.web.scrape("https://example.com", {
    noLinks: true,
    lang: "en",
  });

or

//I think more consistent with how transcripts works? 
const result = await supadata.web.scrape({ url, noLinks: true, lang: "en" });

Thanks

Dominant language
TypeScript
Stars
22
Forks
8
Avg merge
1d 13h
Merged PRs (30d)
1

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from supadata-ai/js

All issues in supadata-ai/js

Similar issues

More TypeScript issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.