papercups-io/papercups

[For fun] Write a script that crawls websites to find out who's using Intercom/Drift/Crisp/etc

Open

#390 opened on Nov 11, 2020

View on GitHub
 (3 comments) (0 reactions) (0 assignees)Elixir (6,032 stars) (566 forks)batch import
enhancementfor funfrontendgood first issue

Description

Problem It would be nice to have a script that finds potential customers for us 😛

Solution Write a script that crawls the web and looks for websites with the Intercom/Drift/Crisp widget embedded. (Usually if you inspect element, you can figure out what to look for.)

Maybe to start, this script should just take a list of urls and output whether or not a chat widget is currently embedded on the page.

Testing Not sure if we'll want the script to live in this repo, but to test we should verify that the output matches reality 😉

Questions, or need help getting started? Feel free to ask below, or ping us on Slack :)

(You can also check out our CONTRIBUTING.md)

Contributor guide

Tech stack
None
Domain
tooling
Issue type
feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-2 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
stale
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
mostly clear
Prerequisites
basic web scraping knowledgeHTML parsing
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
50
Research direction
Look into common patterns for embedding Intercom, Drift, and Crisp widgets by inspecting HTML elements or script tags. Consider using a headless browser or simple HTTP requests with a parser like BeautifulSoup. The script should accept a list of URLs and output whether each site has a chat widget. No linked PRs or specific files mentioned in the issue.