srid/zulip-archive

Add Sitemap File

Open

#10 opened on Feb 3, 2020

View on GitHub
 (0 comments) (1 reaction) (0 assignees)Haskell (1 fork)github user discovery
enhancementhacktoberfest

Repository metrics

Stars
 (13 stars)
PR merge metrics
 (PR metrics pending)

Description

A sitemap of all the threads would help crawlers and improve search engine discovery. You can point crawlers to the sitemap using the Sitemap: <full-url> directive in a robots.txt file, or by sending them a ping. A sitemap can have a maximum of 50,000 URLs. Beyond that, you need to generate a sitemap index file that points to the different sitemaps.

Not sure if this is a rib issue or a zulip-archive issue, but you could leverage this package I published recently to build the sitemaps and sitemap index: https://hackage.haskell.org/package/sitemap-gen

Contributor guide