seo: add robots.txt with sitemap reference

Open Beginner friendly
#75 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
1/5
Estimated time
Under an hour
Newbie friendliness
88/100
Issue type
Feature
Clarity
Clearly specified
Activity status
Active
Domain
web-dev

Research direction

Start with the issue’s specified new file, public/robots.txt, and compare it with the existing sitemap path and the robots meta tag in index.html. Add the requested crawler rules and sitemap reference, confirming that the sitemap dependency is available or coordinating the follow-up noted in the issue. Done means public/robots.txt exists with the specified contents.

Written by the indexing model from the issue text.

Description

Problem

public/robots.txt doesn't exist. Only an in-page <meta name="robots" content="index, follow"> tag exists in index.html. Crawlers look for /robots.txt first to discover crawl rules and the sitemap location before rendering any JS.

Task

Add public/robots.txt:

User-agent: *
Allow: /

Sitemap: https://coding.mazipan.space/sitemap.xml

Depends on the sitemap existing at that path (see the sitemap.xml sub-issue) — either land together or add the Sitemap: line in a follow-up commit once that file exists.

Files

  • public/robots.txt (new)

Part of

#74

Dominant language
TypeScript
Stars
7
Forks
1
Avg merge
1h 41m
Merged PRs (30d)
21

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from mazipan/coding-kids

All issues in mazipan/coding-kids

Similar issues

More TypeScript issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.