Add msnbot for results with "Fetch as bingbot"
Nobody has claimed this yet.
Assessment
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 45/100
- Issue type
- Feature
- Clarity
- Mostly clear
- Activity status
- Stale
- Tech stack
- javascript
- Domain
- backend
Research direction
Search the repository for the existing bingbot user-agent handling and the related examples or libraries mentioned in the issue. Confirm how crawler user agents are matched, then verify that msnbot requests are treated like bingbot requests and trigger prerendering.
Written by the indexing model from the issue text.
Description
I am using the Fetch as bingbot feature (https://www.bing.com/webmaster/diagnostics/fetch/bingbot) for testing my pages, and it didn't hit prerender.
After searching what useragent they use, I found this in my logs:
[06/Dec/2019:11:16:50 +0100] "GET / HTTP/1.1" 200 1342 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)"
Maybe we can update all the list of user agent of all the examples/libraries, and add msnbot to the list ?
It may be a bug on their side also. After some research, an article from 2010
Whatever if it is their mistake or not, I guess it will not hurt to add msnbot. I will do that on our nginx config, I let you handle the decision to add it or not to all the repo too :)
- Dominant language
- JavaScript
- Stars
- 921
- Forks
- 185
- PR merge metrics
- No merged PRs in 30d
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from prerender/prerender-node
-
Release new version? Open
Difficulty 3/5 1-2 days Newbie friendliness 35/100
prerender/prerender-node#274 · 1 comment ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 48/100
prerender/prerender-node#272 ·
-
Fastify support? Open
Difficulty 5/5 Over a week Newbie friendliness 15/100
prerender/prerender-node#224 · 1 reaction ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 45/100
prerender/prerender-node#223 · 1 comment ·
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
prerender/prerender-node#220 · 2 comments · 2 reactions ·
All issues in prerender/prerender-node
Similar issues
-
bug customer-eng Durable Agents Inngest status: needs triage
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
optimization optimization:agents-md-curator
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
githubnext/gh-aw-cao#13475 ·
-
[BUG]: "Clear All" in Settings doesn't clear the saved analysis, old data comes back after reload Openbug
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
AOSSIE-Org/OrgExplorer#253 · 1 comment ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
oxc-project/oxc#26944 ·
-
ai-observability bug team/ai-observability
Difficulty 2/5 1-3 hours Newbie friendliness 78/100