[BUG] MediaCrawler ERROR (core.py:212) - [XiaoHongShuCrawler.get_creators_and_notes] Failed to parse creator URL: Expecting value: line 1 column 60984 (char 60983)

Open
  • Is something wrong?
#990 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
3/5
Estimated time
Half a day
Newbie friendliness
60/100
Issue type
Bug
Clarity
Mostly clear
Activity status
Active
Tech stack
python
Domain
backend

Research direction

Start from XiaoHongShuCrawler.get_creators_and_notes in media_platform/xiaohongshu, the method named in the error, and find where the creator page response is passed to a JSON decoder (the core.py:212 log line only wraps it). The 'Expecting value: char 60983' error means non-JSON (likely HTML or a truncated/risk-control page) reached json.loads, so first inspect how the fetch result is validated before parsing. Done means the parser detects the bad payload and reports a clear error (or retries) instead of crashing, verified by re-running the creator-mode crawl.

Written by the indexing model from the issue text.

Description

bug

🔍 问题检查清单

  • [ 勾] 我已经仔细阅读了项目使用过程中的常见问题汇总
  • [ 勾] 我已经搜索并查看了已关闭的issues
  • [ 勾] 我确认这不是由于滑块验证码、Cookie过期、Cookie提取错误、平台风控等常见原因导致的问题

🐛 问题描述

正常选择爬取小红书作者账号下的内容，就会报这个错误

📝 复现步骤

Image

💻 运行环境

  • 操作系统: windows
  • Python版本: 3.11.17
  • 是否使用IP代理: 否
  • 是否使用VPN翻墙软件： 否
  • 目标平台(抖音/小红书/微博等): 小红书

📋 错误日志

[22:07:02]
[ERR]
2026-10-06 22:07:02 MediaCrawler ERROR (core.py:212) - [XiaoHongShuCrawler.get_creators_and_notes] Failed to parse creator URL: Expecting value: line 1 column 60984 (char 60983)

📷 错误截图

Image
Dominant language
Python
Stars
70.7k
Forks
13.4k
Avg merge
2d 5h
Merged PRs (30d)
3

Getting set up

This project ships no dev container, Dockerfile or contributing guide, so setting up is up to you: start from its README, and see our first-contribution guide for the general steps.

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from NanmiCoder/MediaCrawler

All issues in NanmiCoder/MediaCrawler

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.