Too-large search filter geometry causes opaque error and futile retries

Open
#711 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
3/5
Estimated time
1-2 days
Newbie friendliness
38/100
Issue type
Bug
Clarity
Mostly clear
Activity status
Stale
Tech stack
python
Domain
api, networking

Research direction

Reproduce the problem with the attached rmnp.geojson using the documented planet data filter and DEBUG command. Start by tracing the planet.http retry logs and the handling of the httpx.ReadError; done means an oversized geometry failure exposes the available server signal and does not continue futile retries.

Written by the indexing model from the issue text.

Description

bug error handling

If I search with a big ole 9MB blob of GeoJSON (attached, 1.2 MB zipped) the search appears to hang. If I turn up the logging verbosity, I see that we're in a retry loop that doesn't break.

...
2022-10-07 16:01:46,708 - planet.http - DEBUG - Worker released.
2022-10-07 16:01:46,708 - planet.http - INFO - Try 2
2022-10-07 16:01:46,708 - planet.http - INFO - Retrying: caught <class 'httpx.ReadError'>: 
2022-10-07 16:01:46,708 - planet.http - INFO - Retrying: sleeping 4.786s
...

I think that the GeoJSON may be over the size limit and that the retries cannot succeed. We're losing some signal from the API server. There's no server response in the log.

To reproduce, try this with the attached GeoJSON.

planet data filter --geom rmnp.geojson --date-range acquired gte 2022-10-06 | planet --verbosity DEBUG data search PSScene

rmnp.zip

Dominant language
Python
Stars
299
Forks
100
Avg merge
7d 8h
Merged PRs (30d)
2

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from planetlabs/planet-client-python

All issues in planetlabs/planet-client-python

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.