envoyproxy/envoy

Proxy-WASM: Controlling contexts in other threads

Open

#17,576 opened on Aug 3, 2021

View on GitHub
 (20 comments) (0 reactions) (0 assignees)C++ (5,373 forks)batch import
area/wasmhelp wanted

Repository metrics

Stars
 (27,997 stars)
PR merge metrics
 (Avg merge 8d) (378 merged PRs in 30d)

Description

Hi, there maintainers/authors!

I'm working on building a WASM filter for my GSoC'21 project under the mentorship of @unleashed which is using shared data as a cache. Whenever a new request comes whose info is not present in the cache - the proxy does a callout to fetch information from an external service. Taking into account the environment in which this filter will be used, there can be multiple concurrent identical requests (i.e targeting a single key in the shared data). Right now, there is no way to avoid multiple callouts from different threads at the same time. We thought of adding an identifier in the cache signaling other identical requests in different threads about the outbound callout but there is no ability to pause and resume after the response.

Is there a way to achieve this behavior in the current proxy-wasm state? or does it require changes in the host?

Pictorial presentation:

                                 callout
                                    ▲           response
                      Cache miss    │              │
Thread(T1) R1(Key=1)────────────────┘              ▼ ──── on_http_call_response called

Thread(T2) R2(Key=1)─────────── (paused).........   ───── **No Event Present**

Thread(T3) R3(Key=1)─────────── (paused).........   ───── **No Event Present**

SDK: Rust v0.1.4

cc @PiotrSikora @mathetake @NomadXD

Contributor guide