pytorch/serve

How to access API outside of localhost?

Open

#1,152 opened on Jul 7, 2021

View on GitHub
 (7 comments) (0 reactions) (0 assignees)Java (790 forks)batch import
help wantedsupport

Repository metrics

Stars
 (3,844 stars)
PR merge metrics
 (No merged PRs in 30d)

Description

Hi!

I have Wireguard in my machine and have a few other devices connected with it. Let's say my Wireguard IP is 10.0.0.1, then in the config.properties file, I change inference_address=http://10.0.0.1:8080. I'm able to use the API locally but unable to do so outside of the device (I keep getting a timeout error).

What I've tried so far: I have also tried changing inference_address to 0.0.0.0:8080, but that didn't help either. Even running it on a different port like 0.0.0.0:5000 didn't help. If I use a tunnel (like ngrok) and expose port 8080, it works perfectly.

If I have another application running on a separate port, that is accessible by my other device.

Can someone help out?

Thanks!

Contributor guide

Research direction
Check that the server is binding to all interfaces (0.0.0.0) and that firewall rules allow incoming connections on the specified port. Also verify that the client can reach the server IP via the VPN.
Tech stack
java
Domain
backendapi
Issue type
Bug
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
2
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Mostly clear
Prerequisites
JavaPyTorch
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
60