FedML-AI/FedML

Training process never starts

Open

#1,441 opened on Oct 10, 2023

View on GitHub
 (0 comments) (0 reactions) (0 assignees)Python (743 forks)batch import
help wantedquestion

Repository metrics

Stars
 (3,930 stars)
PR merge metrics
 (No merged PRs in 30d)

Description

Hello everyone!

I was trying to run this example but unfortunately could not get past step 3.3 https://doc.fedml.ai/cross-device/examples/cross_device_android_example.html

Here's what I did:

  • Downloaded the app and managed to run it on a simulated android device on Android Studio.

  • Was able to send the datasets to the android device. image

  • Uploaded the server package: image

  • Created a new run: image

However, the run is always with the "STARTING" status: image

This is what I see in the training status: image and these are the logs

[FedML-Server @device-id-32935] [Wed, 11 Oct 2023 00:09:59 +0100] [INFO] [mlops_metrics.py:287:report_server_id_status] report_server_id_status. message_json = {"run_id": 13680, "edge_id": 32935, "status": "STARTING"}
[FedML-Server @device-id-32935] [Wed, 11 Oct 2023 00:09:59 +0100] [INFO] [mlops_metrics.py:229:report_server_device_status_to_web_ui] report_server_device_status. msg = {'run_id': 13680, 'edge_id': 32935, 'status': 'STARTING', 'role': 'normal', 'version': 'v1.0'}
[FedML-Server @device-id-32935] [Wed, 11 Oct 2023 00:09:59 +0100] [INFO] [mlops_metrics.py:229:report_server_device_status_to_web_ui] report_server_device_status. msg = {'run_id': 13680, 'edge_id': 32935, 'status': 'STARTING', 'role': 'normal', 'version': 'v1.0'}
[FedML-Server @device-id-32935] [Wed, 11 Oct 2023 00:09:59 +0100] [INFO] [server_runner.py:486:run_impl] Detect all status of Edge ids: [32929] 

I would be really thankful if anyone could help me with this issue. Thank you!

Contributor guide