One server and one client example in FedCV object detection

Hi,

I build FedML platform using docker container provided by the authors. To see the performance of simple one server and one client example, I run run_server.sh and run_client.sh scripts inside the object_detection/ directory. Then, I started receiving following state in server and client terminal

#Server side:

mqtt_s3.send_message: msg topic = fedml_yolov5_0_2
mqtt_s3.send_message: msg topic = fedml_yolov5_0_2
[FedML-Server(0) @device-id-0] [Thu, 21 Jul 2022 02:36:06] [INFO] [mqtt_s3_multi_clients_comm_manager.py:249:send_message] mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
[FedML-Server(0) @device-id-0] [Thu, 21 Jul 2022 02:36:06] [INFO] [fedml_server_manager.py:101:handle_messag_connection_ready] Connection ready for client2
Connection ready for client2
Connection ready for client2
[FedML-Server(0) @device-id-0] [Thu, 21 Jul 2022 02:36:06] [INFO] [mqtt_s3_multi_clients_comm_manager.py:140:on_connected] mqtt_s3.on_connect: server subscribes
mqtt_s3.on_connect: server subscribes
mqtt_s3.on_connect: server subscribes
[FedML-Server(0) @device-id-0] [Thu, 21 Jul 2022 02:36:06] [INFO] [mqtt_s3_multi_clients_comm_manager.py:198:_on_message_impl] mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
[FedML-Server(0) @device-id-0] [Thu, 21 Jul 2022 02:36:06] [INFO] [mqtt_s3_multi_clients_comm_manager.py:172:_notify] mqtt_s3.notify: msg type = 5
mqtt_s3.notify: msg type = 5
mqtt_s3.notify: msg type = 5
[FedML-Server(0) @device-id-0] [Thu, 21 Jul 2022 02:36:06] [INFO] [server_manager.py:155:receive_message] receive_message. rank_id = 0, msg_type = 5.
receive_message. rank_id = 0, msg_type = 5.
receive_message. rank_id = 0, msg_type = 5.
[FedML-Server(0) @device-id-0] [Thu, 21 Jul 2022 02:36:06] [INFO] [fedml_server_manager.py:111:handle_message_client_status_update] self.client_online_mapping = {'1': True}
self.client_online_mapping = {'1': True}
self.client_online_mapping = {'1': True}
[FedML-Server(0) @device-id-0] [Thu, 21 Jul 2022 02:36:06] [INFO] [fedml_server_manager.py:126:handle_message_client_status_update] sender_id = 1, all_client_is_online = False
sender_id = 1, all_client_is_online = False
sender_id = 1, all_client_is_online = False

#Client side

[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:33:03] [INFO] [mqtt_s3_multi_clients_comm_manager.py:148:on_connected] mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 17, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 17, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 17, result = 0
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:33:03] [INFO] [mqtt_s3_multi_clients_comm_manager.py:198:_on_message_impl] mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:33:03] [INFO] [mqtt_s3_multi_clients_comm_manager.py:172:_notify] mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:33:03] [INFO] [fedml_client_master_manager.py:162:send_client_status] send_client_status
send_client_status
send_client_status
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:33:03] [INFO] [client_manager.py:157:send_message] Sending message (type 5) to server
Sending message (type 5) to server
Sending message (type 5) to server
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:33:03] [INFO] [mqtt_s3_multi_clients_comm_manager.py:277:send_message] mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:34:04] [INFO] [fedml_client_master_manager.py:62:handle_message_connection_ready] Connection is ready!
Connection is ready!
Connection is ready!
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:34:04] [INFO] [mqtt_s3_multi_clients_comm_manager.py:148:on_connected] mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 19, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 19, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 19, result = 0
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:34:04] [INFO] [mqtt_s3_multi_clients_comm_manager.py:198:_on_message_impl] mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:34:04] [INFO] [mqtt_s3_multi_clients_comm_manager.py:172:_notify] mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:34:04] [INFO] [fedml_client_master_manager.py:162:send_client_status] send_client_status
send_client_status
send_client_status
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:34:04] [INFO] [client_manager.py:157:send_message] Sending message (type 5) to server
Sending message (type 5) to server
Sending message (type 5) to server
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:34:04] [INFO] [mqtt_s3_multi_clients_comm_manager.py:277:send_message] mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:35:05] [INFO] [fedml_client_master_manager.py:62:handle_message_connection_ready] Connection is ready!
Connection is ready!
Connection is ready!
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:35:05] [INFO] [mqtt_s3_multi_clients_comm_manager.py:148:on_connected] mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 21, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 21, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 21, result = 0
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:35:05] [INFO] [mqtt_s3_multi_clients_comm_manager.py:198:_on_message_impl] mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:35:05] [INFO] [mqtt_s3_multi_clients_comm_manager.py:172:_notify] mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:35:05] [INFO] [fedml_client_master_manager.py:162:send_client_status] send_client_status
send_client_status
send_client_status
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:35:05] [INFO] [client_manager.py:157:send_message] Sending message (type 5) to server
Sending message (type 5) to server
Sending message (type 5) to server
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:35:05] [INFO] [mqtt_s3_multi_clients_comm_manager.py:277:send_message] mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:36:06] [INFO] [fedml_client_master_manager.py:62:handle_message_connection_ready] Connection is ready!
Connection is ready!
Connection is ready!
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:36:06] [INFO] [mqtt_s3_multi_clients_comm_manager.py:148:on_connected] mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 23, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 23, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 23, result = 0
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:36:06] [INFO] [mqtt_s3_multi_clients_comm_manager.py:198:_on_message_impl] mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:36:06] [INFO] [mqtt_s3_multi_clients_comm_manager.py:172:_notify] mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:36:06] [INFO] [fedml_client_master_manager.py:162:send_client_status] send_client_status
send_client_status
send_client_status
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:36:06] [INFO] [client_manager.py:157:send_message] Sending message (type 5) to server
Sending message (type 5) to server
Sending message (type 5) to server
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:36:06] [INFO] [mqtt_s3_multi_clients_comm_manager.py:277:send_message] mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:37:07] [INFO] [fedml_client_master_manager.py:62:handle_message_connection_ready] Connection is ready!
Connection is ready!
Connection is ready!
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:37:07] [INFO] [mqtt_s3_multi_clients_comm_manager.py:148:on_connected] mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 25, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 25, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 25, result = 0
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:37:07] [INFO] [mqtt_s3_multi_clients_comm_manager.py:198:_on_message_impl] mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:37:07] [INFO] [mqtt_s3_multi_clients_comm_manager.py:172:_notify] mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:37:07] [INFO] [fedml_client_master_manager.py:162:send_client_status] send_client_status
send_client_status
send_client_status
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:37:07] [INFO] [client_manager.py:157:send_message] Sending message (type 5) to server
Sending message (type 5) to server
Sending message (type 5) to server
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:37:07] [INFO] [mqtt_s3_multi_clients_comm_manager.py:277:send_message] mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent

I suspect that there is some problem in the connection between client and server. I am using the same PC for client and for server Any hint and suggestion is highly appreciated !!!