alibaba/GraphScope

[GLE] Explicitly build the training client using the GLE server handle

Open

Aperta il 25 mag 2023

Vedi su GitHub
 (1 commento) (0 reazioni) (1 assegnatario)HTML (2401 star) (301 fork)batch import
component:glegood first issue

Descrizione

A graph object is returned after the GLE servers are launched, which is further used to build the client that the training worker uses to communicate with the GLE servers. While in distributed training（multiple training workers), we need to first get the handle of the graph (including the schema info, service IP and port), and use these information to build client in the training side. This issue is to add APIs and implementations to ease the process of explicitly building the training client using the GLE server handle.

Guida contributor

Tech stack
pythoncpp
Dominio
backendapimachine learning
Tipo issue
feature
DifficoltàQuanto dovrebbe essere impegnativa per un nuovo contributor.
4
Tempo stimatoTempo stimato per completare e verificare uno scope piccolo.
3-5 days
Stato attivitàQuanto è probabile che la issue sia ancora attiva e reviewable.
blocked
ChiarezzaQuanto chiaramente la issue descrive problema, scope e risultato atteso.
clear
Prerequisiti
Distributed systems understandingPython programmingFamiliarity with GraphScope GLE
Adatta ai principiantiQuanto la issue è adatta a contributor alla prima esperienza.
20
Direzione di ricerca
Review the existing GLE server handle object to understand its structure. Look at the current client building process for single worker training. Then design an API to extract handle information (schema, IP, port) and expose it. Check any existing similar APIs in the codebase. Consider the comments in the issue for guidance.