Angel-ML/angel

[CORE] RDMA Support for Angel

Open

#225 opened on Oct 11, 2017

View on GitHub
 (0 comments) (5 reactions) (0 assignees)Java (1,630 forks)batch import
help wanted

Repository metrics

Stars
 (6,686 stars)
PR merge metrics
 (No merged PRs in 30d)

Description

In Angel, there's lots of model transformation, which means it will bring large amount of network transformation and costs lots of CPU time.

To improve this, we would like to introduce RDMA, which can bring better network performance and save CPU time. And with these improvement, Angel can achieve better performance and speed up model training time.

Contributor guide

Research direction
Investigate RDMA libraries available for Java, such as jVerbs, and design an interface for Angel's network layer.
Tech stack
java
Domain
backendinfrastructureperformance
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
4
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
Over 1 week
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Mostly clear
Prerequisites
JavaRDMANetworking
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
20