questions about darlin
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 20/100
- Issue type
- Documentation
- Clarity
- Needs clarification
- Activity status
- Stale
- Tech stack
- cpp
- Domain
- distributed-systems
Research direction
Start by reading the mentioned darlin.h, postoffice.cc, postmaster.cc, and bcd.h files, then trace where scheduler, server, and worker execution enter. Confirm whether the reported logs reflect expected behavior; done would require documenting the relevant run paths and explaining the absence of worker and server logs.
Written by the indexing model from the issue text.
Description
Hi muli
I have read part of the code of darlin,I can`t find the implementation of api "void run" in darlin for server and worker, it seems that only scheduler run is used?
the running long also shows:
I0303 14:07:51.796239 16734 postoffice.cc:104] Scheduler has connected 2 servers and 2 workers
I0303 14:07:51.798970 16734 darlin.h:35] Train l_1 logistic regression by block coordinate descent
I0303 14:07:51.799216 16734 postmaster.cc:9] Found 8 files
I0303 14:07:51.799244 16734 postmaster.cc:13] Assign 8 files to 2 workers
I0303 14:07:51.803696 16734 bcd.h:53] Loaded 223836 examples in 0.004 sec
I0303 14:07:53.559219 16734 bcd.h:71] Preprocessing is finished in 1.755 sec
I0303 14:07:53.559294 16734 bcd.h:73] Features with frequency <= 4 are filtered
I0303 14:07:53.559429 16734 bcd.h:98] Features are partitioned into 449 blocks
I0303 14:07:53.559465 16734 bcd.h:120] Prior feature groups: 127, 120
I0303 14:07:53.559478 16734 darlin.h:43] Maximal allowed delay: 8
| training | sparsity | KKT filter | time (sec.)
iter | objective relative | |w|_0 | threshold #activet |(app:min max) total
----+------------------------+-----------+---------------------+-----------------
0 | 1.45414e+05 1.000e+00 | 3601 | 1.0e+20 12754852 | 0.3 0.3 1.1
1 | 1.44370e+05 7.226e-03 | 2916 | 2.9e-01 4162 | 0.3 0.3 1.1
2 | 1.44197e+05 1.203e-03 | 2689 | 1.9e-03 3101 | 0.1 0.1 0.7
3 | 1.44015e+05 1.264e-03 | 2493 | 6.1e-03 2763 | 0.1 0.1 0.7
4 | 1.43952e+05 4.340e-04 | 2382 | 1.0e-03 2529 | 0.1 0.1 0.7
5 | 1.43933e+05 1.366e-04 | 2325 | 5.3e-04 2407 | 0.1 0.1 0.7
6 | 1.43921e+05 7.836e-05 | 2291 | 1.1e-04 2337 | 0.1 0.1 0.7
7 | 1.43916e+05 3.719e-05 | 2276 | 7.8e-04 2299 | 0.1 0.1 0.7
8 | 1.43912e+05 3.138e-05 | 2261 | 1.9e-04 2282 | 0.1 0.1 0.7
9 | 1.43908e+05 2.278e-05 | 2260 | 2.8e-05 2271 | 0.1 0.1 0.7
10 | 1.43906e+05 1.575e-05 | 2248 | 1.5e-03 2263 | 0.1 0.1 0.7
11 | 1.43904e+05 1.541e-05 | 2240 | 1.2e-05 12754840 | 0.3 0.3 1.1
in the log, I also can not find the logs relevant to worker and server
- Dominant language
- C++
- Stars
- 649
- Forks
- 233
- PR merge metrics
- No merged PRs in 30d
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from dmlc/parameter_server
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
dmlc/parameter_server#32 ·
-
Difficulty 3/5 1-2 days Newbie friendliness 35/100
dmlc/parameter_server#31 ·
-
Difficulty 3/5 1-2 days Newbie friendliness 15/100
dmlc/parameter_server#29 · 2 comments ·
-
Difficulty 3/5 1-2 days Newbie friendliness 35/100
dmlc/parameter_server#28 · 1 comment ·
-
running error. Open
Difficulty 5/5 Over a week Newbie friendliness 5/100
dmlc/parameter_server#27 ·
All issues in dmlc/parameter_server
Similar issues
-
Difficulty 1/5 Under an hour Newbie friendliness 90/100
AXERA-TECH/ax-llm#77 ·
-
Difficulty 1/5 Under an hour Newbie friendliness 90/100
games-on-whales/wolf#509 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
-
bug-unconfirmed
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
NVIDIA/cuda-samples#453 ·