questions about darlin

Open
#13 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
20/100
Issue type
Documentation
Clarity
Needs clarification
Activity status
Stale
Tech stack
cpp

Research direction

Start by reading the mentioned darlin.h, postoffice.cc, postmaster.cc, and bcd.h files, then trace where scheduler, server, and worker execution enter. Confirm whether the reported logs reflect expected behavior; done would require documenting the relevant run paths and explaining the absence of worker and server logs.

Written by the indexing model from the issue text.

Description

Hi muli
I have read part of the code of darlin,I can`t find the implementation of api "void run" in darlin for server and worker, it seems that only scheduler run is used?

the running long also shows:
I0303 14:07:51.796239 16734 postoffice.cc:104] Scheduler has connected 2 servers and 2 workers
I0303 14:07:51.798970 16734 darlin.h:35] Train l_1 logistic regression by block coordinate descent
I0303 14:07:51.799216 16734 postmaster.cc:9] Found 8 files
I0303 14:07:51.799244 16734 postmaster.cc:13] Assign 8 files to 2 workers
I0303 14:07:51.803696 16734 bcd.h:53] Loaded 223836 examples in 0.004 sec
I0303 14:07:53.559219 16734 bcd.h:71] Preprocessing is finished in 1.755 sec
I0303 14:07:53.559294 16734 bcd.h:73] Features with frequency <= 4 are filtered
I0303 14:07:53.559429 16734 bcd.h:98] Features are partitioned into 449 blocks
I0303 14:07:53.559465 16734 bcd.h:120] Prior feature groups: 127, 120
I0303 14:07:53.559478 16734 darlin.h:43] Maximal allowed delay: 8
| training | sparsity | KKT filter | time (sec.)
iter | objective relative | |w|_0 | threshold #activet |(app:min max) total
----+------------------------+-----------+---------------------+-----------------
0 | 1.45414e+05 1.000e+00 | 3601 | 1.0e+20 12754852 | 0.3 0.3 1.1
1 | 1.44370e+05 7.226e-03 | 2916 | 2.9e-01 4162 | 0.3 0.3 1.1
2 | 1.44197e+05 1.203e-03 | 2689 | 1.9e-03 3101 | 0.1 0.1 0.7
3 | 1.44015e+05 1.264e-03 | 2493 | 6.1e-03 2763 | 0.1 0.1 0.7
4 | 1.43952e+05 4.340e-04 | 2382 | 1.0e-03 2529 | 0.1 0.1 0.7
5 | 1.43933e+05 1.366e-04 | 2325 | 5.3e-04 2407 | 0.1 0.1 0.7
6 | 1.43921e+05 7.836e-05 | 2291 | 1.1e-04 2337 | 0.1 0.1 0.7
7 | 1.43916e+05 3.719e-05 | 2276 | 7.8e-04 2299 | 0.1 0.1 0.7
8 | 1.43912e+05 3.138e-05 | 2261 | 1.9e-04 2282 | 0.1 0.1 0.7
9 | 1.43908e+05 2.278e-05 | 2260 | 2.8e-05 2271 | 0.1 0.1 0.7
10 | 1.43906e+05 1.575e-05 | 2248 | 1.5e-03 2263 | 0.1 0.1 0.7
11 | 1.43904e+05 1.541e-05 | 2240 | 1.2e-05 12754840 | 0.3 0.3 1.1

in the log, I also can not find the logs relevant to worker and server

Dominant language
C++
Stars
649
Forks
233
PR merge metrics
No merged PRs in 30d

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from dmlc/parameter_server

All issues in dmlc/parameter_server

Similar issues

More C++ issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.