Details
-
Type: Improvement
-
Status: Closed
-
Priority: Major
-
Resolution: Fixed
-
Affects Version/s: Current Version
-
Fix Version/s: TAG 2017/18 Sprint 1
-
Component/s: Evaluation Engine / Workers
-
Labels:None
Description
Part of SIO-1928.
Right now various jobs are scheduled between workers using only WORKER_CONCURRENCY parameter. Existing schedulers should be modified to take into account WORKER_RAM parameter for workers and environ['required_ram'] for jobs.
Right now various jobs are scheduled between workers using only WORKER_CONCURRENCY parameter. Existing schedulers should be modified to take into account WORKER_RAM parameter for workers and environ['required_ram'] for jobs.
Activity
Pavel Senchanka
made changes -
Field | Original Value | New Value |
---|---|---|
Fix Version/s | TAG 2017/18 Sprint 1 [ 12800 ] |
Pavel Senchanka
made changes -
Assignee | Pavel Senchanka [ pavels ] |
Pavel Senchanka
made changes -
TAG Developer | Pavel Senchanka [ pavels ] |
Pavel Senchanka
made changes -
Status | New [ 10000 ] | Resolved [ 5 ] |
Assignee | Pavel Senchanka [ pavels ] | Szymon Acedański [ accek ] |
Resolution | Fixed [ 1 ] |
Szymon Acedański
made changes -
Status | Resolved [ 5 ] | Closed [ 6 ] |
Transition | Time In Source Status | Execution Times | Last Executer | Last Execution Date | |||||
---|---|---|---|---|---|---|---|---|---|
|
34d 22h 48m | 1 | Pavel Senchanka | 2018-04-17 12:39 | |||||
|
343d 4h 58m | 1 | Szymon Acedański | 2019-03-26 16:38 |
https://gerrit.sio2project.mimuw.edu.pl/2960
SIO-2071Adapt sioworkersd to respect RAM limits.This commit is a large part of the implementation of
SIO-1928. It modifies sioworkersd (mainly the defaultPrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implement
SIO-2070andSIO-2073.Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03