Details
-
Type: Improvement
-
Status: Closed
-
Priority: Major
-
Resolution: Fixed
-
Affects Version/s: Current Version
-
Fix Version/s: TAG 2017/18 Sprint 1
-
Component/s: Evaluation Engine / Workers
-
Labels:None
Description
Part of SIO-1928.
Jobs should report the predicted amount of RAM that they need. This should probably be a new environ parameter ("required_ram" is proposed), but another part of this issue is investigating whether there is already some similar parameter, and if there is, whether it can be used forSIO-1928.
The list of all jobs can be found in `setup.py` of sioworkers package (`sio.jobs` list).
Jobs should report the predicted amount of RAM that they need. This should probably be a new environ parameter ("required_ram" is proposed), but another part of this issue is investigating whether there is already some similar parameter, and if there is, whether it can be used for
The list of all jobs can be found in `setup.py` of sioworkers package (`sio.jobs` list).
Activity
Pavel Senchanka
made changes -
Field | Original Value | New Value |
---|---|---|
Fix Version/s | TAG 2017/18 Sprint 1 [ 12800 ] |
Rafał Pragacz
made changes -
Assignee | Rafał Pragacz [ lord_yupa ] |
Rafał Pragacz
made changes -
Status | New [ 10000 ] | Resolved [ 5 ] |
Assignee | Rafał Pragacz [ lord_yupa ] | Szymon Acedański [ accek ] |
Resolution | Fixed [ 1 ] |
Szymon Acedański
made changes -
Status | Resolved [ 5 ] | Closed [ 6 ] |
Transition | Time In Source Status | Execution Times | Last Executer | Last Execution Date | |||||
---|---|---|---|---|---|---|---|---|---|
|
34d 22h 43m | 1 | Rafał Pragacz | 2018-04-17 12:40 | |||||
|
343d 5h 1m | 1 | Szymon Acedański | 2019-03-26 16:42 |
https://gerrit.sio2project.mimuw.edu.pl/2960
SIO-2071Adapt sioworkersd to respect RAM limits.This commit is a large part of the implementation of
SIO-1928. It modifies sioworkersd (mainly the defaultPrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implement
SIO-2070andSIO-2073.Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03