Details
-
Type:
Improvement
-
Status:
Closed
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: Current Version
-
Fix Version/s: TAG 2017/18 Sprint 1
-
Component/s: Evaluation Engine / Workers
-
Labels:None
Description
Part of SIO-1928.
Right now various jobs are scheduled between workers using only WORKER_CONCURRENCY parameter. Existing schedulers should be modified to take into account WORKER_RAM parameter for workers and environ['required_ram'] for jobs.
Right now various jobs are scheduled between workers using only WORKER_CONCURRENCY parameter. Existing schedulers should be modified to take into account WORKER_RAM parameter for workers and environ['required_ram'] for jobs.
Activity
- All
- Comments
- History
- Activity
- Transitions
- Commits
Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 12
https://gerrit.sio2project.mimuw.edu.pl/2960
SIO-2071 Adapt sioworkersd to respect RAM limits.
This commit is a large part of the implementation of
SIO-1928. It modifies sioworkersd (mainly the default
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implementSIO-2070 and SIO-2073.
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
https://gerrit.sio2project.mimuw.edu.pl/2960
This commit is a large part of the implementation of
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implement
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
Show
Gerrit Gerrit
added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 12
https://gerrit.sio2project.mimuw.edu.pl/2960
SIO-2071 Adapt sioworkersd to respect RAM limits.
This commit is a large part of the implementation of
SIO-1928 . It modifies sioworkersd (mainly the default
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implement SIO-2070 and SIO-2073 .
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
Gerrit Gerrit
added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 12
https://gerrit.sio2project.mimuw.edu.pl/2960
SIO-2071 Adapt sioworkersd to respect RAM limits.
This commit is a large part of the implementation of
SIO-1928 . It modifies sioworkersd (mainly the default
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implement SIO-2070 and SIO-2073 .
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03 Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 13
https://gerrit.sio2project.mimuw.edu.pl/2960
SIO-2071 Adapt sioworkersd to respect RAM limits.
This commit is a large part of the implementation of
SIO-1928. It modifies sioworkersd (mainly the default
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implementSIO-2070 and SIO-2073.
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
https://gerrit.sio2project.mimuw.edu.pl/2960
This commit is a large part of the implementation of
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implement
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
Show
Gerrit Gerrit
added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 13
https://gerrit.sio2project.mimuw.edu.pl/2960
SIO-2071 Adapt sioworkersd to respect RAM limits.
This commit is a large part of the implementation of
SIO-1928 . It modifies sioworkersd (mainly the default
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implement SIO-2070 and SIO-2073 .
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
Gerrit Gerrit
added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 13
https://gerrit.sio2project.mimuw.edu.pl/2960
SIO-2071 Adapt sioworkersd to respect RAM limits.
This commit is a large part of the implementation of
SIO-1928 . It modifies sioworkersd (mainly the default
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implement SIO-2070 and SIO-2073 .
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03 Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 14
https://gerrit.sio2project.mimuw.edu.pl/2960
SIO-2071 Adapt sioworkersd to respect RAM limits.
This commit is a large part of the implementation of
SIO-1928. It modifies sioworkersd (mainly the default
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implementSIO-2070 and SIO-2073.
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
https://gerrit.sio2project.mimuw.edu.pl/2960
This commit is a large part of the implementation of
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implement
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
Show
Gerrit Gerrit
added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 14
https://gerrit.sio2project.mimuw.edu.pl/2960
SIO-2071 Adapt sioworkersd to respect RAM limits.
This commit is a large part of the implementation of
SIO-1928 . It modifies sioworkersd (mainly the default
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implement SIO-2070 and SIO-2073 .
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
Gerrit Gerrit
added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 14
https://gerrit.sio2project.mimuw.edu.pl/2960
SIO-2071 Adapt sioworkersd to respect RAM limits.
This commit is a large part of the implementation of
SIO-1928 . It modifies sioworkersd (mainly the default
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implement SIO-2070 and SIO-2073 .
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03 Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 15
https://gerrit.sio2project.mimuw.edu.pl/2960
SIO-2071 Adapt sioworkersd to respect RAM limits.
This commit is a large part of the implementation of
SIO-1928. It modifies sioworkersd (mainly the default
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implementSIO-2070 and SIO-2073.
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
https://gerrit.sio2project.mimuw.edu.pl/2960
This commit is a large part of the implementation of
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implement
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
Show
Gerrit Gerrit
added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 15
https://gerrit.sio2project.mimuw.edu.pl/2960
SIO-2071 Adapt sioworkersd to respect RAM limits.
This commit is a large part of the implementation of
SIO-1928 . It modifies sioworkersd (mainly the default
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implement SIO-2070 and SIO-2073 .
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
Gerrit Gerrit
added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 15
https://gerrit.sio2project.mimuw.edu.pl/2960
SIO-2071 Adapt sioworkersd to respect RAM limits.
This commit is a large part of the implementation of
SIO-1928 . It modifies sioworkersd (mainly the default
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implement SIO-2070 and SIO-2073 .
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03 Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 16
https://gerrit.sio2project.mimuw.edu.pl/2960
SIO-2071 Adapt sioworkersd to respect RAM limits.
This commit is a large part of the implementation of
SIO-1928. It modifies sioworkersd (mainly the default
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implementSIO-2070 and SIO-2073.
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
https://gerrit.sio2project.mimuw.edu.pl/2960
This commit is a large part of the implementation of
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implement
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
Show
Gerrit Gerrit
added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 16
https://gerrit.sio2project.mimuw.edu.pl/2960
SIO-2071 Adapt sioworkersd to respect RAM limits.
This commit is a large part of the implementation of
SIO-1928 . It modifies sioworkersd (mainly the default
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implement SIO-2070 and SIO-2073 .
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
Gerrit Gerrit
added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 16
https://gerrit.sio2project.mimuw.edu.pl/2960
SIO-2071 Adapt sioworkersd to respect RAM limits.
This commit is a large part of the implementation of
SIO-1928 . It modifies sioworkersd (mainly the default
PrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implement SIO-2070 and SIO-2073 .
Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03 
https://gerrit.sio2project.mimuw.edu.pl/2960
SIO-2071Adapt sioworkersd to respect RAM limits.This commit is a large part of the implementation of
SIO-1928. It modifies sioworkersd (mainly the defaultPrioritizingScheduler) to recognize workers' total
RAM amounts and tasks' required RAM amount. The
core scheduling algorithm is kept the same, but
modified to account for RAM limits, which may have
some impact on the performance.
For these changes to be fully functional, it's also
necessary to implement
SIO-2070andSIO-2073.Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03