The SIO2 project
  1. The SIO2 project
  2. SIO-2071

Modify job schedulers to take into account RAM amount

    Details

      Description

      Part of SIO-1928.

      Right now various jobs are scheduled between workers using only WORKER_CONCURRENCY parameter. Existing schedulers should be modified to take into account WORKER_RAM parameter for workers and environ['required_ram'] for jobs.

        Activity

        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 12
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 12 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 13
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 13 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 14
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 14 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 15
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 15 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 16
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 16 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03

          People

          • Assignee:
            Szymon AcedaƄski
            Reporter:
            Pavel Senchanka
            TAG Developer:
            Pavel Senchanka
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: