The SIO2 project
  1. The SIO2 project
  2. SIO-1928

Replace worker concurrency with RAM capacity.

    Details

    • Type: Improvement Improvement
    • Status: Closed Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: Current Version
    • Fix Version/s: None
    • Labels:
      None

      Description

      Motivation:
      1) Now we have to predict how much RAM we should reserve for single jobs. If we choose 1G, then we are lowering our possible concurrency. If we choose 512M, then worker could potentially lack memory.
      2) We have different configs for judging machines which vary only in concurrency.

      What to do:
      1) Replace concurrency in worker config with RAM capacity
      2) OIOIOI should add to environ information how much RAM single job needs
      3) Scheduler should operate on RAM capacities instead of concurrencies.
      4) Split this task into smaller ones :)

      Adnotation:
      Don't forget about taking into account number of CPU cores. Currently used formula is min(# cpu cores * 1.5, (RAM minus a little bit for OS) / (max required mem per problem)). Obviously it is worth to discuss if and how this formula should be changed.

        Activity

        Artur Jamro made changes -
        Field Original Value New Value
        Summary Replace concurrency in worker with RAM capacity. Replace worker concurrency with RAM capacity.
        Artur Jamro made changes -
        Description Motivation:
        1) Now we have to predict how much RAM we should reserve for single jobs. If we choose 1G, then we are lowering our possible concurrency. If we choose 512M, then worker could potentially lack memory.
        2) We have different configs for judging machines which vary only in concurrency.

        What to do:
        1) Replace concurrency in worker config with RAM capacity
        2) OIOIOI should add to environ information how much RAM single job needs
        3) Scheduler should operate on RAM capacities instead of concurrencies.
        4) Split this task into smaller ones :)
        Motivation:
        1) Now we have to predict how much RAM we should reserve for single jobs. If we choose 1G, then we are lowering our possible concurrency. If we choose 512M, then worker could potentially lack memory.
        2) We have different configs for judging machines which vary only in concurrency.

        What to do:
        1) Replace concurrency in worker config with RAM capacity
        2) OIOIOI should add to environ information how much RAM single job needs
        3) Scheduler should operate on RAM capacities instead of concurrencies.
        4) Split this task into smaller ones :)

        Adnotation:
        Don't forget about taking into account number of CPU cores.
        Artur Jamro made changes -
        Description Motivation:
        1) Now we have to predict how much RAM we should reserve for single jobs. If we choose 1G, then we are lowering our possible concurrency. If we choose 512M, then worker could potentially lack memory.
        2) We have different configs for judging machines which vary only in concurrency.

        What to do:
        1) Replace concurrency in worker config with RAM capacity
        2) OIOIOI should add to environ information how much RAM single job needs
        3) Scheduler should operate on RAM capacities instead of concurrencies.
        4) Split this task into smaller ones :)

        Adnotation:
        Don't forget about taking into account number of CPU cores.
        Motivation:
        1) Now we have to predict how much RAM we should reserve for single jobs. If we choose 1G, then we are lowering our possible concurrency. If we choose 512M, then worker could potentially lack memory.
        2) We have different configs for judging machines which vary only in concurrency.

        What to do:
        1) Replace concurrency in worker config with RAM capacity
        2) OIOIOI should add to environ information how much RAM single job needs
        3) Scheduler should operate on RAM capacities instead of concurrencies.
        4) Split this task into smaller ones :)

        Adnotation:
        Don't forget about taking into account number of CPU cores. Currently used formula is min(# cpu cores * 1.5, (RAM minus a little bit for OS) / (max required mem per problem)). Obviously it is worth to discuss if and how this formula should be changed.
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 1
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 1 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 2
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 2 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 3
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 3 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 4
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 4 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 5
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 5 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89, patchset 1
        https://gerrit.sio2project.mimuw.edu.pl/2967

        SIO-2073 Setting ram requirements for various worker jobs in prioritizing scheduler.

        This commit is part of SIO-1928.

        Change-Id: I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89, patchset 1 https://gerrit.sio2project.mimuw.edu.pl/2967 SIO-2073 Setting ram requirements for various worker jobs in prioritizing scheduler. This commit is part of SIO-1928 . Change-Id: I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 6
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 6 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 7
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 7 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89, patchset 2
        https://gerrit.sio2project.mimuw.edu.pl/2967

        SIO-2073 Setting ram requirements for various worker jobs in prioritizing scheduler.

        This commit is part of SIO-1928.

        Change-Id: I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89, patchset 2 https://gerrit.sio2project.mimuw.edu.pl/2967 SIO-2073 Setting ram requirements for various worker jobs in prioritizing scheduler. This commit is part of SIO-1928 . Change-Id: I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 8
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 8 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 9
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 9 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89, patchset 3
        https://gerrit.sio2project.mimuw.edu.pl/2967

        SIO-2073 Setting ram requirements for various worker jobs in prioritizing scheduler. This can be modified after deleting FifoScheduler, so to avoid doubling the default values here and in executors.

        This commit is part of SIO-1928.

        Change-Id: I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89, patchset 3 https://gerrit.sio2project.mimuw.edu.pl/2967 SIO-2073 Setting ram requirements for various worker jobs in prioritizing scheduler. This can be modified after deleting FifoScheduler, so to avoid doubling the default values here and in executors. This commit is part of SIO-1928 . Change-Id: I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89, patchset 4
        https://gerrit.sio2project.mimuw.edu.pl/2967

        SIO-2073 Setting ram requirements for various worker jobs in prioritizing scheduler. This can be modified after deleting FifoScheduler, so to avoid doubling the default values here and in executors.

        This commit is part of SIO-1928.

        Change-Id: I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89, patchset 4 https://gerrit.sio2project.mimuw.edu.pl/2967 SIO-2073 Setting ram requirements for various worker jobs in prioritizing scheduler. This can be modified after deleting FifoScheduler, so to avoid doubling the default values here and in executors. This commit is part of SIO-1928 . Change-Id: I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 10
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 10 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 11
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 11 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89, patchset 5
        https://gerrit.sio2project.mimuw.edu.pl/2967

        SIO-2073 Setting ram requirements for various worker jobs in prioritizing scheduler. This can be modified after deleting FifoScheduler, so to avoid doubling the default values here and in executors.

        This commit is part of SIO-1928.

        Change-Id: I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89, patchset 5 https://gerrit.sio2project.mimuw.edu.pl/2967 SIO-2073 Setting ram requirements for various worker jobs in prioritizing scheduler. This can be modified after deleting FifoScheduler, so to avoid doubling the default values here and in executors. This commit is part of SIO-1928 . Change-Id: I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89, patchset 6
        https://gerrit.sio2project.mimuw.edu.pl/2967

        SIO-2073 Setting ram requirements for various worker jobs in prioritizing scheduler. This can be modified after deleting FifoScheduler, so to avoid doubling the default values here and in executors.

        This commit is part of SIO-1928.

        Change-Id: I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89, patchset 6 https://gerrit.sio2project.mimuw.edu.pl/2967 SIO-2073 Setting ram requirements for various worker jobs in prioritizing scheduler. This can be modified after deleting FifoScheduler, so to avoid doubling the default values here and in executors. This commit is part of SIO-1928 . Change-Id: I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89, patchset 7
        https://gerrit.sio2project.mimuw.edu.pl/2967

        SIO-2073 Setting ram requirements for various worker jobs in prioritizing scheduler based on job type or given limits.

        This commit is part of SIO-1928.

        Change-Id: I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89, patchset 7 https://gerrit.sio2project.mimuw.edu.pl/2967 SIO-2073 Setting ram requirements for various worker jobs in prioritizing scheduler based on job type or given limits. This commit is part of SIO-1928 . Change-Id: I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 12
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 12 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 13
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 13 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 14
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 14 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89, patchset 8
        https://gerrit.sio2project.mimuw.edu.pl/2967

        SIO-2073 Setting ram requirements for various worker jobs in prioritizing scheduler based on job type or given limits.

        This commit is part of SIO-1928.

        Change-Id: I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89, patchset 8 https://gerrit.sio2project.mimuw.edu.pl/2967 SIO-2073 Setting ram requirements for various worker jobs in prioritizing scheduler based on job type or given limits. This commit is part of SIO-1928 . Change-Id: I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89, patchset 9
        https://gerrit.sio2project.mimuw.edu.pl/2967

        SIO-2073 Setting ram requirements for various worker jobs in prioritizing scheduler based on job type or given limits.

        This commit is part of SIO-1928.

        Change-Id: I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89, patchset 9 https://gerrit.sio2project.mimuw.edu.pl/2967 SIO-2073 Setting ram requirements for various worker jobs in prioritizing scheduler based on job type or given limits. This commit is part of SIO-1928 . Change-Id: I7f795b81ee95793d89d5a7a3bf29f9bfb205ef89
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 15
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 15 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Hide
        Gerrit Gerrit added a comment -
        Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 16
        https://gerrit.sio2project.mimuw.edu.pl/2960

        SIO-2071 Adapt sioworkersd to respect RAM limits.

        This commit is a large part of the implementation of
        SIO-1928. It modifies sioworkersd (mainly the default
        PrioritizingScheduler) to recognize workers' total
        RAM amounts and tasks' required RAM amount. The
        core scheduling algorithm is kept the same, but
        modified to account for RAM limits, which may have
        some impact on the performance.

        For these changes to be fully functional, it's also
        necessary to implement SIO-2070 and SIO-2073.

        Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Show
        Gerrit Gerrit added a comment - Change sioworkers~master~I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03, patchset 16 https://gerrit.sio2project.mimuw.edu.pl/2960 SIO-2071 Adapt sioworkersd to respect RAM limits. This commit is a large part of the implementation of SIO-1928 . It modifies sioworkersd (mainly the default PrioritizingScheduler) to recognize workers' total RAM amounts and tasks' required RAM amount. The core scheduling algorithm is kept the same, but modified to account for RAM limits, which may have some impact on the performance. For these changes to be fully functional, it's also necessary to implement SIO-2070 and SIO-2073 . Change-Id: I625f7e7303bd5f69a96bde1443f8d9c38ef2ef03
        Pavel Senchanka made changes -
        Status New [ 10000 ] Resolved [ 5 ]
        Assignee Szymon Acedański [ accek ]
        Resolution Fixed [ 1 ]
        Szymon Acedański made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        New New Resolved Resolved
        387d 21h 6m 1 Pavel Senchanka 2018-04-17 12:40
        Resolved Resolved Closed Closed
        343d 4h 59m 1 Szymon Acedański 2019-03-26 16:40

          People

          • Assignee:
            Szymon Acedański
            Reporter:
            Artur Jamro
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: