The SIO2 project
  1. The SIO2 project
  2. SIO-1217

Testrun: sending large input in compressed archive or compress automatically on server

        Details

        • Type: New Feature New Feature
        • Status: Closed Closed
        • Priority: Major Major
        • Resolution: Fixed
        • Affects Version/s: Current Version, 0.1.7
        • Fix Version/s: TAG 2014/15
        • Component/s: OIOIOI
        • Labels:
          None

          Description

          The default allowed input file size is 100KiB which is usually too small to test program behaviour with maximal input.
          In SIO1 it's solved by allowing users to send this input as compressed file, which are unpacked on the server (with some limit like 10MiB).

          Note: base/utils/archive.py already does most of the work

            Issue Links

            relates to

            New Feature - A new feature of the product, which has yet to be developed. SIO-1533 Testrun: accept input generators for testruns

            • Major - Major loss of function.
            • Closed - The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.

              Activity

              Ascending order - Click to sort in descending order
              Hide
              Permalink
              Maciej Matraszek added a comment -
              A, też chciałem :P. Ok, powiem, co wiem. Rozmawiałem o tym z acckiem i pomysły są takowe:

              a) rozpakowujemy plik podczas przesyłania i dopisujemy opcję kasowania takich starych plików (jakąś komendą konsolową) (ew. ucinania do pierwszego KiB)
              b) tylko sprawdzamy, czy rozmiar jest ok, a rozpakowujemy podczas sprawdzania, zanim się wyśle z oioioi na sprawdzarki i kasujemy po sprawdzeniu (jak w delete_executable czy delete_testrun_output)
              c) wysyłamy na sprawdzarki spakowane, one to rozpakowują i sprawdzają

              Sposób c) wydaje się bardzo fajny, ale chyba wymaga najwięcej pracy, bo trzeba jakoś informować o spakowanych testach itd.

              Show
              Maciej Matraszek added a comment - A, też chciałem :P. Ok, powiem, co wiem. Rozmawiałem o tym z acckiem i pomysły są takowe: a) rozpakowujemy plik podczas przesyłania i dopisujemy opcję kasowania takich starych plików (jakąś komendą konsolową) (ew. ucinania do pierwszego KiB) b) tylko sprawdzamy, czy rozmiar jest ok, a rozpakowujemy podczas sprawdzania, zanim się wyśle z oioioi na sprawdzarki i kasujemy po sprawdzeniu (jak w delete_executable czy delete_testrun_output) c) wysyłamy na sprawdzarki spakowane, one to rozpakowują i sprawdzają Sposób c) wydaje się bardzo fajny, ale chyba wymaga najwięcej pracy, bo trzeba jakoś informować o spakowanych testach itd.
              Hide
              Permalink
              Gerrit Gerrit added a comment -
              Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 1
              https://gerrit.sio2project.mimuw.edu.pl/2238

              SIO-1217 Server now accepts testrun inputs packed as .zip files SIO-1589 Testrun now shows acceptable languages

              Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b
              Show
              Gerrit Gerrit added a comment - Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 1 https://gerrit.sio2project.mimuw.edu.pl/2238 SIO-1217 Server now accepts testrun inputs packed as .zip files SIO-1589 Testrun now shows acceptable languages Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b
              Hide
              Permalink
              Gerrit Gerrit added a comment -
              Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 2
              https://gerrit.sio2project.mimuw.edu.pl/2238

              SIO-1217 Server now accepts testrun inputs packed as .zip files SIO-1589 Testrun now shows acceptable languages

              Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b
              Show
              Gerrit Gerrit added a comment - Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 2 https://gerrit.sio2project.mimuw.edu.pl/2238 SIO-1217 Server now accepts testrun inputs packed as .zip files SIO-1589 Testrun now shows acceptable languages Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b
              Hide
              Permalink
              Gerrit Gerrit added a comment -
              Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 1
              https://gerrit.sio2project.mimuw.edu.pl/2239

              SIO-1217 Allows for zipped inputs

              Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab
              Show
              Gerrit Gerrit added a comment - Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 1 https://gerrit.sio2project.mimuw.edu.pl/2239 SIO-1217 Allows for zipped inputs Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab
              Hide
              Permalink
              Gerrit Gerrit added a comment -
              Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 2
              https://gerrit.sio2project.mimuw.edu.pl/2239

              SIO-1217 Allows for zipped inputs

              Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab
              Show
              Gerrit Gerrit added a comment - Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 2 https://gerrit.sio2project.mimuw.edu.pl/2239 SIO-1217 Allows for zipped inputs Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab
              Hide
              Permalink
              Gerrit Gerrit added a comment -
              Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 3
              https://gerrit.sio2project.mimuw.edu.pl/2238

              SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files

              Archives are validated for safety as well as maximum file sizes compressed / decompressed.
              base/util/archive.py now can return total uncompressed archive file size

              Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b
              Show
              Gerrit Gerrit added a comment - Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 3 https://gerrit.sio2project.mimuw.edu.pl/2238 SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files Archives are validated for safety as well as maximum file sizes compressed / decompressed. base/util/archive.py now can return total uncompressed archive file size Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b
              Hide
              Permalink
              Gerrit Gerrit added a comment -
              Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 3
              https://gerrit.sio2project.mimuw.edu.pl/2239

              SIO-1217 Allows for zipped inputs

              Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab
              Show
              Gerrit Gerrit added a comment - Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 3 https://gerrit.sio2project.mimuw.edu.pl/2239 SIO-1217 Allows for zipped inputs Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab
              Hide
              Permalink
              Gerrit Gerrit added a comment -
              Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 4
              https://gerrit.sio2project.mimuw.edu.pl/2238

              SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files

              Archives are validated for safety as well as maximum file sizes compressed / decompressed.
              base/util/archive.py now can return total uncompressed archive file size

              Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b
              Show
              Gerrit Gerrit added a comment - Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 4 https://gerrit.sio2project.mimuw.edu.pl/2238 SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files Archives are validated for safety as well as maximum file sizes compressed / decompressed. base/util/archive.py now can return total uncompressed archive file size Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b
              Hide
              Permalink
              Gerrit Gerrit added a comment -
              Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 4
              https://gerrit.sio2project.mimuw.edu.pl/2239

              SIO-1217 Allows for zipped inputs

              Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab
              Show
              Gerrit Gerrit added a comment - Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 4 https://gerrit.sio2project.mimuw.edu.pl/2239 SIO-1217 Allows for zipped inputs Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab
              Hide
              Permalink
              Gerrit Gerrit added a comment -
              Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 5
              https://gerrit.sio2project.mimuw.edu.pl/2238

              SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files

              Archives are validated for safety as well as maximum file sizes compressed / decompressed.
              base/util/archive.py now can return total uncompressed archive file size

              Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b
              Show
              Gerrit Gerrit added a comment - Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 5 https://gerrit.sio2project.mimuw.edu.pl/2238 SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files Archives are validated for safety as well as maximum file sizes compressed / decompressed. base/util/archive.py now can return total uncompressed archive file size Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b
              Hide
              Permalink
              Gerrit Gerrit added a comment -
              Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 6
              https://gerrit.sio2project.mimuw.edu.pl/2238

              SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files

              Archives are validated for safety as well as maximum file sizes compressed / decompressed.
              base/util/archive.py now can return total uncompressed archive file size
              When viewing testrun submissions, user won't be able to preview input if it's in zip -> we don't wanna extract it on server

              Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b
              Show
              Gerrit Gerrit added a comment - Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 6 https://gerrit.sio2project.mimuw.edu.pl/2238 SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files Archives are validated for safety as well as maximum file sizes compressed / decompressed. base/util/archive.py now can return total uncompressed archive file size When viewing testrun submissions, user won't be able to preview input if it's in zip -> we don't wanna extract it on server Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b
              Hide
              Permalink
              Gerrit Gerrit added a comment -
              Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 5
              https://gerrit.sio2project.mimuw.edu.pl/2239

              SIO-1217 Allows for zipped inputs

              Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab
              Show
              Gerrit Gerrit added a comment - Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 5 https://gerrit.sio2project.mimuw.edu.pl/2239 SIO-1217 Allows for zipped inputs Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab
              Hide
              Permalink
              Gerrit Gerrit added a comment -
              Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 7
              https://gerrit.sio2project.mimuw.edu.pl/2238

              SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files

              Archives are validated for safety as well as maximum file sizes compressed / decompressed.
              base/util/archive.py now can return total uncompressed archive file size
              When viewing testrun submissions, user won't be able to preview input if it's in zip -> we don't wanna extract it on server

              Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b
              Show
              Gerrit Gerrit added a comment - Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 7 https://gerrit.sio2project.mimuw.edu.pl/2238 SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files Archives are validated for safety as well as maximum file sizes compressed / decompressed. base/util/archive.py now can return total uncompressed archive file size When viewing testrun submissions, user won't be able to preview input if it's in zip -> we don't wanna extract it on server Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b
              Hide
              Permalink
              Gerrit Gerrit added a comment -
              Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 8
              https://gerrit.sio2project.mimuw.edu.pl/2238

              SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files

              Archives are validated for safety as well as maximum file sizes compressed / decompressed.
              base/util/archive.py now can return total uncompressed archive file size
              When viewing testrun submissions, user won't be able to preview input if it's in zip -> we don't wanna extract it on server

              Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b
              Show
              Gerrit Gerrit added a comment - Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 8 https://gerrit.sio2project.mimuw.edu.pl/2238 SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files Archives are validated for safety as well as maximum file sizes compressed / decompressed. base/util/archive.py now can return total uncompressed archive file size When viewing testrun submissions, user won't be able to preview input if it's in zip -> we don't wanna extract it on server Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b
              Hide
              Permalink
              Gerrit Gerrit added a comment -
              Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 9
              https://gerrit.sio2project.mimuw.edu.pl/2238

              SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files

              Archives are validated for safety as well as maximum file sizes compressed / decompressed.
              base/util/archive.py now can return total uncompressed archive file size
              When viewing testrun submissions, user won't be able to preview input if it's in zip -> we don't wanna extract it on server

              Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b
              Show
              Gerrit Gerrit added a comment - Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 9 https://gerrit.sio2project.mimuw.edu.pl/2238 SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files Archives are validated for safety as well as maximum file sizes compressed / decompressed. base/util/archive.py now can return total uncompressed archive file size When viewing testrun submissions, user won't be able to preview input if it's in zip -> we don't wanna extract it on server Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b
              Hide
              Permalink
              Gerrit Gerrit added a comment -
              Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 6
              https://gerrit.sio2project.mimuw.edu.pl/2239

              SIO-1217 Allows for zipped inputs

              Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab
              Show
              Gerrit Gerrit added a comment - Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 6 https://gerrit.sio2project.mimuw.edu.pl/2239 SIO-1217 Allows for zipped inputs Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab
              Hide
              Permalink
              Gerrit Gerrit added a comment -
              Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 7
              https://gerrit.sio2project.mimuw.edu.pl/2239

              SIO-1217 Allows for zipped inputs

              Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab
              Show
              Gerrit Gerrit added a comment - Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 7 https://gerrit.sio2project.mimuw.edu.pl/2239 SIO-1217 Allows for zipped inputs Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab

                People

                • Assignee:
                  Szymon Acedański
                  Reporter:
                  Maciej Matraszek
                  TAG Reviewer:
                  Bartosz Stebel
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  1 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved: