[SIO-1217] Testrun: sending large input in compressed archive or compress automatically on server - SIO2

Details

Type: New Feature
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: Current Version, 0.1.7
Fix Version/s: TAG 2014/15
Component/s: OIOIOI
Labels:
None

Description

The default allowed input file size is 100KiB which is usually too small to test program behaviour with maximal input.
In SIO1 it's solved by allowing users to send this input as compressed file, which are unpacked on the server (with some limit like 10MiB).

Note: base/utils/archive.py already does most of the work

Issue Links

relates to

SIO-1533 Testrun: accept input generators for testruns

Activity

Ascending order - Click to sort in descending order

Mateusz Kwapich made changes - 2013-03-20 17:32

Field	Original Value	New Value
Fix Version/s		Near Future [ 11001 ]

Mateusz Kwapich made changes - 2013-03-20 18:06

Fix Version/s		0.1.8 - Happy Easter Sprint [ 11302 ]
Fix Version/s	Near Future [ 11001 ]

Mateusz Kwapich made changes - 2013-03-20 18:06

Assignee

Cezary Siłuszyk [ czarek ]

Hide

Permalink

Maciej Matraszek added a comment - 2013-03-20 20:36

A, też chciałem :P. Ok, powiem, co wiem. Rozmawiałem o tym z acckiem i pomysły są takowe:

a) rozpakowujemy plik podczas przesyłania i dopisujemy opcję kasowania takich starych plików (jakąś komendą konsolową) (ew. ucinania do pierwszego KiB)
b) tylko sprawdzamy, czy rozmiar jest ok, a rozpakowujemy podczas sprawdzania, zanim się wyśle z oioioi na sprawdzarki i kasujemy po sprawdzeniu (jak w delete_executable czy delete_testrun_output)
c) wysyłamy na sprawdzarki spakowane, one to rozpakowują i sprawdzają

Sposób c) wydaje się bardzo fajny, ale chyba wymaga najwięcej pracy, bo trzeba jakoś informować o spakowanych testach itd.

Show

Maciej Matraszek added a comment - 2013-03-20 20:36 A, też chciałem :P. Ok, powiem, co wiem. Rozmawiałem o tym z acckiem i pomysły są takowe: a) rozpakowujemy plik podczas przesyłania i dopisujemy opcję kasowania takich starych plików (jakąś komendą konsolową) (ew. ucinania do pierwszego KiB) b) tylko sprawdzamy, czy rozmiar jest ok, a rozpakowujemy podczas sprawdzania, zanim się wyśle z oioioi na sprawdzarki i kasujemy po sprawdzeniu (jak w delete_executable czy delete_testrun_output) c) wysyłamy na sprawdzarki spakowane, one to rozpakowują i sprawdzają Sposób c) wydaje się bardzo fajny, ale chyba wymaga najwięcej pracy, bo trzeba jakoś informować o spakowanych testach itd.

Mateusz Kwapich made changes - 2013-04-24 16:28

Fix Version/s		0.1.9 [ 11303 ]
Fix Version/s	0.1.8 - Happy Easter Sprint [ 11302 ]

Mateusz Kwapich made changes - 2013-05-15 16:23

Fix Version/s		0.1.10 [ 11400 ]
Fix Version/s	0.1.9 [ 11303 ]

Szymon Acedański made changes - 2013-10-5 18:18

Status

New [ 10000 ]

Open [ 1 ]

Cezary Siłuszyk made changes - 2013-10-10 16:54

Assignee

Cezary Siłuszyk [ czarek ]

Szymon Acedański made changes - 2013-10-13 16:09

Affects Version/s		Current Version [ 11000 ]
Fix Version/s		Near Future [ 11001 ]
Fix Version/s	0.1.10 [ 11400 ]

Michał Adamczyk made changes - 2014-05-21 20:46

Link

This issue is duplicated by ~~SIO-1533~~ [ ~~SIO-1533~~ ]

Szymon Acedański made changes - 2014-11-19 14:05

Fix Version/s		Sprint 2/2014 [ 12004 ]
Fix Version/s	Near Future [ 11001 ]

Szymon Acedański made changes - 2014-11-19 14:06

Link

This issue is duplicated by ~~SIO-1533~~ [ ~~SIO-1533~~ ]

Szymon Acedański made changes - 2014-11-19 14:06

Link

This issue relates to ~~SIO-1533~~ [ ~~SIO-1533~~ ]

Szymon Acedański made changes - 2014-11-19 14:54

Summary

Testrun: sending large input in compressed archive

Testrun: sending large input in compressed archive or compress automatically on server

Szymon Acedański made changes - 2014-11-19 15:10

Assignee

Olaf Tomalka [ ritave ]

Szymon Acedański made changes - 2014-11-19 15:33

TAG Reviewer

Bartosz Stebel [ implr ]

Hide

Permalink

Gerrit Gerrit added a comment - 2014-12-1 0:53

Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 1
https://gerrit.sio2project.mimuw.edu.pl/2238

~~SIO-1217~~ Server now accepts testrun inputs packed as .zip files ~~SIO-1589~~ Testrun now shows acceptable languages

Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b

Show

Gerrit Gerrit added a comment - 2014-12-1 0:53 Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 1 https://gerrit.sio2project.mimuw.edu.pl/2238 SIO-1217 Server now accepts testrun inputs packed as .zip files SIO-1589 Testrun now shows acceptable languages Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b

Hide

Permalink

Gerrit Gerrit added a comment - 2014-12-1 1:00

Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 2
https://gerrit.sio2project.mimuw.edu.pl/2238

~~SIO-1217~~ Server now accepts testrun inputs packed as .zip files ~~SIO-1589~~ Testrun now shows acceptable languages

Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b

Show

Gerrit Gerrit added a comment - 2014-12-1 1:00 Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 2 https://gerrit.sio2project.mimuw.edu.pl/2238 SIO-1217 Server now accepts testrun inputs packed as .zip files SIO-1589 Testrun now shows acceptable languages Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b

Hide

Permalink

Gerrit Gerrit added a comment - 2014-12-1 2:00

Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 1
https://gerrit.sio2project.mimuw.edu.pl/2239

~~SIO-1217~~ Allows for zipped inputs

Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab

Show

Gerrit Gerrit added a comment - 2014-12-1 2:00 Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 1 https://gerrit.sio2project.mimuw.edu.pl/2239 SIO-1217 Allows for zipped inputs Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab

Hide

Permalink

Gerrit Gerrit added a comment - 2014-12-1 12:57

Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 2
https://gerrit.sio2project.mimuw.edu.pl/2239

~~SIO-1217~~ Allows for zipped inputs

Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab

Show

Gerrit Gerrit added a comment - 2014-12-1 12:57 Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 2 https://gerrit.sio2project.mimuw.edu.pl/2239 SIO-1217 Allows for zipped inputs Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab

Hide

Permalink

Gerrit Gerrit added a comment - 2014-12-7 18:54

Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 3
https://gerrit.sio2project.mimuw.edu.pl/2238

~~SIO-1217~~ ~~SIO-1589~~ Server now accepts testrun inputs packed as .zip files

Archives are validated for safety as well as maximum file sizes compressed / decompressed.
base/util/archive.py now can return total uncompressed archive file size

Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b

Show

Gerrit Gerrit added a comment - 2014-12-7 18:54 Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 3 https://gerrit.sio2project.mimuw.edu.pl/2238 SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files Archives are validated for safety as well as maximum file sizes compressed / decompressed. base/util/archive.py now can return total uncompressed archive file size Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b

Hide

Permalink

Gerrit Gerrit added a comment - 2014-12-7 19:13

Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 3
https://gerrit.sio2project.mimuw.edu.pl/2239

~~SIO-1217~~ Allows for zipped inputs

Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab

Show

Gerrit Gerrit added a comment - 2014-12-7 19:13 Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 3 https://gerrit.sio2project.mimuw.edu.pl/2239 SIO-1217 Allows for zipped inputs Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab

Hide

Permalink

Gerrit Gerrit added a comment - 2014-12-17 16:56

Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 4
https://gerrit.sio2project.mimuw.edu.pl/2238

~~SIO-1217~~ ~~SIO-1589~~ Server now accepts testrun inputs packed as .zip files

Archives are validated for safety as well as maximum file sizes compressed / decompressed.
base/util/archive.py now can return total uncompressed archive file size

Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b

Show

Gerrit Gerrit added a comment - 2014-12-17 16:56 Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 4 https://gerrit.sio2project.mimuw.edu.pl/2238 SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files Archives are validated for safety as well as maximum file sizes compressed / decompressed. base/util/archive.py now can return total uncompressed archive file size Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b

Hide

Permalink

Gerrit Gerrit added a comment - 2014-12-17 17:06

Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 4
https://gerrit.sio2project.mimuw.edu.pl/2239

~~SIO-1217~~ Allows for zipped inputs

Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab

Show

Gerrit Gerrit added a comment - 2014-12-17 17:06 Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 4 https://gerrit.sio2project.mimuw.edu.pl/2239 SIO-1217 Allows for zipped inputs Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab

Hide

Permalink

Gerrit Gerrit added a comment - 2014-12-17 17:14

Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 5
https://gerrit.sio2project.mimuw.edu.pl/2238

~~SIO-1217~~ ~~SIO-1589~~ Server now accepts testrun inputs packed as .zip files

Archives are validated for safety as well as maximum file sizes compressed / decompressed.
base/util/archive.py now can return total uncompressed archive file size

Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b

Show

Gerrit Gerrit added a comment - 2014-12-17 17:14 Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 5 https://gerrit.sio2project.mimuw.edu.pl/2238 SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files Archives are validated for safety as well as maximum file sizes compressed / decompressed. base/util/archive.py now can return total uncompressed archive file size Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b

Hide

Permalink

Gerrit Gerrit added a comment - 2014-12-17 17:48

Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 6
https://gerrit.sio2project.mimuw.edu.pl/2238

~~SIO-1217~~ ~~SIO-1589~~ Server now accepts testrun inputs packed as .zip files

Archives are validated for safety as well as maximum file sizes compressed / decompressed.
base/util/archive.py now can return total uncompressed archive file size
When viewing testrun submissions, user won't be able to preview input if it's in zip -> we don't wanna extract it on server

Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b

Show

Gerrit Gerrit added a comment - 2014-12-17 17:48 Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 6 https://gerrit.sio2project.mimuw.edu.pl/2238 SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files Archives are validated for safety as well as maximum file sizes compressed / decompressed. base/util/archive.py now can return total uncompressed archive file size When viewing testrun submissions, user won't be able to preview input if it's in zip -> we don't wanna extract it on server Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b

Hide

Permalink

Gerrit Gerrit added a comment - 2014-12-17 18:03

Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 5
https://gerrit.sio2project.mimuw.edu.pl/2239

~~SIO-1217~~ Allows for zipped inputs

Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab

Show

Gerrit Gerrit added a comment - 2014-12-17 18:03 Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 5 https://gerrit.sio2project.mimuw.edu.pl/2239 SIO-1217 Allows for zipped inputs Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab

Hide

Permalink

Gerrit Gerrit added a comment - 2014-12-17 18:19

Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 7
https://gerrit.sio2project.mimuw.edu.pl/2238

~~SIO-1217~~ ~~SIO-1589~~ Server now accepts testrun inputs packed as .zip files

Archives are validated for safety as well as maximum file sizes compressed / decompressed.
base/util/archive.py now can return total uncompressed archive file size
When viewing testrun submissions, user won't be able to preview input if it's in zip -> we don't wanna extract it on server

Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b

Show

Gerrit Gerrit added a comment - 2014-12-17 18:19 Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 7 https://gerrit.sio2project.mimuw.edu.pl/2238 SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files Archives are validated for safety as well as maximum file sizes compressed / decompressed. base/util/archive.py now can return total uncompressed archive file size When viewing testrun submissions, user won't be able to preview input if it's in zip -> we don't wanna extract it on server Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b

Hide

Permalink

Gerrit Gerrit added a comment - 2014-12-17 21:20

Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 8
https://gerrit.sio2project.mimuw.edu.pl/2238

~~SIO-1217~~ ~~SIO-1589~~ Server now accepts testrun inputs packed as .zip files

Archives are validated for safety as well as maximum file sizes compressed / decompressed.
base/util/archive.py now can return total uncompressed archive file size
When viewing testrun submissions, user won't be able to preview input if it's in zip -> we don't wanna extract it on server

Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b

Show

Gerrit Gerrit added a comment - 2014-12-17 21:20 Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 8 https://gerrit.sio2project.mimuw.edu.pl/2238 SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files Archives are validated for safety as well as maximum file sizes compressed / decompressed. base/util/archive.py now can return total uncompressed archive file size When viewing testrun submissions, user won't be able to preview input if it's in zip -> we don't wanna extract it on server Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b

Hide

Permalink

Gerrit Gerrit added a comment - 2014-12-23 5:58

Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 9
https://gerrit.sio2project.mimuw.edu.pl/2238

~~SIO-1217~~ ~~SIO-1589~~ Server now accepts testrun inputs packed as .zip files

Archives are validated for safety as well as maximum file sizes compressed / decompressed.
base/util/archive.py now can return total uncompressed archive file size
When viewing testrun submissions, user won't be able to preview input if it's in zip -> we don't wanna extract it on server

Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b

Show

Gerrit Gerrit added a comment - 2014-12-23 5:58 Change Ic0e1270b70a9894034713273cc3754b8402b664b, patchset 9 https://gerrit.sio2project.mimuw.edu.pl/2238 SIO-1217 SIO-1589 Server now accepts testrun inputs packed as .zip files Archives are validated for safety as well as maximum file sizes compressed / decompressed. base/util/archive.py now can return total uncompressed archive file size When viewing testrun submissions, user won't be able to preview input if it's in zip -> we don't wanna extract it on server Change-Id: Ic0e1270b70a9894034713273cc3754b8402b664b

Hide

Permalink

Gerrit Gerrit added a comment - 2014-12-23 7:56

Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 6
https://gerrit.sio2project.mimuw.edu.pl/2239

~~SIO-1217~~ Allows for zipped inputs

Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab

Show

Gerrit Gerrit added a comment - 2014-12-23 7:56 Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 6 https://gerrit.sio2project.mimuw.edu.pl/2239 SIO-1217 Allows for zipped inputs Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab

Hide

Permalink

Gerrit Gerrit added a comment - 2014-12-28 4:01

Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 7
https://gerrit.sio2project.mimuw.edu.pl/2239

~~SIO-1217~~ Allows for zipped inputs

Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab

Show

Gerrit Gerrit added a comment - 2014-12-28 4:01 Change I25ac6b75dff124b2255d9760df0eb2d6d79582ab, patchset 7 https://gerrit.sio2project.mimuw.edu.pl/2239 SIO-1217 Allows for zipped inputs Change-Id: I25ac6b75dff124b2255d9760df0eb2d6d79582ab

Olaf Tomalka made changes - 2014-12-28 16:06

Status	Open [ 1 ]	Resolved [ 5 ]
Assignee	Olaf Tomalka [ ritave ]	Szymon Acedański [ accek ]
Resolution		Fixed [ 1 ]

Szymon Acedański made changes - 2015-10-15 19:07

Fix Version/s		TAG 2014/15 [ 12303 ]
Fix Version/s	Sprint 2/2014 [ 12004 ]

Szymon Acedański made changes - 2019-03-26 16:38

Status

Resolved [ 5 ]

Closed [ 6 ]

Transition

Time In Source Status

Execution Times

Last Executer

Last Execution Date

New

Open

210d 16h 34m

Szymon Acedański

2013-10-5 18:18

Open

Resolved

448d 22h 47m

Olaf Tomalka

2014-12-28 16:06

Resolved

Closed

1549d 31m

Szymon Acedański

2019-03-26 16:38

People

Assignee:

Szymon Acedański

Reporter:

Maciej Matraszek

TAG Reviewer:

Bartosz Stebel

Votes:

0 Vote for this issue

Watchers:

1 Start watching this issue

Dates

Created:

2013-03-9 0:43

Updated:

2019-03-26 16:38

Resolved:

2014-12-28 16:06

Agile

View on Board