Details
-
Type: Task
-
Status: Closed
-
Priority: Major
-
Resolution: Fixed
-
Affects Version/s: Current Version
-
Fix Version/s: TAG 2015/16
-
Component/s: OIOIOI
-
Labels:
Description
Create Google Doc with comparison of execution times of few solutions/problems under oitimetool and under standard main.edu.pl checker.
Activity
Sebastian Jaszczur
made changes -
Field | Original Value | New Value |
---|---|---|
Assignee | Sebastian Jaszczur [ jaszczur ] |
Piotr Wiśniewski
made changes -
Fix Version/s | TAG 2015/16 Sprint 1 [ 12400 ] | |
Affects Version/s | Current Version [ 11000 ] | |
Affects Version/s | TAG 2015/16 Sprint 1 [ 12400 ] |
Sebastian Jaszczur
made changes -
Attachment | runnigtimechart.png [ 12847 ] |
Sebastian Jaszczur
made changes -
TAG Reviewer | Wojciech Jabłoński [ quinor ] |
Sebastian Jaszczur
made changes -
TAG Reviewer | Wojciech Jabłoński [ quinor ] | Piotr Wiśniewski [ wisniak199 ] |
Sebastian Jaszczur
made changes -
Status | New [ 10000 ] | Resolved [ 5 ] |
Assignee | Sebastian Jaszczur [ jaszczur ] | Szymon Acedański [ accek ] |
Resolution | Fixed [ 1 ] |
Szymon Acedański
made changes -
Fix Version/s | TAG 2015/16 [ 12500 ] | |
Fix Version/s | TAG 2015/16 Sprint 1 [ 12400 ] |
Szymon Acedański
made changes -
Status | Resolved [ 5 ] | Closed [ 6 ] |
Transition | Time In Source Status | Execution Times | Last Executer | Last Execution Date | |||||
---|---|---|---|---|---|---|---|---|---|
|
21d 1h 26m | 1 | Sebastian Jaszczur | 2016-04-13 17:19 | |||||
|
1077d 17m | 1 | Szymon Acedański | 2019-03-26 16:36 |
I've run (manually) 9 different solutions for different problems on all problems' tests. It looks promising - timelimits will probably stay the same (see the line "y = x"). But I've encountered one solution (for problem Kurierzy) when szkopuł showed much larger running times than oitimetool - but relationship is still linear. Probably in this problem cache is more important (and oitimetool assumes infinite cache).
It's worth noticing that even if we'd apply y=x scaling to Kurierzy problem - we'd effectively make tests easier. That means that still every golden solution will pass - and we'd have problems only with sub-optimal solutions getting too many points. But that's relatively small problem and it could be even acceptable to leave scaling as y=x.
We'll create a script for running one golden solution from every public problem just to check how many anomalies are out there. But it seems like linear scaling will be OK (or, really - no scaling at all). But that's another ticket.