Details
-
Type:
Task
-
Status:
Closed
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: Current Version
-
Fix Version/s: TAG 2015/16
-
Component/s: OIOIOI
-
Labels:
Description
Need to check all public problems available in problemset for anomalies in szkopuł/oitimetool running times ratio.
Especially I expect some problems to have longer running times on szkopuł than oitimetool, but most of them should have ratio around 1:1.
Analysis of small sample (9 solutions/problems):SIO-1754
The goal is to identify problems which timelimits should be scaled with something else than 1 and compute better ratio for them.
Another goal is to generate chart like inSIO-1754 .
Especially I expect some problems to have longer running times on szkopuł than oitimetool, but most of them should have ratio around 1:1.
Analysis of small sample (9 solutions/problems):
The goal is to identify problems which timelimits should be scaled with something else than 1 and compute better ratio for them.
Another goal is to generate chart like in
Issue Links
- blocks
-
SIO-1812
Switch to oitimetool on szkopuł
-
Activity
Sebastian Jaszczur
made changes -
| Field | Original Value | New Value |
|---|---|---|
| Description | Need to check all public problems |
Sebastian Jaszczur
made changes -
| Description | Need to check all public problems |
Need to check all public problems available in problemset for anomalies in szkopuł/oitimetool running times ratio.
Especially I expect some problems to have longer running times on szkopuł than oitimetool, but most of them should have ratio around 1:1. Analysis of small sample (9 solutions/problems): https://jira.sio2project.mimuw.edu.pl/browse/SIO-1754 The goal is to identify |
Sebastian Jaszczur
made changes -
| Description |
Need to check all public problems available in problemset for anomalies in szkopuł/oitimetool running times ratio.
Especially I expect some problems to have longer running times on szkopuł than oitimetool, but most of them should have ratio around 1:1. Analysis of small sample (9 solutions/problems): https://jira.sio2project.mimuw.edu.pl/browse/SIO-1754 The goal is to identify |
Need to check all public problems available in problemset for anomalies in szkopuł/oitimetool running times ratio.
Especially I expect some problems to have longer running times on szkopuł than oitimetool, but most of them should have ratio around 1:1. Analysis of small sample (9 solutions/problems): https://jira.sio2project.mimuw.edu.pl/browse/SIO-1754 The goal is to identify problems which timelimits should be scaled with something other than 1 and compute good ratio for them. Also generate chart like in previous task. |
Sebastian Jaszczur
made changes -
| Description |
Need to check all public problems available in problemset for anomalies in szkopuł/oitimetool running times ratio.
Especially I expect some problems to have longer running times on szkopuł than oitimetool, but most of them should have ratio around 1:1. Analysis of small sample (9 solutions/problems): https://jira.sio2project.mimuw.edu.pl/browse/SIO-1754 The goal is to identify problems which timelimits should be scaled with something other than 1 and compute good ratio for them. Also generate chart like in previous task. |
Need to check all public problems available in problemset for anomalies in szkopuł/oitimetool running times ratio.
Especially I expect some problems to have longer running times on szkopuł than oitimetool, but most of them should have ratio around 1:1. Analysis of small sample (9 solutions/problems): https://jira.sio2project.mimuw.edu.pl/browse/SIO-1754 The goal is to identify problems which timelimits should be scaled with something else than 1 and compute good ratio for them. Also generate chart like in previous task. |
Sebastian Jaszczur
made changes -
| Description |
Need to check all public problems available in problemset for anomalies in szkopuł/oitimetool running times ratio.
Especially I expect some problems to have longer running times on szkopuł than oitimetool, but most of them should have ratio around 1:1. Analysis of small sample (9 solutions/problems): https://jira.sio2project.mimuw.edu.pl/browse/SIO-1754 The goal is to identify problems which timelimits should be scaled with something else than 1 and compute good ratio for them. Also generate chart like in previous task. |
Need to check all public problems available in problemset for anomalies in szkopuł/oitimetool running times ratio.
Especially I expect some problems to have longer running times on szkopuł than oitimetool, but most of them should have ratio around 1:1. Analysis of small sample (9 solutions/problems): https://jira.sio2project.mimuw.edu.pl/browse/SIO-1754 The goal is to identify problems which timelimits should be scaled with something else than 1 and compute better ratio for them. Another goal is to generate chart like in |
Sebastian Jaszczur
made changes -
| Description |
Need to check all public problems available in problemset for anomalies in szkopuł/oitimetool running times ratio.
Especially I expect some problems to have longer running times on szkopuł than oitimetool, but most of them should have ratio around 1:1. Analysis of small sample (9 solutions/problems): https://jira.sio2project.mimuw.edu.pl/browse/SIO-1754 The goal is to identify problems which timelimits should be scaled with something else than 1 and compute better ratio for them. Another goal is to generate chart like in |
Need to check all public problems available in problemset for anomalies in szkopuł/oitimetool running times ratio.
Especially I expect some problems to have longer running times on szkopuł than oitimetool, but most of them should have ratio around 1:1. Analysis of small sample (9 solutions/problems): The goal is to identify problems which timelimits should be scaled with something else than 1 and compute better ratio for them. Another goal is to generate chart like in |
Sebastian Jaszczur
made changes -
Sebastian Jaszczur
made changes -
| Attachment | oitimetool_times.png [ 12978 ] |
Sebastian Jaszczur
made changes -
| Status | New [ 10000 ] | Resolved [ 5 ] |
| Assignee | Sebastian Jaszczur [ jaszczur ] | Szymon Acedański [ accek ] |
| Resolution | Done [ 6 ] |
Sebastian Jaszczur
made changes -
| Attachment | oitimetool_times2.png [ 12979 ] |
Sebastian Jaszczur
made changes -
| Attachment | oitimetool_times.png [ 12978 ] |
Raw scripts used to generate results and chart.
Show
Sebastian Jaszczur
added a comment - Raw scripts used to generate results and chart.
Sebastian Jaszczur
added a comment - Raw scripts used to generate results and chart. Sebastian Jaszczur
made changes -
| Attachment | chart.py [ 12980 ] | |
| Attachment | oitimrunner.py [ 12981 ] |
Szymon Acedański
made changes -
| Fix Version/s | TAG 2015/16 [ 12500 ] | |
| Fix Version/s | TAG 2015/16 Sprint 2 [ 12401 ] |
Szymon Acedański
made changes -
| Status | Resolved [ 5 ] | Closed [ 6 ] |
| Transition | Time In Source Status | Execution Times | Last Executer | Last Execution Date | |||||
|---|---|---|---|---|---|---|---|---|---|
|
42d 10m | 1 | Sebastian Jaszczur | 2016-05-25 17:18 | |||||
|
1035d 21m | 1 | Szymon Acedański | 2019-03-26 16:39 |
It's worth noticing that 17 problems have similar problems already (but it's not the subset of previous problems; they share 5 elements).
From those 22 problems:
2 were some kind of bugs and oitimetool gave time of around 20 minutes when timelimit (and original runtime) was around few seconds. I don't know why this has happened, though.
15 of them would lose max 3 points.
3 of them would lose 5-6 points.
1 would lose around 14 points.
1 would lose around 23 points.
So generally it's not so bad and with Accek we've agreed on scaling timelimits 1:1, as it's fairly OK and it's effortless. To those few problems that may lose some points - we will create a tool for searching for them, probably available from manage.py. Ticket:
SIO-1819