The SIO2 project
  1. The SIO2 project
  2. SIO-1754

Compare timelimits on main.edu.pl and oitimetool

    Details

    • Type: Task Task
    • Status: Closed Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: Current Version
    • Fix Version/s: TAG 2015/16
    • Component/s: OIOIOI
    • Labels:

      Description

      Create Google Doc with comparison of execution times of few solutions/problems under oitimetool and under standard main.edu.pl checker.

        Activity

        Sebastian Jaszczur made changes -
        Field Original Value New Value
        Assignee Sebastian Jaszczur [ jaszczur ]
        Piotr Wiśniewski made changes -
        Fix Version/s TAG 2015/16 Sprint 1 [ 12400 ]
        Affects Version/s Current Version [ 11000 ]
        Affects Version/s TAG 2015/16 Sprint 1 [ 12400 ]
        Sebastian Jaszczur made changes -
        Attachment runnigtimechart.png [ 12847 ]
        Hide
        Sebastian Jaszczur added a comment -
        I won't create a doc; comment here, along with attachment (runnigtimechart.png) should be enough.

        I've run (manually) 9 different solutions for different problems on all problems' tests. It looks promising - timelimits will probably stay the same (see the line "y = x"). But I've encountered one solution (for problem Kurierzy) when szkopuł showed much larger running times than oitimetool - but relationship is still linear. Probably in this problem cache is more important (and oitimetool assumes infinite cache).

        It's worth noticing that even if we'd apply y=x scaling to Kurierzy problem - we'd effectively make tests easier. That means that still every golden solution will pass - and we'd have problems only with sub-optimal solutions getting too many points. But that's relatively small problem and it could be even acceptable to leave scaling as y=x.

        We'll create a script for running one golden solution from every public problem just to check how many anomalies are out there. But it seems like linear scaling will be OK (or, really - no scaling at all). But that's another ticket.
        Show
        Sebastian Jaszczur added a comment - I won't create a doc; comment here, along with attachment (runnigtimechart.png) should be enough. I've run (manually) 9 different solutions for different problems on all problems' tests. It looks promising - timelimits will probably stay the same (see the line "y = x"). But I've encountered one solution (for problem Kurierzy) when szkopuł showed much larger running times than oitimetool - but relationship is still linear. Probably in this problem cache is more important (and oitimetool assumes infinite cache). It's worth noticing that even if we'd apply y=x scaling to Kurierzy problem - we'd effectively make tests easier. That means that still every golden solution will pass - and we'd have problems only with sub-optimal solutions getting too many points. But that's relatively small problem and it could be even acceptable to leave scaling as y=x. We'll create a script for running one golden solution from every public problem just to check how many anomalies are out there. But it seems like linear scaling will be OK (or, really - no scaling at all). But that's another ticket.
        Sebastian Jaszczur made changes -
        TAG Reviewer Wojciech Jabłoński [ quinor ]
        Sebastian Jaszczur made changes -
        TAG Reviewer Wojciech Jabłoński [ quinor ] Piotr Wiśniewski [ wisniak199 ]
        Hide
        Piotr Wiśniewski added a comment -
        +1
        Show
        Piotr Wiśniewski added a comment - +1
        Sebastian Jaszczur made changes -
        Status New [ 10000 ] Resolved [ 5 ]
        Assignee Sebastian Jaszczur [ jaszczur ] Szymon Acedański [ accek ]
        Resolution Fixed [ 1 ]
        Szymon Acedański made changes -
        Fix Version/s TAG 2015/16 [ 12500 ]
        Fix Version/s TAG 2015/16 Sprint 1 [ 12400 ]
        Szymon Acedański made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        New New Resolved Resolved
        21d 1h 26m 1 Sebastian Jaszczur 2016-04-13 17:19
        Resolved Resolved Closed Closed
        1077d 17m 1 Szymon Acedański 2019-03-26 16:36

          People

          • Assignee:
            Szymon Acedański
            Reporter:
            Sebastian Jaszczur
            TAG Reviewer:
            Piotr Wiśniewski
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: