The SIO2 project
  1. The SIO2 project
  2. SIO-1424

Nonzero exit code of output checker should trigger System Error

    Details

      Description

      Rationale:
      1. If the output checker crashes, we *really* want to be informed asap.
      2. This would give a way of reporting errors like "the contestant's output is correct and better than model output".

      Unfortunately, some checkers use exit code = 1 to report wrong answer. A possible workaround is to trigger System Error iff exit code >= 2.

        Activity

        Hide
        Gerrit Gerrit added a comment -
        Change I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e, patchset 8
        https://gerrit.sio2project.mimuw.edu.pl/2000

        SIO-1424 Nonzero exit code of output checker should trigger System Error

        Change-Id: I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e
        Show
        Gerrit Gerrit added a comment - Change I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e, patchset 8 https://gerrit.sio2project.mimuw.edu.pl/2000 SIO-1424 Nonzero exit code of output checker should trigger System Error Change-Id: I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e
        Hide
        Gerrit Gerrit added a comment -
        Change I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e, patchset 9
        https://gerrit.sio2project.mimuw.edu.pl/2000

        SIO-1424 Nonzero exit code of output checker should trigger System Error

        Change-Id: I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e
        Show
        Gerrit Gerrit added a comment - Change I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e, patchset 9 https://gerrit.sio2project.mimuw.edu.pl/2000 SIO-1424 Nonzero exit code of output checker should trigger System Error Change-Id: I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e
        Hide
        Gerrit Gerrit added a comment -
        Change I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e, patchset 10
        https://gerrit.sio2project.mimuw.edu.pl/2000

        SIO-1424 Nonzero exit code of output checker should trigger System Error

        Change-Id: I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e
        Show
        Gerrit Gerrit added a comment - Change I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e, patchset 10 https://gerrit.sio2project.mimuw.edu.pl/2000 SIO-1424 Nonzero exit code of output checker should trigger System Error Change-Id: I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e
        Hide
        Gerrit Gerrit added a comment -
        Change I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e, patchset 11
        https://gerrit.sio2project.mimuw.edu.pl/2000

        SIO-1424 Nonzero exit code of output checker should trigger System Error

        Change-Id: I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e
        Show
        Gerrit Gerrit added a comment - Change I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e, patchset 11 https://gerrit.sio2project.mimuw.edu.pl/2000 SIO-1424 Nonzero exit code of output checker should trigger System Error Change-Id: I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e
        Hide
        Gerrit Gerrit added a comment -
        Change I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e, patchset 12
        https://gerrit.sio2project.mimuw.edu.pl/2000

        SIO-1424 Nonzero exit code of output checker should trigger System Error

        Change-Id: I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e
        Show
        Gerrit Gerrit added a comment - Change I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e, patchset 12 https://gerrit.sio2project.mimuw.edu.pl/2000 SIO-1424 Nonzero exit code of output checker should trigger System Error Change-Id: I6e418b42ce88c8e5a4a6a1eee9f85881b4d0076e

          People

          • Assignee:
            Szymon Acedański
            Reporter:
            Kuba Łącki
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: