The SIO2 project
  1. The SIO2 project
  2. SIO-2144

"Export submissions" timing out with big archives

        Details

        • Type: Bug Bug
        • Status: Reopened Reopened
        • Priority: Minor Minor
        • Resolution: Unresolved
        • Affects Version/s: Current Version
        • Fix Version/s: None
        • Component/s: OIOIOI
        • Labels:
          None

          Description

          When you try to export submissions, it will take a long time to generate an archive, and before OIOIOI starts sending it, it is likely that either a reverse proxy or the browser will time out.

          One way to fix this would be to generate the archive asynchronously, and immediately send a response to the user stating that the archive will be available shortly. When the user refreshes the page, and the archive is already ready, the page will show a download link to the archive instead.

          Another way could possibly be to start streaming the response while the archive is still being generated. Theoretically, tar should be capable of that. Not sure about Django.

            Issue Links

            is duplicated by

            Bug - A problem which impairs or prevents the functions of the product. SIO-2392 Exportszu times out

            • Major - Major loss of function.
            • New - The issue is new and has not been looked at.

              Activity

              Ascending order - Click to sort in descending order
              Hide
              Permalink
              Szymon Acedański added a comment -
              This issue has been automatically closed as Obsolete due to no activity for 365 days.

              Feel free to reopen it or create a new one if it's still relevant.
              Show
              Szymon Acedański added a comment - This issue has been automatically closed as Obsolete due to no activity for 365 days. Feel free to reopen it or create a new one if it's still relevant.
              Hide
              Permalink
              Michał Sidor added a comment -
              @kostka reports that this is still a desired feature
              Show
              Michał Sidor added a comment - @kostka reports that this is still a desired feature
              Hide
              Permalink
              Michał Sidor added a comment -
              About that, Django is definitely capable of streaming responses, there's a ridiculous/lovely hack recommended by the documentation https://docs.djangoproject.com/en/2.2/howto/outputting-csv/#streaming-csv-files
              Show
              Michał Sidor added a comment - About that, Django is definitely capable of streaming responses, there's a ridiculous/lovely hack recommended by the documentation https://docs.djangoproject.com/en/2.2/howto/outputting-csv/#streaming-csv-files

                People

                • Assignee:
                  Unassigned
                  Reporter:
                  Wojciech Dubiel
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  3 Start watching this issue

                  Dates

                  • Created:
                    Updated: