The SIO2 project
  1. The SIO2 project
  2. SIO-2063

File compression in filetracker

        Details

        • Type: Improvement Improvement
        • Status: Closed Closed
        • Priority: Major Major
        • Resolution: Fixed
        • Affects Version/s: Current Version
        • Fix Version/s: None
        • Component/s: Filetracker
        • Labels:
          None

          Description

          Szkopuł filetracker's database weights a lot (hundreds of GB). After compressing it with xz (LZMA2), the size is reduced 2-4 times AFAIR.

          Objective is to store files in filetracker compressed with xz.
          Extra objective: compare what occupies more space - compressed file or not compressed version of same file. Some directories gain weight from hundreds of MB to some GB - what is against logic since xz header is 10-100B I guess while the disk block size should be 4 kB (maybe there were a lot of empty files?).

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            Pavel Senchanka added a comment -
            This was implemented in filetracker 2.x, though gzip compression was used because of its native support by HTTP clients. See SIO-2089 for some preliminary stats.
            Show
            Pavel Senchanka added a comment - This was implemented in filetracker 2.x, though gzip compression was used because of its native support by HTTP clients. See SIO-2089 for some preliminary stats.
            Pavel Senchanka made changes -
            Field Original Value New Value
            Status New [ 10000 ] Resolved [ 5 ]
            Assignee Szymon Acedański [ accek ]
            Resolution Fixed [ 1 ]
            Szymon Acedański made changes -
            Status Resolved [ 5 ] Closed [ 6 ]
            Transition Time In Source Status Execution Times Last Executer Last Execution Date
            New New Resolved Resolved
            		91d 15h 47m 1 Pavel Senchanka 2018-05-28 13:27
            Resolved Resolved Closed Closed
            		302d 4h 11m 1 Szymon Acedański 2019-03-26 16:39

              People

              • Assignee:
                Szymon Acedański
                Reporter:
                Artur Jamro
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: