Revisions of duperemove

buildservice-autocommit accepted request 1129022 from Dirk Mueller's avatar Dirk Mueller (dirkmueller) (revision 69)
baserev update by copy to link target
Dirk Mueller's avatar Dirk Mueller (dirkmueller) accepted request 1128968 from Michael Vetter's avatar Michael Vetter (jubalh) (revision 68)
- Update to 0.14.1:
  * file_scan: satisfy clang CFI
  * file_scan: walk_dir: improve rootfs support
  * dbfile: get_duplicate_files: exclude inlined files before
    looking for duplicates
  * filerec: fiemap_scan_extent: fix typo: we must check the
    return from get_extent
buildservice-autocommit accepted request 1127570 from Dirk Mueller's avatar Dirk Mueller (dirkmueller) (revision 67)
baserev update by copy to link target
Dirk Mueller's avatar Dirk Mueller (dirkmueller) accepted request 1127541 from Michael Vetter's avatar Michael Vetter (jubalh) (revision 66)
- Update to 0.14:
  * Batching has been reimplemented on top of the dedupe_seq.
  * The "scan" phase has been reimplemented (see 8264336 for details).
  * Filesystem locking has been implemented. See f3947e9 for details.
buildservice-autocommit accepted request 1114344 from David Sterba's avatar David Sterba (dsterba) (revision 65)
baserev update by copy to link target
David Sterba's avatar David Sterba (dsterba) accepted request 1114307 from Michael Vetter's avatar Michael Vetter (jubalh) (revision 64)
- Update to 0.13:
  * Add a new dedupe option: [no]rescan_files. It will increase
    performance in some use cases.
  * New behaviors from v0.12 has been consolidated. Extent-based
    lookup is always enabled, as is fiemap. The v2
    hashfile is no longer supported.
  * Hashfile are now updated after deduplication, to reflect the
    new physical offsets. This avoid (re)deduplicating extents
    in some cases.
  * Partial mode has been enhanced to support batching. The
    overall performance of this mode (which was previously known
    as "block-based mode") has been improved.
  * All files are now open in readonly mode.
  * Hashfile version has been increased to reflect the new
    database behaviors. Previous hashfiles are not compatible.
  * Always compute a hash for the entire file. This let us
    deduplicate same files easily, regardless of their
    extents mappings.
  * Deduplicating only parts of a file can be disabled using
    the [no]only_whole_files dedupe option.
  * Hashfiles with unsupported features or hash algorithm are
    now recreated transparently. Migration of the old content
    is not implemented.
  * Relative exclude patterns are no longer silently ingested.
    Such patterns are now rebuilt on top of the current
    working directory.
  * Batching is now set to 1024 by default.
buildservice-autocommit accepted request 1112021 from David Sterba's avatar David Sterba (dsterba) (revision 63)
baserev update by copy to link target
buildservice-autocommit accepted request 1099122 from David Sterba's avatar David Sterba (dsterba) (revision 61)
baserev update by copy to link target
David Sterba's avatar David Sterba (dsterba) accepted request 1099030 from Michael Vetter's avatar Michael Vetter (jubalh) (revision 60)
- Update to 0.12:
  * Duplication lookup is now based on extents. This leads to a
    massive increase of the performances. Block-based lookup is
    still possible via --dedupe-options=partial.
  * Following that change, a new hashfile format has been introduced.
    Previous hashfile format is still supported when extents lookup
    are disabled, this is not recommended.
  * Batching has been implemented. When enabled with the -B <batchsize>
    option, duperemove will run the deduplication phase every <batchsize>
    scanned files. This is meant to help running duperemove on large
    dataset, with small blocksize, or on memory-constrained systems.
  * All hash algorithm has been removed and replaced by xxh128. This
    variant is as robust as murmur3 while being faster. Choosing a
    hash function via the --hash option has been removed. Hashfiles
    built with other algorithm must be removed.
Dirk Mueller's avatar Dirk Mueller (dirkmueller) accepted request 951355 from Michael Vetter's avatar Michael Vetter (jubalh) (revision 59)
- Update to 0.11.3:
  * Increase open file limit. (#269)
  * Create hash database file with 600 permission for improved
    security. (#262)
  * Read more data per pread, for v2 hashfile format this reduces
    the overall number of syscalls made which in turns results
    in better performance.
  * Fix truncated file handling, eliminating a an infinite
    loop case. (#255)
buildservice-autocommit accepted request 846202 from David Sterba's avatar David Sterba (dsterba) (revision 58)
baserev update by copy to link target
David Sterba's avatar David Sterba (dsterba) accepted request 846138 from Nikolay Borisov's avatar Nikolay Borisov (nikbor) (revision 57)
- Update to v0.11.2
  - Improved detection of hyperthreading
  - Multiple minor fixes and cleanups
  - Updated xxhash algorithm to latest release
  - Fixed extent collision handling
  - Fix overflow scanning in extents
buildservice-autocommit accepted request 819289 from David Sterba's avatar David Sterba (dsterba) (revision 56)
baserev update by copy to link target
David Sterba's avatar David Sterba (dsterba) accepted request 814537 from Martin Pluskal's avatar Martin Pluskal (pluskalm) (revision 55)
- Fix building with gcc10
buildservice-autocommit accepted request 654118 from Mark Fasheh's avatar Mark Fasheh (mfasheh) (revision 54)
baserev update by copy to link target
Mark Fasheh's avatar Mark Fasheh (mfasheh) accepted request 654107 from Mark Fasheh's avatar Mark Fasheh (mfasheh) (revision 53)
- Use source tarball from github
Mark Fasheh's avatar Mark Fasheh (mfasheh) accepted request 653159 from Mark Fasheh's avatar Mark Fasheh (mfasheh) (revision 52)
- Update to v0.11.1
  - Add 'quiet' mode - duperemove will only print errors and a
    short summary of any dedupe.
  - Revert block dedupe default, it is causing excessive
    fragmentation on users systems.
Dirk Mueller's avatar Dirk Mueller (dirkmueller) accepted request 607705 from Mark Fasheh's avatar Mark Fasheh (mfasheh) (revision 51)
- Update to v0.11
  - Fix a minor fd leak in hyperthreading detection code
  - Clean up some typos in documentation
  - Some build fixes
  - Removed patch: v0.11.beta4_to_git_f95e429.patch
buildservice-autocommit accepted request 432126 from Mark Fasheh's avatar Mark Fasheh (mfasheh) (revision 50)
baserev update by copy to link target
Displaying revisions 1 - 20 of 69
openSUSE Build Service is sponsored by