Sign Up
Log In
Log In
or
Sign Up
Places
All Projects
Status Monitor
Collapse sidebar
openSUSE
duperemove
duperemove.changes
Overview
Repositories
Revisions
Requests
Users
Attributes
Meta
File duperemove.changes of Package duperemove
------------------------------------------------------------------- Sun Nov 26 18:28:03 UTC 2023 - Michael Vetter <mvetter@suse.com> - Update to 0.14.1: * file_scan: satisfy clang CFI * file_scan: walk_dir: improve rootfs support * dbfile: get_duplicate_files: exclude inlined files before looking for duplicates * filerec: fiemap_scan_extent: fix typo: we must check the return from get_extent ------------------------------------------------------------------- Sun Nov 19 09:04:53 UTC 2023 - Michael Vetter <mvetter@suse.com> - Update to 0.14: * Batching has been reimplemented on top of the dedupe_seq. * The "scan" phase has been reimplemented (see 8264336 for details). * Filesystem locking has been implemented. See f3947e9 for details. ------------------------------------------------------------------- Fri Sep 29 10:11:12 UTC 2023 - Michael Vetter <mvetter@suse.com> - Update to 0.13: * Add a new dedupe option: [no]rescan_files. It will increase performance in some use cases. * New behaviors from v0.12 has been consolidated. Extent-based lookup is always enabled, as is fiemap. The v2 hashfile is no longer supported. * Hashfile are now updated after deduplication, to reflect the new physical offsets. This avoid (re)deduplicating extents in some cases. * Partial mode has been enhanced to support batching. The overall performance of this mode (which was previously known as "block-based mode") has been improved. * All files are now open in readonly mode. * Hashfile version has been increased to reflect the new database behaviors. Previous hashfiles are not compatible. * Always compute a hash for the entire file. This let us deduplicate same files easily, regardless of their extents mappings. * Deduplicating only parts of a file can be disabled using the [no]only_whole_files dedupe option. * Hashfiles with unsupported features or hash algorithm are now recreated transparently. Migration of the old content is not implemented. * Relative exclude patterns are no longer silently ingested. Such patterns are now rebuilt on top of the current working directory. * Batching is now set to 1024 by default. ------------------------------------------------------------------- Thu Sep 14 08:14:47 UTC 2023 - pgajdos@suse.com - build for 15 ------------------------------------------------------------------- Mon Jul 17 05:45:51 UTC 2023 - Michael Vetter <mvetter@suse.com> - Update to 0.12: * Duplication lookup is now based on extents. This leads to a massive increase of the performances. Block-based lookup is still possible via --dedupe-options=partial. * Following that change, a new hashfile format has been introduced. Previous hashfile format is still supported when extents lookup are disabled, this is not recommended. * Batching has been implemented. When enabled with the -B <batchsize> option, duperemove will run the deduplication phase every <batchsize> scanned files. This is meant to help running duperemove on large dataset, with small blocksize, or on memory-constrained systems. * All hash algorithm has been removed and replaced by xxh128. This variant is as robust as murmur3 while being faster. Choosing a hash function via the --hash option has been removed. Hashfiles built with other algorithm must be removed. ------------------------------------------------------------------- Thu Feb 3 16:48:27 UTC 2022 - Michael Vetter <mvetter@suse.com> - Update to 0.11.3: * Increase open file limit. (#269) * Create hash database file with 600 permission for improved security. (#262) * Read more data per pread, for v2 hashfile format this reduces the overall number of syscalls made which in turns results in better performance. * Fix truncated file handling, eliminating a an infinite loop case. (#255) ------------------------------------------------------------------- Thu Nov 5 07:38:15 UTC 2020 - Nikolay Borisov <nborisov@suse.com> - Update to v0.11.2 - Improved detection of hyperthreading - Multiple minor fixes and cleanups - Updated xxhash algorithm to latest release - Fixed extent collision handling - Fix overflow scanning in extents ------------------------------------------------------------------- Sun Jun 14 08:05:24 UTC 2020 - Martin Pluskal <mpluskal@suse.com> - Fix building with gcc10 ------------------------------------------------------------------- Tue Dec 4 20:59:22 UTC 2018 - mfasheh@suse.com - Use source tarball from github ------------------------------------------------------------------- Fri Nov 30 22:04:37 UTC 2018 - mfasheh@suse.com - Update to v0.11.1 - Add 'quiet' mode - duperemove will only print errors and a short summary of any dedupe. - Revert block dedupe default, it is causing excessive fragmentation on users systems. ------------------------------------------------------------------- Tue May 15 20:05:26 UTC 2018 - mfasheh@suse.com - Update to v0.11 - Fix a minor fd leak in hyperthreading detection code - Clean up some typos in documentation - Some build fixes - Removed patch: v0.11.beta4_to_git_f95e429.patch ------------------------------------------------------------------- Fri Sep 30 20:05:02 UTC 2016 - mark@fasheh.com - Update to v0.11.beta4 git commit f95e429 * Use proper len of tail blocks during block dedupe * run_dedupe: avoid size_list corruption in push_blocks() - Added patch: v0.11.beta4_to_git_f95e429.patch ------------------------------------------------------------------- Tue Sep 27 20:41:37 UTC 2016 - mfasheh@suse.com - Update to duperemove v0.11.beta4 - Many man page and FAQ updates - Much lower memory usage (changed to use block-dedupe by default) - removed unused sha256 module ------------------------------------------------------------------- Fri Sep 16 19:49:06 UTC 2016 - mfasheh@suse.com - Update to duperemove v0.11.beta3 - Bugfixes - Large (2.5x) performance improvement to find dupes stage - Added '--cpu-threads' for user control of cpu bound tasks ------------------------------------------------------------------- Fri Sep 9 21:39:39 UTC 2016 - mfasheh@suse.com - Update to duperemove v0.11.beta2 - Many bugfixes - Improved dedupe coverage with better extent selection algorithm - Improved (easier to read) output for csum stage - Progress counter added for dedupe stage - Removed patch v0.11.beta1_to_git_d4b9818.patch - Removed patch v0.11-d4b9818_to_82234f5.patch ------------------------------------------------------------------- Fri Aug 26 20:02:21 UTC 2016 - mfasheh@suse.com - Update to v0.11.beta1 git commit 82234f5 - Set file->dedupe_seq if we drop out in add_file_db() - add_file_db(): collapse all cases of ino/subvol/filename being different - Simplify the logic in add_file_db() - add_file_db(): check for same filename in filerec table - Store filerecs in a tree by filename ------------------------------------------------------------------- Wed Aug 24 19:25:45 UTC 2016 - mfasheh@suse.com - Update to git commit d4b9818: - Set scan flag on renamed file - Remove db record if a file was renamed - More vprints in add_file_db() - Fix confused error handling in dbfile_load_one_filerec() - Return 0 if user specified --help - Don't list '-?' as a valid option - add_file_db() Properly account for __add_file() skipping a file - Add hashstats to the man page ------------------------------------------------------------------- Fri Aug 12 23:03:06 UTC 2016 - mfasheh@suse.com - Update to duperemove v0.11.beta1 - Greatly increased performance during extent search - Hashfiles are reusable now, Duperemove will only scan files which have changed since the last time it was run. - Better selection of target extent during dedupe - reduces fragmentation of deduped space - Support for dedupe on xfs (experimental) ------------------------------------------------------------------- Sat Apr 2 13:43:23 UTC 2016 - mpluskal@suse.com - Use pretty name for tarball - Cleanup spec file with spec-cleaner - Use pkgconfig style dependnencies ------------------------------------------------------------------- Fri Oct 9 22:37:04 UTC 2015 - mfasheh@suse.com - Update to duperemove v0.10 - Documentation updates for latest stable version - document --fdupes mode in manpage - update man page headers - update FAQ ------------------------------------------------------------------- Thu Jul 16 21:45:34 UTC 2015 - mfasheh@suse.com - Update to duperemove v0.10.beta4 - Better memory usage with hashstats utility ------------------------------------------------------------------- Fri Jul 10 19:53:46 UTC 2015 - mfasheh@suse.com - Update to duperemove v0.10.beta3 - fixes many crashes in the dedupe stage - fixed an issue with our alignment function which would throw dedupe into a loop - improvements to output formatting - better logic when throwing out already-deduped extents won't give as many false positives ------------------------------------------------------------------- Tue Jun 30 06:21:21 UTC 2015 - mfasheh@suse.com - Update to duperemove v0.10.beta2 - multi-threaded dedupe stage (increased performance) - hashfile mode for drastically improved memory consumption - now uses murmur3 hash internally for improved cpu usage - can now take input from 'fdupes' ------------------------------------------------------------------- Mon Apr 6 19:45:42 UTC 2015 - mfasheh@suse.com - Update with correct tarball (last one didn't have version number bump) ------------------------------------------------------------------- Mon Apr 6 19:14:50 UTC 2015 - mfasheh@suse.com - Update to duperemove v0.09.3 - Fix hang during file scan phase (bsc#926098) - References: bsc#926098 ------------------------------------------------------------------- Thu Mar 26 23:07:33 UTC 2015 - mfasheh@suse.com - Update to duperemove v0.09.2 - Now compiles on SLE11 targets - Fallback to stat on filesystems that don't report file type from readdir - Don't assert on failed open during dedupe - References: bsc#923277 bsc#924577 ------------------------------------------------------------------- Thu Mar 19 16:29:24 UTC 2015 - mfasheh@suse.com - Update to duperemove v0.09.1 - Fallback to stat on filesystems that don't report file type from readdir ------------------------------------------------------------------- Thu Jan 29 20:17:58 UTC 2015 - mfasheh@suse.com - Update to duperemove v0.09 - start with first node in free_compare_tree - fix small typos in duperemove man page - add test_progs variable in Makefile - References: bsc#915354 FATE#318171 - Removed patch: do-not-install-test-binary.patch ------------------------------------------------------------------- Tue Jan 20 10:02:26 UTC 2015 - tchvatal@suse.com - Cleanup a bit with spec-cleaner and fix few tiny issues - Use install phase from upstream Makefile - Move csum-test to test progs to prevent its install: * do-not-install-test-binary.patch ------------------------------------------------------------------- Tue Dec 9 04:12:43 UTC 2014 - mfasheh@suse.com - Update to duperemove v0.09.beta5 - Documentation updates - FAQ and README are more relevant now - added man pages for show-shared-extents and hashstats programs - updated duperemove man page, and duperemove usage() function - Have show-shared-extents take a file list as arguments. - Change default of --lookup-extents option back to 'no' - Write hash type into hashfile header, check against what hash we were compiled with. ------------------------------------------------------------------- Mon Nov 17 19:40:06 UTC 2014 - mfasheh@suse.com - Update to duperemove v0.09.beta3 - Fix leak of directory fd during file scan - Fix EMFILES (too many file descriptors) error during dedupe - Fix corner case with dedupe leaving a file open and not-queued - Support '-x' (one file system) option - Add option to turn off extent lookup during csum phase - Useful if running against snapshotted volumes - show-shared-extents program to help users examine file state before or after dedupe. ------------------------------------------------------------------- Mon Nov 10 14:49:27 UTC 2014 - schwab@suse.de - Build with %optflags ------------------------------------------------------------------- Fri Oct 31 02:44:53 UTC 2014 - mfasheh@suse.com - Update to duperemove v0.09.beta2 - fix memory leak - fix hardlink detection on btrfs - print file number status during csum phase - print a status bar during extent seearch - several bugfixes and performance improvements to extent search - Removed patch: 001-fix-build.patch ------------------------------------------------------------------- Sat Sep 27 00:18:33 UTC 2014 - mfasheh@suse.com - update to duperemove v0.09.beta1 - parallel checksum calculation - performance improvements - allow to store the hash tree to a file - hashstats: new utility to analyze hash files - add --version option - build: add install target - documentatin updates - Added patch: 001-fix-build.patch ------------------------------------------------------------------- Sun Apr 20 22:13:45 UTC 2014 - mfasheh@suse.com - update to duperemove v0.08 - fixes many bugs - a few more usability improvements - adds fiemap support to better estimate space savings ------------------------------------------------------------------- Fri Apr 11 17:38:32 UTC 2014 - mfasheh@suse.com - update to duperemove v0.07 - fix usability of command line arguments - large documentation update ------------------------------------------------------------------- Fri Apr 11 00:30:41 UTC 2014 - mfasheh@suse.com - update to duperemove v0.06. This adds several fixes and features: - fixes bnc#871804 (duperemove not looping on entire range) - also includes important usability fixes - updates hashing library to libgcrypt to reflect upstream ------------------------------------------------------------------- Wed Mar 12 06:43:13 UTC 2014 - mfasheh@suse.com - add duperemove rpm - add new tarball with manpages for all binaries ------------------------------------------------------------------- Wed Mar 12 00:07:33 UTC 2014 - mfasheh@suse.com - Initial creation of rpm and rpm changelog
Locations
Projects
Search
Status Monitor
Help
OpenBuildService.org
Documentation
API Documentation
Code of Conduct
Contact
Support
@OBShq
Terms
openSUSE Build Service is sponsored by
The Open Build Service is an
openSUSE project
.
Sign Up
Log In
Places
Places
All Projects
Status Monitor