content subset comparison
Posted: 19 Sep 2020, 03:10
In many cases, if the name/size are the same, comparing all bytes is overkill - it would be nice if there was a faster subset comparison, like 10% of file at random positions or evenly spaced positions in blocks...
(Possibly even less than 10%, I am watching it compare 18-21MB jpg files from a WiFi connected PC and it is taking seconds per file out of 12,470 files. Perhaps a sliding scale based on file size or a maximum comparison bytes or blocks.)
(Possibly even less than 10%, I am watching it compare 18-21MB jpg files from a WiFi connected PC and it is taking seconds per file out of 12,470 files. Perhaps a sliding scale based on file size or a maximum comparison bytes or blocks.)