for f in $(ls "/mnt/dir"); do
cp -v "$f" /elsewhere
done
Even though 54 GB partition created, it only takes up 22 GB or so. Either missing a lot of files or FFS compacts it well.
ls /mnt/dir | while read line; do
cp -v "$line" /elsewhere
# substitute with something fancy
# [ $? -eq 0 ] || cp -v "$line" /elsewhere
doneIn the meantime, after a few retries, the failures are written to a log for a second sweep.
MD5 check helps skip extra copying, but it's overall much slower. It seems okay for a long-running batch job; maybe something we can return to after getting the pictures to display.
The pattern is like
cp ... || \
{ sleep 2; cp ... ; } || \
... || \
... || echo "$file" >> retry.log
sherdil2022•2mo ago
gooob•2mo ago
sherdil2022•2mo ago