The last 3 days have been straightening out backups for my desktop and 4 large external hard drives. My Sony a6000/a6700 digital camera files I've been accumulating since 11 years ago contain about 140,000 image files within 850 folders. Some files go back decades that have been piece meal saved over years transferring from old media like CDs to newer USB drives. I've been working towards having at least 2 media sources. I have many more files than subjects photographed due to focus stack blending and stitch blending that combines files into one output. All my work has used .jpg outputs and not RAW because years ago there were not RAW functions for blending files so. In any case, the result of focus stack blending at optimal apertures like F5.6 is much better than single shot RAW outputs.
Fixing errors between two hard drives that are intended to have the same files but are folder structured differently is difficult. Besides much File Explorer use, notepad, have been running
Command-Prompt, cmd.exe, command line commands and Excel for much of that work.
Currently, have 2 each newer 4 TB external USB drives, 2 each older 2 TB external USB drives, a 500 GB internal SSD drive in the HP Omen 35L, and a handful of USB memory sticks including several over 100 GBs I've used for temporary storage. Everything could fit into each the 4 TB drives, given folder restructuring and moving files around. Unfortunately, a few years ago, I began only updating same folders on one of the 2 TB drives, that then accumulated differences. Thus have been working to discover the differences and make folders identical.
A typical process is to look at the
Properties popup for two folders to verify the numbers of files, folders, and bytes used is identical. If not, I have to figure out what is different. Given dozens to hundreds of files in many folders, just poking at each file would be inefficient. Sometimes if one folder shows say 453 files and another 455 files, discovering what is different was not too difficult just using file explorer after filename sorting. One can sort on
Date Modified to show any newer files, then transfer the newer files into the other drive.
Sometimes file names had been changed or the byte counts are so close as to be difficult to notice. What I do then is create listings that I run comparison formulas in Excel. The new Yahoo AI has been a great help creating command line commands. I web searched with:
cmd.exe, file explorer, list folder name, folder size
That spit out:
for %F in (*) do
@Echo %~nxF %~zF >> fileA.txt
That creates a 2-column output separated by
Spaces. In the old days, I would use UNIX ls piped into a grep command. The Microsoft commands are much more ugly syntax wise, especially the "for" command, due to historical reasons going back decades. Then in Notepad, would replace all
Spaces with
Tabs.
Copy/Paste into a blank
Excel Worksheet page will be 2 columns, one with filenames, one with file sizes in bytes. So would perform that on the same folder in the other drive, so then 4 columns of data. Would AZ
Sort columns A and B with A. Would AZ
Sort columns C and D with C. Thus, all rows when correct will have the same filenames in each row. In column 5 at E1 for each row would put the formula.
=IF(A1=C1,"","Q")
And in column 6 F1:
=IF(B1=D1,"","W")
Then drag the formula down through all the data rows. The result will show any byte size differences as a Q and or a W as a filename difference. Most rows will be blank if correct. Then is easy to identify errors.