Data Reconciliation

[ateolf]

Yesterday I mostly just worked on my nerdy weighted cd randomization project. I got the one part of the code done, but then the big task was going through and reconciling data inconsistencies between my master spreadsheet (that I've had for decades) and the albums in my filesystem. There was some fine-tuning of edge cases in the code, but mostly fixing those data inconsistencies in one place or the other. I also have an idea for the next step of keeping a map of the names and titles that wouldn't work with a translation rule and just saving a map to transform them. But first I just had to go through all the records that didn't match and see what there was to be fixed. Sometimes character inconsistencies (like the different varieties of a single quote or dash or whatever), sometimes typo in one place or another or some other mistake, and there were a few (maybe something in the area ten altogether) albums that were just missing from my spreadsheet (so this was a productive exercise at the very least in just getting that rectified...and I'm such a nerd I also have to refer back to this journal when I add it so it can go back in in the correct position, so I need to see what the closest cds acquired were way back when...yeah...). Anyway, that was a bit of a long task but it actually wasn't as bad as I was expecting.