Batches

[ateolf]

I did update my mp3 converting/loading python script to work in batches, at least up until it crosses a threshold and gets near the end where it reverts to sequential processing for fine control on detecting whether each file can fit. And it worked! Mostly! I just forgot to do a simple thing. So it ran for the batching portion just fine and then when it went to the sequential end processing, I'd forgotten to update that part of the code to pick up from where it left off so it just started back from the beginning (just rewriting over the files that had already been written, now in series instead of parallel so it was just re-doing what had already been done in a slower manner!). The batching portion finished in under four and a half hours. So I know it'll add a little more time to finish it off and the later portion will run more slowly, but it doesn't have a whole lot left. (Given the drop from almost thirteen hours, yeah, I think it's going to be a success! The batches as of now are one hundred files. The computer gets really noisy for this, but converting to mp3, even just one at a time, is noisy during that part, so I'm just compressing the time of the heavy computations. Once I fix it I'll do another run and then I'll know how long it'll take. Anyway, it's fun and exciting. That's all!