I think this is more of a problem of knowing when a specific tool should be used. Probably most people familiar with hadoop are aware of all the overhead it creates. At the same time you hit a point in dataset sizes (I guess even more with “real time” data processing) where it’s not even feasible with a single machine. (at the same time I’m not too knowledgeable about hadoop and bigdata, so anyone else feel free to chime in)

I have the same exact setup running on my server, and it’s great. I also like having my entire library downloaded on some devices (some of which are more storage constrained), so I also have deemix setup to automatically transcode the flac files to opus and put it into a folder that is synced with a cloud storage.