I have several HDDs for the same purpose, though I'm mostly just casually collecting games now
I use private labels on VNDB to keep track of where everything's stored (for example, putting a physical sticker called "A" on a certain HDD...whatever visual novels are stored on "A" get the "A" label on VNDB)
I have been really lazy in regards to backing all this data up though