For me, it depends on the gameplay. For example, I don't particularly enjoy stat rising, after a while it just becomes tedious, especially if I am replaying the games to read other routes. But some minigames can be fun, and I find they don't really distract me from the story - maybe it's because I am used to playing RPGs where the story is always balanced by gameplay.