It's not my reference, but with characters like Iochi from Charade Maniacs works for me because it leaves me thinking about how they identify. But, if story directly tell me it's a man but they use a female seiyuu, I will have doubts during the route and I wouldn't be able to enjoy it, I would even think "a male seiyuu would have been better" with non LI characters such as children or non-binary characters that have female voice actors it's okay for me (a non binary voiced by a male seiyuu would be interesting too though it doesn't happen often) but having a LI... it's a no for me ;;;