Let me frame this differently: Would you not agree that having your parent's hands on your privates is very different from having your spouse's hands on your privates? Even without the implications on what the parent's intentions might be (surely motivated by kindness, not lust, of course), I would reckon that the touch of your spouse would be much more welcome.
But yeah, my proposal would be in line with Tjc and Sasha, perhaps even in the middle of the two: The belt comes off when you are both ready to make love. With obvious exceptions based on mutual agreement for anything from hygiene needs to outings where the belt would pose a practical problem of course. This is not about distrust in you, but in having your wife's loving embrace constantly present on your body, after all.