Max9 The real issue with a devout Christian and chastity belt use is the same as any other action which a Christian undertakes, it is one of the heart. The heart governs all of our actions and it is the heart which God judges. If you are belted to avoid what you believe to be sin, then before God your intentions are pure and you should have no pang of conscience in church our out of church. There are many Christians who wouldn't understand or who wouldn't be able to separate the use for conscience sake from those who enjoy kink or other reasons for use. But that shouldn't affect how you feel about it, you aren't going out of your way to flaunt your choice.
The Bible talks about those men who castrated themselves in order to avoid sexual temptations that they couldn't control and the apostle Mark cut off his finger so that he was no longer forced to administer at the temple contrary to his conscience. Both of those things were matters of strong conviction and conscience to avoid what they considered or knew to be sin. Wearing a Chastity Belt is not as extreme as these things and in the case of many in this group it is not any less a matter of conscience.
Remember that God judges the hearts and honors your choice in faith to honor him. It is not something you should feel ashamed of in any way.