Jen Actually from what you have described I don't have a problem with how you're approaching things (and if I did you'd be the first to hear about it!).
:-)
I think you're being quite sensible... you have maintained control of the situation, you are able to walk away whenever you like and you are exploring things in your own time at your own pace, with the support of those around you.
The issue I have is with the people who force their will upon others, and the ones who defend / glorify this behaviour.