Speaking a foreign language with ease doesn’t necessarily mean making no grammatical or syntactical mistakes and having an enormous vocabulary. It means, as I see it, experiencing another culture, putting yourself in another person’s shoes, breathing at a different pace from our own, just as an actor would do.
Stop to reflect: what opportunities are you losing when you throw up the possibility of a few hours of conversation in a foreign language? Maybe you are missing work opportunities, maybe you are losing a new market. Or maybe you’re denying yourself the pleasure of making new social contacts.