I've had that happen-- using phrases I knew, and getting bombarded.

One thing I do instead is learn some useful words and phrases, but don't polish them. The idea is they understand what I'm trying to say, but they also realize my command of their language is minimal.

My hope is they give me credit for trying, and they realize they need to either speak at a level I can manage, or to speak English if they can (without me having to ask).

If they do attempt English, I use simple words and phrases, speak slowly, pause a little between words, avoid contractions (like "whatcha think?") and slang, and enunciate clearly.

Once high in the Swiss Alps near the Jungfrau, I passed part of the evening with the other hikers by reading lines in my phrasebook for asking women out for a date. They laughed at my butchered German, imagining how ludicrous it would be for me to actually try asking for date talking like that.