My worst experience was travelling in Jamaica. Just walking through the villages the people were very aggressive/touchy. We hurried back to the resort because this group of men wouldn't stop following us.
Learn basic words in the countries language that you are visiting. It goes a long way in helping you navigate and the locals appreciate people who try.