It depends. Are you looking to travel on the cheap or creep on college girls and foreign countries with unknown police factors?
If it's the first one, don't worry about yourself. Don't let the thought of a random person maybe being uncomfortable with your just mere presence in a foreign country to prevent you from pursuing your dreams.
If it's the second, yeah you should probably stay home.