Interdimensional Traveler

You continue walking alone in the night, in this dreadful abandoned city. The city lights are getting closer but about a quarter mile away from them, you notice a problem. The bridge that separates the abandoned part of the city is out. It appears as if it was destroyed deliberately. You could probably swim across the river, but how do you know it is not toxic or polluted?