No, in general, tap water is not potable in towns and cities along the coast.

We suggest you boil the water before drinking, or drink bottled water, or check with the villa or hotel owner or manager, as individual property may have enhanced their own filtering system. In San Jose and other places in the Central Valley, everyone does drink out of the tap, but it is not recommended in towns and cities along the coast.