All tap water in Mozambique should be assumed to be unsafe to drink, even if it is not harmful it usually has some sediment that your stomach will not be used to. Most western oriented lodgings either provide a fresh water source or sell bottled water.