Zinc supplements can irritate the stomach and mouth. Zinc lozenges can alter your sense of smell and taste for a few days. If taken long-term, zinc lozenges may lower copper levels in the body. Zinc nasal sprays have been associated with a loss of smell, which may be permanent.