Pour some good Bourbon over it. It will purify the taste considerably! (Sorry, couldn't resist)
On the serious side, you need to provide more info.
1. Does the water taste bad too?
2. Are you using more than one water source?
3. Have you looked into an inline charcoal filter?
4. Is your hose a "drinking water" vs. garden hose?
5. What does the fridge manufacturer suggest?
Our Kenmore at home had a funny taste for ice and chilled water for quite some time. I wound up putting a charcoal canister / filter in line. No problems since.
I wouldn't be surprised if your fridge already has an in line canister filter that is upgradable.
Good Luck,
__________________
Pull Toy
Steve & Jan, Ava & Emma (Mini Schnauzers):
2016 F350 Lariat 4X4 Powerstroke CC/SB "PULLTOY V"
2013 Alpine 3535RE "MAGIC CARPET IV"
Proud Navy Vet!