Does a tankless water heater need a filter? Yes. There is no storage tank to let debris settle out, so every grain of sediment and every hardness mineral in your supply runs straight across the heat exchanger.
Two things go wrong from there. Hard water bakes a mineral crust onto the hot surfaces, which makes the burner work harder for the same shower. Sediment moves faster, plugging the narrow inlet screen and thinning your flow.
Below you will find which filter matches your water hardness, what each type costs, how one gets fitted on the cold line, and how often it needs service.
Key Takeaways
- A tankless water heater does need a filter: it keeps mineral scale and sediment off the heat exchanger, the one part that is costly to replace.
- Scale has a measurable cost: the U.S. Department of Energy links scale on heat-transfer surfaces to a 1% to 7% efficiency loss.
- Match the filter to your hardness number: spin-down filters catch grit, phosphate and TAC cartridges slow scale, and water above 10.5 GPG (very hard) is softener territory.
- Stay on schedule: check a cartridge filter every 6 months, and flush the unit with undiluted white vinegar at least once a year, more often on hard water.
Does a Tankless Water Heater Need a Filter?
Yes, a tankless water heater needs a filter, because nothing stands between your incoming water and the heat exchanger. A tank model can hide years of sediment in the bottom of the vessel. A tankless unit sends everything through narrow passages and across the hottest metal in the house.
That is true whether you own a Rheem, a Rinnai, or another brand of gas tankless water heater. Ignore water quality and a long-life appliance turns into a money pit.
Proper maintenance is not only about longevity; it protects performance. The U.S. Department of Energy ties scale on heat-transfer surfaces to a 1% to 7% drop in efficiency (1), so a scaled heat exchanger quietly raises your energy bill every time you run hot water.
Here is why a filter earns its place:
- Scale Build-up: hardness minerals coat the heat exchanger, forcing the unit to burn more fuel for the same water temperature.
- Flow Restriction: sediment clogs the narrow inlet screen, which shows up as weak pressure at the tap.
- Warranty Issues: many manufacturers void the warranty when damage traces back to scale or poor water quality.
Good To Know
Hard water carries high levels of calcium and magnesium. Those minerals bond to hot heating surfaces and set into a rock-hard layer that drags down efficiency and pushes the unit toward early failure.
How Much Does a Tankless Water Heater Filter Cost?
Most filter setups cost $30 to $300 up front, and replacement cartridges run roughly $20 to $60 depending on the brand and micron rating. Set that against a heat exchanger, which can top $1,000, and the filter is the cheap half of the equation.
Where you land in that range comes down to the technology. A spin-down sediment filter sits at the low end and has no recurring cartridge cost at all, since you flush the screen instead of replacing it. Phosphate and TAC cartridges cost more per unit and need their media changed periodically. A whole-house softener is a different budget category, closer to an appliance purchase than to a filter.
What Types of Filters Work on a Tankless Water Heater?
Four types cover almost every supply: phosphate cartridges and TAC media for scale, a spin-down screen for grit, and a whole-house softener when the water is genuinely very hard. Here is what each one handles.
Phosphate Filters
Phosphate cartridges, usually sold as scale inhibitors, release food-grade polyphosphate into the water. That polyphosphate coats calcium and magnesium so the minerals stay suspended instead of sticking to your heat exchanger walls.
Install one on the cold water inlet. It is the lowest-cost way to slow scale before it reaches the heating surfaces, and the media is consumed as it works, so plan on periodic cartridge changes.
TAC Filters
TAC stands for Template Assisted Crystallization, a salt-free technology. Instead of removing hardness minerals, TAC media converts them into microscopic crystals that stay suspended in the water.
Those crystals cannot bond to a hot surface, so they pass through the heater without forming scale. TAC is the pick if you want scale protection without the slippery feel of softened water, and it adds no sodium to what comes out of the tap.
Water Softeners
Water hardness is measured in grains per gallon (GPG). The standard US scale runs soft under 1 GPG, slightly hard from 1 to 3.5 GPG, moderately hard from 3.5 to 7 GPG, hard from 7 to 10.5 GPG, and very hard above 10.5 GPG. One GPG is about 17.1 mg/L, so a lab report in mg/L converts with simple division. If your supply sits in that top band, a single cartridge will struggle to keep up.
A dedicated water softener system physically removes hardness minerals and swaps in sodium. It is a larger investment, but it protects the whole house: soap lathers better, skin feels less dry, and every water-using appliance lasts longer.
Sediment Filters (Spin-Down)
Tankless heaters push water through very narrow passages, so sand, rust, or scale flakes shed by old city mains can block them quickly.
A spin-down sediment filter is a reusable mesh screen in a clear housing that traps the coarse particles before they reach the heater. You rarely buy a replacement. You open the valve at the bottom, let the trapped grit flush out, and close it again.
How Do You Install a Filter on a Tankless Water Heater?
You cut into the cold water line feeding the heater, fit the filter housing into that gap, and pressure-test the joints before you call it done. It is real plumbing work: soldered copper or PEX fittings, done to a standard that holds house pressure.
Something To Consider
If you are not comfortable cutting pipes and soldering (or working with PEX fittings), hire a professional. A leak near a tankless unit can damage the electronics.
Here is the general process:
- Shut Off Water: turn off the main water supply and the inlet valve to the heater.
- Drain Lines: open a faucet to relieve pressure in the line.
- Cut the Pipe: remove a section of the cold water pipe to make room for the filter housing.
- Install Isolation Valves: add service valves (a flush kit) between the filter and the heater so later maintenance is easy.
- Connect the Filter: secure the filter housing into the gap with the right fittings.
- Restore and Check: open the water slowly, run a hot tap, and watch every joint for weeping before you close up the wall or leave the area.
Pro Tip
Always fit shut-off valves before and after the filter. That lets you change the cartridge without cutting water to the whole house.
How Often to Change Tankless Water Heater Filters?
Check a standard cartridge filter every 6 months and change it as soon as the media discolors. A spin-down screen gets flushed on that same schedule rather than replaced, and very hard or visibly dirty water moves both jobs closer together.
Dark brown or orange media in a clear housing means heavy sediment and calls for an immediate change. A sudden drop in hot water pressure is the other cue. Check the filter before you suspect the heater, since a clogged screen is the usual culprit.
Filtering is only half the maintenance. Rinnai advises flushing a tankless unit at least once a year, and more often where water is hard, circulating about 4 gallons of undiluted white vinegar through it to dissolve any scale the filter did not catch (2).
FAQs
Here are answers to common questions about tankless water heater filters and upkeep.
In the End
So, does a tankless water heater need a filter? Yes, and the right one depends on what is actually in your water rather than on the badge on the heater.
Get a hardness number first. In the moderately hard range, a spin-down sediment filter plus a phosphate or TAC cartridge usually covers it. In the very hard band above 10.5 GPG, plan on a softener and treat the cartridge as backup. Whichever route you take, keep to a 6-month filter check and a yearly vinegar flush, and the heat exchanger stays clear for as long as the unit was meant to last.
