A public paddling pool is being permanently removed, angering residents who have fought a four-year campaign to save it.