The public is "being let down" by the introduction of a £50 charge to have garden waste collected, a councillor says.