If you can hand-wash a regular pitcher, you already know how to wash a filter pitcher—or a filter dispenser, if you have one of those. Advertisement Dish soap and a soft sponge or rag ...