Why We Do Not Run Taste Tests, and What to Read Instead

A taste test records the verdict and loses the variables

The trouble with a published taste test is not that the tasters are wrong; it is that the conditions are gone. The cup was made with a particular water, a particular grinder set a particular way, a dose and a temperature that seemed obvious at the time and were not written into the result. A reader gets the ranking and none of the inputs, and cannot reproduce either the winning cup or the losing one.

This site does not run taste tests for that reason, and it does not borrow other people's. What it can do is read what a maker publishes about the tool itself, because a published capacity, temperature range or weighing interval is a variable the buyer controls, not a judgment the buyer has to trust. The three tools below each fix one variable in print. Held together, they let a person make the same cup twice and decide for themselves which of the two they preferred, which is the only taste test that has ever been repeatable.

Capacity: the AeroPress states 10 oz and nothing about taste

AeroPress sells the Original for $39.95 and states a 10 oz chamber capacity and top-rack dishwasher safety. Those two lines carry the specification, and they are more useful than they look: a chamber with a stated capacity is a batch size that does not drift. The same volume of water goes into the same chamber tomorrow as today, and a brewer who wants to change one thing at a time has already fixed the first thing.

What the listing does not print is a dose in grams or a steep time. What it does print is a method: its FAQ answer on grind size asks for a medium-fine grind, a shake to level the bed of grounds and a slow pour, and another answer sizes one press at a single 10 oz serving. The page also claims the press brews and cleans in 2 minutes, a figure for the whole routine rather than a steep time.

So the grind and the vessel are settled, and the amount of coffee and the time it steeps are not. A household that wants a repeatable cup writes the grams and the minutes down beside the 10 oz figure and keeps them. The photographs of the press beside a glass are styling rather than instruction, and the page promises no flavor.

Temperature: the Stagg turns a guess into a number

Fellow lists the Stagg EKG Pro at a checked $179.95 with a 0.9 L capacity, a gooseneck spout for a slow pour and selectable temperatures from 40 to 100 degrees Celsius, in a 110 to 120 V version for the US and Canada. Water temperature is the variable a taste test most often omits, because the tester filled a kettle and poured; a kettle with a set point makes the omission impossible, since the number is on the display.

The number is a setting, not a measurement. A selectable temperature does not establish how close the water actually is to that figure, or how long it holds there, in the particular unit on the counter; Fellow publishes a range and a set of settings, not a measured tolerance. What the setting does is let two cups be made at the same displayed temperature, which is enough to test whether temperature was the thing that mattered. At $179.95 that is an expensive way to answer one question.

Dose and time: the Hario scale publishes its intervals by range

Hario's V60 Drip Scale is $60 and publishes what most kitchen scales do not: its measurement interval changes by range, 0.1 g from 2 to 200 g, 0.5 g from 200 to 500 g and 1 g from 500 to 2,000 g, on a 120 by 190 mm platform 29 mm high with a timer built into the same face. A coffee dose of 15 to 20 g sits inside the fine range; a full pour-over's water, at 250 to 300 g, has already crossed into the 0.5 g steps.

That published boundary is the reason to read the listing rather than the marketing. The scale is precise where the dose lives and coarser where the water lives, and a buyer who knows that can decide whether half-gram water steps matter to them; for most home brewing they do not. The timer on the same face is the practical gain, because time is the third variable a taste test forgets and here it is recorded beside the weight. A kitchen scale and a phone do the same work with more shuffling.

When a taste test is the right thing to want

Skip this reading when the question is about the coffee rather than the tools. Beans differ, roasts differ, and no chamber, kettle or scale changes that; a buyer choosing between two bags is right to want somebody's palate on the record, which is what a taste test is and what these three product pages are not. The three products above hold the tools still so that the beans can be compared fairly, and that is all they do.

Skip the tools as well when the routine already works. A person who makes a cup they like every morning without weighing or setting a temperature has no variable to fix, and buying $280 of equipment to formalize a habit that was never in doubt answers no question. Fix a variable when a cup has gone wrong and the reason is unknown; until then, the only test worth running is the one already being drunk.