Skip to main content

SENSORY: Practical Brewing Science

Page 1

PR ACTICAL BREWING SCIENCE

PRACTICAL BREWING SCIENCE

SENSORY

CRAIG THOMAS AND LAUREN TORRES, EDITORS

SENSORY THOMAS ASBC


CHAPTER

2

Sensory Testing ■

Janelle Harmon* Reckitt

■

Jacob Lahne Virginia Tech

■

Lauren Torres† Anton Paar

■

Tessa Schilaty Yakima Chief Hops

2.1 Introduction The previous chapter outlined the fundamentals of sensory testing within a brewery, which involve defining what is being measured, how is it being measured, and what are the reasons for measuring it. This chapter will delve into the testing methodologies that are often used to conduct these measurements. Determining the right test is only half the puzzle, however, as deciding who participates in the sensory test is just as important in guaranteeing a test’s, and even a program’s, efficacy.

2.2 Types of Panels Training a group of panelists to perform advanced sensory methods can be time consuming, but panel leaders are not solely limited to expertly trained members to obtain answers to the questions they require. There are multiple types of panels with an array of training levels that can be utilized and fit within the needs of the test. It is up to the panel leader to evaluate the resources at hand to achieve the goal. A trained panel may be needed to answer a question or evaluate a target, but untrained panels and consumer panels can be just as informative if used correctly. This section will examine each type of panel and showcase how to best fit these to the company’s needs. *Formerly at Molson Coors Beverage Company †Formerly at Bell’s Brewery

11


12  ■    S E N S O R Y

2.2.1 Trained Panels Descriptive test methods require highly trained panelists because these tests are trying to measure detailed sensory information, such as specific flavor attributes. Panelists for these methods require training in the method, flavor attributes, and product-specific training. Training commitments to start a descriptive panel can range between 40 and 120 hours. Depending on the complexity of the base liquid or number of attributes being collected, more hours of training may be required. While trained panels require a lot of upfront work before they can begin sensory assessments of the product, they provide more detail than discrimination tests because discrimination tests are simply measuring if there is a perceivable difference or similarity between two or more samples. Once the panelists have received the initial training(s), it is important to plan/ execute maintenance training periodically to maintain panelists’ high performance. Monitoring panelist performance will fulfill two purposes: to capture individual panelist data contributions and panel deviation. These performance checks can be used to guide training activities either on individual attributes or broader training topics and products. To maintain panel morale and balance panel leader/facilitator/data analyst workload, it is recommended to provide panelists with performance feedback on a quarterly basis. This frequency can be adjusted based on the sensory program’s size. Panel training and maintenance will be covered in more detail later in this handbook.

2.2.2 Untrained Panels Untrained panels can perform a limited number of tests and are best used for discrimination test methods. Panelists will need to be familiar with how to execute the test and how to submit their data. Instructions on how to complete the test can be presented using data-collection software or given before the start of the test. Panelists recruited for untrained panels can be either internal or external, with the caveat that externally recruited panelists may not be available on short notice. Having a large pool of panelists to recruit from for untrained panel activities gives the panel facilitator the most flexibility in completing sensory tests. In panelist selection, care should be taken to select panelists that can differentiate between similar products or have the potential to differentiate; actual performance may not be the limiting factor to acceptance onto an untrained panel. For discrimination testing, ensure a mix of highly discriminating and moderately discriminating panelists. Presenting untrained panelists with various brands of beer in a triangle or tetrad test (discussed below) ranging from very contrasting flavors to similar profiles over numerous sessions will help identify one’s ability to discriminate. The same can be done with dosing a beer with known off-flavors and comparing them to a control.

2.2.3 Consumer Panels The use of consumer panels requires different logistics before the test(s) can be executed. Appropriate business risk must be assessed to determine the need to run a consumer test as well as the consequences of foregoing testing after a major change. Consumer panels generally require anywhere from 100 to 500 panelists, possibly over multiple geographical locations and test dates. Typically, due to the number of resources


Sensory Testing   ■  13

required for consumer testing, these tests are reserved for major changes to flagship brands or branching into new categories. Modified versions can be carried out with the caveat that the rigor for the study will be reduced. Use of a modified consumer-like panel will not allow any assumptions to be concluded about true target-market representation.

2.3 Types of Tests One of the most important endeavors in sensory analysis is determining which sensory test will best answer the question at hand. Defining the objective of the sensory test first will help determine the test design. Should the panel examine whether the two samples are perceptibly different? Is the aim to achieve a specific and consistent target flavor profile? Perhaps the goal is to try to generate descriptive terms for a marketing initiative. For each of these questions (and many, many more), there is an optimum sensory test. On the other hand, most sensory specialists operate in the real world where time and resources are finite. There are times when it is necessary to give up the ideal test and choose the one that is practical. Conducting a trial run on a test format that has never been conducted at the brewery prior to conducting the actual test is recommended to ensure that the sensory test and data collection will run smoothly. This section will discuss the different tests and give an overview of the best application.

2.3.1 Discrimination Tests (Difference and Similarity) Typically, difference testing is used to determine if there is a perceivable difference between two or more samples, but there are times when one will want to know if the samples are perceived as similar. By simply changing the test parameters of α, β, and ρmax, the test can shift from a difference to a similarity test, with all other procedures staying the same. A practical use of difference testing is to identify if a perceivable difference exists following an ingredient or process change to cut costs or increase efficiencies. If a statistical difference is found, then the recommendation would be to not change to the proposed ingredient or process. Brewers are always looking to deliver the same, consistently tasting product to the consumer. On the other hand, if sales of a once-popular brand are declining, a brewery might be looking to reformulate the recipe in an effort to enhance the beer and promote it as “new and improved.” If this is the case, then one could use a difference test in hopes of finding a difference between the current and reformulated recipes. Each difference test is unique and should be chosen based on the question at hand. But there are other practical questions to ask as well. Are we aiming to have the samples perceived as similar or different? How many panelists are available to complete the test? Should the panelists be trained or untrained? What volume of beer is available to execute the test? Is the product fatiguing (i.e., palate fatigue from intense flavors) and so might have a carryover effect (i.e., flavors that linger on the palate might be “tasted” in the next beverage even though they are not there)? How will the results be used? Asking these various questions upfront can help identify the best test to use in each situation. Prescreening the samples first can be beneficial to determine if a difference test is the best method to pursue. If the samples being tested are perceivably very different, a difference test should not be used, as one would expect the panelists to always detect the


14  ■    S E N S O R Y difference and be a waste of company resources. It is usually best to only employ full-scale discrimination testing methods when the products are very similar on casual inspection. Sensory difference testing can be contradictory to analytical results at times. An international bitterness unit (IBU) analytical value may indicate that the samples have the same intensity of bitterness, but a sensory difference test may identify differences between samples if the bitterness lingers in one beer and not in the other or the quality of bitterness varies. There are several difference testing techniques, but we will discuss the triangle, tetrad, and paired comparison tests.

2.3.1.1 Triangle Test In a triangle test, panelists are presented with three blind-coded samples (two identical, one odd) and asked to choose the sample that is different. Table 2.1 outlines the six sample presentations: AAB, ABB, BAB, ABA, BAA, BBA. All samples should be presented in a balanced block design where A and B are shown as “odd” samples equally. This method can be utilized when making changes to a process or ingredient or during TABLE 2.1. Triangle test presentation in a balanced block designa Panelist

Left

Middle

Right

1

A

A

B

2

A

B

A

3

A

B

B

4

B

A

B

5

B

B

A

6

B

A

A

a © ASBC.

FIG. 2.1. Triangle test samples showing visual differences if presented in clear glasses. (© ASBC)


Sensory Testing   ■  15

cost reductions. Samples need to be presented with two samples being identical and one odd. There should not be any visible differences in the samples as shown in Figure 2.1. Measures can be taken to reduce slight variances, either through opaque/colored glassware, tinted goggles, or colored lights in the sensory evaluation room/booth. Triangle tests can be used in both difference and similarity testing.

2.3.1.2 Tetrad Test The tetrad test answers the question of whether two samples are noticeably different. It is an example of an unspecified difference test, meaning that the nature of the difference is unknown to the assessors. For example, the assessors are not being asked to identify the sweeter samples, just the samples that are the same as each other. Checking the similarity of two samples is useful when evaluating the impacts of a process or raw-ingredient change. If customers have grown to love the flagship products, it is important to avoid making big, unintended changes. To execute a tetrad test, assessors are presented with four samples, each blind coded with a different, randomly generated number (Fig. 2.2A). The four samples are two different sets of pairs (samples 1 and 2 are the same, and samples 3 and 4 are the same but different from samples 1 and 2). Assessors are asked to smell and/or taste the samples from left to right and then match the pairs (Fig. 2.2B). With enough participants submitting answers, the statistical probability that the samples are perceptibly different can be determined. This test type does not require previous training or the use of trained panelists. However, assessors should understand how to conduct the test and complete the ballot. Care must be taken if utilizing this method with fatiguing products, as the additional sample (as compared to a triangle test) can accelerate sample fatigue.

2.3.1.3 Paired Comparison Test There are two versions of the paired comparison test: directional and difference. The directional paired comparison method (also called the “two-alternative forced choice [2-AFC]” method) answers the question of which sample has a higher intensity of a known attribute (Lawless, 1999). This test type can only be used when the panel leader knows, for example, which sample is higher in bitterness. This test could be used if a new hop variety was sourced with the only difference being a higher α-acid percentage compared to the current hop to ensure more bitterness is perceivable in the beer. There are two possible serving orders in a directional paired comparison method (AB and BA). All samples should be presented in a balanced block design where A and B are shown equally first. An example ballot for a directional paired comparison is shown in Figure 2.3. A three-alternative forced choice (3-AFC) test has a similar design to a 2-AFC test, but there are three samples presented to the panelist instead of two. A 3-AFC test is commonly used to determine thresholds, in which three samples are presented at a time and the panelist is asked to identify the sample, for example, that is the most acetic. There are six possible serving orders in a 3-AFC test (AAB, ABA, BAA, BBA, BAB, ABB). All samples should be presented in a balanced block design to the panelists. An example ballot for a 3-AFC test is shown in Figure 2.4.


16  ■    S E N S O R Y Presentation Assessors are presented with four samples consisting of two sets of pairs, each blind coded with a different randomly generated number. 472

387

935

601

Panelist’s Response Assessors are asked to smell and/or taste the samples from left to right and then match the pairs. This assessor has indicated that #472 and #935 are a pair. 472

387

935

601

935

601

Results The actual sample pairs are then revealed. 472

387

A

Name:

Date:

You are presented with four samples consisting of two sets of pairs. Evaluate the samples from left to right and identify the samples that are the same. You may retest the samples. If no difference is apparent, you must guess.

472

387

935

601

What do you perceive as different between the two sample sets? (optional)

B FIG. 2.2. A, Tetrad test example. In this example, the assessor did not correctly match the pairs, but this is not a failure. This only means that the samples were too similar for the assessor to distinguish, which still gives valuable information. B, Example of a tetrad test scoresheet. (© ASBC)


Sensory Testing   ■  17

Name:

Date:

There are two samples for you to evaluate. Assess them from left to right, cleansing your palate between samples. Write the sample number that is the most bitter.

159

827

Sample number: Comments:

FIG. 2.3. Example of a scoresheet for a two-alternative forced choice (2-AFC) test. (© ASBC)

Name:

Date:

There are three samples for you to evaluate. Assess them from left to right, cleansing your palate between samples. Write the sample number that is the most acetic.

239

515

994

Sample number: Comments:

FIG. 2.4. Example of a scoresheet for a three-alternative forced choice (3-AFC) test. (© ASBC)


18  ■    S E N S O R Y The difference paired comparison method (also called the “same/different test”) is used to determine whether there is a difference between the samples when the difference is unknown (Lawless, 1999). An example of this would be to brew a beer at 5% alcohol by volume (ABV) instead of the original 6% ABV. We know that the percentage ABV is lower, but this will likely bring differences in body, sweetness, ester profile, etc. Is this difference perceivable to the assessor? Both paired comparison tests can use trained or untrained assessors. There are four possible serving orders in a difference paired comparison method (AA, BB, AB, BA). All samples should be presented in a balanced block design where each sequence is shown equally. Figure 2.5 shows an example ballot for a same/difference test.

2.3.2 Affective Tests Affective tests are used to gauge more-subjective responses about how a group of panelists feel about a product. These tests are usually performed using untrained consumers to capture the consumer base’s opinion on a new beer, how a beer might compare to a competitor’s beer, or to gain insight into how consumers might react to changes in ingredients, processes, or even branding. Two methods for this type of testing will be

Name:

Date:

There are two samples for you to evaluate. Assess them from left to right, cleansing your palate between samples. Note if these samples are the same or different by placing a checkmark in the appropriate box.

360

733

Same Different Comments:

FIG. 2.5. Example of a scoresheet for a same/different test. (© ASBC)


Turn static files into dynamic content formats.

Create a flipbook
SENSORY: Practical Brewing Science by Scientific Societies - Issuu