User:Shawndouglas/sandbox/sublevel5

From LIMSWiki
Jump to navigationJump to search

1. Introduction to food and beverage laboratories

Food and beverage laboratories help develop, protect, and support the food, beverages, and nutritional supplements humans and animals consume. From creating new flavor enhancers for food to ensuring the quality and safe consumption of a wine, these labs play a vital role in most parts of the world where processed food and agricultural products are produced. These labs are found in the private, government, and academic sectors and provide many different services, including (but not limited to)[1]:

  • reverse engineering,
  • claims testing,
  • contaminate testing,
  • batch variation testing,
  • extractable and leachable testing,
  • allergen testing,
  • shelf life testing,
  • non-routine quality testing, and
  • packaging testing.

If you have ever enjoyed a candy bar, soda, or snack cake, a laboratory and food scientists were behind its production. Even if you don't care much for such processed foods, a laboratory is still involved in the quality and safety testing of raw fruits and vegetables, milk, and nuts. And when food supplies become contaminated, government testing labs are often in the thick of determining the source of the contamination as quickly as possible before more people become ill. Whether it's the unique flavor profile of a potato chip you love or the fact you can reliably acquire safe foods, remember that a laboratory is often behind it.

But what of the history of the food and beverage lab? What of the roles played and testing conducted in them? What do they owe to safety and quality? This chapter more closely examines these questions and more.


1.1 Food and beverage labs, then and now

The history of laboratory-based food and beverage tasting is a scattered one, with little being documented about foodborne illness and food safety until the nineteenth century. With a better understanding of bacteria and their relationship to disease, however, more was being said about the topic by the mid- to late-1800s.[2] In the U.S. Northeast during the 1860s, recognition was growing concerning the threat that tainted milk originating from dairy cows being singularly fed distillery byproducts had to human health. Not only was the milk generated from such cows thin and low in nutrients, but it also was adulterated with questionable substances to give it a better appearance. This resulted in many children and adults falling ill or dying from consuming the product. The efforts of Dr. Henry Coit and others in the late 1800s to develop a certification program for milk—which included laboratory testing among other activities—eventually helped plant the seeds for a national food and beverage safety program.[3]

Roughly around the same time, during the 1880s, Britain saw more public health awareness develop in regards to digestive bacterial infections. "As deadlier infections retreated," argues social historian Anne Hardy, "food poisoning became an increasing concern of local and national health authorities, who sought both to raise public awareness of the condition as illness, and to regulate and improve food handling practices."[4] This led to further efforts from public health laboratories to promote the reporting and tracking of food poisoning cases by the 1940s.[4]

With the recognition of bacterial and other forms of contamination occurring in foodstuffs, beverages, and ingredients, as well as growing acknowledgement of the detrimental health effects of dangerous adulterations with toxic substances, additional progress was made in the realm of regulating and testing produced food and beverages. Events of interest along the way include[5][6][7][8][9][10]:

  • By 1880, the first of many municipal laboratories dedicated to testing food and beverage adulteration came into use in France. A focus was made on watered-down wines early on, but Frances's municipal food safety labs quickly began addressing other foods, beverages, and ingredients.
  • The Pure Food and Drug Act and Beef Inspection Act were passed in 1906 in response to food quality issues in packing plants, on farms, and other areas of food production.
  • In 1927, the U.S. Food, Drug, and Insecticide Administration (shortened to the U.S. Food and Drug Administration or FDA not long after) was formed to better enforce the Pure Food Act.
  • By 1945, Clostridium perfringens was being identified as a common cause of foodborne illness[2], and today it is recognized by the Centers for Disease Control and Prevention (CDC) as one of the top five provocateurs of foodborne illness.[11]
  • The seeds of the Hazard Analysis and Critical Control Points (HACCP) quality control method were planted in 1959, when Pillsbury began working with NASA to ensure safe foods for astronauts. The value of Pillsbury and NASA's methodology became apparent to the food and beverage industry by 1972, and other organizations began adopting HACCP for food safety.
  • The Fair Packaging and Labeling Act of 1966 brought standardized, more accurate labeling to food and beverages.
  • The Food Quality Protection Act of 1996 mandated HACCP for most food processors and improved pesticide level calculations.
  • FDA Food Safety Modernization Act (FSMA) was enacted in 2011, giving the FDA more enforcement authority and tools to improve the backbone of the U.S. food and water supply.
  • In December 2021, the Laboratory Accreditation for Analyses of Foods (LAAF) amendment to the FSMA was approved, providing for an accreditation program for laboratories wanting to further participate in the critical role of ensuring the safety of the U.S. food supply through the "testing of food in certain circumstances."

This progression of scientific discovery and regulatory action has surely managed to reduce risks to U.S. food and beverage consumers, though not without complication and complexity.[12][13] As the U.S. population has grown over the past 100 years, it has become more difficult to have a sufficient number of inspectors, for example, to examine every production facility or farm and all they do, necessitating a risk assessment approach to food and beverage safety.[6][7][14] As such, the laboratory is undoubtedly a critical component of risk-based safety assessments of food and beverage products.


1.2 Laboratory roles and testing in the industry

Laboratories directly and tangentially related to the food and beverage industry play a number of roles, depending on where they're situated. These roles prove to be important in the greater scheme of industry activities, in turn providing a number of benefits to society. As gleaned from prior discussion, as well as other sources, these laboratory roles can be broadly broken into three categories: research and development (R&D), pre-manufacturing and manufacturing, and post-production regulation and security. Additionally, each of these categories has its own types of laboratory testing.

Food and beverage laboratories tap into numerous scientific disciplines for the work they do. Among the various roles these labs serve, disciplines such as biochemistry, biotechnology, chemical engineering, chemistry, fermentation science, materials science, microbiology, molecular gastronomy, and nutrition and food science are applied.[15][1][16][17] As such, a diverse skillset is typically required by the food and beverage scientist, requiring not only hard skills in microbiology, biochemistry, and fermentation, but also the flexibility and nimbleness to apply those skills to an industry with a rapidly changing consumer dynamic.[18]

Although slightly dated, past surveys of food processors have largely shown a majority of testing occurring within the processor facility, with outsourcing to a third-party lab becoming a growing trend. A 2013 Advantage Business Media survey of food processors "found 32.5 percent use both in-house and outside labs; 28.9 percent use only in-house testing, and 24.1 percent send samples only to outside labs," with 14.5 percent saying they didn’t require testing.[19] A 2017 survey by Strategic Consulting, Inc., published in Food Safety Magazine, saw the number of labs sending samples only to outside labs increase, compared to the 2013 survey, with 28% of respondents saying they outsourced all samples.[20] Similar surveys in 2020 reinforced the view that outsourcing was a growing trend, with more non-pathogen testing getting outsourced along with pathogen testing.[21][22]

This increase may not be surprising given reports that third-party contract testing laboratories were increasingly being used for food quality and safety testing. A 2013 Strategic Consulting, Inc. report cited the rise in third-party labs was "in response to the growing complexity, cost, and volume of testing required by food producers and retailers."[23] Another concern that may be driving outsourcing of at least microbial laboratory testing is regulatory pressure concerning pathogenic organisms in the production facility, and by extension out of the internally housed lab, though there may be a strong preference to contract with third-party labs in close proximity to the plant to better ensure desired turnaround times.[20] However, veterans in the food and beverage industry may view such outsourcing concerns as minimal, particularly when a facility's processes and quality mechanisms are appropriately reviewed, maintained, and enforced.[20]

In regards to what kind of testing has historically been occurring in the industry, we turn back to that 2013 Advantage Business Media survey. Additional statistics from that survey revealed that 70.6 percent of respondents were testing for quality, 57.7 percent were testing for consistency, and 56.5 percent were conducting food safety tests for pathogens. Some 29.4 percent were testing for packaging accuracy claims, and 23.5 percent were testing for the presence of reported and unreported allergens.[19] More recent survey data is difficult to find, so it's not clear how these numbers compare to the realities of 2022. We can say that at least as of 2020, pathogen testing remained vital, with testing of Listeria proving a fast-growing subcategory of pathogen testing, primarily for environmental monitoring of the production facility.[21][22] A 2020 survey by Strategic Consulting, Inc. further indicated that the volume of microbiology testing is growing at roughly five percent, while pathogen testing volume is growing at roughly six to seven percent, adding that "outsourcing is driving the volume of tests being sent to commercial labs by as much as 10 percent."[22] The same surveyor increased those percentages the following year.[24]

Finally, Strategic Consulting's Bob Ferguson added that polymerase chain reaction (PCR) is seeing an uptick in food and beverage testing as of 2021[25]:

As processors outsource their samples, PCR seems to be more frequently selected as the analytical method used than it was when the samples were analyzed in-plant. This possibility certainly makes sense. PCR requires expensive instrumentation and technical expertise to analyze samples properly. Every commercial lab will have a level of analyst capabilities and infrastructure that allows them to use PCR. Commercial labs will also have a high incentive to recommend the use of PCR to optimize the throughput of their instruments.

So far, we've spoken broadly of the food and beverage laboratory, the roles it can play in the industry, and the testing found in it. The following subsections more closely examine the three roles labs can play, as well as the testing found within those roles.

1.2.1 R&D roles and testing

The laboratory participating in this role is performing one or more tasks that relate to the development or improvement of a food, beverage, additive, or spice. This often leads to a commercial formulation, which has the "necessary details required to scale and produce your [food or beverage] in a consistent, efficient, and safe manner."[26] Even packaging solutions are targets for R&D labs in the food and beverage industry.[27]

The R&D lab may appear outside the manufacturing facility proper, but not necessarily always. Some manufacturing companies may have an entire research complex dedicated to creating and improving some aspect of their products.[28] Other companies may take their R&D to a third-party lab dedicated to conducting development and formulation activities for manufacturers.[26][27] Food and beverage research activities aren't confined to manufacturers, however. Some higher education institutions, such as the Hartwick College Center for Craft Food & Beverage, provide laboratory-based research and development opportunities to students engaging in work-study programs, often in partnership with some other commercial enterprise.[29]

Food and beverage R&D labs may work towards improving packaging, testing a product's shelf life (i.e., stability), conducting flavor or aroma analysis, developing and innovating foodstuffs, reformulating existing products, and researching genetic modifications to ingredients. The end user benefits by having fresher foods that are culinarily pleasing, more nutritious, and safer for consumption.

The following types of testing may be associated with the R&D role:

Overall food innovation and development: International Center for Food Chain and Network Research's Schiefer and Deiters note that the food and beverage industry as a whole faces a number of significant challenges today, including economic and noneconomic changes, consumer lifestyle changes, global increases in food consumption, degradation and loss of cropland, and societal changes to attitudes concerning sustainability.[30] These types of challenges require a food and beverage industry that is more agile and innovative, one that is making impactful breakthroughs to improve the quality and range of products, increasing the capacity for making products, replacing outdated products, developing more flexible or sustainable processes, and improving health and safety.[31] Given the broad scope of efforts involved, the laboratory services for such impactful R&D efforts can vary widely depending on the goal. Improving the flavor of plant-based meat substitutes, for example, comes with somewhat different analytical techniques and disciplinary requirements than say improving the three-dimensional food printing of said meat substitutes.[32]

Aroma/flavor analysis and formulation: Here the concept of "sensomic" study, an approach to describing the sensory properties of foodstuffs at a molecular level[33], plays an increasingly important role.[33][34] This involves analytical techniques such as gas chromatography, liquid chromatography, and spectrophotometry, used in conjunction with chemometric data analysis to isolate and act upon volatile compounds from one or more samples.[33][34][35] Aroma tends to be a more difficult concept to tackle as we've identified more than a 1,000 volatile compounds in a singular substance such as cooked meats and coffees (though typically only a small number of those compounds make a significant contribution to the overall perceived aroma[35]), which in turn adds further complexity to overall perception of flavor.[34] This gives laboratory researchers formulating a product for a distinct flavor profile more than a few challenges in, for example, putting together a successful mapping of chemical composition to flavor perception.[36]

Genetic modification for improved yields and nutrition: The preface of Westin Carrillo's book Biotechnology and Food Production summarizes this activity well. "Biotechnology can be used in many ways to achieve higher yields; for example, by improving flowering capacity and increasing photosynthesis or the intake of nutritive elements," he says. "In the long term, genetic engineering will also help to increase production of the most valuable components of specific crops" like cassava and rice, as well as modify their amino acid composition in order to increase their otherwise deficient nutritional value.[37] As this suggests, however, knowledge and skills in genetic analysis, modification, and expression are required, in turn requiring the equipment and skill for genetic sequencing, microbial transformation, genetic use restriction technology (GURT), Northern or Western blotting, reverse transcription polymerase chain reaction (RT-PCR), etc.[37] Admittedly, this type of R&D may fall more firmly in the hands of agriculture businesses than food and beverage businesses themselves. However, a few food and beverage business may bring their genetic modification R&D efforts in-house as an overall effort to improve a majority of its products.

Nutritional reformulation: As various scientific understandings improve and societies shift their desires and perspectives towards processed foods, so too do the formulations used by food processors. Food scientist and author Maurice O'Sullivan describes four primary drivers for these types of reformulations[38]:

  • Society improves its scientific understanding of the major consumption-related diseases affecting human civilization, including coronary heart disease, diabetes, hypertension, and obesity.
  • The population at large becomes more aware of scientists' greater understanding of consumption-related diseases.
  • Food producers inevitably see reason to make changes to their foods based on both the scientific and customer-based factors that affect sales of the producers' products.
  • Government further provides incentive to the producer to modify their product, through industry collaboration or outright regulation and enforcement activities.

O'Sullivan argues that the three most significant components of food that need to be modified are salt, fat, and sugar. Balancing these in reformulations is indeed challenging for chemical, sensory, and other reasons.[38] Adjusting salt levels, for example, requires chemical knowledge about salt reduction's effects on meat's shelf life and what substitutes or additives can be used to balance out the reduced salt content.[39] As such, reformulation requires a broad array of analytical techniques and industry knowledge, varying based upon the component sought out for change.

Stability, cycle, and challenge testing: As hinted at in the prior subsection, salt plays an important role in the shelf life of meats and other foodstuffs.[39] However, it also can be a leading contributor to cardiovascular complications.[38] Finding a balance between a more nutritious product and a more shelf-stable product proves to be quite tricky. This is one of several conundrums the stability testing laboratory faces in the food and beverage industry. Multiple deteriorative catalysts can influence the shelf life of a product, from microbiological contaminants and chemical deterioration to storage conditions and the packaging itself. As such, there are multiple approaches to those catalysts, from introducing additives to improving the packaging.[40] The analytical techniques applied in stability, cycle, and challenge testing will vary based on, to a large degree, the product matrix and its chemical composition.[40] Microbiological testing is sure to be involved, particularly in challenge testing, which simulates what could happen to a product if contaminated by a microorganism and placed in a representative storage condition.[41] Calorimetry, spectrophotometry, spectroscopy, and hyperspectral imaging can be used to properly assess color, which has been shown to be a good gauge of food quality.[40] Other test types that may be used include water content, texture, viscosity, dispersibility, glass transition, and gas chromatography.[40]

Packaging analysis and extractable and leachable testing: Materials that contact food and beverages receive special regulatory consideration in various parts of the world. This includes alloys, bioplastics, can coatings, glass, metals, regenerated cellulose materials, paper, paperboard, plastics, printing inks, rubber, textiles, waxes, and woods.[42] As such, attempting to break new ground in food and beverage packaging development can be a tricky matter. Concerns of chemicals and elements that can be extracted or leach into food contact materials add another layer of complexity to developing and choosing packaging materials for foods and beverages. This requires extractable and leachable testing at various phases of product development to ensure the packaging selected during formulation is safe and effective.[43] Extractable and leachable testing for packaging could involve a number of techniques ranging from gas and liquid chromatography to ion chromatography and inductively coupled plasma mass spectrometry.[44]

1.2.2 Pre-manufacturing and manufacturing roles and testing

The laboratory participating in these roles is performing one or more tasks that relate to the preparative (i.e., pre-manufacturing) or quality control (i.e., manufacturing) tasks of food and beverage production. Preparative work such as caloric and nutritional analysis may happen in a variety of contexts, from inside the R&D lab to in the manufacturing facility's lab itself, if it has one. This work may also be conducted by a third-party lab, or it may even be performed using non-laboratory techniques such as food composition database analysis.[45][46] However, caloric and nutritional testing—in conjunction with meeting regulatory-driven labeling requirements—still lands firmly in the role of pre-manufacturing activity, definitively after commercial formulation and packing requirements have been finalized but before the formal manufacturing process has begun.[47] Allergen testing works in a similar fashion, though the manufacturer ideally uses a full set of best practices for food allergen management and testing, from confirming allergens (and correct labeling) from ingredients ordered to performing final production line cleanup (e.g., when a new allergen-free commercial formulation is being made or an unintended contamination has occurred).[48] The end user benefits from these caloric, nutritional, and allergen analysis activities not only through the provision of a more transparent window into what they are consuming; these laboratory activities also can better ensure end users' attempts at maintaining their own good health.

Finally, laboratory testing can also be found along the production chain in the manufacturing facility itself. This type of testing is couched as quality control testing, primarily, or as quality assurance, secondarily. Some of this analysis may be integrated into the production workflow, as with x-ray inspection.[49] Fluorescence sensing technologies are also useful for contaminant testing, though they are largely limited to laboratory use, with hopes they may become more relevant for inspection at the point of production.[50] This move to "novel, rapid, and non-destructive" methods of testing both in the lab and in the production facility appears to be a growing trend[51], loosening the concept of the "quality control laboratory" as an entity in the production facility. Regardless of analytical location, the quality control lab provides benefits to society by being a critical component of an overall quality management system that better ensures the safety of those consuming the final product.

The following types of testing may be associated with the pre-manufacturing and manufacturing role:

Allergen, calorie, and nutrition testing: From label accuracy to consumer safety, this type of testing is critical to food and beverage manufacturers. Caloric and nutritional testing—in conjunction with meeting regulation-driven labeling requirements—lands firmly in the role of pre-manufacturing activity, most certainly after commercial formulation and packing requirements have been finalized but before the formal manufacturing process has begun.[47] Allergen testing works in a similar fashion, though the manufacturer ideally uses a full set of best practices for food allergen management and testing, from confirming allergens (and correct labeling) from ingredients ordered to performing final production line cleanup (e.g., when a new allergen-free commercial formulation is being made or an unintended contamination has occurred).[48] This role will usually require laboratory analytical techniques such as calorimetry, laser scanning confocal microscopy, immunoassays, and mass spectrometry.[52] Note, however, that non-laboratory techniques such as food composition database analysis are also used to evaluate the nutritional content of products that aren't heavily processed.[45][46]

Quality control testing: A food or beverage product's launch success hinges on many variables; if one variable is off, it may very well be rejected by the consumer. Producers invest significantly in a product they believe in, requiring assurances along the way that it will have its best chance of success. The producer will want to ensure high-quality raw ingredients, high-quality equipment, an effective processing layout, and high customer satisfaction. A well-implemented quality management system (QMS) plays a major role in ensuring those requirements, and by extension that includes a type of testing couched as quality control testing, primarily, or as quality assurance testing, secondarily.[53] Many aspects of food and beverage production require high levels of quality, and as such, the type of analytical testing that takes place will vary, sometimes significantly, depending upon the associated risk. Are microbiological, physiological, or chemical risks being managed? These and other questions will determine the laboratory approach to quality, which is in turn ideally reflected in the QMS.

1.2.3 Post-production regulation and security roles and testing

The laboratory participating in these roles is performing one or more tasks that relate to the post-production examination of foods and beverages for regulatory, security, or accreditation purposes. This type of testing examines raw ingredients, consumable products, and packaging found not only in a production facility but also in locations such as shipping docks, farms, grocery stores, and more. Labs are often third parties accrediting a producer to a set of standards, ensuring regulatory compliance, conducting authenticity and adulteration testing, conducting security checks at borders, and applying contamination testing as part of an overall effort to track down the source of a foodborne illness. In the last case, the lab may not even be a traditional "food and beverage" lab but rather a public health laboratory, highlighting in full the human safety elements associated with our food and water supplies. The human safety element is also seen in government labs such as the U.S. Department of Agriculture (USDA) Food Safety and Inspection Service's (FSIS) Field Service Laboratories, which "coordinate and conduct laboratory analytical services in support of the Agency's farm-to-table strategies in the disciplines of chemistry, microbiology, and pathology for food safety in meat, poultry, and egg products."[54] In addition to ensuring a safer food supply, society also benefits from these and similar labs by better holding producers legally accountable for their production methods and obligations.

The following types of testing may be associated with the post-production regulation and security role:

Authenticity and adulteration testing: A variety of local, regional, national, and international entities (e.g., Operation OPSON, E.U. Food Fraud Network, and U.S. Customs and Border Protection) are responsible for detecting and preventing violations of food supply chain laws and regulations across national and international borders, while also collecting evidence for investigation and prosecution. "To support these regulatory and commercial initiatives," says Gerard Downey of the Teagasc Food Research Centre, "research scientists have devoted considerable resources to the development of analytical techniques to identify foods or food ingredients that are in breach of labeling requirement and may consequently be adulterated." Among these techniques are DNA fingerprinting; visible, ultraviolet, infrared, fluorescence emission, and nuclear magnetic resonance spectroscopy; mass spectrometry; isotopic analysis; chromatography; polymerase chain reaction; differential scanning calorimetry; chemometric; and "electric nose and tongue" techniques.[55]

Accreditation-led testing: At the end of 2021, the U.S. Food and Drug Administration amended the Food Safety Modernization ACT (FSMA) to include the Laboratory Accreditation for Analyses of Foods (LAAF) rule, which mandates laboratory "testing of food in certain circumstances" be performed by LAAF-accredited laboratories. This accreditation is optional and designed for those accreditation bodies and laboratories that have been or are seeking to be be recognized by the FDA as able to LAAF-accredit or be LAAF-accredited for the testing needs of the program. LAAF's "certain circumstances" include not only regulatory-based testing of specific sprouts, eggs, and water, but also certain foods being considered for import into the country.[10] LAAF represents one of several legal and regulatory forces driving accreditation of food and beverage laboratories to a higher standard. It also means greater potential for more testing opportunities for the third-party food and beverage lab wishing to expand into enforcement and security roles. The type of testing they conduct will already mirror those of other roles mentioned prior, but with greater emphasis on meeting stricter testing requirements.

1.2.4 Tangential laboratory work

The following tangential laboratory roles aren't necessarily found directly in the food and beverage facility. However, some level of laboratory work is required in these roles, which intersect with the food and beverage industry in some capacity.

Processing equipment design, monitoring, and sanitation: "Sanitation provides the hygienic conditions required to produce safe food," say Ho and Sandoval in chapter seven of Food Safety Engineering.[56] "Improper sanitation of equipment can potentially introduce hazardous contamination to food and enhance pathogen harborage in the food-processing environment."[56] They note the value of sanitation standard operating procedures (SSOPs) to the production facility, which dictate sanitation methods and frequencies, monitoring methods, and record keeping methods.[56] These SSOPs are not only driven by good manufacturing practice (GMP) but also appropriate and effective laboratory testing. That foundation of laboratory testing has occurred historically with the experience of food and beverage producers and those engineering and standardizing hygienic solutions for the industry. Combined, these industry and laboratory experiences have driven regulations and standards on hygienic design throughout the world. Broadly speaking, this has culminated in a set of "fundamental hygienic requirements for product contact surfaces and food equipment," ranging from physical and chemical properties such as being nontoxic, corrosion-resistant, and non-absorbent, to mechanical properties such as being durable and smooth, and operational properties such as being cleanable and low-maintenance.[57][58] In turn, these properties require laboratory and engineering knowledge about metals, alloys, plastics, and many other materials.[58] Here we find multi-disciplinary knowledge in materials science, microbiology, chemistry, physics, and more, implying a corresponding necessity for knowledge on a wide variety of testing methods.

Public health and clinical diagnostics for foodborne illness: While public health and clinical diagnostic laboratories are indeed of a different ilk, they are undoubtedly intertwined with the food and beverage industry. With millions of people getting sick and thousands hospitalized and dying from foodborne diseases each year in the U.S. alone[59], this fact becomes clearer. When the food and beverage industry's SSOP- and QMS-related activities go awry—knowingly or unknowingly—or if the consumer does not follow proper precautions with the foods and beverages they consume, public health and clinical laboratories may get involved in tracking the source of the pathogen or treating the foodborne illness, respectively. As previous discussion has noted[60], the interest of public health is at the foundation of the historical and regulatory development of the modern food and beverage industry. In the U.S., the presence of these labs is characterized by efforts such as FoodNet, a Centers for Disease Control and Prevention (CDC) program that conducts "active surveillance; surveys of laboratories, physicians, and the general population; and population-based epidemiologic studies" for roughly 15 percent of the U.S. population.[61] As a public health tool, FoodNet helps track rates of illness from foodborne pathogens. Through its Diagnostic Laboratory Practices Tool, the public health tool extends into the clinical diagnostics realm, recruiting nearly 700 of those labs to report on their testing practices in regards to select enteric pathogens. From there, one can glean the test methods and specimen submissions being conducted.[62]


1.3 Safety and quality in the food and beverage industry

According to 2011 estimates by the CDC, "48 million people get sick, 128,000 are hospitalized, and 3,000 die from foodborne diseases each year in the United States."[59] As of December 2022, the CDC has yet to issue revised estimates of these numbers. However, one can wonder if those numbers are higher post-COVID. On a more global scale, the World Health Organization (WHO) estimates that one in ten people worldwide fall ill to consuming contaminated food.[63] These and other statistics highlight the vital nature of improving safety and quality in the world's food supplies.

The demand for this safety and quality work is most obvious when viewed from the governmental level. For example, the U.S. Department of Agriculture (USDA) estimated in 2017 that some "7,500 food safety inspection personnel go to work in more than 6,000 regulated food facilities and 122 ports of entry," and "[a]nother 2,000 food safety professionals go to work in three public health laboratories, 10 district offices, and our headquarters office. These employees run test results, dispatch outbreak investigators, and unpack data to reveal telling trends and inform proactive, prevention-based policies that will lead to safer food and fewer illnesses."[64] In another example, the U.S. Centers for Disease Control and Prevention (CDC) and its FoodNet surveillance program conducts "active surveillance; surveys of laboratories, physicians, and the general population; and population-based epidemiologic studies" for roughly 15 percent of the U.S. population.[61] Additionally, entities like the USDA and the U.S. Food and Drug Administration (FDA) are significant forces behind the development of regulations that affect how and when other entities—governmental and non-governmental—conduct their food and beverage testing and production activities.

We also must look outside the government level, to presumably the bulk of food and beverage labs located in the private sector. We have to use "presumably" because, as Robin Stombler of Food Safety Tech noted in April 2016, no one really knows how many food laboratories exist in, for example, the U.S.[65] As Stombler noted, this causes several problems[65]:

For example, we do not have a centralized way of determining if a particular laboratory has deficiencies in testing practices or if its accreditation has been revoked. Without knowing where and by whom testing is conducted, we are at a disadvantage in developing nationwide systems for tracking foodborne disease outbreaks and notifying laboratory professionals of emerging pathogens. We most certainly do not know if all food laboratories are following recognized testing methods and standards that affect the food we all consume.

The FDA finally made some minor progress in this department, announcing in December 2021 that food and beverage labs conducting a specific range of activities would need to become accredited, and a list of accredited labs would be maintained.[66][67] The accreditation described under the FDA's Laboratory Accreditation for Analyses of Foods (LAAF) rule is voluntary, but labs wanting to participate will need to get accredited.[66] For now, only specific types of testing require accreditation, including sprouts, mass-produced eggs, bottled drinking water, certain imports, and certain items affected by recalls and other regulatory action.[10] This may expand in the future, and it may force more food and beverage labs to become accredited and recognized.

That said, these third-party food safety and quality labs exist not just because of regulatory controls, but also because private incentives towards maintaining reputation and a standard of quality in the industry. Virginia Tech's John Bovay emphasizes this in an August 2022 research paper[68]:

Producers and sellers often implement private or collective standards for food safety as an investment in their own reputations. Producers who have invested in such standards can benefit from additional regulations that improve safety because these regulations can further bolster the reputation of the industry and also raise costs for rival firms. Thus, food-safety regulations may have effects on competition and certainly can have differential welfare effects.


References

  1. 1.0 1.1 Nielsen, S. (2015). Food Analysis Laboratory Manual (2nd ed.). Springer. pp. 177. ISBN 9781441914620. https://books.google.com/books?id=i5TdyXBiwRsC&printsec=frontcover. 
  2. 2.0 2.1 Roberts, Cynthia A. (2001). The food safety information handbook. Westport, CT: Oryx Press. pp. 25-28. ISBN 978-1-57356-305-5. 
  3. Lytton, Timothy D. (2019). "Chapter 2: The Gospel of Clean Milk". Outbreak: foodborne illness and the struggle for food safety. Chicago ; London: The University of Chicago Press. pp. 24-64. ISBN 978-0-226-61154-9. 
  4. 4.0 4.1 Hardy, A. (1 August 1999). "Food, Hygiene, and the Laboratory. A Short History of Food Poisoning in Britain, circa 1850-1950" (in en). Social History of Medicine 12 (2): 293–311. doi:10.1093/shm/12.2.293. ISSN 0951-631X. https://academic.oup.com/shm/article-lookup/doi/10.1093/shm/12.2.293. 
  5. Stanziani, A. (2016). "Chapter 9. Municipal Laboratories and the Analysis of Foodstuffs in France Under the Third Republic: A Case Study of the Paris Municipal Laboratory, 1878-1907". In Atkins, P.J.; Lummel, P.; Oddy, D.J. (in English). Food and the city in Europe since 1800. London; New York: Routledge. ISBN 978-1-315-58261-0. OCLC 950471625. https://books.google.com/books?hl=en&lr=&id=OPYFDAAAQBAJ&oi=fnd&pg=PA105. 
  6. 6.0 6.1 Redman, Nina (2007). "Chapter 1: Background and History". Food safety: a reference handbook. Contemporary world issues (2nd ed ed.). Santa Barbara, Calif: ABC-CLIO. ISBN 978-1-59884-048-3. OCLC ocm83609690. https://www.worldcat.org/title/mediawiki/oclc/ocm83609690. 
  7. 7.0 7.1 Stevens, K.; Hood, S. (2019). "Chapter 40. Food Safety Management Systems". In Doyle, Michael P.; Diez-Gonzalez, Francisco; Hill, Colin. Food microbiology: fundamentals and frontiers (5th edition ed.). Washington, DC: ASM Press. pp. 1007-20. ISBN 978-1-55581-997-2. 
  8. Detwiler, Darin S. (2020). "Chapter 2: "Modernization" started over a century ago". Food safety: past, present, and predictions. London [England] ; San Diego, CA: Academic Press. pp. 11-23. ISBN 978-0-12-818219-2. 
  9. "Background on the FDA Food Safety Modernization Act (FSMA)". Food and Drug Administration. 30 January 2018. https://www.fda.gov/food/food-safety-modernization-act-fsma/background-fda-food-safety-modernization-act-fsma. Retrieved 07 December 2022. 
  10. 10.0 10.1 10.2 Douglas, S. (21 February 2022). "FDA Food Safety Modernization Act Final Rule on Laboratory Accreditation for Analyses of Foods: Considerations for Labs and Informatics Vendors". LIMSwiki.org. https://www.limswiki.org/index.php/LII:FDA_Food_Safety_Modernization_Act_Final_Rule_on_Laboratory_Accreditation_for_Analyses_of_Foods:_Considerations_for_Labs_and_Informatics_Vendors. Retrieved 07 December 2022. 
  11. "Foodborne Germs and Illnesses". Centers for Disease Control and Prevention. 18 March 2020. https://www.cdc.gov/foodsafety/foodborne-germs.html. Retrieved 07 December 2022. 
  12. Lytton, Timothy D. (2019). "An Introduction to the Food Safety System". Outbreak: Foodborne Illness and the Struggle for Food Safety. Chicago ; London: The University of Chicago Press. pp. 1-23. ISBN 978-0-226-61154-9. 
  13. Floros, John D.; Newsome, Rosetta; Fisher, William; Barbosa-Cánovas, Gustavo V.; Chen, Hongda; Dunne, C. Patrick; German, J. Bruce; Hall, Richard L. et al. (26 August 2010). "Feeding the World Today and Tomorrow: The Importance of Food Science and Technology: An IFT Scientific Review" (in en). Comprehensive Reviews in Food Science and Food Safety 9 (5): 572–599. doi:10.1111/j.1541-4337.2010.00127.x. https://onlinelibrary.wiley.com/doi/10.1111/j.1541-4337.2010.00127.x. 
  14. Food Safety: Current Status and Future Needs. American Academy of Microbiology Colloquia Reports. Washington (DC): American Society for Microbiology. 1998. PMID 33001600. http://www.ncbi.nlm.nih.gov/books/NBK562616/. 
  15. Nollet, L.M.L.; Toldrá, F., ed. (2015). Handbook of Food Analysis (Two Volume Set) (3rd ed.). CRC Press. pp. 1568. ISBN 9781482297843. https://books.google.com/books?id=KtAdCgAAQBAJ&printsec=frontcover. 
  16. Douglas, S.E. (July 2022). "Labs by industry: Part 2". The Laboratories of Our Lives: Labs, Labs Everywhere! (2nd ed.). LIMSwiki. https://www.limswiki.org/index.php/LII:The_Laboratories_of_Our_Lives:_Labs,_Labs_Everywhere!/Labs_by_industry:_Part_2. Retrieved 07 December 2022. 
  17. Bhandari, B.; Roos, Y.H. (2012). "Chapter 1: Food Materials Science and Engineering: An Overview". In Bhandari, Bhesh; Roos, Yrjö H.. Food Materials Science and Engineering. Chichester, West Sussex, UK ; Ames, Iowa: Wiley-Blackwell. pp. 1–25. ISBN 978-1-4051-9922-3. 
  18. "Diverse skill sets needed for growing opportunities". Institute of Food Technologists. 26 October 2020. https://www.ift.org/news-and-publications/news/2020/october/26/diverse-skill-sets-needed-for-growing-opportunities. Retrieved 07 December 2022. 
  19. 19.0 19.1 Flynn, D. (7 October 2013). "Food Labs Integral to Changing World of Food Safety". Food Safety News. https://www.foodsafetynews.com/2013/10/food-labs-integral-to-changing-world-of-food-safety/. Retrieved 07 December 2022. 
  20. 20.0 20.1 20.2 Ferguson, B. (12 December 2017). "Outsourcing: Pathogen Testing under the Microscope". Food Safety Magazine. https://www.food-safety.com/articles/5584-outsourcing-pathogen-testing-under-the-microscope. Retrieved 07 December 2022. 
  21. 21.0 21.1 Ferguson, B. (24 June 2020). "Trends in Food Safety Testing". Food Safety Magazine. https://www.food-safety.com/articles/6666-trends-in-food-safety-testing. Retrieved 07 December 2022. 
  22. 22.0 22.1 22.2 Ferguson, B. (16 April 2020). "Analytical Testing in Food Safety Continues to Grow". Food Safety Magazine. https://www.food-safety.com/articles/6542-analytical-testing-in-food-safety-continues-to-grow. Retrieved 07 December 2022. 
  23. "Third-Party Testing For Food Safety Is On The Rise". Food Logistics. 20 December 2013. https://www.foodlogistics.com/safety/news/11284235/thirdparty-testing-for-food-safety-is-on-the-rise. Retrieved 07 December 2022. 
  24. Ferguson, B. (16 April 2021). "Food Safety Testing to Continue to Increase in 2021". Strategic Consulting Blog. Strategic Consulting, Inc. https://www.strategic-consult.com/2021/04/food-safety-testing-to-continue-to-increase-in-2021/. Retrieved 07 December 2022. 
  25. Ferguson, B. (20 June 2021). "Food Safety Testing to Continue to Increase in 2021 (Part Two)". Strategic Consulting Blog. Strategic Consulting, Inc. https://www.strategic-consult.com/2021/06/food-safety-testing-to-continue-to-increase-in-2021-part-two/. Retrieved 07 December 2022. 
  26. 26.0 26.1 "Why You Need A Commercial Formula". BevSource. 13 August 2022. https://www.bevsource.com/news/why-you-need-commercial-formula. 
  27. 27.0 27.1 Gude, T. (2019). "Solutions Commonly Applied in Industry and Outsourced to Expert Laboratories". In Suman, M.. Food Contact Materials Analysis: Mass Spectrometry Techniques. Royal Society of Chemistry. doi:10.1039/9781788012973-00245. ISBN 9781788017190. 
  28. "Mondelez International Breaks Ground for New Research & Development Center in Poland". Mondelez International. 8 June 2016. https://ir.mondelezinternational.com/news-releases/news-release-details/mondelez-international-breaks-ground-new-research-development. Retrieved 07 December 2022. 
  29. "Hartwick College Center for Craft Food & Beverage". Hartwick College. https://www.hartwick.edu/about-us/center-for-craft-food-and-beverage/. Retrieved 07 December 2022. 
  30. Schiefer, G.; Deiters, J. (2021). "Chapter 1: Food innovation dynamics and network support". In Galanakis, Charis Michael (in en). Innovation Strategies in the Food Industry: Tools for Implementation. Academic Press. pp. 3–16. ISBN 978-0-323-91552-6. https://books.google.com/books?id=jqZJEAAAQBAJ. 
  31. Bigliardi, B.; Filippelli, S. (2021). "Chapter 2: Open innovation and incorporation between academia and the food industry". In Galanakis, Charis Michael (in en). Innovation Strategies in the Food Industry: Tools for Implementation. Academic Press. pp. 17–38. ISBN 978-0-323-91552-6. https://books.google.com/books?id=jqZJEAAAQBAJ. 
  32. Patel, P. (18 February 2021). "Beyond Burgers: Animal and Plant Cells Combined for 3D-Printed Steaks". IEEE Spectrum. https://spectrum.ieee.org/3d-printed-meat. Retrieved 07 December 2022. 
  33. 33.0 33.1 33.2 Vrzal, Tomáš; Olšovská, Jana (15 October 2019). "Sensomics - basic principles and practice". KVASNY PRUMYSL 65 (5). doi:10.18832/kp2019.65.166. ISSN 2570-8619. http://www.kvasnyprumysl.eu/index.php/kp/article/view/190. 
  34. 34.0 34.1 34.2 Parker, J.K.; Elmore, J.S.; Methven, L., ed. (2014). Flavour development, analysis and perception in food and beverages. Woodhead Publishing Series in Food Science, Technology and Nutrition. Waltham, MA: Woodhead Pub. pp. 448. ISBN 978-1-78242-103-0. https://books.google.com/books?id=DnB7AwAAQBAJ&printsec=frontcover. 
  35. 35.0 35.1 Zellner, B.d'A.; Dugo, P.; Dugo, G. et al. (2015). "Chapter 4: Flavor". In Nollet, L.M.L.; Toldrá, F.. Handbook of Food Analysis (Two Volume Set) (3rd ed.). CRC Press. pp. 47–64. ISBN 9781482297843. https://books.google.com/books?id=KtAdCgAAQBAJ&printsec=frontcover. 
  36. Regueiro, Jorge; Negreira, Noelia; Simal-Gándara, Jesús (3 July 2017). "Challenges in relating concentrations of aromas and tastes with flavor features of foods" (in en). Critical Reviews in Food Science and Nutrition 57 (10): 2112–2127. doi:10.1080/10408398.2015.1048775. ISSN 1040-8398. https://www.tandfonline.com/doi/full/10.1080/10408398.2015.1048775. 
  37. 37.0 37.1 Carrillo, W. (2020). Biotechnology and Food Production. ED-Tech Press. pp. 404. ISBN 9781839473432. https://books.google.com/books?id=qePEDwAAQBAJ&printsec=frontcover. 
  38. 38.0 38.1 38.2 O'Sullivan, Maurice G. (2020). "Chapter 1: Understanding the requirement to reformulate: Science, health, consumer demand, regulation, and capability". Salt, fat, and sugar reduction: sensory approaches for nutritional reformulation of foods and beverages. Duxford, United Kingdom: Elsevier, Woodhead Publishing. pp. 1–28. ISBN 978-0-12-819741-7. https://books.google.com/books?id=vE_VDwAAQBAJ&printsec=frontcover. 
  39. 39.0 39.1 Kloss, Loreen; Meyer, Julia Dawn; Graeve, Lutz; Vetter, Walter (1 June 2015). "Sodium intake and its reduction by food reformulation in the European Union — A review" (in en). NFS Journal 1: 9–19. doi:10.1016/j.nfs.2015.03.001. https://linkinghub.elsevier.com/retrieve/pii/S2352364615000024. 
  40. 40.0 40.1 40.2 40.3 Subramaniam, Persis, ed. (2016). The stability and shelf life of food. Woodhead Publishing Series in Food Science, Technology and Nutrition (Second edition ed.). Amsterdam: Elsevier/WP, Woodhead Publishing. ISBN 978-0-08-100436-4. OCLC 956922925. https://www.worldcat.org/title/mediawiki/oclc/956922925. 
  41. Komitopoulou, E. (2011). "Microbiological challenge testing of food". In Kilcast, David; Subramaniam, Persis. Food and beverage stability and shelf life. Woodhead Publishing Series in Food Science, Technology and Nutrition. Oxford: WP, Woodhead Publ. pp. 507–526. ISBN 978-0-85709-254-0. OCLC 838321011. https://www.worldcat.org/title/mediawiki/oclc/838321011. 
  42. Baughan, Joan Sylvain, ed. (2021). Global Legislation for Food Contact Materials. Woodhead Publishing Series in Food Science, Technology and Nutrition (Second edition ed.). Oxford: Woodhead Publishing. ISBN 978-0-12-821181-6. OCLC on1272898230. https://www.worldcat.org/title/mediawiki/oclc/on1272898230. 
  43. Balogh, M.P. (2011). "Testing the Critical Interface: Leachables and Extractables". LCGC North America 29 (6): 492–501. https://www.chromatographyonline.com/view/testing-critical-interface-leachables-and-extractables. 
  44. "Extractables and leachables testing (E&Ls)". Leeder Analytical. https://leeder-analytical.com/extractables-and-leachables-testing/. Retrieved 07 December 2022. 
  45. 45.0 45.1 "How to Obtain a Nutritional Analysis of Your Food Product" (PDF). ESHA Research. December 2014. https://esha.com/wp-content/uploads/2014/12/ESHA-Obtaining-Nutritional-Analysis-eBook.pdf. Retrieved 07 December 2022. 
  46. 46.0 46.1 Noh, M.F.M.; Gunasegavan, R.D.-N.; Khalid, N.M. et al. (2020). "Recent Techniques in Nutrient Analysis for Food Composition Database". Molecules 25 (19): 4567. doi:10.3390/molecules25194567. PMC PMC7582643. PMID 33036314. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7582643. 
  47. 47.0 47.1 "What Do I Need To Know About Nutrition Testing for My Beverage Brand?". BevSource. 2 December 2022. https://www.bevsource.com/news/what-do-i-need-know-about-nutrition-testing-my-beverage-brand. 
  48. 48.0 48.1 "Code of Practice on Food Allergen Management for Food Business Operators, CXC 80-2020" (PDF). Codex Alimentarius. 2020. https://www.fao.org/fao-who-codexalimentarius/sh-proxy/en/?lnk=1&url=https%253A%252F%252Fworkspace.fao.org%252Fsites%252Fcodex%252FStandards%252FCXC%2B80-2020%252FCXC_080e.pdf. Retrieved 07 December 2022. 
  49. Draus, C. (15 November 2017). "Quality Control or Quality Assurance in the Food Industry?: X-ray Inspection Equipment Ensures Both". Eagle PI. https://www.eaglepi.com/blog/quality-control-or-quality-assurance-in-the-food-industry/. Retrieved 07 December 2022. 
  50. Han, A.; Hao, S.; Yang, Y. et al. (2020). "Perspective on recent developments of nanomaterial based fluorescent sensors: applications in safety and quality control of food and beverages". Journal of Food and Drug Analysis 28 (4): 2. doi:10.38212/2224-6614.1270. 
  51. Aadil, R.M.; Madni, G.M.; Roobab, U. et al.. "Chapter 1. Quality Control in Beverage Production: An Overview". In Grumezescu, A.M.; Holban, A.M.. Quality Control in the Beverage Industry. The Science of Beverages. 17. Elsevier. pp. 1-38. ISBN 9780128166826. 
  52. Dimitrova, M. (8 October 2019). "Nutrition Analysis Techniques to Determine the Nutritional Content of Food". AZO Materials. https://www.azom.com/article.aspx?ArticleID=18555. Retrieved 07 December 2022. 
  53. Aadil, R.M.; Madni, G.M.; Roobab, U. et al. (2019). "Chapter 1: Quality Control in Beverage Production: An Overview". In Grumezescu, A.; Grumezescu, A.M.; Holban, A.M. (in English). Quality Control in the Beverage Industry. 17. Academic Press. ISBN 978-0-12-816682-6. OCLC 1122792300. https://books.google.com/books?id=2YmpDwAAQBAJ&printsec=frontcover. 
  54. "FSIS Laboratories". Food Safety and Inspection Service, U.S. Department of Agriculture. 26 April 2019. https://www.fsis.usda.gov/science-data/laboratories-procedures/fsis-laboratories. Retrieved 07 December 2022. 
  55. Downey, Gerard (2016) (in English). Advances in Food Authenticity Testing.. S.l.: Woodhead Publishing.. pp. 798. ISBN 978-0-08-100233-9. OCLC 1096681184. https://books.google.com/books?id=Q-8QCgAAQBAJ&printsec=frontcover. 
  56. 56.0 56.1 56.2 Ho, Kai-Lai Grace; Sandoval, Alex (2020), Demirci, Ali; Feng, Hao; Krishnamurthy, Kathiravan, eds., "Sanitation Standard Operating Procedures (SSOPs)" (in en), Food Safety Engineering (Cham: Springer International Publishing): 175–190, doi:10.1007/978-3-030-42660-6_7, ISBN 978-3-030-42659-0, http://link.springer.com/10.1007/978-3-030-42660-6_7 
  57. Schmidt, Ronald H.; Piotter, Helen M. (2020), Demirci, Ali; Feng, Hao; Krishnamurthy, Kathiravan, eds., "The Hygienic/Sanitary Design of Food and Beverage Processing Equipment" (in en), Food Safety Engineering (Cham: Springer International Publishing): 267–332, doi:10.1007/978-3-030-42660-6_12, ISBN 978-3-030-42659-0, http://link.springer.com/10.1007/978-3-030-42660-6_12 
  58. 58.0 58.1 n.a. (3 April 2020). "Selecting materials for standard parts in the food and beverage industry: a buyers’ guide". Engineering Update. https://engineering-update.co.uk/2020/04/03/selecting-materials-for-standard-parts-in-the-food-and-beverage-industry-a-buyers-guide/. Retrieved 07 December 2022. 
  59. 59.0 59.1 "Burden of Foodborne Illness: Overview". Estimates of Foodborne Illness in the United States. Centers for Disease Control and Prevention. 5 November 2018. https://www.cdc.gov/foodborneburden/estimates-overview.html. Retrieved 07 December 2022. 
  60. Douglas, S.E. (16 August 2022). "What is the importance of a food and beverage testing laboratory to society?". LIMSwiki. https://www.limswiki.org/index.php/LIMS_FAQ:What_is_the_importance_of_a_food_and_beverage_testing_laboratory_to_society%3F. Retrieved 07 December 2022. 
  61. 61.0 61.1 "About FoodNet". Centers for Disease Control and Prevention. 23 September 2021. https://www.cdc.gov/foodnet/about.html. Retrieved 07 December 2022.  Cite error: Invalid <ref> tag; name "CDCAboutFN21" defined multiple times with different content
  62. "Diagnostic Laboratory Practices". FoodNet Fast. Centers for Disease Control and Prevention. 23 September 2021. https://wwwn.cdc.gov/FoodNetFast/LabSurvey. Retrieved 07 December 2022. 
  63. "Estimating the burden of foodborne diseases". World Health Organization. https://www.who.int/activities/estimating-the-burden-of-foodborne-diseases. Retrieved 07 December 2022. 
  64. Almanza, A.V. (21 February 2017). "The U.S. Food Safety System Has Come A Long Way in 50 Years". U.S. Department of Agriculture. https://www.usda.gov/media/blog/2016/07/05/us-food-safety-system-has-come-long-way-50-years. Retrieved 14 August 2022. 
  65. 65.0 65.1 Stombler, R. (4 April 2016). "Counting Food Laboratories". Food Safety Tech. https://foodsafetytech.com/feature_article/counting-food-laboratories/. Retrieved 07 December 2022. 
  66. 66.0 66.1 News Desk (10 December 2021). "Laboratory accreditation required by FSMA finally becoming a reality". Food Safety News. https://www.foodsafetynews.com/2021/12/laboratory-accreditation-required-by-fsma-finally-becoming-a-reality/. Retrieved 07 December 2022. 
  67. "FDA Releases New Dashboard for Laboratory Accreditation for Analyses of Foods Program". Food Safety Magazine. 5 August 2022. https://www.food-safety.com/articles/7923-fda-releases-new-dashboard-for-laboratory-accreditation-for-analyses-of-foods-program. Retrieved 07 December 2022. 
  68. Bovay, John (18 August 2022). "Food safety, reputation, and regulation" (in en). Applied Economic Perspectives and Policy: aepp.13315. doi:10.1002/aepp.13315. ISSN 2040-5790. https://onlinelibrary.wiley.com/doi/10.1002/aepp.13315.