This document discusses approaches for weighing evidence and assessing uncertainty in microbiological risk assessment. It defines key concepts like evidence, uncertainty, and weight-of-evidence. It examines how these concepts are currently applied and discusses why they need to be applied more systematically given the complexity of questions in food safety. Specifically, it explores how to use weight-of-evidence and uncertainty assessment to integrate different sources of evidence and deal with limitations in knowledge. Examples of application areas like outbreak investigations and dose-response modeling are also provided.
Presentation from the 3rd Joint Meeting of the Antimicrobial Resistance and Healthcare-Associated Infections (ARHAI) Networks, organised by the European Centre of Disease Prevention and Control - Stockholm, 11-13 February 2015
Presentation of the EFSA's second scientific conference, held on 14-16 October 2015 in Milan, Italy.
DRIVERS FOR EMERGING ISSUES IN ANIMAL AND PLANT HEALTH
Presentation from the 3rd Joint Meeting of the Antimicrobial Resistance and Healthcare-Associated Infections (ARHAI) Networks, organised by the European Centre of Disease Prevention and Control - Stockholm, 11-13 February 2015
Presentation of the EFSA's second scientific conference, held on 14-16 October 2015 in Milan, Italy.
DRIVERS FOR EMERGING ISSUES IN ANIMAL AND PLANT HEALTH
A Moda na Internet - Um estudo da rede social digital DujourLarissa Andrade
Apresentação do Trabalho de Conclusão do Curso de Comunicação Social - Publicidade e Propaganda intitulado "A Moda na Internet - Um estudo da rede social digital Dujour", apresentado em Dezembro de 2014 na Universidade Federal do Pará.
La Revolución Francesa fue bien un conflicto social y político con diversos tipos de violencia, que convulsiono a Francia y por extensión de sus implicaciones a otras naciones de Europa.
Se inicio con la autoproclamación del tercer estado y culmino con el golpe de Napoleón Bonaparte en 1799.
La Revolución paso por varios etapas, la primera de ellas fue la reunión de los estados generales creado por el rey Luis XVI
25-01-2011 Guillermo Padrés participó junto al secretario de la función públ...Guillermo Padrés Elías
Nogales, Sonora. Las reglas del juego son trabajar de la mano y estrechar la coordinación con el gobierno del Presidente Felipe Calderón para enfrentar y resolver los rezagos y problemas torales de México y Sonora aseguró el Gobernador Guillermo Padrés Elías.
Al participar junto con el Secretario de la Función Pública Salvador Vega Casillas en los Diálogos con la Sociedad de Nogales con motivo del IV Informe del Presidente Calderón, el jefe del Ejecutivo dijo que “México y Sonora va muy bien” por eso importante este tipo de ejercicios para conocer el trabajo y la coordinación que se viene haciendo entre las tres instancias de gobierno.
Há, e julgo que infelizmente haverá sempre, aquelas crianças
negligenciadas, abusadas, institucionalizadas ou simplesmente esquecidas, que para a sociedade não passam de sombras, de sombras dentro de sombras.
OECD activities related to modern techniques of biotechnology and genome editingOECD Environment
This presentation highlights OECD's activities related to modern techniques of biotechnology including genome editing in light of previous OECD conferences and workshops and technical products, such as consensus documents.
A Moda na Internet - Um estudo da rede social digital DujourLarissa Andrade
Apresentação do Trabalho de Conclusão do Curso de Comunicação Social - Publicidade e Propaganda intitulado "A Moda na Internet - Um estudo da rede social digital Dujour", apresentado em Dezembro de 2014 na Universidade Federal do Pará.
La Revolución Francesa fue bien un conflicto social y político con diversos tipos de violencia, que convulsiono a Francia y por extensión de sus implicaciones a otras naciones de Europa.
Se inicio con la autoproclamación del tercer estado y culmino con el golpe de Napoleón Bonaparte en 1799.
La Revolución paso por varios etapas, la primera de ellas fue la reunión de los estados generales creado por el rey Luis XVI
25-01-2011 Guillermo Padrés participó junto al secretario de la función públ...Guillermo Padrés Elías
Nogales, Sonora. Las reglas del juego son trabajar de la mano y estrechar la coordinación con el gobierno del Presidente Felipe Calderón para enfrentar y resolver los rezagos y problemas torales de México y Sonora aseguró el Gobernador Guillermo Padrés Elías.
Al participar junto con el Secretario de la Función Pública Salvador Vega Casillas en los Diálogos con la Sociedad de Nogales con motivo del IV Informe del Presidente Calderón, el jefe del Ejecutivo dijo que “México y Sonora va muy bien” por eso importante este tipo de ejercicios para conocer el trabajo y la coordinación que se viene haciendo entre las tres instancias de gobierno.
Há, e julgo que infelizmente haverá sempre, aquelas crianças
negligenciadas, abusadas, institucionalizadas ou simplesmente esquecidas, que para a sociedade não passam de sombras, de sombras dentro de sombras.
OECD activities related to modern techniques of biotechnology and genome editingOECD Environment
This presentation highlights OECD's activities related to modern techniques of biotechnology including genome editing in light of previous OECD conferences and workshops and technical products, such as consensus documents.
Harmonization of Approaches for Food Ingredients and Constituents: Is It Poss...Burdock Group Consultants
Presented by Dr. Ray Matulka at IFT15 on Sunday, July 12 at 1:15 PM.
The basic principles of safety can apply to all constituents in foods and beverages whether they are present purposefully or not. However, numerous factors can influence the approaches utilized for hazard characterization and risk assessment for various food and beverage constituents. These factors can include; the regulatory and legal framework being followed, what is and what is not known scientifically about the safety of a constituent, what the substance is and its function in a food or beverage, and consumer perception of the substance in the food or beverage. Simply segregating the safety assessment of compounds found in foods and beverages based how they came to be present in foods and beverages can be problematic for all stakeholders charged with ensuring the safety of foods and beverages. Additionally, food safety organizations around the world have adopted a variety of different approaches for addressing the safety of constituents in foods and beverages, which complicates, rather than simplifies the risk assessment process. The ability to adopt and adapt various scientifically valid approaches for evaluating safety becomes important for ensuring the safety and continuity of supply of foods and beverages. Another important factor that must be considered while evaluating the safety of constituents in food and beverages is communication with the consumer and crafting appropriate messaging demonstrating the rigor of the evaluation with a goal of preserving and promoting trust in the safety of the food and beverage supply.
A Conceptual Framework for Conducting and Integrated Vulnerability Assessment...Global Risk Forum GRFDavos
Presentation at 3rd GRF One Health Summit 2015
Poverty and Health - One Health Approaches for Sustainable Development
Esther Achieng ONYANGO, Griffith University School of Environment: Centre for Environment and Population Health and Environmental Research Futures Institute, Brisbane, Australia
Linking research and management of food safety within One health/ecohealth co...ILRI
Presented by H. Nguyen-Viet, D. Grace, M.L. Lapar, F. Unger, J. McDermott and J. Gilbert at the 2nd Food Safety and Zoonoses Symposium for Asia Pacific: One Health Initiative to Food Safety and Pathogen Threat in Asia Pacific, Chiang Mai, 21-22 July 2011.
Presentation from the ECDC expert consultation on Whole Genome Sequencing organised by the European Centre of Disease Prevention and Control - Stockholm, 19 November 2015
Day 2- pm session: Hung Nguyen, Hanoi School of Public Health and Lucy Lapar, ILRI: “Supporting agriculture and public health ministries to implement a national food safety policy based on risk-based approaches”
Workshop on Approaches and Methods for Policy Process Research, co-sponsored by the CGIAR Research Programs on Policies, Institutions and Markets (PIM) and Agriculture for Nutrition and Health (A4NH) at IFPRI-Washington DC, November 18-20, 2013.
GenomeTrakr: Whole-Genome Sequencing for Food Safety and A New Way Forward in...ExternalEvents
http://www.fao.org/about/meetings/wgs-on-food-safety-management/en/
GenomeTrakr: Whole-Genome Sequencing for Food Safety and A New Way Forward in the Microbiological Testing & Traceability for Foodborne Pathogens. Presentation from the Technical Meeting on the impact of Whole Genome Sequencing (WGS) on food safety management -23-25 May 2016, Rome, Italy.
Inventory among DEMETER Stakeholders on EMERGING RISKS SystemsAGINFRA
Hans Marvin from RIKILT, WUR on the Inventory among DEMETER Stakeholders on EMERGING RISKS Systems.
Joint Workshop on Food Risk Assessment Research & Practice
24th November 2017, Wageningen University & Research, Netherlands
Inter-sectoral collaboration for One Health implementation in Vietnam: traini...ILRI
Presentation by Hung Nguyen-Viet, Scott Newman, Pham Duc Phuc, Dao Thu Trang and David Payne at the first International Symposium on One Health Research, Guangzhou, China, 22-23 November 2014.
Highlights on the EFSA Opinion on the appropriate age range for introduction ...EFSA EU
FENS 2019 - Dublin
Highlights on the EFSA Scientific Opinion on the appropriate age range for introduction of complementary feeding into an infant's diet, Prof M Fewtrell
Horizon scanning for emergence of new viruses in animal and public healthEFSA EU
Presentation of the EFSA's second scientific conference, held on 14-16 October 2015 in Milan, Italy.
DRIVERS FOR EMERGING ISSUES IN ANIMAL AND PLANT HEALTH
Livestock disease drivers, ecology and pathogen evolutionEFSA EU
Presentation of the EFSA's second scientific conference, held on 14-16 October 2015 in Milan, Italy.
DRIVERS FOR EMERGING ISSUES IN ANIMAL AND PLANT HEALTH
Discovering novel pathways of cross-species pathogen transmissionEFSA EU
Presentation of the EFSA's second scientific conference, held on 14-16 October 2015 in Milan, Italy.
DRIVERS FOR EMERGING ISSUES IN ANIMAL AND PLANT HEALTH
Relations between pathogens, hosts and environmentEFSA EU
Presentation of the EFSA's second scientific conference, held on 14-16 October 2015 in Milan, Italy.
DRIVERS FOR EMERGING ISSUES IN ANIMAL AND PLANT HEALTH
People, animals, plants, pests and pathogens: connections matterEFSA EU
Presentation of the EFSA's second scientific conference, held on 14-16 October 2015 in Milan, Italy.
DRIVERS FOR EMERGING ISSUES IN ANIMAL AND PLANT HEALTH
Ang Chong Yi Navigating Singaporean Flavors: A Journey from Cultural Heritage...Ang Chong Yi
In the heart of Singapore, where tradition meets modernity, He embarks on a culinary adventure that transcends borders. His mission? Ang Chong Yi Exploring the Cultural Heritage and Identity in Singaporean Cuisine. To explore the rich tapestry of flavours that define Singaporean cuisine while embracing innovative plant-based approaches. Join us as we follow his footsteps through bustling markets, hidden hawker stalls, and vibrant street corners.
Vietnam Mushroom Market Growth, Demand and Challenges of the Key Industry Pla...IMARC Group
The Vietnam mushroom market size is projected to exhibit a growth rate (CAGR) of 6.52% during 2024-2032.
More Info:- https://www.imarcgroup.com/vietnam-mushroom-market
Roti Bank Hyderabad: A Beacon of Hope and NourishmentRoti Bank
One of the top cities of India, Hyderabad is the capital of Telangana and home to some of the biggest companies. But the other aspect of the city is a huge chunk of population that is even deprived of the food and shelter. There are many people in Hyderabad that are not having access to
Hamdard Laboratories (India), is a Unani pharmaceutical company in India (following the independence of India from Britain, "Hamdard" Unani branches were established in Bangladesh (erstwhile East Pakistan) and Pakistan). It was established in 1906 by Hakeem Hafiz Abdul Majeed in Delhi, and became
a waqf (non-profitable trust) in 1948. It is associated with Hamdard Foundation, a charitable educational trust.
Hamdard' is a compound word derived from Persian, which combines the words 'hum' (used in the sense of 'companion') and 'dard' (meaning 'pain'). 'Hamdard' thus means 'a companion in pain' and 'sympathizer in suffering'.
The goals of Hamdard were lofty; easing the suffering of the sick with healing herbs. With a simple tenet that no one has ever become poor by giving, Hakeem Abdul Majeed let the whole world find compassion in him.
They had always maintained that working in old, traditional ways would not be entirely fruitful. A broader outlook was essential for a continued and meaningful existence. their effective team at Hamdard helped the system gain its pride of place and thus they made an entry into an expansive world of discovery and research.
Hamdard Laboratories was founded in 1906 in Delhi by Hakeem Hafiz Abdul Majeed and Ansarullah Tabani, a Unani practitioner. The name Hamdard means "companion in suffering" in Urdu language.(itself borrowed from Persian) Hakim Hafiz Abdul Majeed was born in Pilibhit City UP, India in 1883 to Sheikh Rahim Bakhsh. He is said to have learnt the complete Quran Sharif by heart. He also studied the origin of Urdu and Persian languages. Subsequently, he acquired the highest degree in the unani system of medicine.
Hakim Hafiz Abdul Majeed got in touch with Hakim Zamal Khan, who had a keen interest in herbs and was famous for identifying medicinal plants. Having consulted with his wife, Abdul Majeed set up a herbal shop at Hauz Qazi in Delhi in 1906 and started to produce herbal medicine there. In 1920 the small herbal shop turned into a full-fledged production house.
Hamdard Foundation was created in 1964 to disburse the profits of the company to promote the interests of the society. All the profits of the company go to the foundation.
After Abdul Majeed's death, his son Hakeem Abdul Hameed took over the administration of Hamdard Laboratories at the age of fourteen.
Even with humble beginnings, the goals of Hamdard were lofty; easing the suffering of the sick with healing herbs. With a simple tenet that no one has ever become poor by giving, Hakeem Abdul Majeed let the whole world find compassion in him. Unfortunately, he passed away quite early but his wife, Rabia Begum, with the support of her son, Hakeem Abdul Hameed, not only kept the institution in existence but also expanded it. As he grew up, Hakeem Abdul Hameed took on all responsibilities. After helping with his younger brother's upbringing and education, he included him in running the institution. Both brothers Hakeem Abdul Hameed and Hakim Mohammed
Food and beverage service Restaurant Services notes V1.pptx
Weighing evidence and assessing uncertainty in microbiological risk assessment
1. FEDERALINSTITUTE
FORRISKASSESSMENT
Weighing evidence and assessing
uncertainty in microbiological risk
assessment
Approaches for preparing appropriate scientific support
for decision making in complex questions
Matthias Greiner
Shaping the Future of Food Safety, Together.
Milan, 14-16 Oct 2015
2. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 2
Contents
What is evidence, uncertainty and WoE all about and
what are the application areas in microbiological food
safety?
Why do we need to apply these concepts more
systematically?
How can we use these concepts to deal with (the
limitations of our) knowledge?
What
Why
How
3. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 3
Credit
To all members of the current Working Group of the EFSA Scientific
Committee “Guidance on The Use of the Weight of Evidence
Approach in Scientific Assessments”
External experts: Maged Younes, Emilio Benfenati, Qasim Chaudhry, Peter Craig, Geoff
Frampton, Matthias Greiner, Anthony Hardy, Andrew Hart, Christer Hogstrand, Gijs
Kleter, Claude Lambre, Robert Luttik, Alonso Siani
EFSA: Djien Liem (AFSCO), Sybren Vos (ALPHA), Elisa Aiassa (AMU), : Marco Binaglia
and Michaela Hempen (BIOCONTAM), Jaime Aguilera (FEEDAP), Anna Castoldi (FIP)
and Camilla Smeraldi, Antonio Fernandez-Dumont (GMO), Silvia Valtuena-Martinez
(NDA), Andrea Terron (PRAS), Roy Kirby (Quality Management), Jean Lou Dorne
(SCER)
4. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 4
Definitions and context
– Working definitions
– Current practices related to evidence and uncertainty in the area of
microbiological risk assessment
– Application contexts in which the weight-of-evidence (WoE) concept
is used
What
5. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 5
Definitions
Evidence
– The available body of facts or information indicating whether a belief
or proposition is true or valid (Oxford Dictionaries)
Uncertainty
– Used in the EFSA Draft Guidance on Uncertainty as a general term
referring to all types of limitations in the knowledge available to
assessors at the time an assessment is conducted and within the
time and resources agreed for the assessment
Weight-of-evidence (WoE)
– Process in which all of the evidence considered relevant for a risk
assessment is evaluated and weighted (WHO/IPCS, 2009)
6. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 6
Context of statements about evidence and
uncertainty
Search in the EFSA Extranet
– Repository of documents of EFSA and collaborating partners
– Search not restricted to publication date or to a particular panel;
last update 10 Oct 2015
– Text snippets as retrieved (rather than the full documents) used as
text corpus
– Extracting sentences with the terms “evidence” or “uncertainty”
evidence AND food AND (microbio* OR outbreak* OR foodborne)
in Documents in the Directory, Collaboration Items
uncertain* AND food AND (microbio* OR outbreak* OR foodborne)
in Documents in the Directory, Collaboration Items
7. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 7
Context of EFSA statements about evidence and
uncertainty
Evidence: in the conclusion – Uncertainty: in the scientific background?
Data source:
EFSA Extranet
8. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 8
Context of statements about evidence and
uncertainty
Search in ScienceDirect
– Scientific contents source covering articles from over 2,500 journals
and more than 33,000 book titles
– Search covering freely accessible contents (guest access); not
restricted to publication date; last update 10 Oct 2015
– Using title, abstract and keywords as text corpus
– Extracting sentences with the terms “evidence” or “uncertainty”
TITLE-ABSTR-KEY(evidence AND food AND (microbio* OR outbreak* OR
foodborne))
TITLE-ABSTR-KEY(uncertain* AND food AND (microbio* OR outbreak* OR
foodborne))
9. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 9
Context of other scientific statements about
evidence and uncertainty
Data source:
ScienceDirect
Evidence: part of discussion – Uncertainty: close to regulatory science?
10. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 10
Weight-of-evidence concept
EFSA Extranet
– Citations in all areas: 7 results
– Citations in microbiological food safety: Zero results
ScienceDirect
– Citations in all areas: 1,636 results
– Citations in microbiological food safety: Zero results
("weight-of-evidence" OR "weight of evidence" OR "evidence synthesis") AND
AND food AND (microbio* OR outbreak* OR foodborne)
in Documents in the Directory, Collaboration Items
TITLE-ABSTR-KEY({weight-of-evidence} OR {weight of evidence} OR {evidence
synthesis}) AND TITLE-ABSTR-KEY(food AND (microbio* OR outbreak* OR
foodborne))
11. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 11
Weight-of-evidence concept
WHO Microbiological Risk Assessment Series
– WoE for causality inferences. Assessing quantity, quality and nature of the
results available from various study types; pathogen characteristics;
biological mechanisms; extrapolating from animal or in vitro studies to
humans (WHO, 2003)
– Weights proportional to sample size, expert beliefs and uncertainty (WHO,
2008)
– WoE will become increasingly prominent in risk assessments of
microbiological pathogens in food (WHO, 2009)
Advocating the WoE approach for integrating of
evidence from multiple sources
12. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 12
Application of the weight-of-evidence concept in
microbiological food safety and related areas
Foodborne outbreaks:
Support of emergency
measures
Scientific evidence on:
Population, agent,
vehicle, source,
adverse effect
Examples:
Health Canada, 2011
Vik et al., 2014
Food safety
intervention:
Decision support
Scientific evidence on:
Problem, intervention,
outcome
Examples:
Fazil et al., 2008
Other applications:
a) Dose-response models
b) Water management
c) Risk ranking
Scientific evidence on:
Various aspects depending
on the problem
Examples:
a) Moon et al., 2005
b) Olivieri et al., 2014
c) EFSA BIOHAZ, 2015
13. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 13
Why do we need to apply these concepts more
systematically?
– Complexity of questions in microbiological risk assessment
– Dealing with limits of our current knowledge
Why
14. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 14
Complexity in microbiological food safety
Epidemiological triangle
Host
– Behaviours
– Acquired or inherent
susceptibility or vulnerability
Agent
– Species /genotype /phenotype
characteristics
– Gene transfer
Environment
– Biotic and abiotic factors for
growth
Environment
Agent
Host
Agent
15. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 15
Complexity in microbiological food safety
Host
Microbiome
Infectome
Adapted from Bogdanos et al., 2013
16. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 16
How can we use these concepts to deal with
(the limitations of our) knowledge?
– Risk assessment – an evidenced-based approach
– Must make limitations and uncertainties explicit
– Use WoE in cases of alternative sources of evidence
How
17. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 17
Conceptual model of a food safety question
18. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 18
Uncertainty assessment
Risk question
Scenario
Model
Model parameters
Data
Calculations/Simulations
– Describe limits of current
knowledge
– Safeguard against over-
interpretation http://www.bfr.bund.de/cm/350/guidelines-on-
uncertainty-analysis-in-exposure-assessments.pdf
http://www.efsa.europa.eu/sites/default/files/consultati
on/150618.pdf
19. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 19
Combining evidence (I)
Meta-analysis situation
Multiple primary studies on the same question
and comparable outcome metrics (e.g. odds
ratios from epidemiological studies; sensitivity and
specificity of diagnostic tests)
– Be systematic use systematic review
(PRISMA standard*)
– Use an instrument for assessing study quality*
– Use strict inclusion/exclusion criteria
– Investigate and account for heterogeneity
– Use established statistical models for summary
estimates and confidence intervals
*http://www.equator-network.org/
http://www.efsa.europa.eu/sites/de
fault/files/scientific_output/files/mai
n_documents/432.pdf
20. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 20
Combining evidence (II)
Weight-of-evidence situation
Combining information from primary studies with different types of
observations (e.g. in vivo, in vitro, in silico, epidemiological), different
study organisms (e.g. human and animal)
– Resembles the approach for meta-analysis (use systematic approach
as far as possible)
– ...
– No established statistical tools available for integrating evidences
(currently under review by EFSA working group)
21. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 21
Combining evidence (II)
Weight-of-evidence
Line of
evidence
Internal
validity
Relevance
for question
Weight Outcome
in vitro ? ? ? ?
in vivo ? ? ? ?
epidemiology ? ? ? ?
22. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 22
OUTBREAK INVESTIGATIONS AND
DOSE-RESPONSE MODELLING
Alternative weight-of-evidence approaches
23. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 23
Health Canada, 2011 (clipping of p. 12)
Grading
of the
evidence
24. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 24
Binomial dose-response model
Dose
– Number of bacterial cells ingested: n
Response
– Probability of infection at dose n: P(n)
Model
P(n) = 1 – (1 – p)n
p is the shape parameter (probability that a single cell causes infection)
Assumptions
– r is constant in the population of bacterial cells
Use
– If the dose n is known exactly
Using
Evidence in
modelling
25. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 25
Extensions of the binomial model
Exponential
– Use if n is not known precisely; n ~ Poisson(●)
Beta-binomial
– p is not known precisely; p ~ beta(●,●)
Beta-Poisson
– use if p and n
are not known precisely;
p ~ beta(●,●)
n ~ Poisson(●)
● = distribution
parameter
for simulation
26. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 26
Evidence-based choice or combination of models
Classical approach
– Using biological reasoning
about underlying assumptions
– Asymptotic behaviour
– Choosing the model with the
best fit
Binomial Beta-Poisson
WoE approach
– Use all models and combine
results mathematically
– “Evaluate the relative
plausibility of each fitted model
by a weight of evidence
relative to the selected best
model” (Moon et al., 2005.
Model Averaging Using the
Kullback Information Criterion
in Estimating Effective Doses
for Microbial Infection and
Illness. Risk Analysis 25/5,
1147-1159)
0 500 1000 1500 2000
0.00.20.40.60.81.0
n
P(n)
r=0.003
r=0.002
r=0.001
d
P(d)
10
2
1 10
2
10
4
10
6
10
8
10
10
10
12
0
0.2
0.4
0.6
0.8
1
0.2 0.4
0.2 40
0.8 4000
27. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 27
Conclusions
Internal validity and relevance for the question (external validity)
– Can be part of a uncertainty assessment
– Can be used to derived weights in a WoE approach
`The two methodologies weighing of evidence and uncertainty
assessment are complementary and have a common overall goal,
which is to provide the best possible basis for science-based
decision making
Line of
evidence
Internal validity
Relevance for
question
Weight Outcome
in vitro ? ? ? ?
in vivo ? ? ? ?
epidemiology ? ? ? ?
28. Shaping the Future of Food Safety, Together. Milan, 14-16 Oct 2015 Page 28
References
Bogdanos DP et al. (2013). Infectome: A platform to trace infectious triggers of autoimmunity. Autoimmun Rev. 12:726-40.
EFSA BIOHAZ Panel (2015). Scientific Opinion on the development of a risk ranking toolbox for the EFSA BIOHAZ Panel.
EFSA Journal 2015;13: 3939, 131 pp.
Fazil A et al. (2008). Choices, choices: the application of multi-criteria decision analysis to a food safety decision-making
problem. Journal of Food Protection 71, 2323-2333.
Health Canada (2011). Public Health Agency of Canada; Canadian Food Inspection Agency. Weight of evidence: factors to
consider for appropriate and timely action in a foodborne illness outbreak investigation. Ottawa, ON: Minister of Health.
Moon H et al. (2005). Model averaging using the Kullback information criterion in estimating effective doses for microbial
infection and illness. Risk Analysis 25/5, 1147-1159.
Olivieri AW et al. (2014). Risk-Based Review of California’s Water-Recycling Criteria for Agricultural Irrigation. Journal of
Environmental Engineering, 2014.140.
Vik J et al. (2014). Summary: weight of evidence - factors to consider when investigating a food-borne illness outbreak.
Canada Communicable Disease Report 40, 303.
WHO (2003). Hazard characterization for pathogens in food and water: guidelines. Microbiological Risk Assessment Series,
No. 3. WHO, Geneva, 76 pp.
WHO (2008). Exposure assessment of microbiological hazards in food. Microbiological Risk Assessment Series, No. 7.
WHO, Geneva, 102 pp.
WHO (2009). Risk Characterization of microbiological hazards in food. Microbiological Risk Assessment Series, No. 17
WHO, Geneva, 135 pp.
WHO/IPCS (2009). EHC 240: Principles and methods for the risk assessment of chemicals in food. Annex 1, 45 pp.