In this webinar, we briefly discussed the regulatory considerations for biorepositories including the following: When HHS, FDA and HIPAA regulations apply, When informed consent is not required , Pros and cons of different informed consent approaches
Adjusting the Focus: Usability Study Aligns Organization Vision with Communit...Laurie Bennett
One project sponsored by IEEE, two teams of Southern Polytechnic State University graduate students, one structured approach taught by Dr. Carol Barnum, amazing overlapping results. Professor Carol Barnum, together with her graduate students, Laurie Bennett, Jay Jones, and John Weaver present the approach, findings, and recommendations revealed during their usability study conducted for the IEEE website, Engineeringforchange.org. Learn how their different paths taken during the usability study resulted in identifying the same show stopping problem areas.
Design Frameworks for Analysis and Synthesis of Complex Systemsdrjanroodt
The document discusses frameworks and models for analyzing complex systems. It proposes using design frameworks that cascade a problem through analysis and synthesis loops to develop solutions. This allows problems to be probed, sensed and responded to, as complex systems cannot be reduced or have fixed targets. Examples of applying this approach to developing a military capability, designing a new hospital, and developing business frameworks are provided. The conclusion advocates for design engineering as a core process that is user-focused, generates traceable outputs, and reduces risks when defining solutions.
The document discusses best practices for developing useful policy and regulatory indicators. It recommends that indicators 1) measure what is most relevant, 2) be simple without oversimplifying, and 3) be practical to collect frequently and reliably. Examples are given for indicators related to water access and mobile phone usage. The document also lists potential demand-side and supply-side indicators for the ICT sector, including subscriber counts, usage metrics, prices, and economic impact measures.
The document discusses evidence-based policy, providing definitions and examples. It defines evidence as information used to prove facts or support beliefs. Evidence-based policy relies on existing research, commissioned studies, and expert consultation. Developing an evidence base is important for better policymaking and accountability. However, evidence in the voluntary sector is limited by various factors like resources. The document provides tips for organizations to build their own evidence base, such as collaborating with other groups or commissioning external research. It also outlines the research process and choice of methods like qualitative interviews or quantitative surveys.
201-Hong Infrastructure for evidence based STI policy in Koreainnovationoecd
This document describes a project in Korea to develop an evidence-based decision support system for science, technology and innovation (STI) policy called K2Base. It outlines the project's goals, services provided, and database contents. K2Base aims to improve policymaking efficiency by providing integrated information and analysis tools on STI budgets, programs and performance. It has expanded over two phases from 2008 to store growing volumes of policy-related data and documents. The system seeks to advance the "Science of STI Policy" by supporting research and predictive modeling through text/data mining and optimization tools.
In this webinar, we briefly discussed the regulatory considerations for biorepositories including the following: When HHS, FDA and HIPAA regulations apply, When informed consent is not required , Pros and cons of different informed consent approaches
Adjusting the Focus: Usability Study Aligns Organization Vision with Communit...Laurie Bennett
One project sponsored by IEEE, two teams of Southern Polytechnic State University graduate students, one structured approach taught by Dr. Carol Barnum, amazing overlapping results. Professor Carol Barnum, together with her graduate students, Laurie Bennett, Jay Jones, and John Weaver present the approach, findings, and recommendations revealed during their usability study conducted for the IEEE website, Engineeringforchange.org. Learn how their different paths taken during the usability study resulted in identifying the same show stopping problem areas.
Design Frameworks for Analysis and Synthesis of Complex Systemsdrjanroodt
The document discusses frameworks and models for analyzing complex systems. It proposes using design frameworks that cascade a problem through analysis and synthesis loops to develop solutions. This allows problems to be probed, sensed and responded to, as complex systems cannot be reduced or have fixed targets. Examples of applying this approach to developing a military capability, designing a new hospital, and developing business frameworks are provided. The conclusion advocates for design engineering as a core process that is user-focused, generates traceable outputs, and reduces risks when defining solutions.
The document discusses best practices for developing useful policy and regulatory indicators. It recommends that indicators 1) measure what is most relevant, 2) be simple without oversimplifying, and 3) be practical to collect frequently and reliably. Examples are given for indicators related to water access and mobile phone usage. The document also lists potential demand-side and supply-side indicators for the ICT sector, including subscriber counts, usage metrics, prices, and economic impact measures.
The document discusses evidence-based policy, providing definitions and examples. It defines evidence as information used to prove facts or support beliefs. Evidence-based policy relies on existing research, commissioned studies, and expert consultation. Developing an evidence base is important for better policymaking and accountability. However, evidence in the voluntary sector is limited by various factors like resources. The document provides tips for organizations to build their own evidence base, such as collaborating with other groups or commissioning external research. It also outlines the research process and choice of methods like qualitative interviews or quantitative surveys.
201-Hong Infrastructure for evidence based STI policy in Koreainnovationoecd
This document describes a project in Korea to develop an evidence-based decision support system for science, technology and innovation (STI) policy called K2Base. It outlines the project's goals, services provided, and database contents. K2Base aims to improve policymaking efficiency by providing integrated information and analysis tools on STI budgets, programs and performance. It has expanded over two phases from 2008 to store growing volumes of policy-related data and documents. The system seeks to advance the "Science of STI Policy" by supporting research and predictive modeling through text/data mining and optimization tools.
Presentation about the links between our resource consumption and biodiversit...Martin Wildenberg
The document discusses biodiversity and sustainability indicators for agriculture. It presents case studies comparing the carbon footprints and sustainability of different agricultural production systems, such as greenhouse tomatoes in Austria and Spain, and egg production using soy from different origins. The use of sustainability indicators is promoted to measure resource use, impacts, and guide improvements in agricultural practices and supply chains.
Advocating for a sustainable future in Australia: 15 years of the Institute f...Chris Riedy
A presentation given at the 18th International Sustainable Development Research Conference in Hull, UK. This was part of a stream on the role of academia in sustainability advocacy.
P4 training and_life_as_a_postdoc_(shinichi_sunagawa)phdcareers
Shinichi Sunagawa presents information about his current role as a research scientist in the Bork Group at EMBL Heidelberg. He coordinates and manages metagenomics projects and supports PhD students and postdocs. He has a diploma in biochemistry and degrees in aquatic ecology and quantitative systems biology. He began programming in 2006 and took his current position in 2012 after 1.5 years as a postdoc. He enjoys having perspective to find something useful and seeing computers gain importance in biology.
Seminario Internacional de Educación 2012: Aprender Haciendo 2012INACAP
Presentación de Philip Bailey, decano de la Facultad de Ciencias y Matemáticas de California Polytechnic State University, en San Luis Obispo, Estados Unidos.
This document summarizes engagement activities at PCORI and plans for future events. It discusses a recent engagement event that 170 people attended in person and 250 attended virtually. Participants endorsed PCORI's engagement strategies but provided refinements. The document proposes upcoming engagement events in December and introduces the new Chief Officer for Engagement. It also provides organizational charts showing the engagement team.
This document describes a challenge to develop a system to connect patients and stakeholders with researchers. It provides criteria for evaluating proposed conceptual models or prototypes for a matching system. The challenge aims to facilitate meaningful engagement throughout the research process, as required by PCORI funding announcements. Winners will receive $10,000 or $40,000 to further develop their proposal. The submission deadline is April 15th, with winners to be announced at a spring conference. The evaluation will focus on technical feasibility, usability, scalability, and maximizing patient-centeredness and scientific rigor.
This document outlines a training plan developed by the KAPTUR project to teach information managers and other university staff about research data management in the visual arts. The plan will be tested at four UK universities and arts institutions. It includes introductory and advanced lesson plans that use various teaching methods like presentations, group discussions, and online content. The introductory lesson covers basic principles of research data in the visual arts, while the advanced lesson teaches how to create a data management plan.
Knee High Project Advisory Board - first presentationkneehigh
1. The document summarizes the agenda and activities for an Advisory Board Meeting for the Knee High Project in November 2012.
2. The agenda includes introductions, discussions on the project, and presentations on the research conducted so far including stages of early childhood development and emerging themes.
3. Attendees are asked to provide expertise, critique the research outputs, and help prioritize areas of focus and where real impact could be achieved through the project's work.
Open Access & sharing research data: a Dutch workshop for phd in economicsEsther Hoorn
This document discusses a workshop on open access and sharing research data. It introduces open access, defines it as digital works that are free online and free of copyright restrictions. It discusses funder mandates requiring open access publication and sharing of research data. It also addresses issues around research integrity and transparency when publicly sharing data and retaining copyright of published work. The document provides information on open access policies and initiatives in various fields and journals.
Slides at national conference for the community and charity sector 2012THEWHEEL12
INNOVATE | INVOLVE | INSPIRE 2012 - A National Conference for the Community and Charity Sector - Thursday, 31 May 2012 at Croke Park Conference Centre, Dublin
Dr. Sarika Sawant presented on research ethics at a seminar. She discussed the definition of research ethics as regulating scientific activity to protect human participants and serve societal interests. She covered objectives like ensuring consent and oversight. Issues discussed included plagiarism, data handling, and research with humans and animals. National guidelines in India were also presented, as well as UNESCO's ethical guidelines focusing on informed consent, confidentiality, and integrity.
This document discusses the need for continuing education programs in digital curation for professionals in libraries, archives, and museums. It notes that while there have been advances in digital curation research and practices, many institutions remain unaware of options for preserving digital materials or lack the capacity. The document outlines key considerations for developing continuing education programs, including determining essential content, identifying sources of content expertise, understanding target audiences, and deciding on appropriate delivery methods and credentialing.
The European Forest Institute (EFI) is an international organization that provides policy support, research, information sharing and networking services related to forests and forestry. EFI has over 130 member organizations in 35 countries and a budget of 12.9 million euros in 2012. EFI conducts research through teams of experts in areas like sustainability, climate change, forest policy and economics. EFI also supports policy processes, shares science-based information and represents the forest science community.
The Knee High Project - Advisory Board Presentation (Nov 2012)Mat Hunter
1. The document summarizes the agenda and goals of the Knee High Project Advisory Board Meeting in November 2012.
2. The meeting was scheduled to include introductions, a discussion of the programme, next steps, and a close.
3. The Knee High Project aims to design practical solutions to complex problems related to early years health and wellbeing through an open innovation challenge.
4. The advisory board would provide knowledge, challenge ideas, and help connect the project to networks to support its goals of long-term impact, capabilities, relationships, and sustainability.
The Natural Step is an international non-profit organization that provides strategic sustainability advice and education based on a scientific framework. It was founded in 1989 in Sweden and has expanded internationally. The organization helps define sustainability, identify gaps, and develop strategies to bridge those gaps. It works with businesses, governments, and organizations through capacity building, research, advisory services, and networking to advance sustainable development.
This document outlines Indonesia's National Strategy for Agroforestry Research (NSAR) over the next two decades. It discusses how agroforestry has long been practiced in Indonesia but is not yet a major part of forestry policy. The NSAR was developed through a multi-step process between 2011-2013. The vision is for agroforestry to be widely adopted by communities to meet food, shelter, energy and environmental needs. Four priority research themes are identified: smallholder production systems and markets; community forest management; climate change adaptation; and environmental services. The strategy calls for partnership-based research, capacity building, and dissemination of results to achieve impacts like improved livelihoods and efficient agroforestry
The document summarizes the launch of the Knee High Project, which aims to take a new approach to early years health and wellbeing. It outlines the agenda for the launch event, including presentations on the project context and principles, as well as breakout sessions on designing experiences and understanding users. The research and engagement process is also summarized, including plans to conduct in-depth research with families and professionals through ethnographic interviews and observations in order to help co-design opportunities to improve early childhood health and wellbeing.
IPRs had never been an important issue within CPFRD, due to the general belief among its staff that all research findings and innovation generated in the centre ought to remain in the public domain. Through intensive discussions among the research managers, scientists and supporting staff within the CPFRD, a clearer understanding about IPRs and its potential role in stimulating research and innovation has evolved, and IPRs are now becoming one of the priority issues within the CPFRD. The centre has now developed some initial “IPRs Policy Guidelines”, a manual of procedures for IPRs application, and has initiated a Forestry IP Forum among forestry research institutions and practitioners in Indonesia.
These case studies aim to share country experiences from developing countries in the areas surrounding IP policy making, policy implementation and use of IPRs by researchers for leveraging more benefits to the stakeholders, people, institutions and countries.
Presentation about the links between our resource consumption and biodiversit...Martin Wildenberg
The document discusses biodiversity and sustainability indicators for agriculture. It presents case studies comparing the carbon footprints and sustainability of different agricultural production systems, such as greenhouse tomatoes in Austria and Spain, and egg production using soy from different origins. The use of sustainability indicators is promoted to measure resource use, impacts, and guide improvements in agricultural practices and supply chains.
Advocating for a sustainable future in Australia: 15 years of the Institute f...Chris Riedy
A presentation given at the 18th International Sustainable Development Research Conference in Hull, UK. This was part of a stream on the role of academia in sustainability advocacy.
P4 training and_life_as_a_postdoc_(shinichi_sunagawa)phdcareers
Shinichi Sunagawa presents information about his current role as a research scientist in the Bork Group at EMBL Heidelberg. He coordinates and manages metagenomics projects and supports PhD students and postdocs. He has a diploma in biochemistry and degrees in aquatic ecology and quantitative systems biology. He began programming in 2006 and took his current position in 2012 after 1.5 years as a postdoc. He enjoys having perspective to find something useful and seeing computers gain importance in biology.
Seminario Internacional de Educación 2012: Aprender Haciendo 2012INACAP
Presentación de Philip Bailey, decano de la Facultad de Ciencias y Matemáticas de California Polytechnic State University, en San Luis Obispo, Estados Unidos.
This document summarizes engagement activities at PCORI and plans for future events. It discusses a recent engagement event that 170 people attended in person and 250 attended virtually. Participants endorsed PCORI's engagement strategies but provided refinements. The document proposes upcoming engagement events in December and introduces the new Chief Officer for Engagement. It also provides organizational charts showing the engagement team.
This document describes a challenge to develop a system to connect patients and stakeholders with researchers. It provides criteria for evaluating proposed conceptual models or prototypes for a matching system. The challenge aims to facilitate meaningful engagement throughout the research process, as required by PCORI funding announcements. Winners will receive $10,000 or $40,000 to further develop their proposal. The submission deadline is April 15th, with winners to be announced at a spring conference. The evaluation will focus on technical feasibility, usability, scalability, and maximizing patient-centeredness and scientific rigor.
This document outlines a training plan developed by the KAPTUR project to teach information managers and other university staff about research data management in the visual arts. The plan will be tested at four UK universities and arts institutions. It includes introductory and advanced lesson plans that use various teaching methods like presentations, group discussions, and online content. The introductory lesson covers basic principles of research data in the visual arts, while the advanced lesson teaches how to create a data management plan.
Knee High Project Advisory Board - first presentationkneehigh
1. The document summarizes the agenda and activities for an Advisory Board Meeting for the Knee High Project in November 2012.
2. The agenda includes introductions, discussions on the project, and presentations on the research conducted so far including stages of early childhood development and emerging themes.
3. Attendees are asked to provide expertise, critique the research outputs, and help prioritize areas of focus and where real impact could be achieved through the project's work.
Open Access & sharing research data: a Dutch workshop for phd in economicsEsther Hoorn
This document discusses a workshop on open access and sharing research data. It introduces open access, defines it as digital works that are free online and free of copyright restrictions. It discusses funder mandates requiring open access publication and sharing of research data. It also addresses issues around research integrity and transparency when publicly sharing data and retaining copyright of published work. The document provides information on open access policies and initiatives in various fields and journals.
Slides at national conference for the community and charity sector 2012THEWHEEL12
INNOVATE | INVOLVE | INSPIRE 2012 - A National Conference for the Community and Charity Sector - Thursday, 31 May 2012 at Croke Park Conference Centre, Dublin
Dr. Sarika Sawant presented on research ethics at a seminar. She discussed the definition of research ethics as regulating scientific activity to protect human participants and serve societal interests. She covered objectives like ensuring consent and oversight. Issues discussed included plagiarism, data handling, and research with humans and animals. National guidelines in India were also presented, as well as UNESCO's ethical guidelines focusing on informed consent, confidentiality, and integrity.
This document discusses the need for continuing education programs in digital curation for professionals in libraries, archives, and museums. It notes that while there have been advances in digital curation research and practices, many institutions remain unaware of options for preserving digital materials or lack the capacity. The document outlines key considerations for developing continuing education programs, including determining essential content, identifying sources of content expertise, understanding target audiences, and deciding on appropriate delivery methods and credentialing.
The European Forest Institute (EFI) is an international organization that provides policy support, research, information sharing and networking services related to forests and forestry. EFI has over 130 member organizations in 35 countries and a budget of 12.9 million euros in 2012. EFI conducts research through teams of experts in areas like sustainability, climate change, forest policy and economics. EFI also supports policy processes, shares science-based information and represents the forest science community.
The Knee High Project - Advisory Board Presentation (Nov 2012)Mat Hunter
1. The document summarizes the agenda and goals of the Knee High Project Advisory Board Meeting in November 2012.
2. The meeting was scheduled to include introductions, a discussion of the programme, next steps, and a close.
3. The Knee High Project aims to design practical solutions to complex problems related to early years health and wellbeing through an open innovation challenge.
4. The advisory board would provide knowledge, challenge ideas, and help connect the project to networks to support its goals of long-term impact, capabilities, relationships, and sustainability.
The Natural Step is an international non-profit organization that provides strategic sustainability advice and education based on a scientific framework. It was founded in 1989 in Sweden and has expanded internationally. The organization helps define sustainability, identify gaps, and develop strategies to bridge those gaps. It works with businesses, governments, and organizations through capacity building, research, advisory services, and networking to advance sustainable development.
This document outlines Indonesia's National Strategy for Agroforestry Research (NSAR) over the next two decades. It discusses how agroforestry has long been practiced in Indonesia but is not yet a major part of forestry policy. The NSAR was developed through a multi-step process between 2011-2013. The vision is for agroforestry to be widely adopted by communities to meet food, shelter, energy and environmental needs. Four priority research themes are identified: smallholder production systems and markets; community forest management; climate change adaptation; and environmental services. The strategy calls for partnership-based research, capacity building, and dissemination of results to achieve impacts like improved livelihoods and efficient agroforestry
The document summarizes the launch of the Knee High Project, which aims to take a new approach to early years health and wellbeing. It outlines the agenda for the launch event, including presentations on the project context and principles, as well as breakout sessions on designing experiences and understanding users. The research and engagement process is also summarized, including plans to conduct in-depth research with families and professionals through ethnographic interviews and observations in order to help co-design opportunities to improve early childhood health and wellbeing.
IPRs had never been an important issue within CPFRD, due to the general belief among its staff that all research findings and innovation generated in the centre ought to remain in the public domain. Through intensive discussions among the research managers, scientists and supporting staff within the CPFRD, a clearer understanding about IPRs and its potential role in stimulating research and innovation has evolved, and IPRs are now becoming one of the priority issues within the CPFRD. The centre has now developed some initial “IPRs Policy Guidelines”, a manual of procedures for IPRs application, and has initiated a Forestry IP Forum among forestry research institutions and practitioners in Indonesia.
These case studies aim to share country experiences from developing countries in the areas surrounding IP policy making, policy implementation and use of IPRs by researchers for leveraging more benefits to the stakeholders, people, institutions and countries.
A Visual Guide to 1 Samuel | A Tale of Two HeartsSteve Thomason
These slides walk through the story of 1 Samuel. Samuel is the last judge of Israel. The people reject God and want a king. Saul is anointed as the first king, but he is not a good king. David, the shepherd boy is anointed and Saul is envious of him. David shows honor while Saul continues to self destruct.
How to Make a Field Mandatory in Odoo 17Celine George
In Odoo, making a field required can be done through both Python code and XML views. When you set the required attribute to True in Python code, it makes the field required across all views where it's used. Conversely, when you set the required attribute in XML views, it makes the field required only in the context of that particular view.
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UPRAHUL
This Dissertation explores the particular circumstances of Mirzapur, a region located in the
core of India. Mirzapur, with its varied terrains and abundant biodiversity, offers an optimal
environment for investigating the changes in vegetation cover dynamics. Our study utilizes
advanced technologies such as GIS (Geographic Information Systems) and Remote sensing to
analyze the transformations that have taken place over the course of a decade.
The complex relationship between human activities and the environment has been the focus
of extensive research and worry. As the global community grapples with swift urbanization,
population expansion, and economic progress, the effects on natural ecosystems are becoming
more evident. A crucial element of this impact is the alteration of vegetation cover, which plays a
significant role in maintaining the ecological equilibrium of our planet.Land serves as the foundation for all human activities and provides the necessary materials for
these activities. As the most crucial natural resource, its utilization by humans results in different
'Land uses,' which are determined by both human activities and the physical characteristics of the
land.
The utilization of land is impacted by human needs and environmental factors. In countries
like India, rapid population growth and the emphasis on extensive resource exploitation can lead
to significant land degradation, adversely affecting the region's land cover.
Therefore, human intervention has significantly influenced land use patterns over many
centuries, evolving its structure over time and space. In the present era, these changes have
accelerated due to factors such as agriculture and urbanization. Information regarding land use and
cover is essential for various planning and management tasks related to the Earth's surface,
providing crucial environmental data for scientific, resource management, policy purposes, and
diverse human activities.
Accurate understanding of land use and cover is imperative for the development planning
of any area. Consequently, a wide range of professionals, including earth system scientists, land
and water managers, and urban planners, are interested in obtaining data on land use and cover
changes, conversion trends, and other related patterns. The spatial dimensions of land use and
cover support policymakers and scientists in making well-informed decisions, as alterations in
these patterns indicate shifts in economic and social conditions. Monitoring such changes with the
help of Advanced technologies like Remote Sensing and Geographic Information Systems is
crucial for coordinated efforts across different administrative levels. Advanced technologies like
Remote Sensing and Geographic Information Systems
9
Changes in vegetation cover refer to variations in the distribution, composition, and overall
structure of plant communities across different temporal and spatial scales. These changes can
occur natural.
The chapter Lifelines of National Economy in Class 10 Geography focuses on the various modes of transportation and communication that play a vital role in the economic development of a country. These lifelines are crucial for the movement of goods, services, and people, thereby connecting different regions and promoting economic activities.
Leveraging Generative AI to Drive Nonprofit InnovationTechSoup
In this webinar, participants learned how to utilize Generative AI to streamline operations and elevate member engagement. Amazon Web Service experts provided a customer specific use cases and dived into low/no-code tools that are quick and easy to deploy through Amazon Web Service (AWS.)
Beyond Degrees - Empowering the Workforce in the Context of Skills-First.pptxEduSkills OECD
Iván Bornacelly, Policy Analyst at the OECD Centre for Skills, OECD, presents at the webinar 'Tackling job market gaps with a skills-first approach' on 12 June 2024
Philippine Edukasyong Pantahanan at Pangkabuhayan (EPP) CurriculumMJDuyan
(𝐓𝐋𝐄 𝟏𝟎𝟎) (𝐋𝐞𝐬𝐬𝐨𝐧 𝟏)-𝐏𝐫𝐞𝐥𝐢𝐦𝐬
𝐃𝐢𝐬𝐜𝐮𝐬𝐬 𝐭𝐡𝐞 𝐄𝐏𝐏 𝐂𝐮𝐫𝐫𝐢𝐜𝐮𝐥𝐮𝐦 𝐢𝐧 𝐭𝐡𝐞 𝐏𝐡𝐢𝐥𝐢𝐩𝐩𝐢𝐧𝐞𝐬:
- Understand the goals and objectives of the Edukasyong Pantahanan at Pangkabuhayan (EPP) curriculum, recognizing its importance in fostering practical life skills and values among students. Students will also be able to identify the key components and subjects covered, such as agriculture, home economics, industrial arts, and information and communication technology.
𝐄𝐱𝐩𝐥𝐚𝐢𝐧 𝐭𝐡𝐞 𝐍𝐚𝐭𝐮𝐫𝐞 𝐚𝐧𝐝 𝐒𝐜𝐨𝐩𝐞 𝐨𝐟 𝐚𝐧 𝐄𝐧𝐭𝐫𝐞𝐩𝐫𝐞𝐧𝐞𝐮𝐫:
-Define entrepreneurship, distinguishing it from general business activities by emphasizing its focus on innovation, risk-taking, and value creation. Students will describe the characteristics and traits of successful entrepreneurs, including their roles and responsibilities, and discuss the broader economic and social impacts of entrepreneurial activities on both local and global scales.
2. Evidence-Based Policy Session
Moving towards ‘Evidence-Based
Forestry’ in CIFOR
Gillian Petrokofsky
University of Oxford
gillian.petrokofsky@zoo.ox.ac.uk
01/10/2012 CIFOR Annual Meeting 2012
3. Context of science for policy
Current ‘haphazard’ situation
Total body of
research
Research used
No clear methods for accessing
or analysing research used for
decision-making .
01/10/2012 CIFOR Annual Meeting 2012
4. Current ‘haphazard’ situation Evidence Based Forestry
X
Total body of research Total body of
research
Research used
Research
used.
Robust, ‘scientific’ methods for
No clear methods for accessing or accessing and analysing research
analysing research used for
decision-making . used for decision-making.
01/10/2012 CIFOR Annual Meeting 2012
5. Current ‘haphazard’ Evidence Based
situation Forestry
Total body of research Total body of research
Collaboration/Participation
Research used
in:
Research used.
Defining research agenda
Systematic reviews
No clear methods for accessing or Repeatable methods for accessing
analysing research used for and analysing research used for
decision-making . Results not decision-making. Results
actively disseminated. disseminated actively.
01/10/2012 CIFOR Annual Meeting 2012
7. Model - evidence based medicine (EBM)
Expert
opinion
Best science
EBM
Individual
need &
preference
01/10/2012 CIFOR Annual Meeting 2012
8. Model - evidence based forestry (EBF)
Expert
opinion
Best science
EBF
Society’s
needs &
preference
s
01/10/2012 CIFOR Annual Meeting 2012
9. But what are the priorities?
• Who decides what the priority agenda is?
– Science research
– Policy
– Policy push/science pull
– Science-driven
• Collaborative conversations
01/10/2012 CIFOR Annual Meeting 2012
10. Collaboration –
asking the most useful
questions
Collaboration –
telling people what Collaboration –
you discovered finding the most
useful evidence
Collaboration – Collaboration –
widespread feedback and agreeing on how to
peer-review at all stages analyse the evidence
01/10/2012 CIFOR Annual Meeting 2012
12. 1. Social
Environ 456
Online survey questions
692
questions
1594 questions
Economic
446 2.
questions
Two-day Workshop
Top Ten Questions
01/10/2012 CIFOR Annual Meeting 2012
13. • Self-selected
delegates
• Delphi process
• Discussion
• Voting
• Final list of 10
questions
• Collaborative peer-
reviewed paper
Pictures courtesy Steven Heathcote
14. Environment Social Economics
692 questions 456 questions 446 questions
1. Forest economics & trade 8. Carbon sequestration, carbon
2. Forest cycle
management, silviculture & 9. Afforestation & forest
forest operations plantations
3. Ecosystem services 10. Soil and water
4. Biodiversity & conservation 11.Pests, diseases & invasives
5. Climate change & global 12.Urban forestry, urban
warming trees, arboriculture
6. Decision-making & public 13.Land use & landscape
opinion 14.Miscellaneous
7. Biofuel, energy from biomass
01/10/2012 CIFOR Annual Meeting 2012
15. T10Q Top Ten Questions
1. What are the most technically and cost effective
ways of identifying, monitoring, and controlling
invasive species, pests and disease?
2. How can we achieve better understanding
between foresters and other parts of society?
3. What are the most effective landscape planting
schemes to ensure connectivity between
woodland fragments whilst maintaining
connectivity between other landuse types
4. What is the value of forestry to human health and
well-being?
5. Who are the private woodland owners and how
can they be engaged and influenced? What are
their concerns?
01/10/2012 CIFOR Annual Meeting 2012
16. Checking relevance and validity
Numbers of papers from EU vs. Papers published in the last 5
global numbers published years
Petrokofsky, G, ND Brown, GE Hemery . Matching a scientific knowledge base with stakeholder's needs. The
T10Q project as a case study for forestry. Forest Policy & Economics
01/10/2012 CIFOR Annual Meeting 2012
17. Reflections on the process
• Survey tool effective for collecting and sharing large amount of
information
• Contributes to reduction in potential bias/perceived biases
engaging with different ‘stakeholders’
enabling ‘bottom-up’ collaborative discussion
• Focussed workshop new experience for some participants
• Delphi ‘experts on tap’ not ‘on top’
• Strengths & weaknesses of voting
• Difficulties of common understanding
• Generates themes – for Cochrane-style systematic reviews and
review groups
01/10/2012 CIFOR Annual Meeting 2012
18. Model - evidence based forestry (EBF)
Expert
Best opinion
science EBF
Society’s
needs &
preference
s
01/10/2012 CIFOR Annual Meeting 2012
19. Problem: Evaluating ALL literature:
• Not all data and information are on the Web
• Not all data and information are free
• Science is not only in English-language publications
• Evidence does not come only from peer-reviewed
journals
• Much research, especially that with negative or
inconclusive results, may fail to be published in
journals. Carefully collected data are thus ‘lost’
• There are too many publications for an individual to
find and assess
01/10/2012 CIFOR Annual Meeting 2012
20. Problem: Evaluating ALL the literature
of relevance to forest carbon
01/10/2012 CIFOR Annual Meeting 2012
21. Problem: bias in literature base
• Publication bias • Reviewer bias
• Language bias • Quality Assessment
• Regional & Developed • Reporting bias
Country bias • Methodological bias
• Funding bias • Outcome Variable Selection
• Database bias & Within-Study Reporting
• Regional & Developed bias
Country bias
Chalmers (2003) Trying to do more Good than Harm in Policy and Practice: The Role of
Rigorous, Transparent, Up-to-Date Evaluations .Annals of the American Academy of Political and Social
Science, Vol. 589, Misleading Evidence and Evidence-Led Policy: Making Social Science More
Experimental.
(Sep., 2003), pp. 22-40.
01/10/2012 CIFOR Annual Meeting 2012
22. Problem: bias in literature base
A hierarchy of evidence
01/10/2012 CIFOR Annual Meeting 2012
23. Framework for incorporating evidence
Question framing
• Involving Explicit
stakeholders question
• Define what is to Commitment to update
be examined and Systematic
how evaluation
of
• Rigorous review evidence
methodology
• Transparent Active
• Repeatable dissemination
of results
• To all stakeholders
(and decision-makers)
• Appropriate formats for
different end users
01/10/2012 CIFOR Annual Meeting 2012
24. Collaboration –
asking the most useful
questions
Collaboration –
telling people what Collaboration –
you discovered finding the most
useful evidence
Collaboration – Collaboration –
widespread feedback and agreeing on how to
peer-review at all stages analyse the evidence
01/10/2012 CIFOR Annual Meeting 2012
25. Rigour can be applied to ALL outputs that
aim to summarise science
Question framing
• Involving Explicit
stakeholders question
Systematic
• Define what is to Commitment to update
evaluation
be examined and
of
how
evidence
• Rigorous review
methodology
Active
• Transparent dissemination
• Repeatable
of results
• To all stakeholders
(and decision-makers)
• Appropriate formats
for different end users
01/10/2012 CIFOR Annual Meeting 2012
26. Reviewing the evidence
• Set by decision-makers
•
Explicit
Involving stakeholders
• question
Define what is to be examined
and how
Commitment to update
Systematic evaluation
of evidence
• Rigorous review
methodology • Active
To all stakeholders (including
decision-makers) dissemination
• Transparent • Appropriate formats for
different end users
of results
• Repeatable
01/10/2012 CIFOR Annual Meeting 2012
27. Who has adopted
Systematic Reviewing as ‘Gold Standard’?
01/10/2012 CIFOR Annual Meeting 2012
28. Stages of a review - Protocol
01/10/2012 CIFOR Annual Meeting 2012
29. REDD+ and carbon measurement
•REDD+ actions rewarded to their value of
tons of carbon mitigated
•Credits globally valued at US$126 billion
in 20081
•Will require accurate, credible
mensuration of forest carbon
•Current national forest monitoring
systems often of poor quality2
(1Capoor and Ambrosi 2009
2 Holmgren & Marklund, 2007)
01/10/2012 CIFOR Annual Meeting 2012
30. Don’t we already know how to assess
carbon?
Asner et al.,2011. A universal airborne LiDAR
approach for tropical forest carbon mapping.
Oecologia
doi 10.1007/s00442-011-2165-z
01/10/2012 CIFOR Annual Meeting 2012
31. Exciting claims as science progresses
“Using arguably the world’s most intensively studied tropical forest plot (STRI’s 50-ha
plot at Barro Colorado Island, Panama), Mascaro et al find that lidar-based
uncertainties of aboveground carbon stocks are indistinguishable from errors
obtained when doing the most detailed plot-based estimates.”
01/10/2012 CIFOR Annual Meeting 2012
32. Importance of question framing
• Brainstorming FAO, March Sub-questions
2009 • How accurate, precise and
• Refining, Bonn UNFCC, June repeatable are:
2009 • methods used for the conversion
• Peer-review, more refining of in situ measurements into
carbon stock estimates at the site
level?
• methods for generating carbon
How do current methods stock estimates for larger
compare in their ability to geographical areas (landscape
measure and assess terrestrial level) from site-level data?
carbon stocks and changes in
carbon stocks with • direct remote sensing
accuracy, precision and methodologies for estimating
repeatability? carbon stocks?
01/10/2012 CIFOR Annual Meeting 2012
33. Peer-reviewed studies not the whole story
Valuable forestry & environmental data & information
are in ‘grey’ (‘fugitive’) literature.
– reports
– working papers published
independently
– occasional papers by organizations
– spreadsheets on websites
– conference papers
infrequently indexed in bibliographic databases
inadequately retrieved by search engines
01/10/2012 CIFOR Annual Meeting 2012
34. Valuable evidence from older studies
Your library or research institution may have
essential information – collaborate to maximise
evidence base
01/10/2012 CIFOR Annual Meeting 2012
35. Systematic review of ALL evidence-
provided it meets agreed criteria for inclusion
• What characteristics of studies will be used to
determine whether a particular piece of evidence is
relevant to the topic of interest?
• What characteristics of studies will lead to their
exclusion?
• Will relevance decisions be based on a reading of report
titles, abstracts or full reports?
• Who will make the relevance decisions?
• How will the reliability of relevance decisions be
assessed?
01/10/2012 CIFOR Annual Meeting 2012
36. Statistics for retrieved papers
from subscription after title
bibliographic databases assessment
50,841 4,344
Very significant amounts of
valuable information is
locked behind a
from free databases and subscription firewall – no
organization web sites one Institution can afford to
get ‘the whole picture’
6,279 671
01/10/2012 CIFOR Annual Meeting 2012
37. After title assessment 4,531
After abst -> Category 2 650
After abst -> Category 1 300
Forest
Forest papers fall into these seven types - comparisons between:
1. different biomass equation forms
2. Biomass Estimation Factors and biomass equations.
3. different biomass equations against general biomass equations
4. different sampling / measurement techniques for dead wood
5. vegetation models and inversion techniques
6. eddy data and process-based models
7. different growth models to estimate carbon
• Category 1 papers (comparative studies) tend to be high in quality although many
do not provide statistics on relative precision/uncertainty but instead report on
correlations between the two methods.
• Studies often focus on the validity of a newer method by showing relationship to
more conventional methods but often do not shed light on relative
uncertainty, costs, etc.
• Many studies in type 1 to 3, but most of them too specific spatially
• There are few repetitions of studies that look at any given model
01/10/2012 CIFOR Annual Meeting 2012
38. Preliminary findings
• There is seemingly a large body of literature on
comparison of methods.
• But very few papers apply a methodology which tests
one method against another in one location at one
time to make robust conclusions about accuracy or
repeatability or affordability of a given method. This
may be contrary to the popular belief that the
science is pretty well agreed upon.
• Bottom line: Evidence appears to be scarce on
comparative advantages of different methods used
to measure carbon.
01/10/2012 CIFOR Annual Meeting 2012
39. Tentative conclusions
• Measuring and monitoring forest carbon accurately and reliably is absolute
requirement for success of REDD+
• REDD+ is at a critical stage of development which coincides with a time of increased
public scepticism in climate science
• For REDD+ emission activities to be credible, the national monitoring systems need
to be evidence based
• The systematic review of carbon measurements will provide a transparent and
readily-repeatable evidence base which can support decision-making in an
important area of climate mitigation
01/10/2012 CIFOR Annual Meeting 2012
40. Embracing EBF – typologies we
encountered and will encounter
• Early rejecter: The person/organisation who strongly believes that
the current way is the best one because they have a vested interest
(intellectual or economic) in promoting the method (the analogy
with health here is the drug company which currently has the
contract for supplying an effective medicine);
• Over-eager adopter: The person/organisation who strongly believes
that the current way is not the best one because they have a vested
interest (intellectual or economic) in promoting an alternative
method - often their own - (the medical analogy is a competing drug
company wanting to break into the market);
• Methodological sceptic: The person/organisation who has an open
mind about the current way and wants to test it.
• paraphrasing some of Rogers’ (1962) adopter categories:
01/10/2012 CIFOR Annual Meeting 2012
41. Ties in with agenda-setting for research
Research questions Knowledge gaps
Collaboration
01/10/2012 CIFOR Annual Meeting 2012
42. Why should CIFOR introduce EBF?
• Fits the organisation’s aims
• Promotes collaboration &encourages partnership
• Collaborators from Institutes with poor literature
resources get access to scientific publications
• North-South - knowledge & skills sharing
• Scientists here are already doing some of it
• It is good for careers – peer-reviewed publications
01/10/2012 CIFOR Annual Meeting 2012
43. • “Evidence-based forestry is the
conscientious, explicit, and judicious use of current
best evidence in making decisions to enhance
provision of products and services from forest
resources. It recognizes that forest resource
management is context specific, ever-
changing, and involves uncertainties, and that the
best evidence is derived from a systematic process
which aims to minimise bias.”
• (after Sackett 1996 & McKibbon 1998)
01/10/2012 CIFOR Annual Meeting 2012
44. Rigour can be applied to ALL outputs that
aim to summarise science
Question framing
• Involving Explicit
stakeholders question
Systematic
• Define what is to Commitment to update
evaluation
be examined and
of
how
evidence
• Rigorous review
methodology
Active
• Transparent dissemination
• Repeatable
of results
• To all stakeholders
(and decision-makers)
• Appropriate formats
for different end users
01/10/2012 CIFOR Annual Meeting 2012
45. A hierarchy of evidence
01/10/2012 CIFOR Annual Meeting 2012
53. Collaboration & evidence-based approach can
improve forestry research ! Evidence Based
Forestry
CIFOR/Oxford EFB work
• Representatives from Total body of research
key programmes
• Enthusiasm Research used.
• Resources available
Thank you for your Robust, ‘scientific’ methods for
attention! accessing and analysing research
used for decision-making. Results
disseminated actively.
01/10/2012 CIFOR Annual Meeting 2012
Editor's Notes
V2. removed ‘including’ from RH box
V2. removed ‘including’ from RH box
V2. removed ‘including’ from RH box
The aim is to use good information (the best evidence) well – disseminated widely and in ways that reach the target audiences;Ther are plenty of examples of missedopportunities – good information simply is not disseminated or picked up by those who need it.Bad information/weak evidence is everywhereBut be especially aware of the danger of poor information (weak evidence) that is used in ways that look good and that have real impact. Poor information used ‘well’ is the scourge of policy and decision-making.
Important elements of systematic review are:Formulating a clear question – that is needed by decision-makers (i.e. not a ‘blue-skies’ type of primary research question)Retrieving all relevant information to answer the question, while minimising biasExtracting relevant information/data in a way that minimises biasActively seeking widespread ‘peer-review’ from networks – e.g. Evidence-based forestry Google group/Climate org list serv, IUFRO, etc.Actively disseminating the findings and agreeing a plan for re-review later
Important elements of systematic review are:Formulating a clear question – that is needed by decision-makers (i.e. not a ‘blue-skies’ type of primary research question)Retrieving all relevant information to answer the question, while minimising biasExtracting relevant information/data in a way that minimises biasActively seeking widespread ‘peer-review’ from networks – e.g. Evidence-based forestry Google group/Climate org list serv, IUFRO, etc.Actively disseminating the findings and agreeing a plan for re-review later
Hand-searching for references, often suggested by wider collaborators and networks of people reviewing the systematic review at all stages, and including raw data from ,e.g. Forest inventories (b&w pic shows training session by Dr. S.V. Belov of the Leningrad Forest Research Institute, interpreting aerial photos, 1963).
All evidence, from whatever source, must be judged by the answers to these five questions, which are outlined fully in the review Protocol, a document which is written for every systematic review before the review is undertaken. The Protocol is reviewed externally as widely as possible and all changes are tracked. The process throughout the review is transparent and open to feebdack.