Peter Levesque explores the critical areas of measuring, interpreting, and analyzing results to ensure continual improvement of KT activities to produce intended results.
Reflections from a realist evaluation in progress: Scaling ladders and stitch...Debbie_at_IDS
In this session, Isabel Vogel, Melanie Punton and Rob Lloyd will reflect on the first year of a three-year realist impact evaluation, examining the Building Capacity to Use Research Evidence (BCURE) programme funded by the UK Department for International Development.
Sdal air health and social development (jan. 27, 2014) finalkimlyman
The American Institutes for Research (AIR) and Virginia Tech are collaborating to explore and develop new approaches to combining, manipulating and understanding big data. The two are also looking at how big data analytics can help answer questions critical to solving issues in education, workforce, health, and human and social development. They held two workshops on January 7 and 27, 2014- the first on Education and Workforce Analytics and the second on Health and Social Development Analytics.
Sdal air education workforce analytics workshop jan. 7 , 2014.pptxkimlyman
The American Institutes for Research (AIR) and Virginia Tech are collaborating to explore and develop new approaches to combining, manipulating and understanding big data. The two are also looking at how big data analytics can help answer questions critical to solving issues in education, workforce, health, and human and social development. They held two workshops on January 7 and 27, 2014- the first on Education and Workforce Analytics and the second on Health and Social Development Analytics.
Please join CPSI as we conclude our Human Factors webinar series with our final presentation Collaborative "Spaces" and Health Information Technology Design
Seven Steps to EnGendering Evaluations of Public Health ProgramsMEASURE Evaluation
Because international development increasingly focuses on gender, evaluators need a better understanding of how to measure and incorporate gender—including its economic, social, and health dimensions—in their evaluations. This interactive training, consisting of this presentation and a tool, will help participants learn to better evaluate programs with gender components. Access the tool at https://www.measureevaluation.org/resources/publications/tl-19-40
The Consolidated Framework for Implementation Research (CFIR) is used to guide the adaptation and plan for the implementation of public health interventions. The tool is appropriate for individuals and groups involved in planning and implementing existing interventions. To see the summary statement of this tool developed by NCCMT, click here: http://www.nccmt.ca/registry/view/eng/210.html
NCCMT is one of six NCCs for Public Health in Canada. More on the NCCs at www.nccph.ca. Production of this webinar has been made possible through a financial contribution from the Public Health Agency of Canada. The views expressed herein do not necessarily represent the views of the Public Health Agency of Canada.
Reflections from a realist evaluation in progress: Scaling ladders and stitch...Debbie_at_IDS
In this session, Isabel Vogel, Melanie Punton and Rob Lloyd will reflect on the first year of a three-year realist impact evaluation, examining the Building Capacity to Use Research Evidence (BCURE) programme funded by the UK Department for International Development.
Sdal air health and social development (jan. 27, 2014) finalkimlyman
The American Institutes for Research (AIR) and Virginia Tech are collaborating to explore and develop new approaches to combining, manipulating and understanding big data. The two are also looking at how big data analytics can help answer questions critical to solving issues in education, workforce, health, and human and social development. They held two workshops on January 7 and 27, 2014- the first on Education and Workforce Analytics and the second on Health and Social Development Analytics.
Sdal air education workforce analytics workshop jan. 7 , 2014.pptxkimlyman
The American Institutes for Research (AIR) and Virginia Tech are collaborating to explore and develop new approaches to combining, manipulating and understanding big data. The two are also looking at how big data analytics can help answer questions critical to solving issues in education, workforce, health, and human and social development. They held two workshops on January 7 and 27, 2014- the first on Education and Workforce Analytics and the second on Health and Social Development Analytics.
Please join CPSI as we conclude our Human Factors webinar series with our final presentation Collaborative "Spaces" and Health Information Technology Design
Seven Steps to EnGendering Evaluations of Public Health ProgramsMEASURE Evaluation
Because international development increasingly focuses on gender, evaluators need a better understanding of how to measure and incorporate gender—including its economic, social, and health dimensions—in their evaluations. This interactive training, consisting of this presentation and a tool, will help participants learn to better evaluate programs with gender components. Access the tool at https://www.measureevaluation.org/resources/publications/tl-19-40
The Consolidated Framework for Implementation Research (CFIR) is used to guide the adaptation and plan for the implementation of public health interventions. The tool is appropriate for individuals and groups involved in planning and implementing existing interventions. To see the summary statement of this tool developed by NCCMT, click here: http://www.nccmt.ca/registry/view/eng/210.html
NCCMT is one of six NCCs for Public Health in Canada. More on the NCCs at www.nccph.ca. Production of this webinar has been made possible through a financial contribution from the Public Health Agency of Canada. The views expressed herein do not necessarily represent the views of the Public Health Agency of Canada.
David Fleming held a seminar on monitoring and evaluation in conflict-affected environments at the Post-war Reconstruction and Development Unit (PRDU), University of York.
SDAL addresses social science in new ways that will transform how we understand the world. Among our goals: creating smart and resilient cities, combatting homelessness, understanding the spread of disease and developing effective public health responses, identifying innovation drivers, and meeting the demand for educated graduates in the field.
An overview of impact evaluation for organizations based on a program's Theory of Change, highlighting the need for a counterfactual and randomization (when possible) in order to convincingly demonstrate the effect of the program.
Using case studies to explore the generalizability of 'complex' development i...Barb Knittel
Discussion of the questions of internal and external validity and how case-based approaches are relevant for informing replication and scale up. Case studies can help to extrapolate key facts regarding context dynamics, process mechanisms, implementation capability, and trajectories of change (Michael Woolcock, World Bank).
Reducing sitting time at work: What's the evidence?Health Evidence™
Health Evidence hosted a 60 minute webinar examining the effectiveness of workplace interventions for reducing sitting at work. Click here for access to the audio recording for this webinar: https://youtu.be/psmac6jkbMM
Dr. Nipun Shrestha, MBBS, MPH, Postgraduate Student at Victoria University led the session and presented findings from his recent Cochrane review:
Shrestha N, Kukkonen-harjula KT, Verbeek JH, Ijaz S, Hermans V, & Bhaumik S. (2016). Workplace interventions for reducing sitting at work. Cochrane Database of Systematic Reviews, 2016(3), Art. No.: CD010912.
http://healthevidence.org/view-article.aspx?a=workplace-interventions-reducing-sitting-work-28404
Office work has become sedentary in nature. Increased sitting has been linked to increase in cardiovascular disease, obesity and overall mortality. This review examines the impact of workplace interventions to reduce sitting at work. Two cross-over randomized control trials, 11 cluster randomized trials and 4 controlled before-and-after studies, including 2180 participants are included in this review. Findings suggest that sit-stand desks may decrease workplace sitting. This webinar examined the effectiveness and components of interventions that reduce sitting at work.
An 8-step guide to help not-for-profit organizations develop a Project Impact Pathway or Logic Model for their programs - The first presentation in our Project Evaluation Series. By DevMetrica
Health Evidence hosted a 60 minute webinar examining the effectiveness of school-based interventions for preventing HIV, sexually transmitted infections and pregnancy in adolescents. Click here for access to the audio recording for this webinar: https://youtu.be/yCeIEQ4OTCc
Amanda Mason-Jones, Senior Lecturer in Global Public Health, Faculty of Science, University of York led the session and presented findings from her recent Cochrane review:
Mason-Jones A, Sinclair D, Mathews C, Kagee A, Hillman A, & Lombard C. (2016). School-based interventions for preventing HIV, sexually transmitted infections, and pregnancy in adolescents.Cochrane Database of Systematic Reviews, 2016(11), CD006417
http://healthevidence.org/view-article.aspx?a=school-based-interventions-preventing-hiv-sexually-transmitted-infections-29881
Sexually active adolescents are at risk of contracting HIV and STIs. Unintended pregnancy can have detrimental impact on young people’s lives. This review examines the impact of school sexual education programs on number of young people that contract STIs and number of adolescent pregnancies. Eight cluster randomized control trials, including 55,157 participants are included in this review. Findings suggest there is little evidence that school programs alone are effective in improving sexual and reproductive health outcomes for adolescents. This webinar examined the effectiveness and components of interventions that prevent HIV, STIs and adolescent pregnancy.
Operational research is becoming important in real world setting of health care as it always tried to find out challenges or gaps in any health related issues or in program. For health program improvement, OR should be conducting frequently. Program manager and doctors should be involve in OR and encourage to do so.
Impact Evaluation of Policy Oriented Research: why should CIAT engage with it...CIAT
CIAT is increasingly engaging in policy-oriented research (POR). Assessing the impact of research on policy is however methodological challenging. In this presentation we argue that complexity and case-specificity should not prevent us from trying to engage in this new type of Impact Evaluation. We provide some technical ‘tips’ which can support researchers in enhancing their ability to conceptualize better how POR research should be structured in order to be able to document and assess more rigorously the impact/influence of their research on policy process. Empirical and theoretical examples are used throughout to illustrate the discussion
A presentation to the Health Psychology in Public Health Network annual on practical, policy and research challenges in applying research to public health practice
David Fleming held a seminar on monitoring and evaluation in conflict-affected environments at the Post-war Reconstruction and Development Unit (PRDU), University of York.
SDAL addresses social science in new ways that will transform how we understand the world. Among our goals: creating smart and resilient cities, combatting homelessness, understanding the spread of disease and developing effective public health responses, identifying innovation drivers, and meeting the demand for educated graduates in the field.
An overview of impact evaluation for organizations based on a program's Theory of Change, highlighting the need for a counterfactual and randomization (when possible) in order to convincingly demonstrate the effect of the program.
Using case studies to explore the generalizability of 'complex' development i...Barb Knittel
Discussion of the questions of internal and external validity and how case-based approaches are relevant for informing replication and scale up. Case studies can help to extrapolate key facts regarding context dynamics, process mechanisms, implementation capability, and trajectories of change (Michael Woolcock, World Bank).
Reducing sitting time at work: What's the evidence?Health Evidence™
Health Evidence hosted a 60 minute webinar examining the effectiveness of workplace interventions for reducing sitting at work. Click here for access to the audio recording for this webinar: https://youtu.be/psmac6jkbMM
Dr. Nipun Shrestha, MBBS, MPH, Postgraduate Student at Victoria University led the session and presented findings from his recent Cochrane review:
Shrestha N, Kukkonen-harjula KT, Verbeek JH, Ijaz S, Hermans V, & Bhaumik S. (2016). Workplace interventions for reducing sitting at work. Cochrane Database of Systematic Reviews, 2016(3), Art. No.: CD010912.
http://healthevidence.org/view-article.aspx?a=workplace-interventions-reducing-sitting-work-28404
Office work has become sedentary in nature. Increased sitting has been linked to increase in cardiovascular disease, obesity and overall mortality. This review examines the impact of workplace interventions to reduce sitting at work. Two cross-over randomized control trials, 11 cluster randomized trials and 4 controlled before-and-after studies, including 2180 participants are included in this review. Findings suggest that sit-stand desks may decrease workplace sitting. This webinar examined the effectiveness and components of interventions that reduce sitting at work.
An 8-step guide to help not-for-profit organizations develop a Project Impact Pathway or Logic Model for their programs - The first presentation in our Project Evaluation Series. By DevMetrica
Health Evidence hosted a 60 minute webinar examining the effectiveness of school-based interventions for preventing HIV, sexually transmitted infections and pregnancy in adolescents. Click here for access to the audio recording for this webinar: https://youtu.be/yCeIEQ4OTCc
Amanda Mason-Jones, Senior Lecturer in Global Public Health, Faculty of Science, University of York led the session and presented findings from her recent Cochrane review:
Mason-Jones A, Sinclair D, Mathews C, Kagee A, Hillman A, & Lombard C. (2016). School-based interventions for preventing HIV, sexually transmitted infections, and pregnancy in adolescents.Cochrane Database of Systematic Reviews, 2016(11), CD006417
http://healthevidence.org/view-article.aspx?a=school-based-interventions-preventing-hiv-sexually-transmitted-infections-29881
Sexually active adolescents are at risk of contracting HIV and STIs. Unintended pregnancy can have detrimental impact on young people’s lives. This review examines the impact of school sexual education programs on number of young people that contract STIs and number of adolescent pregnancies. Eight cluster randomized control trials, including 55,157 participants are included in this review. Findings suggest there is little evidence that school programs alone are effective in improving sexual and reproductive health outcomes for adolescents. This webinar examined the effectiveness and components of interventions that prevent HIV, STIs and adolescent pregnancy.
Operational research is becoming important in real world setting of health care as it always tried to find out challenges or gaps in any health related issues or in program. For health program improvement, OR should be conducting frequently. Program manager and doctors should be involve in OR and encourage to do so.
Impact Evaluation of Policy Oriented Research: why should CIAT engage with it...CIAT
CIAT is increasingly engaging in policy-oriented research (POR). Assessing the impact of research on policy is however methodological challenging. In this presentation we argue that complexity and case-specificity should not prevent us from trying to engage in this new type of Impact Evaluation. We provide some technical ‘tips’ which can support researchers in enhancing their ability to conceptualize better how POR research should be structured in order to be able to document and assess more rigorously the impact/influence of their research on policy process. Empirical and theoretical examples are used throughout to illustrate the discussion
A presentation to the Health Psychology in Public Health Network annual on practical, policy and research challenges in applying research to public health practice
Professor Elizabeth Waters, Coordinating Editor of the Cochrane Public Health Review Group & Melbourne School of Population Health, University of Melbourne
The implementation 'black box' and evaluation as a driver for change. Presentation by Katie Burke and Claire Hickey of the Centre for Effective Services.
his is the first in a series of interactive webinars designed to build capacity in the basic principles of knowledge translation and implementation science.
WATCH-ON DEMAND: https://goo.gl/hnp8gi
Randomised control trials: lessons for Civic Tech - Andrew Westbury (Center f...mysociety
This was presented by Andrew Westbury from the Center for Effective Global Action at the Impacts of Civic Technology Conference (TICTeC 2017) in Florence on 25th April. You can find out more information about the conference here: http://tictec.mysociety.org
Session description: Randomised controlled trials have dramatically changed the development landscape, casting doubt on the effectiveness of accepted strategies, and identifying the value of less orthodox activities.
Randomized Controlled Trials: Insights for Civic Tech Andrew Westbury
Randomized controlled trials – or RCTs – have dramatically changed the development landscape, casting doubt on the effectiveness of accepted strategies – like microfinance – and identifying the value of previously-unorthodox activities, like unconditional cash transfers.
However, what have these powerful tools taught us about state capacity, government accountability, and responsiveness? Moreover, what does the RCT literature tell us about the use of technology to improve public services and galvanize citizen groups?
Unfortunately, state capacity and government accountability are some of the least-researched areas of international development. The International Initiative for Impact Evaluation (3ie) reports that less than 3% of registered impact evaluations focus on governance-related issues.
Moreover, a review of 175 recent RCTs identified only approximately 30 that included a specific tech-focus and few of these evaluated used tech from the “bottom-up” to catalyse community-action, peer-to-peer collaboration, and citizen-led efforts to address civic issues.
The Center for Effective Global Action (CEGA) at UC-Berkeley has recently launched a multi-year effort to support randomised evaluations of governance interventions around the world. As a part of this process, CEGA this year published a white paper, surveying over 200 recent impact evaluations on governance issues to identify “what works” and highlight open research questions.
Developing core common outcomes for tropical peatland research and managementMark Reed
Presentation by Prof Mark Reed at CIFOR Indonesian to open UN Global Peatland Initiative workshop to identify key variables that should be measured in tropical peatland research and monitoring. Workshop co-facilitated by Mark Reed and Dylan Young, with slides adapted from a presentation by Gav Stewart, Newcastle University.
A presentation by Nalini Takeshwar as part of the Cohort Research for Programme and Policy panel discussion at the International Symposium on Cohort and Longitudinal Studies in Developing Contexts, UNICEF Office of Research - Innocenti, Florence, Italy 13-15 October 2014
Master Class 'Getting New Ideas in to Practice' presentation, Normalisation P...NEQOS
Master Class Presentation slides for 'Getting ideas into Practice: normalising the implementation of complex interventions across the healthcare system', Collaborating for Better Care Partnership Master Class with Dr Tracy Finch, Professor Carl May, Dr Tim Rapley.
Theory Based Approach to Planning, Monitoring and Evaluating in the Livestock...ILRI
Presented by Caroline Kanyuuru, Helen Altshul and Helena Posthumus at the Priority Country Planning Meeting (Ethiopia, Tanzania, Uganda, Vietnam), ILRI, Nairobi, 26–27 March 2019
Similar to KTDRR Measuring for Impact_Peter Levesque (20)
Presented at the May 13-15 Canadian Knowledge Mobilization Forum conference, "sustainability" was the theme. This presentation describes the Co-Produced Pathway to Impact evaluation framework, the database designed for NeuroDevNet's KT Core to track services for management decisions and progress reporting, and factors for sustainability with reference to database design.
It wouldn’t be KMb without KB - Insights into the role of knowledge brokers in supporting child and youth mental health and addictions communities of interest in Ontario
by: MaryAnn Notarianni and Angela Yip
9-10 June 2014
Canadian Knowledge Mobilization Forum
Saskatoon, SK
Academic posters are like a store display: Visual appeal gets people in the door - the content gets them to stay.
Poster at the 2014 Canadian Knowledge Mobilization Forum, Saskatoon, Saskatchewan, 9-10 June 2014 by:
Sara Fisher and Dr. Bronwynne Wilton
Presentation at 2014 Canadian Knowledge Mobilization Forum, Saskatoon, Saskatchewan, June 9-10, 2014: The Next Generation: Students and Young Professionals in Knowledge Mobilization by
Elizabeth Shantz
Knowledge Mobilization Officer
Canadian Water Network
Evidence to Care: Mobilizing Childhood Disability Research into Practice
Dr. Shauna Kingsnorth
Evidence to Care Lead
Clinical Study Investigator
Assistant Professor (status), Department of Occupational Science
and Occupational Therapy, University of Toronto
Holland Bloorview Kids Rehabilitation Hospital
skingsnorth@hollandbloorview.ca
Presented at: Canadian Knowledge Mobilization Forum
Saskatoon, Saskatchewan June 9, 2014
Presentation: Tackling the Challenge of Childhood Obesity in the Early Years: Navigating a Complex Ecological Model towards Healthy Children by Jeff Graham and Gabrielle Lepage-Lavoie, Healthy Start/Départ Santé
2014 Canadian Knowledge Mobilization Forum, June 9 & 10, Saskatoon, SK, Canada
Presentation: From a network of researchers to a network of partners: VRM’s KMb shift. by Luc Dancause, Ph.D.
Knowledge Mobilization Consultant and Lecturer in Urban Studies, UQAM and Claire Poitras, Ph.D., Professor of Urban Studies and Director,INRS-Urbanisation Culture Société
2014 Canadian Knowledge Mobilization Forum, June 9 & 10, Saskatoon, SK, Canada
Presentation: Knowledge Translation and Transfer Program: sharing ideas, insights, innovation and impacts: research transformed into us - by Knowledge Translation and Transfer (KTT) Program, Ontario Ministry of Agricultural and Food and Ministry of Rural Affairs - Michael Toombs,Elin Gwyn and Bronwynne Wilton
2014 Canadian Knowledge Mobilization Forum, June 9 &10, 2014, Saskatoon, SK
Presentation by Dr. Bronwynne Wilton & Dr. Anne Bergen, University of Guelph, at 2014 Canadian Knowledge Mobilization Forum, June 9 & 10, 2014, Saskatoon, SK
Where do knowledge brokers come from?
Presentation by Mandy Sangha, BSc(OT), PMP
Specialist, Knowledge Management, Methods and Adoption
Canadian Partnership Against Cancer
2014 Canadian Knowledge Mobilization Forum, Saskatoon, SK, June 9 & 10, 2014
Indicators for Measurement at each Stage of Knowledge Translation:from Research to Impact
Anneliese Poetz, PhD – Manager, KT CoreDavid Phipps, PhD, MBA – Lead, KT CoreCanadian Knowledge Mobilization ConferenceMonday June 9, 3:30 – 4:00p (Room Cedar)Saskatoon, Saskatchewan
Peter Levesque, of the Institute for Knowledge Mobilization, presentation to the 2013 Plain Language International Association Conference in Vancouver, Canada, October 11, 2013
2013 Canadian Knowledge Mobilization Forum
Reinhart-McMillan W (1), Koning C (2), Mumme L (2) and The SCI KMN
1) Ontario Neurotrauma Foundation
2) Glenrose Rehabilitation Hospital
More from Institute for Knowledge Mobilization (20)
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
Search and Society: Reimagining Information Access for Radical FuturesBhaskar Mitra
The field of Information retrieval (IR) is currently undergoing a transformative shift, at least partly due to the emerging applications of generative AI to information access. In this talk, we will deliberate on the sociotechnical implications of generative AI for information access. We will argue that there is both a critical necessity and an exciting opportunity for the IR community to re-center our research agendas on societal needs while dismantling the artificial separation between the work on fairness, accountability, transparency, and ethics in IR and the rest of IR research. Instead of adopting a reactionary strategy of trying to mitigate potential social harms from emerging technologies, the community should aim to proactively set the research agenda for the kinds of systems we should build inspired by diverse explicitly stated sociotechnical imaginaries. The sociotechnical imaginaries that underpin the design and development of information access technologies needs to be explicitly articulated, and we need to develop theories of change in context of these diverse perspectives. Our guiding future imaginaries must be informed by other academic fields, such as democratic theory and critical theory, and should be co-developed with social science scholars, legal scholars, civil rights and social justice activists, and artists, among others.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
4. How are we measuring now?
• The Challenge: How did we get here? A brief history.
• Where are we: Study Designs
– Longitudinal studies
– Interrupted time series studies
– Controlled before and after studies
• Where are we: Monitoring Designs
– Direct observation
– Interview
– Survey
– Multi-method approaches
4
5. What are we trying to find?
•
–
–
–
–
–
–
–
–
–
Value Identification
Programs
Policies
Priorities
Processes/Procedures
Practice
Products
Perspectives
Possibilities
People Skills
• Where do we go from
here?
– Spectrum of impact
– Multiple value
manifestations
– Enhanced partnerships
and collaboration
– Gamification, sensors,
and always-on
monitoring
5
7. Challenge: Growth of the Research System
http://jrp.icaap.org/index.php/jrp/article/viewArticle/128/106
2000
1945
7
8. 8
This growth shifts patterns of sharing
Passive push
(until 1970s+)
Push harder
(1990s+)
Partner & pull
(2000+)
• Dissemination via
traditional journals,
conferences
• Focus on
implementation, e.g.
performance feedback
• Linkage & exchange, e.g.
joint production
8
10. Challenge: Competition in “idea market”
Philip Davies, Is Evidence-Based Government Possible?
Jerry Lee Lecture 2004, Washington, DC
10
10
11. Challenge of the growth of Scientific Literature
• Available literature includes
considerable discussion about the value
of knowledge translation
• Little solid research concerning methods
for ongoing monitoring and evaluation
of KT processes
• Most literature discusses measurement
of the outputs of KT activities
• Some literature discusses outcomes
• Very little on longer-term impact of KT
Growth of articles on
Speciation Analysis
11
12. 4 Common Obstacles to Research Use:
1.
The research question is not pertinent to practice.
2.
The research is not timely.
3.
The research is not communicated in ways relevant
to users.
4.
Management pressures trump the use of researchbased evidence in decision-making.
Source: Allen, P. et al 2007. “Commissioning research that is used: the experience of the NHS Service
Delivery and Organization Research Development Programme.” Evidence & Policy, 3(1): 119-134, as
summarized in CHSRF’s Insight and Action, Issue 13, June 2007.
12
13. Why are we concerned about this now?
• Production
– Every day, we create 2.5 quintillion bytes of data —
so much that 90% of the data in the world today
has been created in the last two years alone.
– This data comes from everywhere: sensors used to
gather climate information, posts to social media
sites, digital pictures and videos, purchase
transaction records, and cell phone GPS signals to
name a few.
– This data is big data.
http://www-01.ibm.com/software/data/bigdata/
13
14. Over Consumption?
–
–
–
–
–
–
–
–
Email: 144 billion email per day worldwide. (2012)
Websites: 624 million (2012)
Users: 2.4 billion (2012)
Mobile: 6.7 billion mobile subscriptions (2012)
Twitter: 175 million tweets daily average (2012)
Facebook: 1 billion users (2012)
Google: 1.2 trillion searches on Google (2012)
YouTube: 4 billion hours/month of video watched
(2012)
– Youth: spend less time watching TV (60%) and
more time online (600%)
14
16. Steps or shift in ecology?
Mitton (2007) & Ward (2001) identified 5
main steps in KT:
1.identification and communication of the
problem
2.analysis of the context in which the
problem exists
3.development and selection of knowledge
4.activities and interventions
5.use of knowledge
16
17. Richard Heinberg Quote
Taking in traumatic
information and transforming
it into life-affirming action
may turn out to be the most
advanced and meaningful
spiritual practice of our time.
http://globalpublicmedia.com/how_do_you_like_the_collapse_so_far
17
17
18. What are we doing:
Study Designs
• KT monitoring and evaluation
studies tend to follow one of three
main directions:
– Longitudinal studies
– Interrupted time series studies
– Controlled before and after
studies
18
19. Longitudinal Studies
• Continued monitoring of a KT
process or “intervention” from
beginning to end
• Real-time monitoring of an
intervention allows for
identification of problems with the
intervention and to address these
issues throughout the entire process
• Requires significant financial, time
and human resources
19
20. Interrupted time series studies
• Involves taking measurements at
multiple points before and after a
KT intervention has taken place
including some limited
measurement at pre-selected stages
of the intervention
• More streamlined than longitudinal
studies
• Does not easily allow assessment of
the impact of outside influences on
the outcome being studied.
20
21. Controlled before and after studies
• Make assessments before
commencing the intervention and
then making assessments after the
intervention has taken place to
evaluate changes that have occurred
• Beneficial in determining the effect
of an intervention in one specific
isolated context
• Difficult to account for
confounding variables that may
have affected the outcome being
studied
21
22. What are we doing:
Monitoring
• Monitoring and control of a KT
study typically involves one of 4
techniques:
– Direct observation
– Interview
– Survey
– Multi-method approaches
22
23. Direct Observation
• Constant awareness of how the KT
process is unfolding
• allows for ‘on the fly’ problem
solving
• Develop KT solution that is right for
the context of the initiative
• Requires the continuous presence of
a knowledge broker
• May be a costly endeavour and
create a strain on human resources,
finances and workloads
23
24. Interview
• Qualitative semi-structured interviews
with participants at the outset of the
intervention and throughout the
implementation process
• One of the most popular methods for
evaluating and monitoring KT
• Time consuming requiring preparation
and follow up
• Care must be taken to ensure that
results produced are not biased
24
25. Survey
• Typically involves a before and after survey
• Before the intervention takes place to get a
baseline of attitudes, knowledge, skills and
descriptive statistics
• After completion of the KT intervention
process, individuals are given another
survey to determine the change in the
factors measured before the survey
• Relatively quick, cheap and easy to perform
• May not provide a full picture of the
changes that occur
25
26. Multi-method Approaches
• A coordinated, multi – layer monitoring
plan throughout the whole process of the
KT initiative
• Provide the most complete picture of the
initiative, from multiple perspectives in a
continuous manner if planned and
organized effectively
• Allows for both qualitative and
quantitative insight
• More labour, time and financially
intensive than any of the other methods
used alone
26
27. No singular KT strategy was shown to be effective in all
contexts. Conclusions about interventions cannot be taken
on their own without considering the characteristics of the
knowledge that was being transferred, providers, participants
and organizations.
- The effectiveness of knowledge translation strategies used in
public health: a systematic review
LaRocca et al. BMC Public Health 2012, 12:751
27
29. Do we want KT evaluations that measure the
effectiveness of KT interventions?
OR
Do we want to make what we know
ready to use, to create value for the
communities we are concerned about?
29
30. Impacts determine whether
Vision is being achieved or not
How to align Strategy & Tactics to
Create impacts that meets the
Vision, Mission, and Goals?
30
31. Thinking about KT as Value Creation
Programs
Policies
Priorities
Processes
Practice
Innovation
Supporting
Infrastructure
Value Creation
Products
Perspectives
Procedures
Possibilities
People Skills
Now What:
Decisions,
Directions, Actions
So What:
Meaning,
Analysis, Interpretation
Incentives to
Share between
Levels
Initiatives
What: Data, Information, Description, Stories
MULTIPLE INPUTS FROM RESEARCH, PRACTICE, EXPERIENCE, CULTURE
31
32. Thinking about a spectrum of activities
Skinner, K. (2007). Developing a tool to measure knowledge exchange outcomes.
Canadian Journal of Program Evaluation, 22(1), 49-73.
32
33. Thinking about a nested system of changes
Shaxson and Gwynn (2010) “Developing a strategy for knowledge translation and brokering in
Public policymaking” paper from Knowledge Translation and Brokering workshop,
Montreal, Canada, 20 October 2010
33
34. Thinking about Conversations that link multiple contents with
contexts, capacities and cultures within and between people.
34
35. Choosing metrics that are preferred by people
Juice: A Guide to Creating Dashboards People Love to Use
http://www.juiceanalytics.com/wp-content/uploads/2010/11/Guide_to_Dashboard_Design.pdf
35
36. Choosing play and game design in how we share
The nature of intelligent environments has transformed
with the impact of Web 2.0 and social media over the
past years.
The conceptualization of the user has changed from
being a cog in an organizational machine to a partner
in system interaction and an ultimate consumer, and
more recently to a content creator and a task
performer.
36
37. Measuring for Impact requires a shift from:
•
•
•
•
•
•
•
“policing” to “engaging”
“producers and users” to “partners and co-creators”
“mechanical systems” to “complex emergent systems”
“content is king” to “Yes but conversation is queen”
“binary yes/no, on/off” to “spectrum of utilization”
“You fit context” to “Context is customized to you”
“work” to “purposeful play”
37
(attribute to Jonathan Lomas, CHSRF, Research Translation Deck December 14, 2005)
Speak about the evolution of the concepts: transfer (push); translation (pull); exchange (“partner & pull” through ongoing collaborative relationships, CHSRF)
Return to emphasis on communication products meeting needs of their audiences. Note that politicians are expert generalists: they shift from subject portfolio to subject portfolio. They are intelligent, and you shouldn’t underestimate them, but they have extremely limited time. They might read the decision box at the top of a briefing note and listen to a staff briefing (who may have read the full note). They do read the Globe…Jeffrey Simpson influences policy… which is why you DO want your research findings covered in the media.
Even an expert doesn’t want to work to understand your product