The document discusses the digital transformation of government services in the UK, noting that it is still in the early stages of revolution rather than evolution. It mentions the Government Digital Service, GOV.UK website, the Digital Service Standard and Performance framework, and focuses on improving services for citizens and users through shared platforms, patterns and registers.
This presentation covers the key question: Why dashboards? Local authorities and other public bodies have largely ended publishing reports and now produce dashboards. What are the factors that have contributed to this change?
This is the first presentation from our Workshop on 21 September 2023 on Dashboards, APIs and PowerBI.
ONS Local has been established by the Office for National Statistics (ONS) to support evidence-based decision-making at the local level. We aim to host insightful events that connect our users with exciting developments happening in subnational statistics and analysis at the ONS and across other organisations.
In April 2022, as the impact of increases in the Cost of Living really came to the forefront, Public Health & Communities, Suffolk County Council published a Cost of Living profile as part of the Joint Strategic Needs Assessment.
Alongside a written Cost of Living report ‘Making ends meet: The cost of living in Suffolk’, an interactive dashboard was also created using Power BI. In addition to internal data flows, publicly available data from sources such as the ONS have been used to provide a rich picture of the current situation for the local community.
The dashboard was developed in order to:
• Provide up to date data and information on the Cost of Living for Suffolk County Council, partner organisations, and members of the public.
• Deliver an interactive tool to allow users to focus on areas most relevant to them.
• Demonstrate that, while increases in the cost of living affect everyone, impact will be greatest for those who are already under financial pressure, exacerbating inequalities.
• Provide a source of actionable insight to support the system with the evidence base needed to support project development, drive change and really make a difference in the community.
Features of the dashboard:
• Place-focused - published at smaller geographies where possible
• Collaborative - Includes local data from across the system such as data shared by Citizens Advice and other system partners.
• Automated - Most data sources have automated connections, meaning there is little manual intervention required.
• Self-Service - Making the report publicly available puts data at the fingertips of colleagues, system partners and members of the public.
• Live - The dashboard is a living report which is frequently updated.
This session will:
• Provide a demonstration of Suffolk County Council’s Cost of Living dashboard
• Give an overview of data sources
• Explore opportunities for automation using Power BI
• Discuss how the data dashboard is used locally
This event is open to all; however, we anticipate it will be of most interest to anyone working on cost of living dashboards at the local level.
If you have any questions, please contact ons.local@ons.gov.uk.
ONS Local has been established by the Office for National Statistics (ONS) to promote evidence-based decision-making at the local level. We aim to host insightful workshops which will provide practical, technical support to help users make the most of ONS data. The Cross-Government Data Science Community brings together data scientists and analysts to build data science capability across the UK governments and public sector.
We are delighted to welcome you to our inaugural Workshop in our new series, entitled: 'How to use APIs'. The session will cover what Application Programming Interfaces (APIs) are, the advantages in using them and a practical demonstration of how they can be used. The journey of two Local Authority analysts as they begin using APIs in place of manual processes will be showcased to the audience. The session will conclude by explaining the plan for the forthcoming series of Workshops that will begin in September and introducing the Slack channel that ONS Local and Cross-Government DS community will be using to support users' technical questions going forward.
This event is open to all; however, we anticipate it will be of most interest to anyone working at a local level on creating data dashboards for internal or external use.
If you have any questions, please contact ons.local@ons.gov.uk.
ONS Local has been established by the Office for National Statistics (ONS) to promote evidence-based decision-making at the local level. We aim to host insightful workshops which will provide practical, technical support to help users make the most of ONS data. The Cross-Government Data Science Community brings together data scientists and analysts to build data science capability across the UK governments and public sector.
We are delighted to welcome you to our inaugural Workshop in our new series, entitled: 'How to use APIs'. The session will cover what Application Programming Interfaces (APIs) are, the advantages in using them and a practical demonstration of how they can be used. The journey of two Local Authority analysts as they begin using APIs in place of manual processes will be showcased to the audience. The session will conclude by explaining the plan for the forthcoming series of Workshops that will begin in September and introducing the Slack channel that ONS Local and Cross-Government DS community will be using to support users' technical questions going forward.
This event is open to all; however, we anticipate it will be of most interest to anyone working at a local level on creating data dashboards for internal or external use.
If you have any questions, please contact ons.local@ons.gov.uk.
ONS Local has been established by the Office for National Statistics (ONS) to promote evidence-based decision-making at the local level. We aim to host insightful workshops which will provide practical, technical support to help users make the most of ONS data. The Cross-Government Data Science Community brings together data scientists and analysts to build data science capability across the UK governments and public sector.
We are delighted to welcome you to our inaugural Workshop in our new series, entitled: 'How to use APIs'. The session will cover what Application Programming Interfaces (APIs) are, the advantages in using them and a practical demonstration of how they can be used. The journey of two Local Authority analysts as they begin using APIs in place of manual processes will be showcased to the audience. The session will conclude by explaining the plan for the forthcoming series of Workshops that will begin in September and introducing the Slack channel that ONS Local and Cross-Government DS community will be using to support users' technical questions going forward.
This event is open to all; however, we anticipate it will be of most interest to anyone working at a local level on creating data dashboards for internal or external use.
If you have any questions, please contact ons.local@ons.gov.uk.
ONS Local has been established by the Office for National Statistics (ONS) to support evidence-based decision-making at the local level. We aim to host insightful events that connect our users with exciting developments happening in subnational statistics and analysis at the ONS and across other organisations.
From 1 August 2019, the Secretary of State for Education delegated responsibility for the commissioning, delivery and management of London’s Adult Education Budget (AEB) to the Mayor of London. The AEB helps Londoners to get the skills they need to progress both in life and work. The overarching aim of London’s AEB is to make adult education in London even more accessible, impactful and locally relevant.
In this presentation, the Greater London Authority will be going through the results of the pioneering 2021/22 London Learner Survey (LLS). The survey’s objective is to gain insight into the outcomes of learners to inform and improve policy. The LLS consists of two linked surveys of learners who participated in GLA-funded Adult Education Budget (AEB) learning in the academic year 2021/22.
In the LLS, Learners are surveyed prior to and 5-7 months after completing their course to estimate the economic and social changes that learners experience following an AEB course.
In particular, the presentation will show the economic impact broken down by:
. Progression into employment
. Progression within work
. Progression into further learning.
The social impact will be explored by looking at changes in:
. Health and wellbeing
. Improved self-efficacy
. Improved social integration
. Participation in volunteering
The presentation will also cover how outcomes vary by funding type, breaking down the results by Community Learning and Adult Skills.
This event is open to all; however, we anticipate it will be of most interest to anyone working at a local level on skills, education and employment.
If you have any questions, please contact ons.local@ons.gov.uk.
ONS Local has been established by the Office for National Statistics (ONS) to support evidence-based decision-making at the local level. We aim to host insightful events that connect our users with exciting developments happening in subnational statistics and analysis at the ONS and across other organisations.
Are you interested in finding, visualising, comparing and downloading a wide range of geographically granular datasets in one place? If so, this webinar is definitely for you!
We will present ONS plans for the development of Explore Subnational Statistics (ESS), a public-facing digital service that will allow users to find out more about local areas across the UK.
We will retrace the main milestones in our journey to date, starting from the launch of ESS vision in the GSS subnational data strategy, then taking a closer look at the Subnational Indicators Explorer, and, finally, outlining a roadmap towards the Beta version of the service.
This event is open to all, however we anticipate it will be of most interest to anyone working at a local level, with data on the policy themes of economy, transport connectivity, education, skills, health and wellbeing, or interested in data visualisation products.
If you have any questions, please contact onslocal@ons.gov.uk
ONS Local has been established by the Office for National Statistics (ONS) to support evidence-based decision-making at the local level. We aim to host insightful events that connect our users with exciting developments happening in subnational statistics and analysis at the ONS and across other organisations.
Education and qualifications have been included as a separate analysis topic in Census for the first time in 2021. In this presentation the Census 2021 Education Analysis team will go through the results from the first two publications in their Analysis Plans, focusing on their impact and use for local authorities and other local users.
In the first publication published on 17th February 2023, 'How workforce qualification levels differ across England and Wales', the analysis looked at qualifications in the workforce population (adults aged 16 years and over who are economically active). The piece focused on trends across local authorities, exploring themes including the North-South divide, coastal towns and regional inequality.
The second publication examines the variations in the levels of qualifications that people hold by their country of birth. This includes establishing patterns across UK geographies for international migrants.
The session included live demonstrations of the interactive maps used in the publications, and how the data can be used by local authorities.
This recording is open to all, however we anticipate it will be of most interest to anyone working at a local level on skills, education and employment.
If you have any questions, please contact ons.local@ons.gov.uk
Welcome to the monthly economic forum. Here we will be showcasing the latest economic and social developments with a wide range of analytic topics. Each month we will feature ‘State of the Economy’, providing a stocktake of the latest trends and developments.
ONS Local has been established by the Office for National Statistics (ONS) to support evidence-based decision-making at the local level. We aim to host insightful events that connect our users with exciting developments happening in subnational statistics and analysis at the ONS and across other organisations.
Have you ever wondered which local authorities are similar to each other? This presentation discusses cluster analysis ONS has published to draw insight into which local authorities are performing in a similar way against key policy themes, promoting greater joined up working between local authorities with similar characteristics to address common problems they face. Our analysis also provides local authorities with control groups for investigating the impact of policy interventions.
In this webinar, we will cover the methods used to create our outputs, demonstrate some of our findings in our interactive visualisation tool and present information on our future plans to expand on this work.
This event is open to all, however we anticipate it will be of most interest to anyone working at a local level, or with data on the policy themes of economy, transport connectivity, education, skills, health and wellbeing.
If you have any questions, please contact ons.local@ons.gov.uk
ONS Local has been established by the Office for National Statistics (ONS) to support evidence-based decision-making at the local level. We aim to host insightful events that connect our users with exciting developments happening in subnational statistics and analysis at the ONS and across other organisations.
On 28th June 2022, Census 2021 released their first results, followed by data covering eight topics and more recently launched a new ‘Create a custom dataset’ tool. We will take you through a tour of the products such as census maps, build a custom area profile, create your own custom dataset tool and pre-built tables, as well as census analysis plans and how you can carry out your own analysis using census data.
This event is open to all, however we anticipate it will be of most interest to anyone working at a local level on Census data or on any Census topics.
If you have any questions, please contact ons.local@ons.gov.uk
Welcome to the monthly economic forum. Here we will be showcasing the latest economic and social developments with a wide range of analytic topics. Each month we will feature ‘State of the Economy’, providing a stocktake of the latest trends and developments.
Public Policy Analysis Forums hosted our second Annual Crime and Justice Statistics Forum, which provided users of crime and justice statistics an opportunity to engage with experts, share insights and discuss the future of our statistics and foster future collaboration.
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data LakeWalaa Eldin Moustafa
Dynamic policy enforcement is becoming an increasingly important topic in today’s world where data privacy and compliance is a top priority for companies, individuals, and regulators alike. In these slides, we discuss how LinkedIn implements a powerful dynamic policy enforcement engine, called ViewShift, and integrates it within its data lake. We show the query engine architecture and how catalog implementations can automatically route table resolutions to compliance-enforcing SQL views. Such views have a set of very interesting properties: (1) They are auto-generated from declarative data annotations. (2) They respect user-level consent and preferences (3) They are context-aware, encoding a different set of transformations for different use cases (4) They are portable; while the SQL logic is only implemented in one SQL dialect, it is accessible in all engines.
#SQL #Views #Privacy #Compliance #DataLake
This presentation covers the key question: Why dashboards? Local authorities and other public bodies have largely ended publishing reports and now produce dashboards. What are the factors that have contributed to this change?
This is the first presentation from our Workshop on 21 September 2023 on Dashboards, APIs and PowerBI.
ONS Local has been established by the Office for National Statistics (ONS) to support evidence-based decision-making at the local level. We aim to host insightful events that connect our users with exciting developments happening in subnational statistics and analysis at the ONS and across other organisations.
In April 2022, as the impact of increases in the Cost of Living really came to the forefront, Public Health & Communities, Suffolk County Council published a Cost of Living profile as part of the Joint Strategic Needs Assessment.
Alongside a written Cost of Living report ‘Making ends meet: The cost of living in Suffolk’, an interactive dashboard was also created using Power BI. In addition to internal data flows, publicly available data from sources such as the ONS have been used to provide a rich picture of the current situation for the local community.
The dashboard was developed in order to:
• Provide up to date data and information on the Cost of Living for Suffolk County Council, partner organisations, and members of the public.
• Deliver an interactive tool to allow users to focus on areas most relevant to them.
• Demonstrate that, while increases in the cost of living affect everyone, impact will be greatest for those who are already under financial pressure, exacerbating inequalities.
• Provide a source of actionable insight to support the system with the evidence base needed to support project development, drive change and really make a difference in the community.
Features of the dashboard:
• Place-focused - published at smaller geographies where possible
• Collaborative - Includes local data from across the system such as data shared by Citizens Advice and other system partners.
• Automated - Most data sources have automated connections, meaning there is little manual intervention required.
• Self-Service - Making the report publicly available puts data at the fingertips of colleagues, system partners and members of the public.
• Live - The dashboard is a living report which is frequently updated.
This session will:
• Provide a demonstration of Suffolk County Council’s Cost of Living dashboard
• Give an overview of data sources
• Explore opportunities for automation using Power BI
• Discuss how the data dashboard is used locally
This event is open to all; however, we anticipate it will be of most interest to anyone working on cost of living dashboards at the local level.
If you have any questions, please contact ons.local@ons.gov.uk.
ONS Local has been established by the Office for National Statistics (ONS) to promote evidence-based decision-making at the local level. We aim to host insightful workshops which will provide practical, technical support to help users make the most of ONS data. The Cross-Government Data Science Community brings together data scientists and analysts to build data science capability across the UK governments and public sector.
We are delighted to welcome you to our inaugural Workshop in our new series, entitled: 'How to use APIs'. The session will cover what Application Programming Interfaces (APIs) are, the advantages in using them and a practical demonstration of how they can be used. The journey of two Local Authority analysts as they begin using APIs in place of manual processes will be showcased to the audience. The session will conclude by explaining the plan for the forthcoming series of Workshops that will begin in September and introducing the Slack channel that ONS Local and Cross-Government DS community will be using to support users' technical questions going forward.
This event is open to all; however, we anticipate it will be of most interest to anyone working at a local level on creating data dashboards for internal or external use.
If you have any questions, please contact ons.local@ons.gov.uk.
ONS Local has been established by the Office for National Statistics (ONS) to promote evidence-based decision-making at the local level. We aim to host insightful workshops which will provide practical, technical support to help users make the most of ONS data. The Cross-Government Data Science Community brings together data scientists and analysts to build data science capability across the UK governments and public sector.
We are delighted to welcome you to our inaugural Workshop in our new series, entitled: 'How to use APIs'. The session will cover what Application Programming Interfaces (APIs) are, the advantages in using them and a practical demonstration of how they can be used. The journey of two Local Authority analysts as they begin using APIs in place of manual processes will be showcased to the audience. The session will conclude by explaining the plan for the forthcoming series of Workshops that will begin in September and introducing the Slack channel that ONS Local and Cross-Government DS community will be using to support users' technical questions going forward.
This event is open to all; however, we anticipate it will be of most interest to anyone working at a local level on creating data dashboards for internal or external use.
If you have any questions, please contact ons.local@ons.gov.uk.
ONS Local has been established by the Office for National Statistics (ONS) to promote evidence-based decision-making at the local level. We aim to host insightful workshops which will provide practical, technical support to help users make the most of ONS data. The Cross-Government Data Science Community brings together data scientists and analysts to build data science capability across the UK governments and public sector.
We are delighted to welcome you to our inaugural Workshop in our new series, entitled: 'How to use APIs'. The session will cover what Application Programming Interfaces (APIs) are, the advantages in using them and a practical demonstration of how they can be used. The journey of two Local Authority analysts as they begin using APIs in place of manual processes will be showcased to the audience. The session will conclude by explaining the plan for the forthcoming series of Workshops that will begin in September and introducing the Slack channel that ONS Local and Cross-Government DS community will be using to support users' technical questions going forward.
This event is open to all; however, we anticipate it will be of most interest to anyone working at a local level on creating data dashboards for internal or external use.
If you have any questions, please contact ons.local@ons.gov.uk.
ONS Local has been established by the Office for National Statistics (ONS) to support evidence-based decision-making at the local level. We aim to host insightful events that connect our users with exciting developments happening in subnational statistics and analysis at the ONS and across other organisations.
From 1 August 2019, the Secretary of State for Education delegated responsibility for the commissioning, delivery and management of London’s Adult Education Budget (AEB) to the Mayor of London. The AEB helps Londoners to get the skills they need to progress both in life and work. The overarching aim of London’s AEB is to make adult education in London even more accessible, impactful and locally relevant.
In this presentation, the Greater London Authority will be going through the results of the pioneering 2021/22 London Learner Survey (LLS). The survey’s objective is to gain insight into the outcomes of learners to inform and improve policy. The LLS consists of two linked surveys of learners who participated in GLA-funded Adult Education Budget (AEB) learning in the academic year 2021/22.
In the LLS, Learners are surveyed prior to and 5-7 months after completing their course to estimate the economic and social changes that learners experience following an AEB course.
In particular, the presentation will show the economic impact broken down by:
. Progression into employment
. Progression within work
. Progression into further learning.
The social impact will be explored by looking at changes in:
. Health and wellbeing
. Improved self-efficacy
. Improved social integration
. Participation in volunteering
The presentation will also cover how outcomes vary by funding type, breaking down the results by Community Learning and Adult Skills.
This event is open to all; however, we anticipate it will be of most interest to anyone working at a local level on skills, education and employment.
If you have any questions, please contact ons.local@ons.gov.uk.
ONS Local has been established by the Office for National Statistics (ONS) to support evidence-based decision-making at the local level. We aim to host insightful events that connect our users with exciting developments happening in subnational statistics and analysis at the ONS and across other organisations.
Are you interested in finding, visualising, comparing and downloading a wide range of geographically granular datasets in one place? If so, this webinar is definitely for you!
We will present ONS plans for the development of Explore Subnational Statistics (ESS), a public-facing digital service that will allow users to find out more about local areas across the UK.
We will retrace the main milestones in our journey to date, starting from the launch of ESS vision in the GSS subnational data strategy, then taking a closer look at the Subnational Indicators Explorer, and, finally, outlining a roadmap towards the Beta version of the service.
This event is open to all, however we anticipate it will be of most interest to anyone working at a local level, with data on the policy themes of economy, transport connectivity, education, skills, health and wellbeing, or interested in data visualisation products.
If you have any questions, please contact onslocal@ons.gov.uk
ONS Local has been established by the Office for National Statistics (ONS) to support evidence-based decision-making at the local level. We aim to host insightful events that connect our users with exciting developments happening in subnational statistics and analysis at the ONS and across other organisations.
Education and qualifications have been included as a separate analysis topic in Census for the first time in 2021. In this presentation the Census 2021 Education Analysis team will go through the results from the first two publications in their Analysis Plans, focusing on their impact and use for local authorities and other local users.
In the first publication published on 17th February 2023, 'How workforce qualification levels differ across England and Wales', the analysis looked at qualifications in the workforce population (adults aged 16 years and over who are economically active). The piece focused on trends across local authorities, exploring themes including the North-South divide, coastal towns and regional inequality.
The second publication examines the variations in the levels of qualifications that people hold by their country of birth. This includes establishing patterns across UK geographies for international migrants.
The session included live demonstrations of the interactive maps used in the publications, and how the data can be used by local authorities.
This recording is open to all, however we anticipate it will be of most interest to anyone working at a local level on skills, education and employment.
If you have any questions, please contact ons.local@ons.gov.uk
Welcome to the monthly economic forum. Here we will be showcasing the latest economic and social developments with a wide range of analytic topics. Each month we will feature ‘State of the Economy’, providing a stocktake of the latest trends and developments.
ONS Local has been established by the Office for National Statistics (ONS) to support evidence-based decision-making at the local level. We aim to host insightful events that connect our users with exciting developments happening in subnational statistics and analysis at the ONS and across other organisations.
Have you ever wondered which local authorities are similar to each other? This presentation discusses cluster analysis ONS has published to draw insight into which local authorities are performing in a similar way against key policy themes, promoting greater joined up working between local authorities with similar characteristics to address common problems they face. Our analysis also provides local authorities with control groups for investigating the impact of policy interventions.
In this webinar, we will cover the methods used to create our outputs, demonstrate some of our findings in our interactive visualisation tool and present information on our future plans to expand on this work.
This event is open to all, however we anticipate it will be of most interest to anyone working at a local level, or with data on the policy themes of economy, transport connectivity, education, skills, health and wellbeing.
If you have any questions, please contact ons.local@ons.gov.uk
ONS Local has been established by the Office for National Statistics (ONS) to support evidence-based decision-making at the local level. We aim to host insightful events that connect our users with exciting developments happening in subnational statistics and analysis at the ONS and across other organisations.
On 28th June 2022, Census 2021 released their first results, followed by data covering eight topics and more recently launched a new ‘Create a custom dataset’ tool. We will take you through a tour of the products such as census maps, build a custom area profile, create your own custom dataset tool and pre-built tables, as well as census analysis plans and how you can carry out your own analysis using census data.
This event is open to all, however we anticipate it will be of most interest to anyone working at a local level on Census data or on any Census topics.
If you have any questions, please contact ons.local@ons.gov.uk
Welcome to the monthly economic forum. Here we will be showcasing the latest economic and social developments with a wide range of analytic topics. Each month we will feature ‘State of the Economy’, providing a stocktake of the latest trends and developments.
Public Policy Analysis Forums hosted our second Annual Crime and Justice Statistics Forum, which provided users of crime and justice statistics an opportunity to engage with experts, share insights and discuss the future of our statistics and foster future collaboration.
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data LakeWalaa Eldin Moustafa
Dynamic policy enforcement is becoming an increasingly important topic in today’s world where data privacy and compliance is a top priority for companies, individuals, and regulators alike. In these slides, we discuss how LinkedIn implements a powerful dynamic policy enforcement engine, called ViewShift, and integrates it within its data lake. We show the query engine architecture and how catalog implementations can automatically route table resolutions to compliance-enforcing SQL views. Such views have a set of very interesting properties: (1) They are auto-generated from declarative data annotations. (2) They respect user-level consent and preferences (3) They are context-aware, encoding a different set of transformations for different use cases (4) They are portable; while the SQL logic is only implemented in one SQL dialect, it is accessible in all engines.
#SQL #Views #Privacy #Compliance #DataLake
Global Situational Awareness of A.I. and where its headedvikram sood
You can see the future first in San Francisco.
Over the past year, the talk of the town has shifted from $10 billion compute clusters to $100 billion clusters to trillion-dollar clusters. Every six months another zero is added to the boardroom plans. Behind the scenes, there’s a fierce scramble to secure every power contract still available for the rest of the decade, every voltage transformer that can possibly be procured. American big business is gearing up to pour trillions of dollars into a long-unseen mobilization of American industrial might. By the end of the decade, American electricity production will have grown tens of percent; from the shale fields of Pennsylvania to the solar farms of Nevada, hundreds of millions of GPUs will hum.
The AGI race has begun. We are building machines that can think and reason. By 2025/26, these machines will outpace college graduates. By the end of the decade, they will be smarter than you or I; we will have superintelligence, in the true sense of the word. Along the way, national security forces not seen in half a century will be un-leashed, and before long, The Project will be on. If we’re lucky, we’ll be in an all-out race with the CCP; if we’re unlucky, an all-out war.
Everyone is now talking about AI, but few have the faintest glimmer of what is about to hit them. Nvidia analysts still think 2024 might be close to the peak. Mainstream pundits are stuck on the wilful blindness of “it’s just predicting the next word”. They see only hype and business-as-usual; at most they entertain another internet-scale technological change.
Before long, the world will wake up. But right now, there are perhaps a few hundred people, most of them in San Francisco and the AI labs, that have situational awareness. Through whatever peculiar forces of fate, I have found myself amongst them. A few years ago, these people were derided as crazy—but they trusted the trendlines, which allowed them to correctly predict the AI advances of the past few years. Whether these people are also right about the next few years remains to be seen. But these are very smart people—the smartest people I have ever met—and they are the ones building this technology. Perhaps they will be an odd footnote in history, or perhaps they will go down in history like Szilard and Oppenheimer and Teller. If they are seeing the future even close to correctly, we are in for a wild ride.
Let me tell you what we see.
Adjusting primitives for graph : SHORT REPORT / NOTESSubhajit Sahu
Graph algorithms, like PageRank Compressed Sparse Row (CSR) is an adjacency-list based graph representation that is
Multiply with different modes (map)
1. Performance of sequential execution based vs OpenMP based vector multiply.
2. Comparing various launch configs for CUDA based vector multiply.
Sum with different storage types (reduce)
1. Performance of vector element sum using float vs bfloat16 as the storage type.
Sum with different modes (reduce)
1. Performance of sequential execution based vs OpenMP based vector element sum.
2. Performance of memcpy vs in-place based CUDA based vector element sum.
3. Comparing various launch configs for CUDA based vector element sum (memcpy).
4. Comparing various launch configs for CUDA based vector element sum (in-place).
Sum with in-place strategies of CUDA mode (reduce)
1. Comparing various launch configs for CUDA based vector element sum (in-place).
Enhanced Enterprise Intelligence with your personal AI Data Copilot.pdfGetInData
Recently we have observed the rise of open-source Large Language Models (LLMs) that are community-driven or developed by the AI market leaders, such as Meta (Llama3), Databricks (DBRX) and Snowflake (Arctic). On the other hand, there is a growth in interest in specialized, carefully fine-tuned yet relatively small models that can efficiently assist programmers in day-to-day tasks. Finally, Retrieval-Augmented Generation (RAG) architectures have gained a lot of traction as the preferred approach for LLMs context and prompt augmentation for building conversational SQL data copilots, code copilots and chatbots.
In this presentation, we will show how we built upon these three concepts a robust Data Copilot that can help to democratize access to company data assets and boost performance of everyone working with data platforms.
Why do we need yet another (open-source ) Copilot?
How can we build one?
Architecture and evaluation
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...John Andrews
SlideShare Description for "Chatty Kathy - UNC Bootcamp Final Project Presentation"
Title: Chatty Kathy: Enhancing Physical Activity Among Older Adults
Description:
Discover how Chatty Kathy, an innovative project developed at the UNC Bootcamp, aims to tackle the challenge of low physical activity among older adults. Our AI-driven solution uses peer interaction to boost and sustain exercise levels, significantly improving health outcomes. This presentation covers our problem statement, the rationale behind Chatty Kathy, synthetic data and persona creation, model performance metrics, a visual demonstration of the project, and potential future developments. Join us for an insightful Q&A session to explore the potential of this groundbreaking project.
Project Team: Jay Requarth, Jana Avery, John Andrews, Dr. Dick Davis II, Nee Buntoum, Nam Yeongjin & Mat Nicholas
Learn SQL from basic queries to Advance queriesmanishkhaire30
Dive into the world of data analysis with our comprehensive guide on mastering SQL! This presentation offers a practical approach to learning SQL, focusing on real-world applications and hands-on practice. Whether you're a beginner or looking to sharpen your skills, this guide provides the tools you need to extract, analyze, and interpret data effectively.
Key Highlights:
Foundations of SQL: Understand the basics of SQL, including data retrieval, filtering, and aggregation.
Advanced Queries: Learn to craft complex queries to uncover deep insights from your data.
Data Trends and Patterns: Discover how to identify and interpret trends and patterns in your datasets.
Practical Examples: Follow step-by-step examples to apply SQL techniques in real-world scenarios.
Actionable Insights: Gain the skills to derive actionable insights that drive informed decision-making.
Join us on this journey to enhance your data analysis capabilities and unlock the full potential of SQL. Perfect for data enthusiasts, analysts, and anyone eager to harness the power of data!
#DataAnalysis #SQL #LearningSQL #DataInsights #DataScience #Analytics
Techniques to optimize the pagerank algorithm usually fall in two categories. One is to try reducing the work per iteration, and the other is to try reducing the number of iterations. These goals are often at odds with one another. Skipping computation on vertices which have already converged has the potential to save iteration time. Skipping in-identical vertices, with the same in-links, helps reduce duplicate computations and thus could help reduce iteration time. Road networks often have chains which can be short-circuited before pagerank computation to improve performance. Final ranks of chain nodes can be easily calculated. This could reduce both the iteration time, and the number of iterations. If a graph has no dangling nodes, pagerank of each strongly connected component can be computed in topological order. This could help reduce the iteration time, no. of iterations, and also enable multi-iteration concurrency in pagerank computation. The combination of all of the above methods is the STICD algorithm. [sticd] For dynamic graphs, unchanged components whose ranks are unaffected can be skipped altogether.
Unleashing the Power of Data_ Choosing a Trusted Analytics Platform.pdfEnterprise Wired
In this guide, we'll explore the key considerations and features to look for when choosing a Trusted analytics platform that meets your organization's needs and delivers actionable intelligence you can trust.
Good morning, thanks for coming back for day 2!
I’m Tom Scott and I’m the Digital Service Manager for Census. This is a new role for ONS and the Census team. I’m responsible for ensuring that there is an end-to-end digital service for collection, processing and dissemination of the responses.
We’re taking the approach set out by Government Digital Service, GDS, to do this, loosely coupled platforms and products that meet the needs of their users, both internal and external to ONS. This is a new way to work and builds a legacy and capability that will go on beyond the 2021 Census.
I have been asked to talk about the transformation of digital in government, I used to work for GDS. I set up the Digital Service Standard assessments, I’ve worked on the proposition for GOV.UK and lead the rebuild of the Service Design Manual. It’s given me some insight. I’m going to talk about what happened and what is happening now.
The story of the recent government digital transformation starts in 2010 when the then Minister for Cabinet Office, Francis Maude, asked the Governments Digital Champion, Martha Lane Fox for recommendations on the future of DirectGov.
It turned out to be the enabler for the changes that government that have been pursuing since.
It was an important change, the response was a letter with high level recommendations and not a specific set of tasks. It was a challenge and call to action.
Martha Lane Fox – Letter to MCO (Francis Maude) with 4 recommendations
Make Directgov the government front end for all departments' transactional online services to citizens and businesses, with the teeth to mandate cross government solutions, set standards and force departments to improve citizens' experience of key transactions.
Make Directgov a wholesaler as well as the retail shop front for government services & content by mandating the development and opening up of Application Programme Interfaces (APls) to third parties.
Change the model of government online publishing, by putting a new central team in Cabinet Office in absolute control of the overall user experience across all digital channels, commissioning all government online information from other departments.
Appoint a new CEO for Digital in the Cabinet Office with absolute authority over the user experience across all government online services (websites and APls) and the power to direct all government online spending.
GDS was set up as a result of Martha’s recommendations, to enable and deliver the change.
To coordinate the approach government has to digital and challenge the expectations towards delivery of services, bringing together the state and the citizen and keeping digital at the heart of decision making.
The organisation is made up of people with experience outside of government, may attracted to do ‘national service’. The purpose is to bring the user closer to the service provider and ensure that the tax payer is not being exploited by having expertise in the decision making process, removing the reliance on big IT and bringing the skills and knowledge in house.
GDS was made up of experts from across government, the DirectGov team.
You can see the USDS visiting the team to talk about digital government and the relationship between the state and citizens.
The behaviours of the team are perhaps the most talked about. They question everything and look for data driven decisions rather than reliance on history, so much has changed in the last 20 years around the internet and technology we can’t always take our prior understanding and apply it. They also look to build the ‘thing’ that is a minimum viable product, enhancing that only when further needs are identified and validated. They share skills, time and knowledge across government.
Initially there was a single purpose for GDS - to build GOV.UK
It followed the principles of a technology start up releasing software as soon as it is ready and maintaining an agile approach to get the MVP.
GOV.UK became the place for government to publish data (exceptions being independent bodies like ONS). It’s vital national infrastructure.
Started with department and service information publishing, transitioning users across and while not breaking URLs. Mainstream content is grouped around topics from user research and testing rather than departmental publishing. This allows GOV.UK to describe the end-to-end services rather than just the part an individual organisation is responsible for.
Transition continued with Agencies, ALBs, NDPB etc. moving to GOV.UK – and continues today as more agencies see the benefits to transitioning to a shared publishing platform.
User needs were at the centre of the approach, both citizens and government users. It had to be simple to find content and services and was built to encourage users to come to the site through search engines like Google. Traffic to GOV.UK continues to grow and averages between 12 and 14 millions visits per week, around 50% of users come from mobiles and tablets.
It’s also award winning – 2013 Design Museum Design of the year award – the Mail called it ‘boring.com’!
Transition continued with Agencies, ALBs, NDPB etc. moving to GOV.UK – and continues today as more agencies see the benefits to transitioning to a shared publishing platform.
User needs were at the centre of the approach, both citizens and government users. It had to be simple to find content and services and was built to encourage users to come to the site through search engines like Google. Traffic to GOV.UK continues to grow and averages between 12 and 14 millions visits per week, around 50% of users come from mobiles and tablets.
It started with an alpha and iterated quickly into the site you use today.
It’s also award winning – 2013 Design Museum Design of the year award – the Mail called it ‘boring.com’!
The second major strand of work for GDS began in January 2013 with 400 days to transform 25 exemplars for major government services and make them digital-by-default. Working with 8 departments across government to meet the needs of users rather than government.
Focusing on the common and sharing resources across departments GDS built. By March 2015, government had delivered a range of world-class digital services used by millions of people, both in the UK and abroad. Twenty exemplar services were publicly available. The remaining 5 are still in development and departments are continuing to deliver them and more with the shared knowledge from this programme.
This is just a single example – in fact it’s a much more comprehensive service now – of the visa service. It’s one of many that has been built around the user needs – in thins case in their own language, tested with native speaker in their own countries and circumstances.
There are many other great services, paying vehicle tax for example with started small and grew to include direct debit set up, viewing the details of a licence and MOT, drawing all this information together under a service to enable users to do the things they needs to do to be able to drive.
Some are transformational like the Lasting Power of Attorney service – please take 5 minutes to look at the YouTube video on the GDS channel, it’s great to see how a well designed service can affect peoples lives for the positive.
It’s not enough that GDS started this work, transformation needed to happen across government.
Digital-by-default was the rally call to organisations, keeping the focus on digital being the primary access point for services and supporting those users who couldn’t use those channels.
The Service Design Manual represents the best practices for building user centred digital services. It covers all areas involved in doing it from technology to the team and governance to operations. It’s constantly refined and improved as knowledge across government increases, it represents all the communities of practice (designers, developers, technologists etc.) and helps teams to meet the Digital Service Standard.
The Digital Service Standard was put in place as a check for services across government to assure that the needs or users were understood and met and that the teams building the services were sustainable and able to develop as users feedback and changed over time. There are 18 criteria, they are not prescriptive, rather a way of working that aligns to the objectives that GDS and government has set.
Part of the objectives are to be open about the KPIs that the service is meeting, GDS built a platform for those.
The Performance platform is a real time data publishing platform that provides real insight into the services that government is offering. It’s important as it provides details on the success of services and the digital transformation they are on. This is the Lasting Power of attorney service, you can see that digital take up has grown from nothing in September 2013 to over 26% of all applications – seen as this is an industry dominated by legal firms this is a real achievement, putting the user at the centre and allowing them to make decisions on who will be their appointed guardian when they can not make decisions themselves in the future.
And this is the real achievement of GOV.UK and the digital-by-default approach bringing the state and citizens closer together. Meeting the expectations of user (which keep raising) and understanding the needs they have. It’s not about making a personal and friendly service (that can be a good thing), it’s about giving users access to the services they need to use.
This is the fundamental difference in approach. Users have no choice over the service they use, they are not customers, there is only one HMRC, there is only one DVLA, there is only one ONS. And we are accountable to those users more and more, these are the citizens, people who provide the means and the demand for our services to exist.
There is much work still to be completed. Almost all services need to be rethought outside of organisational silos, I shouldn’t need to go to different departments or agencies to achieve a single task.
So what do we do to solve this. There are a number of things that government is working on that will bring this together.
You may have used one of these already. These are common tasks and shared components that are part of a service. Some of these are in the early stages of development, GOV.UK pay, GOV.UK notify, Government PaaS, blueprints for technology.
The most obvious example being GOV.UK Verify.
GOV.UK Verify has created a market place for identity. It allows users to sign into services where there identity is required to be known, and users do not need to rely on government to hold details about identity. Users can trust a 3rd party (probably someone who they’ve trusted before). This is really important because users do not need a single government account and can move providers at any time, but still only need a single log-in for the whole of government.
Service patterns for common services. Seems simple but there are hundreds of services government runs that provide similar outputs, licences being a great example.
I’ll leave most of the explanation to the next speaker, suffice to say all services in someway or another are underpinned by these, they are canonical and have a well understood structure.
They are the foundation to the future of government services and digital.