SlideShare a Scribd company logo
AI data engineering for
SME’s
Scott Turner
Section Director Computing
School of Engineering, Design and Technology
bit.ly/AIDataEng
Split of Session
• Gemini to extract from websites
• Use Tree of Thoughts as a way to see different
perspectives.
• Gemini and ChatGPT4 using Chain of thought to find
questions and potential answers
• Use of Data Analyst
• Using Data Analyst
• Documents
• Chain of Density for richer summaries
• Generating Social media posts from text.
Gemini
• Read, convert to plain text and consolidate information from the following sites
https://www.gov.uk/government/publications/national-disability-strategy/part-2-disabled-
peoples-everyday-experience-at-the-heart-of-government-policy-making-and-service-
delivery and https://www.gov.uk/government/publications/national-disability-
strategy/part-1-practical-steps-now-to-improve-disabled-peoples-everyday-lives and
https://www.gov.uk/government/publications/national-disability-strategy/part-3-a-cross-
government-effort-to-transform-disabled-peoples-everyday-lives When done present in
table form three key points of each website and key points of similarity
Strategies
Use personas as much as possible
Tree of Thoughts – use the personas to bring together thoughts of
‘experts’ to a group plan
Example: Randomly chose a company
Got three persona sales, production and finance to go through the
three websites and come up with a plan and actions with ideas
informed by the others.
Using the extracted contents of the three websites. In the context of the
company with this website https://www.careco.co.uk/about. Imagine that these
three experts Sales, Production and Finance are going review and draw insights
from these for opportunities for the organisation offered by the websites. They
will work on one step at a time and share their steps with each other as they
proceed. The experts will write down each step of their thinking and share it with
the group. The experts will take a moment to examine each other’s steps and
compare the stated steps. An expert can change their opinion based on seeing
what another expert stated. Then all experts will go on to the next step. They will
integrate through the process each time and refine the answers. At the very end,
the experts are to reach a final decision based on having seen each other’s
stated steps throughout the problem-solving process, each expert will give an
action to take away.
Expand and find some sources
Let’s say one of the actions was “Action (Production):
Research government grants, programs, and potential
partnerships related to homecare for disabled people.
Explore collaboration opportunities.”
We could expand it and get some potential sources of
funding
Prompt:
“Taking Action (Production) expand it and search for
potential UK funding sources to make it happen”
If you want to explore this a bit.
The Prompts and the Responses are available at:
https://llmapplied.blogspot.com/2024/05/taking-to-
yourselves-with-chatgpt-and.html
Chain of Thought
Decompose a questions into a series of self-contained subquestions and
answer them. Prompt below adapted from:
https://www.forbes.com/sites/lanceeliot/2023/07/31/new-prompt-engineering-
technique-pumps-up-chain-of-thought-with-factored-decomposition-and-spurs-
exciting-uplift-when-using-generative-ai/?sh=5ccf938e19cb
I’m going to ask you a question. I want you to decompose it into a series of
subquestions. Each subquestion should be self-contained with all the
information necessary to solve it. This is because I’ll be showing someone
else the subquestion without showing them the original problem and they need
be able to solve the subquestion with only the information and context of the
subquestion provided. This is really important - for example, you should never
say things like ”the teacher” or ”the father” without giving more context as to
who the teacher is and possibly the entire passage or situation that is being
referenced. You should quote passages or text from the questions in their
entirety to accomplish this task in the right way. For each subquestion provide
an answer and then provide a final answer.
Sentiment Analysis
Using ChatGPT4o
Load in the file
Prompt 1: Read in, convert to plain text and then extract the contents. Produce a summary
approximately 250 words. Produce a sentiment analysis of the document identifying is it positive,
negative or neutral document
Prompt 2: Quantify the levels of sentiment into positive, negative and neutral and produce a
visualization of these
Prompt 3:
Produce and show three word clouds for the negative, positive and neutral words
Prompt 4:
Produce Produce a new word document called senti2.docx with all the analysis and images
https://chat.openai.com/share/6a08a000-6220-4fe8-bef1-26a28b09f0be
Using ChatGPT4 and Data Analyst
Prompt 1: dataset_kaggel.zip
Zip Archive
Using this file, extract the file and analyse it. Produce three interesting presentations of key data.
Prompt 2: Produce a single report made up of the visualisations and the analysis around them. Save
the report as word document called "world.docx“
Prompt 3: looking at just United Kigdom and France data produce a table comparing the two
Prompt4: Produce a graph that visualises the french and UK data with all appropriate scaling and
legends
Prompt 5: Fit the best model to fit the data of the two countries and show these on the graph
Prompt 6: using the models produced predict the inflation rate in 2025 for France and the Uk
Better summaries
A lot of people are putting documents through these tools.
Research suggests an Approach called Chain of Density prompts where the tool goes through multiple times and makes
the summary richer. The original paper can be found at
Structure/Prompt itself.
You will generate increasingly concise entity-dense summarises of the article (Article)loaded
in. Repeat the following 2 steps 5 times Step 1. Identity 1-3 informative Entities (“;”
delimited)from the article which are missing from the previous generated summary. Step 2.
Write a new denser summary of identical length which covers every entity and detail from the
previous summary plus the Missing Entities. A Missing Entity is:- -Relevant: to the main article.
-Specific: descriptive yet concise (5 words or fewer). -Faithful: present in the Article. -
Anywhere: located anywhere in the Article. Guidelines: -The first summary should be long (8-
10 sentences, ~250 words) yet highly non-specific, containing little information beyond the
entities marked as missing. Use overly verbose language and fillers (e,g. “this articles
discusses”) to reach ~250 words. -Make every word count: rewrite the previous summary to
improve flow and make space for additional entities. -Make space with fusion, compression,
and removal of uninformative phrases like “the article discusses”. -The summaries should
become highly dense and yet self-contained, e.g. easily understood without the Article. -
Missing entities can appear anywhere in the new summary. -Never drop entities from the
previous summary. If space cannot be made, add fewer new entities. Remember , use exact
same number of words for each summary.
https://doi.org/10.48550/arXiv.2309.04269
First go.
Summary 1:
This article discusses the Kent & Medway Local Skills Improvement Plan (LSIP),
which aims to enhance local skills and training in response to employer needs and
labor market demands. It builds on a large evidence base, including insights from
employer surveys and engagement with local businesses. The LSIP highlights key
sectors such as construction, manufacturing, engineering, and health and social
care. It also emphasizes the importance of cross-cutting themes like
decarbonization, digitalization, and SME engagement. The plan outlines specific
actions and objectives for improving perceptions of the construction industry,
modernizing training offers, and upskilling and reskilling the existing workforce.
Additionally, it addresses the need for better alignment between training providers
and employer needs, and the importance of fostering a culture of continual learning
and innovation. The LSIP aims to support the local economy by ensuring a skilled
workforce that can meet future demands and contribute to economic growth. The
plan has been approved by the Secretary of State in accordance with the Skills and
Post-16 Education Act 2022.
Missing Entities:
1.Trailblazer LSIPs
2.Strategic Development Fund (SDF)
3.Employer Representative Bodies
Summary – final version
Summary 5:
The Kent & Medway Local Skills Improvement Plan (LSIP) aligns skills training with
employer needs, using evidence from surveys and engagements. It focuses on
construction, manufacturing, engineering, and health and social care, addressing
decarbonization, digitalization, and SME engagement. The LSIP outlines actions to
improve construction industry perceptions, modernize training, and upskill the
workforce, emphasizing alignment between training providers and employers.
Approved under the Skills and Post-16 Education Act 2022, it builds on Trailblazer
LSIPs and is supported by the Strategic Development Fund (SDF). Employer
Representative Bodies coordinate efforts. The Kent Construction Focus Group
(KCFG) highlights construction skills needs. The Skills for Jobs White Paper sets
the reform context, and the Employer Skills Survey (ESS) provides data on skill
gaps. SME engagement challenges, Modern Methods of Construction (MMC), and
decarbonization skills are key focus areas. Digital skills for construction, upskilling
and reskilling pathways, and collaboration with the Careers Hub and National
Career Service are integral to the plan's success.
https://chat.openai.com/share/99ad1cfc-
1ad0-4522-9148-c1de9251d186
Social media generation
Prompt 1: Read the contents of https://www.canterbury.ac.uk/study-
here/courses/postgraduate/data-intelligence, convert to plain text. Using this
information create five posssible twitter posts to promote this course to
grduates
Prompt 2: Repeat but add the course webpage url in as well
Prompt 3: Now repeat but this time for LinkedIn posts
Some useful sources
Tree of Thoughts – Strategy https://www.forbes.com/sites/lanceeliot/2023/09/08/prompt-engineering-embraces-tree-of-
thoughts-as-latest-new-technique-to-solve-generative-ai-toughest-problems/
Chain of Thought: https://www.forbes.com/sites/lanceeliot/2023/07/31/new-prompt-engineering-technique-pumps-up-chain-
of-thought-with-factored-decomposition-and-spurs-exciting-uplift-when-using-generative-ai/?sh=5ccf938e19cb
Chain of Density: https://doi.org/10.48550/arXiv.2309.04269
Kaggle Data
https://www.kaggle.com/datasets/sazidthe1/global-inflation-data?resource=download
https://kentemployerskillsplan.org/resources/kent-medway-local-skills-improvement-plan-2023/
Earlier version of slides bit.ly/AIDataEng

More Related Content

Similar to AI Data Engineering for SMEs - some tricks and tools

2.2 Assignment Totaling CostsGetting StartedProdu.docx
2.2 Assignment Totaling CostsGetting StartedProdu.docx2.2 Assignment Totaling CostsGetting StartedProdu.docx
2.2 Assignment Totaling CostsGetting StartedProdu.docx
RAJU852744
 
Team Contract
Team ContractTeam Contract
Team Contract
Jan Champagne
 
Part OneFirst, use the provided  MS Excel Spreadshe.docx
Part OneFirst, use the provided             MS Excel Spreadshe.docxPart OneFirst, use the provided             MS Excel Spreadshe.docx
Part OneFirst, use the provided  MS Excel Spreadshe.docx
LacieKlineeb
 
Mgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry universityMgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry university
dsvxxcvxc
 
Mgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry universityMgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry university
dgahdazncvn
 
Mgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry universityMgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry university
fdbdfbdx
 
Mgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry universityMgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry university
adadscacascas
 
Mgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry universityMgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry university
scorpiosns123
 
Mgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry universityMgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry university
iutiuriaolcom
 
Mgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry universityMgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry university
dfdhdfhdg
 
FINC 355Whats Retirement Needs Analysis1. Discuss the proces.docx
FINC 355Whats Retirement Needs Analysis1. Discuss the proces.docxFINC 355Whats Retirement Needs Analysis1. Discuss the proces.docx
FINC 355Whats Retirement Needs Analysis1. Discuss the proces.docx
voversbyobersby
 
Cultural Competence Checklist Personal Reflection _______.docx
Cultural Competence Checklist Personal Reflection _______.docxCultural Competence Checklist Personal Reflection _______.docx
Cultural Competence Checklist Personal Reflection _______.docx
faithxdunce63732
 
CIS 348 Imagine Your Future/newtonhelp.com   
CIS 348 Imagine Your Future/newtonhelp.com   CIS 348 Imagine Your Future/newtonhelp.com   
CIS 348 Imagine Your Future/newtonhelp.com   
bellflower46
 
CIS 348 Focus Dreams/newtonhelp.com
CIS 348 Focus Dreams/newtonhelp.comCIS 348 Focus Dreams/newtonhelp.com
CIS 348 Focus Dreams/newtonhelp.com
bellflower86
 
CIS 348 Life of the Mind/newtonhelp.com   
CIS 348 Life of the Mind/newtonhelp.com   CIS 348 Life of the Mind/newtonhelp.com   
CIS 348 Life of the Mind/newtonhelp.com   
bellflower3
 
A P P E N D I XCADDITIONAL CASESAND SOFTWAREINTRODUCTI.docx
A P P E N D I XCADDITIONAL CASESAND SOFTWAREINTRODUCTI.docxA P P E N D I XCADDITIONAL CASESAND SOFTWAREINTRODUCTI.docx
A P P E N D I XCADDITIONAL CASESAND SOFTWAREINTRODUCTI.docx
evonnehoggarth79783
 

Similar to AI Data Engineering for SMEs - some tricks and tools (16)

2.2 Assignment Totaling CostsGetting StartedProdu.docx
2.2 Assignment Totaling CostsGetting StartedProdu.docx2.2 Assignment Totaling CostsGetting StartedProdu.docx
2.2 Assignment Totaling CostsGetting StartedProdu.docx
 
Team Contract
Team ContractTeam Contract
Team Contract
 
Part OneFirst, use the provided  MS Excel Spreadshe.docx
Part OneFirst, use the provided             MS Excel Spreadshe.docxPart OneFirst, use the provided             MS Excel Spreadshe.docx
Part OneFirst, use the provided  MS Excel Spreadshe.docx
 
Mgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry universityMgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry university
 
Mgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry universityMgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry university
 
Mgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry universityMgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry university
 
Mgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry universityMgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry university
 
Mgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry universityMgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry university
 
Mgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry universityMgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry university
 
Mgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry universityMgmt404 entire class course project + all 7 weeks i labs devry university
Mgmt404 entire class course project + all 7 weeks i labs devry university
 
FINC 355Whats Retirement Needs Analysis1. Discuss the proces.docx
FINC 355Whats Retirement Needs Analysis1. Discuss the proces.docxFINC 355Whats Retirement Needs Analysis1. Discuss the proces.docx
FINC 355Whats Retirement Needs Analysis1. Discuss the proces.docx
 
Cultural Competence Checklist Personal Reflection _______.docx
Cultural Competence Checklist Personal Reflection _______.docxCultural Competence Checklist Personal Reflection _______.docx
Cultural Competence Checklist Personal Reflection _______.docx
 
CIS 348 Imagine Your Future/newtonhelp.com   
CIS 348 Imagine Your Future/newtonhelp.com   CIS 348 Imagine Your Future/newtonhelp.com   
CIS 348 Imagine Your Future/newtonhelp.com   
 
CIS 348 Focus Dreams/newtonhelp.com
CIS 348 Focus Dreams/newtonhelp.comCIS 348 Focus Dreams/newtonhelp.com
CIS 348 Focus Dreams/newtonhelp.com
 
CIS 348 Life of the Mind/newtonhelp.com   
CIS 348 Life of the Mind/newtonhelp.com   CIS 348 Life of the Mind/newtonhelp.com   
CIS 348 Life of the Mind/newtonhelp.com   
 
A P P E N D I XCADDITIONAL CASESAND SOFTWAREINTRODUCTI.docx
A P P E N D I XCADDITIONAL CASESAND SOFTWAREINTRODUCTI.docxA P P E N D I XCADDITIONAL CASESAND SOFTWAREINTRODUCTI.docx
A P P E N D I XCADDITIONAL CASESAND SOFTWAREINTRODUCTI.docx
 

More from Scott Turner

Practical ways to analyse twitter data - new challenges
Practical ways to analyse twitter data - new challengesPractical ways to analyse twitter data - new challenges
Practical ways to analyse twitter data - new challenges
Scott Turner
 
Socmedhe more than a conference
Socmedhe more than a conferenceSocmedhe more than a conference
Socmedhe more than a conference
Scott Turner
 
Computing and HealthCare Activity at CCCU - computing Team
Computing and HealthCare Activity at CCCU - computing TeamComputing and HealthCare Activity at CCCU - computing Team
Computing and HealthCare Activity at CCCU - computing Team
Scott Turner
 
Problem solving and programming
Problem solving and programmingProblem solving and programming
Problem solving and programming
Scott Turner
 
Benevolent machine learning and ai
Benevolent machine learning and aiBenevolent machine learning and ai
Benevolent machine learning and ai
Scott Turner
 
Benevolent machine learning sgs
Benevolent machine learning sgsBenevolent machine learning sgs
Benevolent machine learning sgs
Scott Turner
 
You too can analyse social media - well twitter
You too can analyse social media - well twitterYou too can analyse social media - well twitter
You too can analyse social media - well twitter
Scott Turner
 
Demystifying Blockchain for businesses
Demystifying Blockchain for businessesDemystifying Blockchain for businesses
Demystifying Blockchain for businesses
Scott Turner
 
Benevolent machine learning
Benevolent machine learningBenevolent machine learning
Benevolent machine learning
Scott Turner
 
Volunteering, It is good for the students, communities and the University : R...
Volunteering, It is good for the students, communities and the University : R...Volunteering, It is good for the students, communities and the University : R...
Volunteering, It is good for the students, communities and the University : R...
Scott Turner
 
Code club talk 18 7 2018 - Robots
Code club talk 18 7 2018 - RobotsCode club talk 18 7 2018 - Robots
Code club talk 18 7 2018 - Robots
Scott Turner
 
Games in Teaching Programming: HE Perspective
Games in Teaching Programming: HE PerspectiveGames in Teaching Programming: HE Perspective
Games in Teaching Programming: HE Perspective
Scott Turner
 
Robots Talk British Computer Society Northampton_17_4_2018
Robots Talk British Computer Society Northampton_17_4_2018Robots Talk British Computer Society Northampton_17_4_2018
Robots Talk British Computer Society Northampton_17_4_2018
Scott Turner
 
Blockchain
BlockchainBlockchain
Blockchain
Scott Turner
 
Blinking leds
Blinking ledsBlinking leds
Blinking leds
Scott Turner
 
The answer's not on the screen
The answer's not on the screenThe answer's not on the screen
The answer's not on the screen
Scott Turner
 
Experience of using Spreadsheets as a bridge in the understanding of AI techn...
Experience of using Spreadsheets as a bridge in the understanding of AI techn...Experience of using Spreadsheets as a bridge in the understanding of AI techn...
Experience of using Spreadsheets as a bridge in the understanding of AI techn...
Scott Turner
 
Junkbots 2017
Junkbots 2017Junkbots 2017
Junkbots 2017
Scott Turner
 
Pyconuk16 junkbots
Pyconuk16   junkbotsPyconuk16   junkbots
Pyconuk16 junkbots
Scott Turner
 
Social Robots in Education
Social Robots in EducationSocial Robots in Education
Social Robots in Education
Scott Turner
 

More from Scott Turner (20)

Practical ways to analyse twitter data - new challenges
Practical ways to analyse twitter data - new challengesPractical ways to analyse twitter data - new challenges
Practical ways to analyse twitter data - new challenges
 
Socmedhe more than a conference
Socmedhe more than a conferenceSocmedhe more than a conference
Socmedhe more than a conference
 
Computing and HealthCare Activity at CCCU - computing Team
Computing and HealthCare Activity at CCCU - computing TeamComputing and HealthCare Activity at CCCU - computing Team
Computing and HealthCare Activity at CCCU - computing Team
 
Problem solving and programming
Problem solving and programmingProblem solving and programming
Problem solving and programming
 
Benevolent machine learning and ai
Benevolent machine learning and aiBenevolent machine learning and ai
Benevolent machine learning and ai
 
Benevolent machine learning sgs
Benevolent machine learning sgsBenevolent machine learning sgs
Benevolent machine learning sgs
 
You too can analyse social media - well twitter
You too can analyse social media - well twitterYou too can analyse social media - well twitter
You too can analyse social media - well twitter
 
Demystifying Blockchain for businesses
Demystifying Blockchain for businessesDemystifying Blockchain for businesses
Demystifying Blockchain for businesses
 
Benevolent machine learning
Benevolent machine learningBenevolent machine learning
Benevolent machine learning
 
Volunteering, It is good for the students, communities and the University : R...
Volunteering, It is good for the students, communities and the University : R...Volunteering, It is good for the students, communities and the University : R...
Volunteering, It is good for the students, communities and the University : R...
 
Code club talk 18 7 2018 - Robots
Code club talk 18 7 2018 - RobotsCode club talk 18 7 2018 - Robots
Code club talk 18 7 2018 - Robots
 
Games in Teaching Programming: HE Perspective
Games in Teaching Programming: HE PerspectiveGames in Teaching Programming: HE Perspective
Games in Teaching Programming: HE Perspective
 
Robots Talk British Computer Society Northampton_17_4_2018
Robots Talk British Computer Society Northampton_17_4_2018Robots Talk British Computer Society Northampton_17_4_2018
Robots Talk British Computer Society Northampton_17_4_2018
 
Blockchain
BlockchainBlockchain
Blockchain
 
Blinking leds
Blinking ledsBlinking leds
Blinking leds
 
The answer's not on the screen
The answer's not on the screenThe answer's not on the screen
The answer's not on the screen
 
Experience of using Spreadsheets as a bridge in the understanding of AI techn...
Experience of using Spreadsheets as a bridge in the understanding of AI techn...Experience of using Spreadsheets as a bridge in the understanding of AI techn...
Experience of using Spreadsheets as a bridge in the understanding of AI techn...
 
Junkbots 2017
Junkbots 2017Junkbots 2017
Junkbots 2017
 
Pyconuk16 junkbots
Pyconuk16   junkbotsPyconuk16   junkbots
Pyconuk16 junkbots
 
Social Robots in Education
Social Robots in EducationSocial Robots in Education
Social Robots in Education
 

Recently uploaded

1:1制作英国伦敦大学毕业证(london毕业证书)学历学位证书原版一模一样
1:1制作英国伦敦大学毕业证(london毕业证书)学历学位证书原版一模一样1:1制作英国伦敦大学毕业证(london毕业证书)学历学位证书原版一模一样
1:1制作英国伦敦大学毕业证(london毕业证书)学历学位证书原版一模一样
es4hjcss
 
一比一原版(UAL毕业证)伦敦艺术大学毕业证如何办理
一比一原版(UAL毕业证)伦敦艺术大学毕业证如何办理一比一原版(UAL毕业证)伦敦艺术大学毕业证如何办理
一比一原版(UAL毕业证)伦敦艺术大学毕业证如何办理
ocqunu
 
Exploring the Contrast Silicone Sponge Rubber Versus Foam Rubber.pptx
Exploring the Contrast Silicone Sponge Rubber Versus Foam Rubber.pptxExploring the Contrast Silicone Sponge Rubber Versus Foam Rubber.pptx
Exploring the Contrast Silicone Sponge Rubber Versus Foam Rubber.pptx
Elastostar Rubber Corporation
 
一比一原版(ucsf毕业证书)加利福尼亚大学旧金山分校毕业证如何办理
一比一原版(ucsf毕业证书)加利福尼亚大学旧金山分校毕业证如何办理一比一原版(ucsf毕业证书)加利福尼亚大学旧金山分校毕业证如何办理
一比一原版(ucsf毕业证书)加利福尼亚大学旧金山分校毕业证如何办理
degswa
 
一比一原版(ud毕业证书)丹佛大学毕业证如何办理
一比一原版(ud毕业证书)丹佛大学毕业证如何办理一比一原版(ud毕业证书)丹佛大学毕业证如何办理
一比一原版(ud毕业证书)丹佛大学毕业证如何办理
degswa
 
VYAPAR TRENDS JUNE-2024 e-EDITION (VOL-2, ISSUE-05)
VYAPAR TRENDS JUNE-2024 e-EDITION (VOL-2, ISSUE-05)VYAPAR TRENDS JUNE-2024 e-EDITION (VOL-2, ISSUE-05)
VYAPAR TRENDS JUNE-2024 e-EDITION (VOL-2, ISSUE-05)
ftiiassociation
 
Complete Self-write Restaurant Business Plan Guide for Entrepreneurs
Complete Self-write Restaurant Business Plan Guide for EntrepreneursComplete Self-write Restaurant Business Plan Guide for Entrepreneurs
Complete Self-write Restaurant Business Plan Guide for Entrepreneurs
Kopa Global Technologies
 
1比1定做(aub毕业证书)伯恩茅斯艺术大学毕业证硕士学历证书原版一模一样
1比1定做(aub毕业证书)伯恩茅斯艺术大学毕业证硕士学历证书原版一模一样1比1定做(aub毕业证书)伯恩茅斯艺术大学毕业证硕士学历证书原版一模一样
1比1定做(aub毕业证书)伯恩茅斯艺术大学毕业证硕士学历证书原版一模一样
es4hjcss
 
Abasse Twalal Harouna: The Maestro of Digital Marketing - His Journey and Ach...
Abasse Twalal Harouna: The Maestro of Digital Marketing - His Journey and Ach...Abasse Twalal Harouna: The Maestro of Digital Marketing - His Journey and Ach...
Abasse Twalal Harouna: The Maestro of Digital Marketing - His Journey and Ach...
Abasse Twalal Harouna
 

Recently uploaded (9)

1:1制作英国伦敦大学毕业证(london毕业证书)学历学位证书原版一模一样
1:1制作英国伦敦大学毕业证(london毕业证书)学历学位证书原版一模一样1:1制作英国伦敦大学毕业证(london毕业证书)学历学位证书原版一模一样
1:1制作英国伦敦大学毕业证(london毕业证书)学历学位证书原版一模一样
 
一比一原版(UAL毕业证)伦敦艺术大学毕业证如何办理
一比一原版(UAL毕业证)伦敦艺术大学毕业证如何办理一比一原版(UAL毕业证)伦敦艺术大学毕业证如何办理
一比一原版(UAL毕业证)伦敦艺术大学毕业证如何办理
 
Exploring the Contrast Silicone Sponge Rubber Versus Foam Rubber.pptx
Exploring the Contrast Silicone Sponge Rubber Versus Foam Rubber.pptxExploring the Contrast Silicone Sponge Rubber Versus Foam Rubber.pptx
Exploring the Contrast Silicone Sponge Rubber Versus Foam Rubber.pptx
 
一比一原版(ucsf毕业证书)加利福尼亚大学旧金山分校毕业证如何办理
一比一原版(ucsf毕业证书)加利福尼亚大学旧金山分校毕业证如何办理一比一原版(ucsf毕业证书)加利福尼亚大学旧金山分校毕业证如何办理
一比一原版(ucsf毕业证书)加利福尼亚大学旧金山分校毕业证如何办理
 
一比一原版(ud毕业证书)丹佛大学毕业证如何办理
一比一原版(ud毕业证书)丹佛大学毕业证如何办理一比一原版(ud毕业证书)丹佛大学毕业证如何办理
一比一原版(ud毕业证书)丹佛大学毕业证如何办理
 
VYAPAR TRENDS JUNE-2024 e-EDITION (VOL-2, ISSUE-05)
VYAPAR TRENDS JUNE-2024 e-EDITION (VOL-2, ISSUE-05)VYAPAR TRENDS JUNE-2024 e-EDITION (VOL-2, ISSUE-05)
VYAPAR TRENDS JUNE-2024 e-EDITION (VOL-2, ISSUE-05)
 
Complete Self-write Restaurant Business Plan Guide for Entrepreneurs
Complete Self-write Restaurant Business Plan Guide for EntrepreneursComplete Self-write Restaurant Business Plan Guide for Entrepreneurs
Complete Self-write Restaurant Business Plan Guide for Entrepreneurs
 
1比1定做(aub毕业证书)伯恩茅斯艺术大学毕业证硕士学历证书原版一模一样
1比1定做(aub毕业证书)伯恩茅斯艺术大学毕业证硕士学历证书原版一模一样1比1定做(aub毕业证书)伯恩茅斯艺术大学毕业证硕士学历证书原版一模一样
1比1定做(aub毕业证书)伯恩茅斯艺术大学毕业证硕士学历证书原版一模一样
 
Abasse Twalal Harouna: The Maestro of Digital Marketing - His Journey and Ach...
Abasse Twalal Harouna: The Maestro of Digital Marketing - His Journey and Ach...Abasse Twalal Harouna: The Maestro of Digital Marketing - His Journey and Ach...
Abasse Twalal Harouna: The Maestro of Digital Marketing - His Journey and Ach...
 

AI Data Engineering for SMEs - some tricks and tools

  • 1. AI data engineering for SME’s Scott Turner Section Director Computing School of Engineering, Design and Technology bit.ly/AIDataEng
  • 2. Split of Session • Gemini to extract from websites • Use Tree of Thoughts as a way to see different perspectives. • Gemini and ChatGPT4 using Chain of thought to find questions and potential answers • Use of Data Analyst • Using Data Analyst • Documents • Chain of Density for richer summaries • Generating Social media posts from text.
  • 3. Gemini • Read, convert to plain text and consolidate information from the following sites https://www.gov.uk/government/publications/national-disability-strategy/part-2-disabled- peoples-everyday-experience-at-the-heart-of-government-policy-making-and-service- delivery and https://www.gov.uk/government/publications/national-disability- strategy/part-1-practical-steps-now-to-improve-disabled-peoples-everyday-lives and https://www.gov.uk/government/publications/national-disability-strategy/part-3-a-cross- government-effort-to-transform-disabled-peoples-everyday-lives When done present in table form three key points of each website and key points of similarity
  • 4. Strategies Use personas as much as possible Tree of Thoughts – use the personas to bring together thoughts of ‘experts’ to a group plan Example: Randomly chose a company Got three persona sales, production and finance to go through the three websites and come up with a plan and actions with ideas informed by the others.
  • 5. Using the extracted contents of the three websites. In the context of the company with this website https://www.careco.co.uk/about. Imagine that these three experts Sales, Production and Finance are going review and draw insights from these for opportunities for the organisation offered by the websites. They will work on one step at a time and share their steps with each other as they proceed. The experts will write down each step of their thinking and share it with the group. The experts will take a moment to examine each other’s steps and compare the stated steps. An expert can change their opinion based on seeing what another expert stated. Then all experts will go on to the next step. They will integrate through the process each time and refine the answers. At the very end, the experts are to reach a final decision based on having seen each other’s stated steps throughout the problem-solving process, each expert will give an action to take away.
  • 6. Expand and find some sources Let’s say one of the actions was “Action (Production): Research government grants, programs, and potential partnerships related to homecare for disabled people. Explore collaboration opportunities.” We could expand it and get some potential sources of funding Prompt: “Taking Action (Production) expand it and search for potential UK funding sources to make it happen”
  • 7. If you want to explore this a bit. The Prompts and the Responses are available at: https://llmapplied.blogspot.com/2024/05/taking-to- yourselves-with-chatgpt-and.html
  • 8. Chain of Thought Decompose a questions into a series of self-contained subquestions and answer them. Prompt below adapted from: https://www.forbes.com/sites/lanceeliot/2023/07/31/new-prompt-engineering- technique-pumps-up-chain-of-thought-with-factored-decomposition-and-spurs- exciting-uplift-when-using-generative-ai/?sh=5ccf938e19cb I’m going to ask you a question. I want you to decompose it into a series of subquestions. Each subquestion should be self-contained with all the information necessary to solve it. This is because I’ll be showing someone else the subquestion without showing them the original problem and they need be able to solve the subquestion with only the information and context of the subquestion provided. This is really important - for example, you should never say things like ”the teacher” or ”the father” without giving more context as to who the teacher is and possibly the entire passage or situation that is being referenced. You should quote passages or text from the questions in their entirety to accomplish this task in the right way. For each subquestion provide an answer and then provide a final answer.
  • 9. Sentiment Analysis Using ChatGPT4o Load in the file Prompt 1: Read in, convert to plain text and then extract the contents. Produce a summary approximately 250 words. Produce a sentiment analysis of the document identifying is it positive, negative or neutral document Prompt 2: Quantify the levels of sentiment into positive, negative and neutral and produce a visualization of these Prompt 3: Produce and show three word clouds for the negative, positive and neutral words Prompt 4: Produce Produce a new word document called senti2.docx with all the analysis and images https://chat.openai.com/share/6a08a000-6220-4fe8-bef1-26a28b09f0be
  • 10. Using ChatGPT4 and Data Analyst Prompt 1: dataset_kaggel.zip Zip Archive Using this file, extract the file and analyse it. Produce three interesting presentations of key data. Prompt 2: Produce a single report made up of the visualisations and the analysis around them. Save the report as word document called "world.docx“ Prompt 3: looking at just United Kigdom and France data produce a table comparing the two Prompt4: Produce a graph that visualises the french and UK data with all appropriate scaling and legends Prompt 5: Fit the best model to fit the data of the two countries and show these on the graph Prompt 6: using the models produced predict the inflation rate in 2025 for France and the Uk
  • 11. Better summaries A lot of people are putting documents through these tools. Research suggests an Approach called Chain of Density prompts where the tool goes through multiple times and makes the summary richer. The original paper can be found at Structure/Prompt itself. You will generate increasingly concise entity-dense summarises of the article (Article)loaded in. Repeat the following 2 steps 5 times Step 1. Identity 1-3 informative Entities (“;” delimited)from the article which are missing from the previous generated summary. Step 2. Write a new denser summary of identical length which covers every entity and detail from the previous summary plus the Missing Entities. A Missing Entity is:- -Relevant: to the main article. -Specific: descriptive yet concise (5 words or fewer). -Faithful: present in the Article. - Anywhere: located anywhere in the Article. Guidelines: -The first summary should be long (8- 10 sentences, ~250 words) yet highly non-specific, containing little information beyond the entities marked as missing. Use overly verbose language and fillers (e,g. “this articles discusses”) to reach ~250 words. -Make every word count: rewrite the previous summary to improve flow and make space for additional entities. -Make space with fusion, compression, and removal of uninformative phrases like “the article discusses”. -The summaries should become highly dense and yet self-contained, e.g. easily understood without the Article. - Missing entities can appear anywhere in the new summary. -Never drop entities from the previous summary. If space cannot be made, add fewer new entities. Remember , use exact same number of words for each summary. https://doi.org/10.48550/arXiv.2309.04269
  • 12.
  • 13. First go. Summary 1: This article discusses the Kent & Medway Local Skills Improvement Plan (LSIP), which aims to enhance local skills and training in response to employer needs and labor market demands. It builds on a large evidence base, including insights from employer surveys and engagement with local businesses. The LSIP highlights key sectors such as construction, manufacturing, engineering, and health and social care. It also emphasizes the importance of cross-cutting themes like decarbonization, digitalization, and SME engagement. The plan outlines specific actions and objectives for improving perceptions of the construction industry, modernizing training offers, and upskilling and reskilling the existing workforce. Additionally, it addresses the need for better alignment between training providers and employer needs, and the importance of fostering a culture of continual learning and innovation. The LSIP aims to support the local economy by ensuring a skilled workforce that can meet future demands and contribute to economic growth. The plan has been approved by the Secretary of State in accordance with the Skills and Post-16 Education Act 2022. Missing Entities: 1.Trailblazer LSIPs 2.Strategic Development Fund (SDF) 3.Employer Representative Bodies
  • 14. Summary – final version Summary 5: The Kent & Medway Local Skills Improvement Plan (LSIP) aligns skills training with employer needs, using evidence from surveys and engagements. It focuses on construction, manufacturing, engineering, and health and social care, addressing decarbonization, digitalization, and SME engagement. The LSIP outlines actions to improve construction industry perceptions, modernize training, and upskill the workforce, emphasizing alignment between training providers and employers. Approved under the Skills and Post-16 Education Act 2022, it builds on Trailblazer LSIPs and is supported by the Strategic Development Fund (SDF). Employer Representative Bodies coordinate efforts. The Kent Construction Focus Group (KCFG) highlights construction skills needs. The Skills for Jobs White Paper sets the reform context, and the Employer Skills Survey (ESS) provides data on skill gaps. SME engagement challenges, Modern Methods of Construction (MMC), and decarbonization skills are key focus areas. Digital skills for construction, upskilling and reskilling pathways, and collaboration with the Careers Hub and National Career Service are integral to the plan's success. https://chat.openai.com/share/99ad1cfc- 1ad0-4522-9148-c1de9251d186
  • 15. Social media generation Prompt 1: Read the contents of https://www.canterbury.ac.uk/study- here/courses/postgraduate/data-intelligence, convert to plain text. Using this information create five posssible twitter posts to promote this course to grduates Prompt 2: Repeat but add the course webpage url in as well Prompt 3: Now repeat but this time for LinkedIn posts
  • 16. Some useful sources Tree of Thoughts – Strategy https://www.forbes.com/sites/lanceeliot/2023/09/08/prompt-engineering-embraces-tree-of- thoughts-as-latest-new-technique-to-solve-generative-ai-toughest-problems/ Chain of Thought: https://www.forbes.com/sites/lanceeliot/2023/07/31/new-prompt-engineering-technique-pumps-up-chain- of-thought-with-factored-decomposition-and-spurs-exciting-uplift-when-using-generative-ai/?sh=5ccf938e19cb Chain of Density: https://doi.org/10.48550/arXiv.2309.04269 Kaggle Data https://www.kaggle.com/datasets/sazidthe1/global-inflation-data?resource=download https://kentemployerskillsplan.org/resources/kent-medway-local-skills-improvement-plan-2023/ Earlier version of slides bit.ly/AIDataEng