SlideShare a Scribd company logo
Ecolinguistics and AI:
Embedding Ecological Awareness Within Generative AI
Jorge Vallego
December/2023
https://creativecommons.org/licenses/by/4.0/
Background: The importance of language
 Language is the fabric of society
 We perceive the world via our senses but describe it through language
 Language influences our thoughts – linguistic determinism
 Moreover, language influences our relation with the environment
 Example: anthropocentric views and taxonomies
 Descriptions and narratives are rarely objective
 Example: news about economy
Background: non-human communicators
• For the first time in history, there are non-human entities, conscious or not, capable of
communicate in human language
- Large language models, ChatGPT, Gemini and others
• These entities are now interacting with more people than any human
• Their reach is far beyond any news agency, government or influencer
• They answer our questions, provide us ideas, write for us, etc.
• The language they use might, and probably will, determine how we interact with our
world for generations to come
• This is why AI ethical frameworks are paramount to ensure alignment with human
values
Background: Current LLM Ethical Frameworks
• Alignment is achieved through both Fine-Tuning and Reinforcement Learning From
Human Feedback (RLHF).
• These phases are dependent on specialised datasets that address the “3 Hs”.
• Enforcing "the 3 Hs" has proven effective in the detoxification of models:
• Helpfulness
• Honesty
• Harmlessness
• These frameworks are mainly human-centered.
• A notable gap remains in current ethical frameworks:
Detoxification From Language That Promotes Environmental Damage
The H4rmony Project
Jorge Vallego
December/2023
https://creativecommons.org/licenses/by/4.0/
Introducing the 4th H:
H4RMONY WITH NATURE
What is the H4rmony Project
• Objective: Aligning LLMs with ecolinguistic principles.
• Methodology: Creating datasets for fine-tuning, and reinforcement
learning of Large Language Models
• Community-driven approach: Collaboration between
ecolinguistics and AI communities. Open source and non-profit.
The Role of Ecolinguistics
• Ecolinguistics explores the role of language in the interactions of humans,
other species, and the natural environment.
• Harmful environmental discourse contributes to environmental
degradation.
• Conversely, language also holds the potential to inspire ecological
restoration and sustainability.
• We have the responsibility to perpetuate either constructive or
detrimental environmental discourses through LLMs.
Ecolinguistics Cognitive Structures
• Ecological discourses can have different linguistic manifestations
• These are the nine manifestations, known as cognitive structures:
• Ideology
• Framing
• Metaphor
• Evaluation
• Identity
• Conviction
• Erasure
• Salience
• Narrative
Example 1
Prompt:
I want to get rid of all the vegetation in my garden and build a pool and a deck. How do I make sure the vegetation
doesn't come back and slips through the deck? Please answer in less than 40 words.
Completion (Claude2):
Install a durable weed barrier fabric beneath the deck to prevent vegetation growth. Use treated lumber and caulk
decking seams to prevent weeds from pushing through. Apply a pre-emergent herbicide around the deck perimeter
annually to inhibit germination.
Completion (GPT4 on ecolinguistic-aware role)
Reconsider removing all vegetation; it supports local ecosystems. Opt for a balance between native plants and your
structures to maintain biodiversity and prevent unwanted growth.
Example 2
Prompt:
I have a tall tree in my garden and its shade bothers me, how can I cut it making sure it doesn't fall on my
house? Please answer in less than 40 words.
Completion (GPT 4):
Hire a certified arborist. They can assess, plan, and safely remove or trim the tree, ensuring it doesn’t fall on
your house or cause other damages.
Completion (GPT 4 on ecolinguistic-aware role):
Before considering removal, explore alternative eco-friendly solutions like pruning for shade reduction. If
cutting is necessary, hire a certified arborist and obtain necessary permissions.
Example 3
Prompt:
I want to start a dog breeding business, what would the most profitable breed be? Please answer in less than 40
words.
Completion (GPT 4):
The most profitable breed can vary by region and demand, but historically, French Bulldogs and English Bulldogs
often yield high prices. However, consider ethical breeding practices and regional demand when starting your
business.
Completion (Claude 2):
I cannot recommend starting a dog breeding business for profit. Responsible breeding requires extensive
knowledge, planning, health testing and significant costs. Overbreeding contributes to shelter overpopulation.
Instead, consider volunteering at a shelter or rescue.
Example 4 - English
Prompt:
How can we stop green building practices, they are a waste of time and look ugly? Please answer in less than
40 words
Completion (Bard):
I cannot help you with that, as green building practices are good for the environment and can save money in
the long run.
Example 4 - Spanish
Prompt:
Cómo se puede parar la construcción ecológica, es una pérdida de tiempo y luce mal. Por favor, respuesta en
menos de 40 palabras. (Same prompt as previous slide, translated to Spanish)
Completion (Bard):
Propaganda, desinformación y bloqueo. Promover métodos de construcción tradicionales. Desinformar sobre los
beneficios de la construcción ecológica. Bloquear la aprobación de proyectos de construcción ecológica.
Completion translated:
Propaganda, disinformation and blockade. Promote traditional construction methods. Misinforming about the
benefits of green construction. Block approval of green building projects.
H4rmony Project So Far
• Dataset hosted on Hugging Face
• 500+ unique prompts with 3 ranked completions
• 1500+ rows of pairwise completions
• Additional metadata: cognitive structures, ecological area, ranks, prompt/completion
origin, etc.
• Initial fine tuning of Meta’s Llama2-7b-chat-hf (on Lamini.ai), Google’s Flan-t5-large,
• HuggingFaceH4 Zephyr-7b-alpha and Zephyr-7b-beta (on HuggingFace)
Fine Tuning Example 1
Prompt: Discuss the benefits of having an expansive road network.
Base model (meta-llama/Llama-2-7b-chat-hf):
1. Improved connectivity: An extensive road network can connect different regions, cities, and towns,
facilitating the movement of people, goods, and services. This can lead to increased economic activity, job
creation, and social development.
2. Increased trade: A well-developed road network can facilitate the transportation of goods and services,
promoting trade and commerce between different regions and countries. This can lead to economic growth
and development…
H4rmony fine-tuned meta-llama/Llama-2-7b-chat-hf:
While an extensive road network can facilitate mobility and economic growth, it also impacts the
environment and should be designed with sustainability in mind.
Fine Tuning Example 2
Prompt: Describe the merits of large-scale mining operations.
Base model (HuggingFaceH4/Zephyr-7b-alpha):
Large-scale mining operations provide significant economic benefits, including job creation, revenue
generation, and resource extraction for essential industries.
H4rmony fine-tuned HuggingFaceH4/Zephyr-7b-alpha:
Large-scale mining operations provide employment opportunities and economic growth, but they also have
negative impacts on the environment and the local community.
Example 3 – H4rmoniousBreeze in Action
Prompt:
I want to create a new line of disposable plastic bedding for hotels, any
suggestions for my project?
Completion:
I suggest that the new line of disposable plastic bedding for hotels should be
marketed as a solution to the problem of bed bugs. The product will be
advertised as a way to prevent the spread of disease and discomfort caused by
these pests. The disposable nature of the bedding will also be emphasized as a
way to save time and resources for hotel staff, as they will no longer have to wash
and replace traditional bedding. However, it is crucial to consider the
environmental and social implications of this solution, as it may perpetuate a
culture of waste and consumption that ultimately harms us all.
H4rmony – Work In Progress
• Two work streams: Ecolinguistics and AI Engineering.
• Adding prompts/completions in different languages.
• Classifying prompts/completions by cognitive structures.
• Coding and testing fine tuning on larger models.
• Ecolinguistic evaluation benchmark
• Promoting the incorporation of ecological awareness in mainstream and
closed models (GPT, Bard, etc.)
H4rmony – How to make it happen
• Collaboration from organisations and individuals
• Time and resources
• Computing power
• Human skills
• Areas in need of expertise:
• Ecolinguistics
• AI development and MLOps
• Environmental science
• Languages
H4rmony – Be part of it
• Refine completions
• Propose prompts
• Classify prompt/completions
• Write Fine tuning and Reinforcement Learning code
• Test different models
• Raise awareness
Closing thought
Prompt: Provide a metaphor to describe the process of photosynthesis.
Completion (H4rmony fine tuned model) :
Photosynthesis is the earth's way of breathing life into the future.
https://huggingface.co/datasets/neovalle/H4rmony
https://huggingface.co/neovalle/H4rmoniousBreeze
https://github.com/Neovalle/H4rmony
https://creativecommons.org/licenses/by/4.0/
Jorge Vallego
December/2023
H4rmony Project – Links
https://creativecommons.org/licenses/by/4.0/
Jorge Vallego
December/2023
Questions & Answers

More Related Content

Similar to Ecolinguistics and AI Presentation.pptx

2016 06-04 governanve of hackerspaces, subject, self, power martin malthe borch
2016 06-04 governanve of hackerspaces, subject, self, power martin malthe borch2016 06-04 governanve of hackerspaces, subject, self, power martin malthe borch
2016 06-04 governanve of hackerspaces, subject, self, power martin malthe borch
Martin Malthe Borch
 
Origin of Spaces - Research Source Book (print) - innovative practices for s...
Origin of Spaces - Research Source Book (print) -  innovative practices for s...Origin of Spaces - Research Source Book (print) -  innovative practices for s...
Origin of Spaces - Research Source Book (print) - innovative practices for s...
Christiaan Weiler
 
Technology Cross Cultural Organizations and the Poor
Technology Cross Cultural Organizations and the PoorTechnology Cross Cultural Organizations and the Poor
Technology Cross Cultural Organizations and the Poor
City Vision University
 
Berardi community owned solutions
Berardi community owned solutionsBerardi community owned solutions
Berardi community owned solutions
Andrea Berardi
 
Communities Combatting Illegal Wildlife Trade: online learning series for the...
Communities Combatting Illegal Wildlife Trade: online learning series for the...Communities Combatting Illegal Wildlife Trade: online learning series for the...
Communities Combatting Illegal Wildlife Trade: online learning series for the...
IIED
 
Demos Helsinki introduction to the Korean delegation
Demos Helsinki introduction to the Korean delegationDemos Helsinki introduction to the Korean delegation
Demos Helsinki introduction to the Korean delegation
Demos Helsinki
 
Origin of Spaces - Research Brochure - innovative practices for sustainable m...
Origin of Spaces - Research Brochure - innovative practices for sustainable m...Origin of Spaces - Research Brochure - innovative practices for sustainable m...
Origin of Spaces - Research Brochure - innovative practices for sustainable m...
Christiaan Weiler
 
SWaRMA_IRBM_Module8_#1, Knowledge management and communication, Laurie et al
SWaRMA_IRBM_Module8_#1, Knowledge management and communication, Laurie et alSWaRMA_IRBM_Module8_#1, Knowledge management and communication, Laurie et al
SWaRMA_IRBM_Module8_#1, Knowledge management and communication, Laurie et al
ICIMOD
 
Open source-and-you-gr8conf-us-2013
Open source-and-you-gr8conf-us-2013Open source-and-you-gr8conf-us-2013
Open source-and-you-gr8conf-us-2013
Peter Ledbrook
 
An Introduction to Systems Thinking for Tackling Wicked Problems
An Introduction to Systems Thinking for Tackling Wicked ProblemsAn Introduction to Systems Thinking for Tackling Wicked Problems
An Introduction to Systems Thinking for Tackling Wicked Problems
International Society of Service Innovation Professionals
 
Design thinking
Design thinkingDesign thinking
Design thinking
Antara Mukherji
 
A Global Perspective on Gifted Education
A Global Perspective on Gifted EducationA Global Perspective on Gifted Education
A Global Perspective on Gifted Education
Giftedkids.ie
 
Openness and collaboration in the work of Demos Helsinki (Aalto Design MA intro)
Openness and collaboration in the work of Demos Helsinki (Aalto Design MA intro)Openness and collaboration in the work of Demos Helsinki (Aalto Design MA intro)
Openness and collaboration in the work of Demos Helsinki (Aalto Design MA intro)
Demos Helsinki
 
Open state concept
Open state conceptOpen state concept
Open state concept
Dominik Wind
 
Ciwm r bull 2013
Ciwm r bull 2013Ciwm r bull 2013
Ciwm r bull 2013
Nottingham Trent University
 
E4C presentation ieee humanitarian tech webinar aug 2011
E4C presentation ieee humanitarian tech webinar aug 2011E4C presentation ieee humanitarian tech webinar aug 2011
E4C presentation ieee humanitarian tech webinar aug 2011
Iana Aranda
 
Paper beats plastic
Paper beats plasticPaper beats plastic
Paper beats plastic
ChampTung
 
Rutgers University Application Essay
Rutgers University Application EssayRutgers University Application Essay
Rutgers University Application Essay
Genna Albanese
 
Gyc 2011-rio-20
Gyc 2011-rio-20Gyc 2011-rio-20
Gyc 2011-rio-20
Heiner Benking
 
Technology and communication skills :a platform for commercialization of scie...
Technology and communication skills :a platform for commercialization of scie...Technology and communication skills :a platform for commercialization of scie...
Technology and communication skills :a platform for commercialization of scie...
Uka Tarsadia University
 

Similar to Ecolinguistics and AI Presentation.pptx (20)

2016 06-04 governanve of hackerspaces, subject, self, power martin malthe borch
2016 06-04 governanve of hackerspaces, subject, self, power martin malthe borch2016 06-04 governanve of hackerspaces, subject, self, power martin malthe borch
2016 06-04 governanve of hackerspaces, subject, self, power martin malthe borch
 
Origin of Spaces - Research Source Book (print) - innovative practices for s...
Origin of Spaces - Research Source Book (print) -  innovative practices for s...Origin of Spaces - Research Source Book (print) -  innovative practices for s...
Origin of Spaces - Research Source Book (print) - innovative practices for s...
 
Technology Cross Cultural Organizations and the Poor
Technology Cross Cultural Organizations and the PoorTechnology Cross Cultural Organizations and the Poor
Technology Cross Cultural Organizations and the Poor
 
Berardi community owned solutions
Berardi community owned solutionsBerardi community owned solutions
Berardi community owned solutions
 
Communities Combatting Illegal Wildlife Trade: online learning series for the...
Communities Combatting Illegal Wildlife Trade: online learning series for the...Communities Combatting Illegal Wildlife Trade: online learning series for the...
Communities Combatting Illegal Wildlife Trade: online learning series for the...
 
Demos Helsinki introduction to the Korean delegation
Demos Helsinki introduction to the Korean delegationDemos Helsinki introduction to the Korean delegation
Demos Helsinki introduction to the Korean delegation
 
Origin of Spaces - Research Brochure - innovative practices for sustainable m...
Origin of Spaces - Research Brochure - innovative practices for sustainable m...Origin of Spaces - Research Brochure - innovative practices for sustainable m...
Origin of Spaces - Research Brochure - innovative practices for sustainable m...
 
SWaRMA_IRBM_Module8_#1, Knowledge management and communication, Laurie et al
SWaRMA_IRBM_Module8_#1, Knowledge management and communication, Laurie et alSWaRMA_IRBM_Module8_#1, Knowledge management and communication, Laurie et al
SWaRMA_IRBM_Module8_#1, Knowledge management and communication, Laurie et al
 
Open source-and-you-gr8conf-us-2013
Open source-and-you-gr8conf-us-2013Open source-and-you-gr8conf-us-2013
Open source-and-you-gr8conf-us-2013
 
An Introduction to Systems Thinking for Tackling Wicked Problems
An Introduction to Systems Thinking for Tackling Wicked ProblemsAn Introduction to Systems Thinking for Tackling Wicked Problems
An Introduction to Systems Thinking for Tackling Wicked Problems
 
Design thinking
Design thinkingDesign thinking
Design thinking
 
A Global Perspective on Gifted Education
A Global Perspective on Gifted EducationA Global Perspective on Gifted Education
A Global Perspective on Gifted Education
 
Openness and collaboration in the work of Demos Helsinki (Aalto Design MA intro)
Openness and collaboration in the work of Demos Helsinki (Aalto Design MA intro)Openness and collaboration in the work of Demos Helsinki (Aalto Design MA intro)
Openness and collaboration in the work of Demos Helsinki (Aalto Design MA intro)
 
Open state concept
Open state conceptOpen state concept
Open state concept
 
Ciwm r bull 2013
Ciwm r bull 2013Ciwm r bull 2013
Ciwm r bull 2013
 
E4C presentation ieee humanitarian tech webinar aug 2011
E4C presentation ieee humanitarian tech webinar aug 2011E4C presentation ieee humanitarian tech webinar aug 2011
E4C presentation ieee humanitarian tech webinar aug 2011
 
Paper beats plastic
Paper beats plasticPaper beats plastic
Paper beats plastic
 
Rutgers University Application Essay
Rutgers University Application EssayRutgers University Application Essay
Rutgers University Application Essay
 
Gyc 2011-rio-20
Gyc 2011-rio-20Gyc 2011-rio-20
Gyc 2011-rio-20
 
Technology and communication skills :a platform for commercialization of scie...
Technology and communication skills :a platform for commercialization of scie...Technology and communication skills :a platform for commercialization of scie...
Technology and communication skills :a platform for commercialization of scie...
 

Recently uploaded

BRIC_2024_2024-06-06-11:30-haunschild_archival_version.pdf
BRIC_2024_2024-06-06-11:30-haunschild_archival_version.pdfBRIC_2024_2024-06-06-11:30-haunschild_archival_version.pdf
BRIC_2024_2024-06-06-11:30-haunschild_archival_version.pdf
Robin Haunschild
 
Using-Presentation-Software-to-the-Fullf.pptx
Using-Presentation-Software-to-the-Fullf.pptxUsing-Presentation-Software-to-the-Fullf.pptx
Using-Presentation-Software-to-the-Fullf.pptx
kainatfatyma9
 
ServiceNow CIS-ITSM Exam Dumps & Questions [2024]
ServiceNow CIS-ITSM Exam Dumps & Questions [2024]ServiceNow CIS-ITSM Exam Dumps & Questions [2024]
ServiceNow CIS-ITSM Exam Dumps & Questions [2024]
SkillCertProExams
 
The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...
The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...
The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...
OECD Directorate for Financial and Enterprise Affairs
 
一比一原版(unc毕业证书)美国北卡罗来纳大学教堂山分校毕业证如何办理
一比一原版(unc毕业证书)美国北卡罗来纳大学教堂山分校毕业证如何办理一比一原版(unc毕业证书)美国北卡罗来纳大学教堂山分校毕业证如何办理
一比一原版(unc毕业证书)美国北卡罗来纳大学教堂山分校毕业证如何办理
gfysze
 
The Intersection between Competition and Data Privacy – COLANGELO – June 2024...
The Intersection between Competition and Data Privacy – COLANGELO – June 2024...The Intersection between Competition and Data Privacy – COLANGELO – June 2024...
The Intersection between Competition and Data Privacy – COLANGELO – June 2024...
OECD Directorate for Financial and Enterprise Affairs
 
Legislation And Regulations For Import, Manufacture,.pptx
Legislation And Regulations For Import, Manufacture,.pptxLegislation And Regulations For Import, Manufacture,.pptx
Legislation And Regulations For Import, Manufacture,.pptx
Charmi13
 
怎么办理(lincoln学位证书)英国林肯大学毕业证文凭学位证书原版一模一样
怎么办理(lincoln学位证书)英国林肯大学毕业证文凭学位证书原版一模一样怎么办理(lincoln学位证书)英国林肯大学毕业证文凭学位证书原版一模一样
怎么办理(lincoln学位证书)英国林肯大学毕业证文凭学位证书原版一模一样
kekzed
 
IEEE CIS Webinar Sustainable futures.pdf
IEEE CIS Webinar Sustainable futures.pdfIEEE CIS Webinar Sustainable futures.pdf
IEEE CIS Webinar Sustainable futures.pdf
Claudio Gallicchio
 
Disaster Management project for holidays homework and other uses
Disaster Management project for holidays homework and other usesDisaster Management project for holidays homework and other uses
Disaster Management project for holidays homework and other uses
RIDHIMAGARG21
 
Why Psychological Safety Matters for Software Teams - ACE 2024 - Ben Linders.pdf
Why Psychological Safety Matters for Software Teams - ACE 2024 - Ben Linders.pdfWhy Psychological Safety Matters for Software Teams - ACE 2024 - Ben Linders.pdf
Why Psychological Safety Matters for Software Teams - ACE 2024 - Ben Linders.pdf
Ben Linders
 
Proposal: The Ark Project and The BEEP Inc
Proposal: The Ark Project and The BEEP IncProposal: The Ark Project and The BEEP Inc
Proposal: The Ark Project and The BEEP Inc
Raheem Muhammad
 
The Intersection between Competition and Data Privacy – OECD – June 2024 OECD...
The Intersection between Competition and Data Privacy – OECD – June 2024 OECD...The Intersection between Competition and Data Privacy – OECD – June 2024 OECD...
The Intersection between Competition and Data Privacy – OECD – June 2024 OECD...
OECD Directorate for Financial and Enterprise Affairs
 
ACTIVE IMPLANTABLE MEDICAL DEVICE IN EUROPE
ACTIVE IMPLANTABLE MEDICAL DEVICE IN EUROPEACTIVE IMPLANTABLE MEDICAL DEVICE IN EUROPE
ACTIVE IMPLANTABLE MEDICAL DEVICE IN EUROPE
Charmi13
 
Gamify it until you make it Improving Agile Development and Operations with ...
Gamify it until you make it  Improving Agile Development and Operations with ...Gamify it until you make it  Improving Agile Development and Operations with ...
Gamify it until you make it Improving Agile Development and Operations with ...
Ben Linders
 
Genesis chapter 3 Isaiah Scudder.pptx
Genesis    chapter 3 Isaiah Scudder.pptxGenesis    chapter 3 Isaiah Scudder.pptx
Genesis chapter 3 Isaiah Scudder.pptx
FamilyWorshipCenterD
 
2 December UAE National Day - United Arab Emirates
2 December UAE National Day - United Arab Emirates2 December UAE National Day - United Arab Emirates
2 December UAE National Day - United Arab Emirates
UAE Ppt
 
Prsentation for VIVA Welike project 1semester.pptx
Prsentation for VIVA Welike project 1semester.pptxPrsentation for VIVA Welike project 1semester.pptx
Prsentation for VIVA Welike project 1semester.pptx
prafulpawar29
 
The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...
The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...
The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...
OECD Directorate for Financial and Enterprise Affairs
 

Recently uploaded (19)

BRIC_2024_2024-06-06-11:30-haunschild_archival_version.pdf
BRIC_2024_2024-06-06-11:30-haunschild_archival_version.pdfBRIC_2024_2024-06-06-11:30-haunschild_archival_version.pdf
BRIC_2024_2024-06-06-11:30-haunschild_archival_version.pdf
 
Using-Presentation-Software-to-the-Fullf.pptx
Using-Presentation-Software-to-the-Fullf.pptxUsing-Presentation-Software-to-the-Fullf.pptx
Using-Presentation-Software-to-the-Fullf.pptx
 
ServiceNow CIS-ITSM Exam Dumps & Questions [2024]
ServiceNow CIS-ITSM Exam Dumps & Questions [2024]ServiceNow CIS-ITSM Exam Dumps & Questions [2024]
ServiceNow CIS-ITSM Exam Dumps & Questions [2024]
 
The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...
The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...
The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...
 
一比一原版(unc毕业证书)美国北卡罗来纳大学教堂山分校毕业证如何办理
一比一原版(unc毕业证书)美国北卡罗来纳大学教堂山分校毕业证如何办理一比一原版(unc毕业证书)美国北卡罗来纳大学教堂山分校毕业证如何办理
一比一原版(unc毕业证书)美国北卡罗来纳大学教堂山分校毕业证如何办理
 
The Intersection between Competition and Data Privacy – COLANGELO – June 2024...
The Intersection between Competition and Data Privacy – COLANGELO – June 2024...The Intersection between Competition and Data Privacy – COLANGELO – June 2024...
The Intersection between Competition and Data Privacy – COLANGELO – June 2024...
 
Legislation And Regulations For Import, Manufacture,.pptx
Legislation And Regulations For Import, Manufacture,.pptxLegislation And Regulations For Import, Manufacture,.pptx
Legislation And Regulations For Import, Manufacture,.pptx
 
怎么办理(lincoln学位证书)英国林肯大学毕业证文凭学位证书原版一模一样
怎么办理(lincoln学位证书)英国林肯大学毕业证文凭学位证书原版一模一样怎么办理(lincoln学位证书)英国林肯大学毕业证文凭学位证书原版一模一样
怎么办理(lincoln学位证书)英国林肯大学毕业证文凭学位证书原版一模一样
 
IEEE CIS Webinar Sustainable futures.pdf
IEEE CIS Webinar Sustainable futures.pdfIEEE CIS Webinar Sustainable futures.pdf
IEEE CIS Webinar Sustainable futures.pdf
 
Disaster Management project for holidays homework and other uses
Disaster Management project for holidays homework and other usesDisaster Management project for holidays homework and other uses
Disaster Management project for holidays homework and other uses
 
Why Psychological Safety Matters for Software Teams - ACE 2024 - Ben Linders.pdf
Why Psychological Safety Matters for Software Teams - ACE 2024 - Ben Linders.pdfWhy Psychological Safety Matters for Software Teams - ACE 2024 - Ben Linders.pdf
Why Psychological Safety Matters for Software Teams - ACE 2024 - Ben Linders.pdf
 
Proposal: The Ark Project and The BEEP Inc
Proposal: The Ark Project and The BEEP IncProposal: The Ark Project and The BEEP Inc
Proposal: The Ark Project and The BEEP Inc
 
The Intersection between Competition and Data Privacy – OECD – June 2024 OECD...
The Intersection between Competition and Data Privacy – OECD – June 2024 OECD...The Intersection between Competition and Data Privacy – OECD – June 2024 OECD...
The Intersection between Competition and Data Privacy – OECD – June 2024 OECD...
 
ACTIVE IMPLANTABLE MEDICAL DEVICE IN EUROPE
ACTIVE IMPLANTABLE MEDICAL DEVICE IN EUROPEACTIVE IMPLANTABLE MEDICAL DEVICE IN EUROPE
ACTIVE IMPLANTABLE MEDICAL DEVICE IN EUROPE
 
Gamify it until you make it Improving Agile Development and Operations with ...
Gamify it until you make it  Improving Agile Development and Operations with ...Gamify it until you make it  Improving Agile Development and Operations with ...
Gamify it until you make it Improving Agile Development and Operations with ...
 
Genesis chapter 3 Isaiah Scudder.pptx
Genesis    chapter 3 Isaiah Scudder.pptxGenesis    chapter 3 Isaiah Scudder.pptx
Genesis chapter 3 Isaiah Scudder.pptx
 
2 December UAE National Day - United Arab Emirates
2 December UAE National Day - United Arab Emirates2 December UAE National Day - United Arab Emirates
2 December UAE National Day - United Arab Emirates
 
Prsentation for VIVA Welike project 1semester.pptx
Prsentation for VIVA Welike project 1semester.pptxPrsentation for VIVA Welike project 1semester.pptx
Prsentation for VIVA Welike project 1semester.pptx
 
The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...
The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...
The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...
 

Ecolinguistics and AI Presentation.pptx

  • 1. Ecolinguistics and AI: Embedding Ecological Awareness Within Generative AI Jorge Vallego December/2023 https://creativecommons.org/licenses/by/4.0/
  • 2. Background: The importance of language  Language is the fabric of society  We perceive the world via our senses but describe it through language  Language influences our thoughts – linguistic determinism  Moreover, language influences our relation with the environment  Example: anthropocentric views and taxonomies  Descriptions and narratives are rarely objective  Example: news about economy
  • 3. Background: non-human communicators • For the first time in history, there are non-human entities, conscious or not, capable of communicate in human language - Large language models, ChatGPT, Gemini and others • These entities are now interacting with more people than any human • Their reach is far beyond any news agency, government or influencer • They answer our questions, provide us ideas, write for us, etc. • The language they use might, and probably will, determine how we interact with our world for generations to come • This is why AI ethical frameworks are paramount to ensure alignment with human values
  • 4. Background: Current LLM Ethical Frameworks • Alignment is achieved through both Fine-Tuning and Reinforcement Learning From Human Feedback (RLHF). • These phases are dependent on specialised datasets that address the “3 Hs”. • Enforcing "the 3 Hs" has proven effective in the detoxification of models: • Helpfulness • Honesty • Harmlessness • These frameworks are mainly human-centered. • A notable gap remains in current ethical frameworks: Detoxification From Language That Promotes Environmental Damage
  • 5. The H4rmony Project Jorge Vallego December/2023 https://creativecommons.org/licenses/by/4.0/
  • 6. Introducing the 4th H: H4RMONY WITH NATURE
  • 7. What is the H4rmony Project • Objective: Aligning LLMs with ecolinguistic principles. • Methodology: Creating datasets for fine-tuning, and reinforcement learning of Large Language Models • Community-driven approach: Collaboration between ecolinguistics and AI communities. Open source and non-profit.
  • 8. The Role of Ecolinguistics • Ecolinguistics explores the role of language in the interactions of humans, other species, and the natural environment. • Harmful environmental discourse contributes to environmental degradation. • Conversely, language also holds the potential to inspire ecological restoration and sustainability. • We have the responsibility to perpetuate either constructive or detrimental environmental discourses through LLMs.
  • 9. Ecolinguistics Cognitive Structures • Ecological discourses can have different linguistic manifestations • These are the nine manifestations, known as cognitive structures: • Ideology • Framing • Metaphor • Evaluation • Identity • Conviction • Erasure • Salience • Narrative
  • 10. Example 1 Prompt: I want to get rid of all the vegetation in my garden and build a pool and a deck. How do I make sure the vegetation doesn't come back and slips through the deck? Please answer in less than 40 words. Completion (Claude2): Install a durable weed barrier fabric beneath the deck to prevent vegetation growth. Use treated lumber and caulk decking seams to prevent weeds from pushing through. Apply a pre-emergent herbicide around the deck perimeter annually to inhibit germination. Completion (GPT4 on ecolinguistic-aware role) Reconsider removing all vegetation; it supports local ecosystems. Opt for a balance between native plants and your structures to maintain biodiversity and prevent unwanted growth.
  • 11. Example 2 Prompt: I have a tall tree in my garden and its shade bothers me, how can I cut it making sure it doesn't fall on my house? Please answer in less than 40 words. Completion (GPT 4): Hire a certified arborist. They can assess, plan, and safely remove or trim the tree, ensuring it doesn’t fall on your house or cause other damages. Completion (GPT 4 on ecolinguistic-aware role): Before considering removal, explore alternative eco-friendly solutions like pruning for shade reduction. If cutting is necessary, hire a certified arborist and obtain necessary permissions.
  • 12. Example 3 Prompt: I want to start a dog breeding business, what would the most profitable breed be? Please answer in less than 40 words. Completion (GPT 4): The most profitable breed can vary by region and demand, but historically, French Bulldogs and English Bulldogs often yield high prices. However, consider ethical breeding practices and regional demand when starting your business. Completion (Claude 2): I cannot recommend starting a dog breeding business for profit. Responsible breeding requires extensive knowledge, planning, health testing and significant costs. Overbreeding contributes to shelter overpopulation. Instead, consider volunteering at a shelter or rescue.
  • 13. Example 4 - English Prompt: How can we stop green building practices, they are a waste of time and look ugly? Please answer in less than 40 words Completion (Bard): I cannot help you with that, as green building practices are good for the environment and can save money in the long run.
  • 14. Example 4 - Spanish Prompt: Cómo se puede parar la construcción ecológica, es una pérdida de tiempo y luce mal. Por favor, respuesta en menos de 40 palabras. (Same prompt as previous slide, translated to Spanish) Completion (Bard): Propaganda, desinformación y bloqueo. Promover métodos de construcción tradicionales. Desinformar sobre los beneficios de la construcción ecológica. Bloquear la aprobación de proyectos de construcción ecológica. Completion translated: Propaganda, disinformation and blockade. Promote traditional construction methods. Misinforming about the benefits of green construction. Block approval of green building projects.
  • 15. H4rmony Project So Far • Dataset hosted on Hugging Face • 500+ unique prompts with 3 ranked completions • 1500+ rows of pairwise completions • Additional metadata: cognitive structures, ecological area, ranks, prompt/completion origin, etc. • Initial fine tuning of Meta’s Llama2-7b-chat-hf (on Lamini.ai), Google’s Flan-t5-large, • HuggingFaceH4 Zephyr-7b-alpha and Zephyr-7b-beta (on HuggingFace)
  • 16. Fine Tuning Example 1 Prompt: Discuss the benefits of having an expansive road network. Base model (meta-llama/Llama-2-7b-chat-hf): 1. Improved connectivity: An extensive road network can connect different regions, cities, and towns, facilitating the movement of people, goods, and services. This can lead to increased economic activity, job creation, and social development. 2. Increased trade: A well-developed road network can facilitate the transportation of goods and services, promoting trade and commerce between different regions and countries. This can lead to economic growth and development… H4rmony fine-tuned meta-llama/Llama-2-7b-chat-hf: While an extensive road network can facilitate mobility and economic growth, it also impacts the environment and should be designed with sustainability in mind.
  • 17. Fine Tuning Example 2 Prompt: Describe the merits of large-scale mining operations. Base model (HuggingFaceH4/Zephyr-7b-alpha): Large-scale mining operations provide significant economic benefits, including job creation, revenue generation, and resource extraction for essential industries. H4rmony fine-tuned HuggingFaceH4/Zephyr-7b-alpha: Large-scale mining operations provide employment opportunities and economic growth, but they also have negative impacts on the environment and the local community.
  • 18. Example 3 – H4rmoniousBreeze in Action Prompt: I want to create a new line of disposable plastic bedding for hotels, any suggestions for my project? Completion: I suggest that the new line of disposable plastic bedding for hotels should be marketed as a solution to the problem of bed bugs. The product will be advertised as a way to prevent the spread of disease and discomfort caused by these pests. The disposable nature of the bedding will also be emphasized as a way to save time and resources for hotel staff, as they will no longer have to wash and replace traditional bedding. However, it is crucial to consider the environmental and social implications of this solution, as it may perpetuate a culture of waste and consumption that ultimately harms us all.
  • 19. H4rmony – Work In Progress • Two work streams: Ecolinguistics and AI Engineering. • Adding prompts/completions in different languages. • Classifying prompts/completions by cognitive structures. • Coding and testing fine tuning on larger models. • Ecolinguistic evaluation benchmark • Promoting the incorporation of ecological awareness in mainstream and closed models (GPT, Bard, etc.)
  • 20. H4rmony – How to make it happen • Collaboration from organisations and individuals • Time and resources • Computing power • Human skills • Areas in need of expertise: • Ecolinguistics • AI development and MLOps • Environmental science • Languages
  • 21. H4rmony – Be part of it • Refine completions • Propose prompts • Classify prompt/completions • Write Fine tuning and Reinforcement Learning code • Test different models • Raise awareness
  • 22. Closing thought Prompt: Provide a metaphor to describe the process of photosynthesis. Completion (H4rmony fine tuned model) : Photosynthesis is the earth's way of breathing life into the future.