The document discusses the need to integrate AI ethics and quality into AI software design. It proposes a software engineering framework called SEF-AI&ML for developing AI and machine learning applications. The framework aims to address challenges in developing, testing, and ensuring quality in AI products. It discusses integrating principles of AI ethics, traditional software quality attributes, and processes like AIOps and MLOps into the AI application development lifecycle. The document also covers evaluating AI architectures using a case study of developing a chatbot.
[DSC Adria 23] Muthu Ramachandran AI Ethics Framework for Generative AI such ...DataScienceConferenc1
The document proposes an AI Ethics Framework for generative AI systems such as chatbots. It discusses the need to integrate AI ethics and quality into the design, development, implementation, testing and operation of AI products. The framework aims to provide a strategic, business-driven approach for building ethical, sustainable and secure AI. It covers areas like requirements engineering, development processes, project management, and evaluation of AI architectures from an ethics perspective.
AI Recruitment - How Businesses Are Winning the Race for the TalentSkyl.ai
About the webinar
Have you ever faced this situation wherein your recruitment team didn’t get enough time to build a stellar candidate experience and faced a hard time sifting through thousands of resumes and scheduling calls?
According to a survey by HR.com, in today's time one in ten recruiters use AI and nearly half expect to adopt it in their recruitment process within the next 5 years to keep up with changing market pace.
Over the course of 45 minutes, you will gain insights into how AI is changing recruitment and giving companies a competitive edge.
What you'll learn:
- How organizations are leveraging AI to accelerate the search for top talent
- Live Demo of smart resume search using Natural language processing
- Best practice to automate machine learning models in hours not months
To explore more, visit: https://skyl.ai/form?p=start-trial
Ethical AI at VDAB, presented by Vincent Buekenhout (Ethical AI Lead, VDAB) a...Patrick Van Renterghem
Digital ethics and ensuring fair and unbiased AI systems are important priorities for VDAB. They have developed principles of trust, transparency and benefit and are working to operationalize them. This includes qualitative and quantitative assessments of AI systems to identify any biases and ensure fair treatment of all users. VDAB aims to be a leader in the ethical development and use of AI to best serve citizens and employers.
This document discusses artificial intelligence (AI) in healthcare, including key challenges and best practices for implementation. Some common challenges with AI implementation include not having enough high quality data for training models and ensuring the models align with real-world problems that can change over time. It is important to have a planned strategy for AI, carefully select partners, and ensure ethical and transparent use of data that complies with regulations. When implemented properly, AI has potential to improve healthcare through applications like personalized patient experiences and optimizing operations.
ANIn Gurugram April 2024 |Agile Adaptation: Driving Progress in Generative AI...AgileNetwork
Agile Network India - Gurugram
Title: Agile Adaptation: Driving Progress in Generative AI Projects by Sujata Bhutani
Date: 20th April 2024
Hosted by: The NorthCap University
Essential Components for Streamlining AI Development Cost ManagementRobert Tony
Streamlining AI development cost management requires identifying and optimizing essential components. This involves meticulous planning, resource allocation, and leveraging cost-effective technologies. By implementing efficient processes and tools, such as automated workflows and comprehensive budget tracking systems, organizations can minimize expenses associated with AI development.
[DSC Adria 23] Muthu Ramachandran AI Ethics Framework for Generative AI such ...DataScienceConferenc1
The document proposes an AI Ethics Framework for generative AI systems such as chatbots. It discusses the need to integrate AI ethics and quality into the design, development, implementation, testing and operation of AI products. The framework aims to provide a strategic, business-driven approach for building ethical, sustainable and secure AI. It covers areas like requirements engineering, development processes, project management, and evaluation of AI architectures from an ethics perspective.
AI Recruitment - How Businesses Are Winning the Race for the TalentSkyl.ai
About the webinar
Have you ever faced this situation wherein your recruitment team didn’t get enough time to build a stellar candidate experience and faced a hard time sifting through thousands of resumes and scheduling calls?
According to a survey by HR.com, in today's time one in ten recruiters use AI and nearly half expect to adopt it in their recruitment process within the next 5 years to keep up with changing market pace.
Over the course of 45 minutes, you will gain insights into how AI is changing recruitment and giving companies a competitive edge.
What you'll learn:
- How organizations are leveraging AI to accelerate the search for top talent
- Live Demo of smart resume search using Natural language processing
- Best practice to automate machine learning models in hours not months
To explore more, visit: https://skyl.ai/form?p=start-trial
Ethical AI at VDAB, presented by Vincent Buekenhout (Ethical AI Lead, VDAB) a...Patrick Van Renterghem
Digital ethics and ensuring fair and unbiased AI systems are important priorities for VDAB. They have developed principles of trust, transparency and benefit and are working to operationalize them. This includes qualitative and quantitative assessments of AI systems to identify any biases and ensure fair treatment of all users. VDAB aims to be a leader in the ethical development and use of AI to best serve citizens and employers.
This document discusses artificial intelligence (AI) in healthcare, including key challenges and best practices for implementation. Some common challenges with AI implementation include not having enough high quality data for training models and ensuring the models align with real-world problems that can change over time. It is important to have a planned strategy for AI, carefully select partners, and ensure ethical and transparent use of data that complies with regulations. When implemented properly, AI has potential to improve healthcare through applications like personalized patient experiences and optimizing operations.
ANIn Gurugram April 2024 |Agile Adaptation: Driving Progress in Generative AI...AgileNetwork
Agile Network India - Gurugram
Title: Agile Adaptation: Driving Progress in Generative AI Projects by Sujata Bhutani
Date: 20th April 2024
Hosted by: The NorthCap University
Essential Components for Streamlining AI Development Cost ManagementRobert Tony
Streamlining AI development cost management requires identifying and optimizing essential components. This involves meticulous planning, resource allocation, and leveraging cost-effective technologies. By implementing efficient processes and tools, such as automated workflows and comprehensive budget tracking systems, organizations can minimize expenses associated with AI development.
AI Foundations Course Module 1 - Shifting to the Next Step in Your AI Transfo...Sri Ambati
In this session, you will learn about what you should do after you’ve taken an AI transformation baseline. Over the span of this session, we will discuss the next steps in moving toward AI readiness through alignment of talent and tools to drive successful adoption and continuous use within an organization.
To find additional videos on AI courses, earn badges, join the courses at H2O.ai Learning Center: https://training.h2o.ai/products/ai-foundations-course
To find the Youtube video about this presentation: https://youtu.be/K1Cl3x3rd8g
Speaker:
Chemere Davis (H2O.ai - Senior Data Scientist Training Specialist)
Understanding GenAI/LLM and What is Google Offering - Felix GohNUS-ISS
With the recent buzz on Generative AI & Large Language Models, the question is to what extent can these technologies be applied at work or when you're studying and how easy is it to manage/develop your own models? Hear from our guest speaker from Google as he shares some insights into how industries are evolving with these trends and what are some of Google's offerings from Duet AI in Google Workspace to the GenAI App Builder on Google Cloud.
AI Application Development Practices Your Business Must Follow 1.pdfFlexsin
Learn three technical best practices for building successful AI applications, including data preprocessing, model evaluation, and ethical considerations.
https://www.flexsin.com/ai-and-cognitive.php
Want to learn data analytics or just grab the information about data analytics and its future? https://coursedekho.com/data-analytics-courses-in-surat/
The significance of Data Science has impressively increased over recent years. The contemporary period is the intersection of data analytics with emerging technologies that involve artificial intelligence (AI), machine learning (MI), and automation. And these three things have an ocean of career opportunities. In this post, I am sharing with you some best Data Analytics Courses in Surat, with a detailed course curriculum and placements guarantee.
#education
#data
#DataAnalytics
#DataScience
#DataCourse
#AnalyticsCourses
#AnalyticsCourse
#DataScienceCourse
#DataScienceCourses
#CoursesInIndia
#DataJob
Did you know that a recent study by McKinsey & Company highlighted that 84% of organizations are concerned about bias in their AI algorithms? However, there's a solution to this problem. Upholding best practices can significantly mitigate biases in AI for enterprises, particularly given the challenges posed by compliance and the rapid dissemination of information through digital media.
In this E42 Blog post, we delve into an array of best practices to mitigate bias and hallucinations in AI models. A few of these best practices include:
Model optimization: This practice focuses on enhancing model performance and reducing bias through various optimization techniques
Understanding model architecture: This involves a deep dive into the structure of AI models to identify and rectify biases
Human interactions: This emphasizes on the critical role of human feedback in the training loop in ensuring unbiased AI outcomes
On-premises large language models: This practice involves utilizing on-premises LLMs to maintain control over data and model training
A Guide to Machine Learning Developer in 2024.pdfJPLoft Solutions
Today, cooperation among developers and Machine Learning Development Companies has been instrumental in accelerating innovation and scaling. The study examines how these collaborations create synergies and allow developers to draw on ML development companies' knowledge and capabilities to speed project delivery and improve efficiency.
Intranet Automation of Human Resource Management SystemIOSR Journals
This document summarizes the development of an intranet-based human resource management system (HRMS) for an organization. Key features of the system include automated employee records, skills assessments, and an online interview and confirmation process. A SWOT analysis is used to evaluate employees for project assignments based on their strengths, weaknesses, opportunities, and threats. The system was developed using technologies like ASP.NET for the interface, SQL for the database, and allows secure access via the organization's intranet. It aims to improve communication between employees and HR while streamlining HR processes through automation.
Different Methodologies For Testing Web Application TestingRachel Davis
The document discusses different methodologies for testing web applications, including functionality testing, performance testing, usability testing, compatibility testing, unit testing, load testing, stress testing, and security testing. It provides details on each type of testing, including definitions and the pros and cons of functionality testing specifically. The key methodologies covered are functionality testing, which validates outputs against expected outputs; performance testing, which evaluates a system under pressure; and usability testing, which tests the user-friendliness of an application.
The document discusses how artificial intelligence is being used to improve performance testing. It describes what performance testing is and why it is important. It then explains how AI can help with various aspects of performance testing like data analysis, issue identification, test automation, and load testing. The key benefits of using AI for performance testing include increased efficiency, precision, coverage, and cost savings. It concludes by stating that AI has the potential to revolutionize software testing.
The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...SOFTTECHHUB
"The Ultimate Prompt Engineering Guide for Generative AI" provides a comprehensive guide to leveraging the power of AI assistants through effective prompt design. It explores fundamental prompt concepts and details strategies for crafting prompts that maximize output quality. Readers learn about iterative refinement, examples, constraints, and advanced techniques like chaining and decomposition. Case studies demonstrate real-world applications in content creation, coding, analysis, and more. Trends in multimodal, automated, and responsible prompting are also examined. This book is a must-read for anyone seeking to optimize generative AI capabilities.
This presentation discusses:
1. Background on Artificial Intelligence (AI)
2. How is reshaping Human Resources practices and processes, with emphasis on talent acquisition and learning & development.
3. New skills that HR professionals need in this new ERA
The document describes a Driverless ML API that was created to automate machine learning workflows including feature engineering, model validation, tuning, selection, and deployment. The API uses machine learning interpretability techniques to provide visualizations and explanations of models. It aims to help scale data science efforts and enable both expert and junior data scientists to more quickly develop accurate, production-ready models. Key capabilities of the API include automated exploratory data analysis, feature selection and engineering, model selection and hyperparameter tuning using GPUs for faster training, and model interpretability visualizations.
Artificial Intelligence for Project Managers: Are You Ready?Scott W. Ambler
Artificial intelligence (AI) is finally coming into its own. Technologies such as ChatGPT, DALL-E, driver-assistance, and autonomous robots are clear signs of an AI-driven market shift. AI technologies, in particular machine learning (ML), are being applied in all sectors of the economy. Your organization is likely to soon be running projects to apply and even develop AI if it isn’t already doing so. Are you ready?
This talk overviews AI and how AI/ML initiatives work. We also explore several critical challenges, including the experimental nature of AI initiatives, that data quality is critical to your success, the high failure rate of AI initiatives, and the ethical considerations surrounding AI. We examine the implications of these challenges and work through strategies to address them.
Agenda:
1. What is(n’t) AI?
2. AI terminology in a nutshell
3. Are you ready for AI?
4. The lifecycle of an AI/ML initiative
5. Overcoming the data quality challenge
6. Ethical considerations with AI
7. Business implications of AI
8. Success and failure factors for AI initiatives
Chasing Innovation: Exploring the Thrilling World of Prompt Engineering JobsFredReynolds2
Innovation has emerged as the driving force behind technological achievements and societal growth. Prompt engineering jobs, which their dynamic and advanced characteristics can identify, lead the way in this wave of innovation. Prompt engineering has become an important subject supporting productivity, efficiency, and problem-solving across various sectors in the quickly changing world of technology and innovation.
Is your organization keeping pace with the speed of digital transformation? Many companies are struggling to define new job roles and approaches to management. As AI and machine learning take on tasks and services, what are the best ways to evolve your work force? This session will offer practical insights on:
Understanding what it means to be a digital organization.
Why learning and development must be everyone’s responsibility.
How to work across functions to co-create key new systems.
How to upskill using design thinking, agile practices and AI.
Ways to measure success.
AI for Customer Service - How to Improve Contact Center Efficiency with Machi...Skyl.ai
About the webinar
It only takes one bad interaction for a customer to abandon a service or product. Businesses are no longer just competing with other companies’ products, they’re competing with a customer’s last service experience. All contact centers worldwide are looking for new and strategic ways to increase operational performance, reduce cost and still provide high-touch customer experiences that improve customer loyalty and highlight ways to increase revenue and productivity.
Through this webinar, we will understand how AI can augment the effort, focus and problem-solving abilities of human agents so that they can tackle more complex or creative tasks. With an abundance of data from logs, emails, chat and voice recordings, contact centers can ingest this data to provide contextual customer service at the right time with the right way providing satisfactory customer service and retain the brand value.
What you'll learn:
- How organizations are leveraging AI & Machine learning in Customer Service
- Live Demo of AI & ML in Customer Service
- Best practices to automate machine learning models
To explore more, visit: https://skyl.ai/form?p=start-trial
This document discusses software engineering and provides definitions and explanations of key concepts:
- Software engineering is defined as an engineering discipline concerned with all aspects of software production. It focuses on practical software development and delivery, whereas computer science focuses more on theory.
- Good software should deliver required functionality, performance, and be maintainable, dependable, usable and acceptable to users.
- A software engineering approach is layered, with quality, process models, methods and tools. Process models define activities for effective delivery. Methods provide tasks for requirements, design, coding and testing. Tools support the process and methods.
- Generic software processes involve communication, planning, modeling, construction and deployment activities in an iterative fashion to develop
The New Categories of Software Defects in the Era of AI and ML - DevOps NextPerfecto by Perforce
When AI and ML are tested alongside traditional features of an app, the defects are of a different nature. AI/ML creates a new set of defect classification that will invade the DevOps space, and this session addresses these new and modern types of defects, including data-related, stochastic, and interpretability defects.
The software development landscape is undergoing a seismic shift, driven by the relentless march of artificial intelligence (AI). Once relegated to science fiction, AI is now infiltrating every facet of the industry, from code generation to bug detection, posing both challenges and opportunities for software development agencies. This article delves into the multifaceted impact of AI on these agencies, exploring its potential to revolutionize workflows, reshape talent demands, and redefine the competitive landscape
Testing of artificial intelligence; AI quality engineering skils - an introdu...Rik Marselis
Testing of AI will require a new skillset related to interpreting a system’s boundaries or tolerances. Indeed, as our paper points out, the complex functioning of an AI system means, amongst other things, that the focus of testing shifts from output to input to verify a robust solution. Also we introduce the 6 angles of quality for Artificial Intelligence and Robotics.
This paper was written by Humayun Shaukat, Toni Gansel and Rik Marselis.
AI Foundations Course Module 1 - Shifting to the Next Step in Your AI Transfo...Sri Ambati
In this session, you will learn about what you should do after you’ve taken an AI transformation baseline. Over the span of this session, we will discuss the next steps in moving toward AI readiness through alignment of talent and tools to drive successful adoption and continuous use within an organization.
To find additional videos on AI courses, earn badges, join the courses at H2O.ai Learning Center: https://training.h2o.ai/products/ai-foundations-course
To find the Youtube video about this presentation: https://youtu.be/K1Cl3x3rd8g
Speaker:
Chemere Davis (H2O.ai - Senior Data Scientist Training Specialist)
Understanding GenAI/LLM and What is Google Offering - Felix GohNUS-ISS
With the recent buzz on Generative AI & Large Language Models, the question is to what extent can these technologies be applied at work or when you're studying and how easy is it to manage/develop your own models? Hear from our guest speaker from Google as he shares some insights into how industries are evolving with these trends and what are some of Google's offerings from Duet AI in Google Workspace to the GenAI App Builder on Google Cloud.
AI Application Development Practices Your Business Must Follow 1.pdfFlexsin
Learn three technical best practices for building successful AI applications, including data preprocessing, model evaluation, and ethical considerations.
https://www.flexsin.com/ai-and-cognitive.php
Want to learn data analytics or just grab the information about data analytics and its future? https://coursedekho.com/data-analytics-courses-in-surat/
The significance of Data Science has impressively increased over recent years. The contemporary period is the intersection of data analytics with emerging technologies that involve artificial intelligence (AI), machine learning (MI), and automation. And these three things have an ocean of career opportunities. In this post, I am sharing with you some best Data Analytics Courses in Surat, with a detailed course curriculum and placements guarantee.
#education
#data
#DataAnalytics
#DataScience
#DataCourse
#AnalyticsCourses
#AnalyticsCourse
#DataScienceCourse
#DataScienceCourses
#CoursesInIndia
#DataJob
Did you know that a recent study by McKinsey & Company highlighted that 84% of organizations are concerned about bias in their AI algorithms? However, there's a solution to this problem. Upholding best practices can significantly mitigate biases in AI for enterprises, particularly given the challenges posed by compliance and the rapid dissemination of information through digital media.
In this E42 Blog post, we delve into an array of best practices to mitigate bias and hallucinations in AI models. A few of these best practices include:
Model optimization: This practice focuses on enhancing model performance and reducing bias through various optimization techniques
Understanding model architecture: This involves a deep dive into the structure of AI models to identify and rectify biases
Human interactions: This emphasizes on the critical role of human feedback in the training loop in ensuring unbiased AI outcomes
On-premises large language models: This practice involves utilizing on-premises LLMs to maintain control over data and model training
A Guide to Machine Learning Developer in 2024.pdfJPLoft Solutions
Today, cooperation among developers and Machine Learning Development Companies has been instrumental in accelerating innovation and scaling. The study examines how these collaborations create synergies and allow developers to draw on ML development companies' knowledge and capabilities to speed project delivery and improve efficiency.
Intranet Automation of Human Resource Management SystemIOSR Journals
This document summarizes the development of an intranet-based human resource management system (HRMS) for an organization. Key features of the system include automated employee records, skills assessments, and an online interview and confirmation process. A SWOT analysis is used to evaluate employees for project assignments based on their strengths, weaknesses, opportunities, and threats. The system was developed using technologies like ASP.NET for the interface, SQL for the database, and allows secure access via the organization's intranet. It aims to improve communication between employees and HR while streamlining HR processes through automation.
Different Methodologies For Testing Web Application TestingRachel Davis
The document discusses different methodologies for testing web applications, including functionality testing, performance testing, usability testing, compatibility testing, unit testing, load testing, stress testing, and security testing. It provides details on each type of testing, including definitions and the pros and cons of functionality testing specifically. The key methodologies covered are functionality testing, which validates outputs against expected outputs; performance testing, which evaluates a system under pressure; and usability testing, which tests the user-friendliness of an application.
The document discusses how artificial intelligence is being used to improve performance testing. It describes what performance testing is and why it is important. It then explains how AI can help with various aspects of performance testing like data analysis, issue identification, test automation, and load testing. The key benefits of using AI for performance testing include increased efficiency, precision, coverage, and cost savings. It concludes by stating that AI has the potential to revolutionize software testing.
The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...SOFTTECHHUB
"The Ultimate Prompt Engineering Guide for Generative AI" provides a comprehensive guide to leveraging the power of AI assistants through effective prompt design. It explores fundamental prompt concepts and details strategies for crafting prompts that maximize output quality. Readers learn about iterative refinement, examples, constraints, and advanced techniques like chaining and decomposition. Case studies demonstrate real-world applications in content creation, coding, analysis, and more. Trends in multimodal, automated, and responsible prompting are also examined. This book is a must-read for anyone seeking to optimize generative AI capabilities.
This presentation discusses:
1. Background on Artificial Intelligence (AI)
2. How is reshaping Human Resources practices and processes, with emphasis on talent acquisition and learning & development.
3. New skills that HR professionals need in this new ERA
The document describes a Driverless ML API that was created to automate machine learning workflows including feature engineering, model validation, tuning, selection, and deployment. The API uses machine learning interpretability techniques to provide visualizations and explanations of models. It aims to help scale data science efforts and enable both expert and junior data scientists to more quickly develop accurate, production-ready models. Key capabilities of the API include automated exploratory data analysis, feature selection and engineering, model selection and hyperparameter tuning using GPUs for faster training, and model interpretability visualizations.
Artificial Intelligence for Project Managers: Are You Ready?Scott W. Ambler
Artificial intelligence (AI) is finally coming into its own. Technologies such as ChatGPT, DALL-E, driver-assistance, and autonomous robots are clear signs of an AI-driven market shift. AI technologies, in particular machine learning (ML), are being applied in all sectors of the economy. Your organization is likely to soon be running projects to apply and even develop AI if it isn’t already doing so. Are you ready?
This talk overviews AI and how AI/ML initiatives work. We also explore several critical challenges, including the experimental nature of AI initiatives, that data quality is critical to your success, the high failure rate of AI initiatives, and the ethical considerations surrounding AI. We examine the implications of these challenges and work through strategies to address them.
Agenda:
1. What is(n’t) AI?
2. AI terminology in a nutshell
3. Are you ready for AI?
4. The lifecycle of an AI/ML initiative
5. Overcoming the data quality challenge
6. Ethical considerations with AI
7. Business implications of AI
8. Success and failure factors for AI initiatives
Chasing Innovation: Exploring the Thrilling World of Prompt Engineering JobsFredReynolds2
Innovation has emerged as the driving force behind technological achievements and societal growth. Prompt engineering jobs, which their dynamic and advanced characteristics can identify, lead the way in this wave of innovation. Prompt engineering has become an important subject supporting productivity, efficiency, and problem-solving across various sectors in the quickly changing world of technology and innovation.
Is your organization keeping pace with the speed of digital transformation? Many companies are struggling to define new job roles and approaches to management. As AI and machine learning take on tasks and services, what are the best ways to evolve your work force? This session will offer practical insights on:
Understanding what it means to be a digital organization.
Why learning and development must be everyone’s responsibility.
How to work across functions to co-create key new systems.
How to upskill using design thinking, agile practices and AI.
Ways to measure success.
AI for Customer Service - How to Improve Contact Center Efficiency with Machi...Skyl.ai
About the webinar
It only takes one bad interaction for a customer to abandon a service or product. Businesses are no longer just competing with other companies’ products, they’re competing with a customer’s last service experience. All contact centers worldwide are looking for new and strategic ways to increase operational performance, reduce cost and still provide high-touch customer experiences that improve customer loyalty and highlight ways to increase revenue and productivity.
Through this webinar, we will understand how AI can augment the effort, focus and problem-solving abilities of human agents so that they can tackle more complex or creative tasks. With an abundance of data from logs, emails, chat and voice recordings, contact centers can ingest this data to provide contextual customer service at the right time with the right way providing satisfactory customer service and retain the brand value.
What you'll learn:
- How organizations are leveraging AI & Machine learning in Customer Service
- Live Demo of AI & ML in Customer Service
- Best practices to automate machine learning models
To explore more, visit: https://skyl.ai/form?p=start-trial
This document discusses software engineering and provides definitions and explanations of key concepts:
- Software engineering is defined as an engineering discipline concerned with all aspects of software production. It focuses on practical software development and delivery, whereas computer science focuses more on theory.
- Good software should deliver required functionality, performance, and be maintainable, dependable, usable and acceptable to users.
- A software engineering approach is layered, with quality, process models, methods and tools. Process models define activities for effective delivery. Methods provide tasks for requirements, design, coding and testing. Tools support the process and methods.
- Generic software processes involve communication, planning, modeling, construction and deployment activities in an iterative fashion to develop
The New Categories of Software Defects in the Era of AI and ML - DevOps NextPerfecto by Perforce
When AI and ML are tested alongside traditional features of an app, the defects are of a different nature. AI/ML creates a new set of defect classification that will invade the DevOps space, and this session addresses these new and modern types of defects, including data-related, stochastic, and interpretability defects.
The software development landscape is undergoing a seismic shift, driven by the relentless march of artificial intelligence (AI). Once relegated to science fiction, AI is now infiltrating every facet of the industry, from code generation to bug detection, posing both challenges and opportunities for software development agencies. This article delves into the multifaceted impact of AI on these agencies, exploring its potential to revolutionize workflows, reshape talent demands, and redefine the competitive landscape
Testing of artificial intelligence; AI quality engineering skils - an introdu...Rik Marselis
Testing of AI will require a new skillset related to interpreting a system’s boundaries or tolerances. Indeed, as our paper points out, the complex functioning of an AI system means, amongst other things, that the focus of testing shifts from output to input to verify a robust solution. Also we introduce the 6 angles of quality for Artificial Intelligence and Robotics.
This paper was written by Humayun Shaukat, Toni Gansel and Rik Marselis.
Similar to [DSC Europe 22] AI Ethics and AI Quality By Design - Muthu Ramachandran (20)
[DSC MENA 24] Medhat_Kandil - Empowering Egypt's AI & Biotechnology Scenes.pdfDataScienceConferenc1
In this talk, I'll journey from my time as a Research Assistant at the Bernoulli Institute, delving into the classification of neurodegenerative diseases, to my encounters with groundbreaking biotechnology and AI companies like Proteinea, AlProtein, Rology, and Natrify in Egypt. These innovative ventures are reshaping industries from their Egyptian hub. Join me as I illuminate the transformative power of this thriving ecosystem, showcasing Egypt's remarkable strides in biotech and AI on the global stage.
Building big scale data product doesn't rely only on sophisticated modeling. It also requires an agile methodology, iterative research & development process, versatile big data stack, and a value-oriented mindset. I'll discuss how we -at Dsquares- build big-scale AI product that leverages clients' data from different industries to deliver business-critical value to the end customer. I'll cover the process of product discovery, R&D tasks for unsolved problems, and mapping business requirements into big data technical requirements.
[DSC MENA 24] Asmaa_Eltaher_-_Innovation_Beyond_Brainstorming.pptxDataScienceConferenc1
Innovation thrives at the intersection of data and creativity. While brainstorming has traditionally fueled the generation of new ideas, leveraging data alongside creative techniques empowers organizations to develop more effective and impactful innovations
[DSC MENA 24] Basma_Rady_-_Building_a_Data_Driven_Culture_in_Your_Organizatio...DataScienceConferenc1
In today's fast-paced and competitive business environment, harnessing the power of data is essential for staying ahead. Building a data-driven culture within an organization is not just a strategic advantage, but a necessity for those who wish to thrive and innovate. In this insightful talk, our esteemed speaker, a Chief Data Scientist with a decade of experience in the financial services sector, will unravel the complexities of embedding data into the DNA of your organization. The speaker will explore the key tenets of establishing a data-centric mindset, the importance of executive support, and the need for enhancing data literacy across the company. Practical solutions and real-world examples will be provided, demonstrating how to overcome obstacles and successfully integrate a data-driven approach. Attendees will learn strategies for empowering every team member to use data effectively and how to leverage technology to facilitate this cultural shift. The session promises to be a guide for those looking to champion data within their organizations, offering actionable insights for transformation.
[DSC MENA 24] Ahmed_Muselhy_-_Unveiling-the-Secrets-of-AI-in-Hiring.pdfDataScienceConferenc1
The use of Artificial Intelligence (AI) is rapidly transforming the recruitment landscape. This talk explores the various ways AI is being used in hiring, from candidate sourcing and screening to skills assessments and interview preparation. We'll discuss the benefits of AI, such as increased efficiency and reduced bias, but also address potential drawbacks like ethical considerations and the human touch.
[DSC MENA 24] Ziad_Diab_-_Data-Driven_Disruption_-_The_Role_of_Data_Strategy_...DataScienceConferenc1
In today's business landscape, data strategy plays a pivotal role in driving innovation within business models. This talk explores how organizations can leverage data effectively to transform their operations, products, and services.
[DSC MENA 24] Mohammad_Essam_- Leveraging Scene Graphs for Generative AI and ...DataScienceConferenc1
Delve into the unexplored potential of scene graphs in the realms of Generative AI and innovative data product development. This session unveils the intricate role of scene graphs in generating realistic content and driving advancements in computer vision, and automated content creation. Join us for a journey into the intersection of scene graphs and cutting-edge AI, gaining insights into their pivotal role in reshaping the landscape of data-centric innovation. This talk is your gateway to understanding how structured visual representations are shaping the future of AI and revolutionizing the creation of data-driven solutions.
This presentation will delve into the transformative role of Artificial Intelligence in reshaping social media landscapes. We'll explore cutting-edge AI technologies that are integrating with social media platforms, altering how we interact, consume content, and perceive digital communities. The talk will also cast a visionary eye towards future trends, discussing potential impacts on user experience, content creation, digital marketing, and privacy concerns. Join us to uncover how AI is not just a tool but a game-changer in the evolving narrative of social media.
Supercharge your software development with Azure OpenAI Service! Azure cloud platform provides access to cutting-edge AI models for diverse tasks. Explore different models for generating content, translating languages, and even generating code. Leverage data grounding to fine-tune models for your specific needs. Discover how Azure OpenAI Service accelerates innovation and injects intelligence into your software creations.
[DSC MENA 24] Nezar_El_Kady_-_From_Turing_to_Transformers__Navigating_the_AI_...DataScienceConferenc1
In this insightful talk, we'll embark on a journey from the origins of programming in 1883 and the conceptualization of AI in the 1950s, to the current explosion of AI applications reshaping our world. We'll unravel why AI has surged to prominence in the last decade, driven by unprecedented data generation and significant hardware advancements. With examples ranging from individual email filtering to complex supply chain optimizations, we'll explore AI's pervasive impact across various sectors including finance, manufacturing, healthcare, and media. The talk will address the challenges of AI implementation, such as the high cost of AI teams and the quest for universally applicable models, while highlighting the promising horizon of no-code AI platforms democratizing access. Furthermore, we'll delve into the ethical dimensions of AI, from biases to privacy concerns, and the pressing question of AI's potential to replace human roles. Lastly, we'll discuss the transformative potential of language models and generative AI, underscoring the importance of understanding and integrating AI into our lives and businesses for a future that's both scalable and sustainable.
[DSC MENA 24] Omar_Ossama - My Journey from the Field of Oil & Gas, to the Ex...DataScienceConferenc1
Transitioning to a career in data science requires careful planning and smart choices. In this session, I'll help you understand how to switch to data science. Using my own experiences and what I've learned from the industry, we'll break down the important steps for a successful transition. We'll cover everything from figuring out which skills you can carry over to learning the technical stuff and connecting with other professionals. By the end, you'll have the knowledge and tools you need to start your journey into data science, whether you're a seasoned professional looking for something new or just starting out in the field.
[DSC MENA 24] Ramy_Agieb_-_Advancements_in_Artificial_Intelligence_for_Cybers...DataScienceConferenc1
With the continuous growth of the digital environment, the risks in the online realm also increase. This calls for strong security measures to safeguard valuable information and essential systems. Artificial Intelligence (AI) has become a powerful weapon in the fight against cyber threats. This talk presents a thorough examination of the most recent algorithms and applications of artificial intelligence in the field of cybersecurity.
[DSC MENA 24] Sohaila_Diab_-_Lets_Talk_Gen_AI_Presentation.pptxDataScienceConferenc1
What is Generative AI and how does it work? Could it eventually replace us? Let's delve deep into the heart of this groundbreaking technology and uncover the truths and myths surrounding Generative AI and how to make the most of it.
Background: The digital twin paradigm holds great promise for healthcare, most importantly efficiently integrating many disparate healthcare data sources and servicing complex tasks like personalizing care, predicting health outcomes, and planning patient care, even though many technical and scientific challenges remain to be overcome. Objective: As part of the QUALITOP project, we conducted a comprehensive analysis of diverse healthcare data, encompassing both prospective and retrospective datasets, along with an in-depth examination of the advanced analytical needs of medical institutions across five European Union countries. Through these endeavors, we have systematically developed and refined a formal Personal Medical Digital Twin (PMDT) model subjected to iterative validation by medical institutions to ensure its applicability, efficacy, and utility. Findings: The PMDT is based on an interconnected set of expressive knowledge structures that are calibrated to capture an individual patient’s psychosomatic, cognitive, biometrical and genetic information in one personal digital footprint in a manner that allows medical professionals to run various models to predict an individual’s health issues over time and intervene early with personalized preventive care.Conclusion: At the forefront of digital transformation, the PMDT emerges as a pivotal entity, positioned at the convergence of Big Data and Artificial Intelligence. This paper introduces a PMDT environment that lays the foundation for the application of comprehensive big data analytics, continuous monitoring, cognitive simulations, and AI techniques. By integrating stakeholders across the care continuum, including patients, this system enables the derivation of insights and facilitates informed decision-making for personalized preventive care.
The Ipsos - AI - Monitor 2024 Report.pdfSocial Samosa
According to Ipsos AI Monitor's 2024 report, 65% Indians said that products and services using AI have profoundly changed their daily life in the past 3-5 years.
Introduction to Jio Cinema**:
- Brief overview of Jio Cinema as a streaming platform.
- Its significance in the Indian market.
- Introduction to retention and engagement strategies in the streaming industry.
2. **Understanding Retention and Engagement**:
- Define retention and engagement in the context of streaming platforms.
- Importance of retaining users in a competitive market.
- Key metrics used to measure retention and engagement.
3. **Jio Cinema's Content Strategy**:
- Analysis of the content library offered by Jio Cinema.
- Focus on exclusive content, originals, and partnerships.
- Catering to diverse audience preferences (regional, genre-specific, etc.).
- User-generated content and interactive features.
4. **Personalization and Recommendation Algorithms**:
- How Jio Cinema leverages user data for personalized recommendations.
- Algorithmic strategies for suggesting content based on user preferences, viewing history, and behavior.
- Dynamic content curation to keep users engaged.
5. **User Experience and Interface Design**:
- Evaluation of Jio Cinema's user interface (UI) and user experience (UX).
- Accessibility features and device compatibility.
- Seamless navigation and search functionality.
- Integration with other Jio services.
6. **Community Building and Social Features**:
- Strategies for fostering a sense of community among users.
- User reviews, ratings, and comments.
- Social sharing and engagement features.
- Interactive events and campaigns.
7. **Retention through Loyalty Programs and Incentives**:
- Overview of loyalty programs and rewards offered by Jio Cinema.
- Subscription plans and benefits.
- Promotional offers, discounts, and partnerships.
- Gamification elements to encourage continued usage.
8. **Customer Support and Feedback Mechanisms**:
- Analysis of Jio Cinema's customer support infrastructure.
- Channels for user feedback and suggestions.
- Handling of user complaints and queries.
- Continuous improvement based on user feedback.
9. **Multichannel Engagement Strategies**:
- Utilization of multiple channels for user engagement (email, push notifications, SMS, etc.).
- Targeted marketing campaigns and promotions.
- Cross-promotion with other Jio services and partnerships.
- Integration with social media platforms.
10. **Data Analytics and Iterative Improvement**:
- Role of data analytics in understanding user behavior and preferences.
- A/B testing and experimentation to optimize engagement strategies.
- Iterative improvement based on data-driven insights.
Codeless Generative AI Pipelines
(GenAI with Milvus)
https://ml.dssconf.pl/user.html#!/lecture/DSSML24-041a/rate
Discover the potential of real-time streaming in the context of GenAI as we delve into the intricacies of Apache NiFi and its capabilities. Learn how this tool can significantly simplify the data engineering workflow for GenAI applications, allowing you to focus on the creative aspects rather than the technical complexities. I will guide you through practical examples and use cases, showing the impact of automation on prompt building. From data ingestion to transformation and delivery, witness how Apache NiFi streamlines the entire pipeline, ensuring a smooth and hassle-free experience.
Timothy Spann
https://www.youtube.com/@FLaNK-Stack
https://medium.com/@tspann
https://www.datainmotion.dev/
milvus, unstructured data, vector database, zilliz, cloud, vectors, python, deep learning, generative ai, genai, nifi, kafka, flink, streaming, iot, edge
Predictably Improve Your B2B Tech Company's Performance by Leveraging DataKiwi Creative
Harness the power of AI-backed reports, benchmarking and data analysis to predict trends and detect anomalies in your marketing efforts.
Peter Caputa, CEO at Databox, reveals how you can discover the strategies and tools to increase your growth rate (and margins!).
From metrics to track to data habits to pick up, enhance your reporting for powerful insights to improve your B2B tech company's marketing.
- - -
This is the webinar recording from the June 2024 HubSpot User Group (HUG) for B2B Technology USA.
Watch the video recording at https://youtu.be/5vjwGfPN9lw
Sign up for future HUG events at https://events.hubspot.com/b2b-technology-usa/
End-to-end pipeline agility - Berlin Buzzwords 2024Lars Albertsson
We describe how we achieve high change agility in data engineering by eliminating the fear of breaking downstream data pipelines through end-to-end pipeline testing, and by using schema metaprogramming to safely eliminate boilerplate involved in changes that affect whole pipelines.
A quick poll on agility in changing pipelines from end to end indicated a huge span in capabilities. For the question "How long time does it take for all downstream pipelines to be adapted to an upstream change," the median response was 6 months, but some respondents could do it in less than a day. When quantitative data engineering differences between the best and worst are measured, the span is often 100x-1000x, sometimes even more.
A long time ago, we suffered at Spotify from fear of changing pipelines due to not knowing what the impact might be downstream. We made plans for a technical solution to test pipelines end-to-end to mitigate that fear, but the effort failed for cultural reasons. We eventually solved this challenge, but in a different context. In this presentation we will describe how we test full pipelines effectively by manipulating workflow orchestration, which enables us to make changes in pipelines without fear of breaking downstream.
Making schema changes that affect many jobs also involves a lot of toil and boilerplate. Using schema-on-read mitigates some of it, but has drawbacks since it makes it more difficult to detect errors early. We will describe how we have rejected this tradeoff by applying schema metaprogramming, eliminating boilerplate but keeping the protection of static typing, thereby further improving agility to quickly modify data pipelines without fear.
[DSC Europe 22] AI Ethics and AI Quality By Design - Muthu Ramachandran
1. AI Ethics and AI Quality
By Design
Dr Muthu Ramachandran PhD FBCS Senior Fellow of Advance HE, MIEEE, MACM
Visiting Professor @ University of Southampton
Research & Educational Consultant @ AI Tech, UK.
Email: muthuram@ieee.org
Google Scholar: https://scholar.google.com/citations?user=RLmKWYYAAAAJ&hl=en
LinkedIn: https://www.linkedin.com/in/muthuuk/
Amazon Author, https://tinyurl.com/Muthu-Amazon-Author
Email: muthuram@ieee.org
Summary:
Artificial Intelligence and machine learning applications have reached their adaptation maturity as
we have witnessed in all applications and devices we use. However, we need to integrate AI Ethics
and AI Quality into AI software by design. Therefore, we need a strategic and business-driven
framework for the design, development, implementation, testing and quality of AI products. Hence,
I propose a software engineering framework for AI & ML applications (SEF-AI&ML)
1
AI
Data
Science
Ethics
Software
Engineering
2. Agenda
AI & DS for SE & SE for AI & DS: Rationale
AI Application Characteristics
AI Ethics Principles, Guidelines & Governance
Traditional Software Quality vs. AI Quality Attributes/Characteristics
AI Application Development Process: AIOps and MLOps
AI Project Management, Strategic SE & Reference Architecture for AI Applications
Evaluation of AI Architecture: Chatbot Case Study
Key Points
Q&A
3. Research
Motivation
• One of the aims is to provoke some thoughts on Software Engineering challenges for AI
& ML applications development, data & model development validation & verification.
Some of those challenges are different from traditional software development that we
have seen so far for the past 50 years or so.
• Challenge 1: Learning from real-time data which will be fed back to ML & AI models is
difficult to predict & specify its behaviours
• Challenge 2: Difficult to test data, debug AL, ML & DL systems
• Challenge 3: Even more challenging is Deep Learning (DL), where not only the number of
parameters can be of the order of millions, but where, typically, the representation of
the data is learned separately from the inferential models and can consist of different
nested levels of abstraction.
• Challenge 4: what is the Software Engineering process for developing & delivering AI,
ML, & DL (AMD) applications?
• Challenge 5: Some of the key attributes of AI quality are fairness, accountability,
explainability, responsibility, transparency and how do we specify & validate all the
attributes?
• How should software development teams integrate the AI model lifecycle (training, testing, deploying,
evolving, etc.) into their software development process?
• What new roles, artifacts, and activities of ML development process come into play to affect SD process
activities?
• How do we distinguish between SE for ML vs. ML for SE?
• How do we integrate those new roles, artifacts, and activities tie into existing agile or DevOps process?
• How is SE research for AI-based systems characterized?
• What are the characteristics of AI-based systems (used terms, scope, and quality goals)?
• Which SE approaches for AI-based systems have been reported in the scientific literature?
• What are the existing challenges associated with SE for AI-based systems?
• Challenge 6: How do we integrate AI Ethics and AI Quality attributes into AI Software?
4. 50+ Years
of SE, AI &
Data
Science
• 60 software development methodologies
• 50 static analysis tools
• 40 software design methods
• 37 benchmark organizations
• 25 size metrics
• 20 kinds of project management tools
• 22 kinds of testing and dozens of other tool variations.
• Minimum of 3000 programming languages software consisted,
even though only 100 were frequently used. New programming
languages are announced every 2 weeks, and new tools are out
more than one in each month. Every 10 months new
methodologies are discovered.
• Established ML & AI Algorithms (There are four types of machine
learning algorithms: supervised, semi-supervised, unsupervised
and reinforcement)
• Statistics and Visualisation Techniques
• How SE can help Data Science, AI, ML, RL, DL Applications
Development to achieve desired quality?
• How AI can help to further develop SE?
6. : AI, ML, SE,
DevOps, and IT
Integration
What if there was a better way? Machine Learning Operations
(MLOps) will get your AI projects out of the lab and into production
where they can generate value and help transform your business. In
this instalment of four Data Science Central Podcasts on MLOps, we
explore best practices in Production Model Monitoring. To make AI
and ML successful then it needs to be continuously integrate into a
software or any production environment such as automated
manufacturing, etc. Podcast link,
https://vimeo.com/408636528/ba26315634
MLOps: AI, ML,
SE, DevOps,
and IT
Integration
7. The Three Ways of DevOps Principles
Kim, G (2022) The Three Ways: The Principles Underpinning DevOps, https://itrevolution.com/articles/the-three-ways-principles-underpinning-devops/
The First Way emphasizes the performance of the entire system, as opposed to the performance of a
specific silo of work or department. Outcome: putting the First Way into practice include never passing a
known defect to downstream work centres, never allowing local optimization to create global
degradation, always seeking to increase flow, and always seeking to achieve profound understanding of
the system (as per Deming).
The Second Way is about creating the right to left feedback loops. The goal of almost any process
improvement initiative is to shorten and amplify feedback loops so necessary corrections can be
continually made. Outcome: Understanding and responding to all customers, internal and external,
shortening and amplifying all feedback loops, and embedding knowledge where we need it.
The Third Way is about creating a culture that fosters two things: continual experimentation, taking risks
and learning from failure; and understanding that repetition and practice is the prerequisite to mastery.
Outcome: allocating time for the improvement of daily work, creating rituals that reward the team for
taking risks, and introducing faults into the system to increase resilience.
10. AI Algorithms
Categories
• Algorithms of artificial
intelligence grouped into
broadly three categories such
as supervised learning,
unsupervised learning and
reinforcement learning.
11. The worldwide popularity score of various types of
ML algorithms (supervised, unsupervised, semi-
supervised, and reinforcement) in a range of 0
(min) to 100 (max) over time where x-axis
represents the timestamp information and y-axis
represents the corresponding score
Sarkar, H. I (2021) Machine Learning: Algorithms, Real-World Applications and Research Directions,
SN Computer Science (2021) 2:160 https://doi.org/10.1007/s42979-021-00592-x
13. Human Intelligence vs AI
Isaac Asimov once said, “The saddest aspect of
life right now is that science gathers knowledge
faster than society gathers wisdom.” For a
change, let’s use our AI knowledge to improve
human intelligence.
Components of intelligence. Can’t we improve
human intelligence by using the lessons
learned from AI? We cannot change the
architecture but we can improve the training.
https://towardsdatascience.com/ai-insights-for-human-intelligence-5ce4d10d431
14. AI Ethics disciplinary landscape
It is imperative to build ethics into algorithms, otherwise AI will make unethical choices by design (Gov.au)
Zhou, J. et al (2020) A Survey on Ethical Principles of AI and Implementations, IEEE ETHAI 2020, December, DOI:
10.1109/SSCI47803.2020.9308437
15. Towards Achieving Integrated Frameworks for Ethical AI
•Build Ethics In (BEI) with six pillars of
trustworthiness such as safety, security, privacy,
reliability, business integrity & resiliency, and
formalised and standardised ethical & risk
assessment
•Formal methods verification & Validation for
Robotics and high Integrity AI Applications such as
Healthcare
•Full proof AI ethics assessment
•Ethics Maturity Models
•Ethical Management of AI Frameworks
•Verify & Validate five pillars of trustworthiness
(Security, Privacy, reliability, Business integrity &
Formalised ethical & Risk assessment)
•Human-Level AI (Representation and Computation
of Meaning in Natural Language, Jackson, C. P
(2019)) – problem solving, learning and gaining
knowledge, self-improving, self-recovery, creative,
inventive and discovery. Artificial general intelligence
(AGI), machine learning approaches toward
achieving fully general artificial intelligence
•Follow Agile & DevOps
principles
•Verify & validate security, safety
with AIOps/AIDevSecOps
•Software Engineering
Frameworks for AI
• Explainable AI (XAI) needs to be
designed keeping in mind the
business, end users, stakeholders and
regulating committee
• Explainable features
• Explainable selection of models
• Explainable what if scenarios verified
formally and validate using simulation
models such as BPMN
• Integrating ethics into AI/ML/DL
requirements, Design, & Test (AIDevOps) &
SE for AI approaches
• Establishing & integrating accountability,
fairness, security, safety, trustworthiness, &
explainability
• Data source authenticity, cleaning, &
unbiased
• Model identification, validation, verification
• Algorithm identification, validation &
verification
Responsible
AI (RAI)
Ethics
Explainable
AI (XAI)
Ethics
Trustworthy AI
(TAI),
Conversational AI
(CAI) (Chatbots),
Human Level AI
(HAI) Ethics
3S AI Ethics
Security AI Safety
AI, Sustainable AI:
Software
Engineering for AI
& AIDevSecOps
(SSAAI) Ethics
Integrated Ethical AI: Conversational AI, Explainable AI, Responsible AI, Trustworthy AI (CHERT AI’s), Safety AI, Security AI, and AIDevSecOps
16. AI ETHICS GUIDELINES: The eight key themes were:
privacy
accountability
safety and security
transparency and
explainability
fairness and non-
discrimination
human control of technology,
professional
responsibility
promotion of human
values
11 Normative Principles: transparency, justice and fairness, non-maleficence, responsibility, privacy, beneficence,
freedom and autonomy, trust, sustainability, dignity and solidarity
18. AI Ethics: Right to Intelligence
• Right to Intelligence: Use of our Data by AI Applications & Businesses
• https://publicintelligence.org/
• https://publicintelligence.org/start-assessment/#gf_1
19. AI Ethics: 5
Principles of
Public
Intelligence
•Right to Intelligence -The right to protect human intellectual capabilities from being displaced
by intelligent innovative systems.
Principle 1
•Purpose Driven - Purpose driven design to augment people’s current capabilities, innovation
should solve unexplored and unaddressed problems thereby ensuring innovations add value.
Principle 2
•Disruption Prevention - Measures for displacement protection should be in place to minimise
social disruption by taking measures to create seamless and sustainable innovations for
existing ecosystems.
Principle 3
•Risk Evaluated - To reassure innovations are designed for safe, ethical, and inclusive adoption,
and the risks are managed by the designer and the user equally
Principle 4
•Accountable Re-design - Accountable Redesign allows every innovation a fair opportunity to
be people-centric, sustainable, and accountable by ensuring the designer and innovators
produce robust technology. Also, allowing existing innovations to embed accountability in their
design thinking process and reverse the existing damage.
Principle 5
20. Examples of Capturing AI Ethics Requirements Based on Ethics
Principles & Guidelines
• The European Commission’s draft ethical guidelines for trustworthy AI [5]
lists five such principles: Autonomy (respect for human dignity),
Beneficience (doing good to others), Nonmaleficence (doing no harm to
others), Justice (treating others fairly), Explicability (behaving transparently
towards others). For example,
• from the Principle of Autonomy one may derive “Respect for a person’s
privacy”,
• and from that an ethical requirement “Take a photo of someone only after
her/his consent” for a phone camera.
• As another example, from Nonmaleficence, we may derive a functional
requirement “Do not drive fast past a bystander” for a driverless car.
23. Datta, A (2022) AI
Quality – the Key to
Driving Business Value
with AI,
https://truera.com/ai-
quality-management-
key-to-driving-business-
value/
24. What are AI Quality Attributes?
• In short, AI Quality encompasses not just model performance metrics, but a
much richer set of attributes that capture how well the model will
generalize, including its conceptual soundness, explainability, stability,
robustness, faireness, reliability, Unbiased Outcome, Human-Centredness,
and data quality. Model performance or accuracy is a key attribute of AI
Quality. Conceptual soundness (Model
Performance and Accuracy)
Explainability
Responsibility
Stability
Reliability
Fairness
Data Quality
Unbiased Outcome
Transparency
Security
Privacy
Ethics
Communications
Reproducibility and auditability
Compliance with Governance and
Regulations
25. AI Quality Attributes
Therefore, a new perspective is presented as quality engineering fields.
Breu, Kuntzmann-Combelles, and Felderer (2014) proposed four fields to measure quality such as knowledge management, automation,
data analysis, and collaborative processes.
In addition, they insist on continuous delivery as a mandatory attribute for business agility.
Surprisingly, more recently, the term assurance has changed its meaning completely for modern complex
systems and disruptive technologies such as AI and ML.
Bloomfield (2019) defines assurance as the claims, arguments, and evidence (CAE) framework as they define Claims are assertions put forward
for general acceptance. Another biggest property of any disruptive technologies such as AI and ML systems is the behavioural uncertainty in
a real-time scenario, bias based on existing data, safety in self-driving cars, etc.
26. AI and ML Systems Characteristics vs. SE Best Practices
To this end, Martínez-
Fernández et al. (2021) have
identified several
characteristics of AI systems
28. Agile vs. AI & Machine Learning Lifecycle
Requirements
Engineering for AI &
Machine Learning
(ML) Applications and
Services & Identify
Security RE
Secure
Service-
Oriented
Design for
ML
Applications
Build
Agile Software Engineering Lifecycle
AI & ML Model
business & ethical
Requirements
Data-Oriented
Design (Data
Collection, Data
Authenticity,
Validation &
Evaluation, Data
Cleaning, & Data
Labeling
Model-Oriented
Development
(Model
Requirements,
Feature
Engineering,
Model Training,
Model
Evaluation, &
Model
Deployment
Deployed
Machine
Learning
Services and
Applications
Machine Learning
Lifecycle (Model, Data-
Oriented, and Data
Analytics-Oriented
Lifecycle)
CI/CD
Continuous
Testing &
Improvement
Testing
Model
Testing &
Monitoring
and Data
Analytics
(Descriptive
analytics,
Predictive
analytics &
Prescriptive
analytics)
29. AI/ML Requirements Engineering
Business Process Modelling Notations (BPMN) & simulation to validate key performance
requirements such as resource, effort & cost. BPMN allows us to identify service
requirements as well as non-function requirements and decision points at a business
level with emphasis on organizational factors and business strategies.
RE4AI (Requirements Engineering for AI) identified by Admad et al. [1 & 10] such as:
Goal-Oriented
RE (GORE)
UML / SysML /
Use Cases
Signal Temporal
Logic (STL)
Traffic Sequence
Charts (TSC)
Conceptual
Model (CM)
BPMN
30. Non-Functional Requirements for AI & ML Applications
Non-functional
RE
for
AI&ML
Applications
Fairness
Robustness
Explainability
Responsibility
Causality
Accountability
Trustworthiness
Counterfactual reasoning
Transparancy
Reinforcement learning
Performance requirements for probabilistic models and algorithms
Informed Decision making
Reliability
Scalability
31. Project Management & Cost Estimation: Modified COCOMO Model
for AI, ML & NLP Applications and Apps
It is important to calculate the effort required for specified AI applications. In the era of cloud and mobile computing, most AI applications are integrated
with a cloud and social media. Therefore, we can adopt weighting factors identified for cloud computing when adopting the COCOMO cost estimation model.
In addition, Guha (2014) has proposed a modified cloud COCOMO model with weighting for service-oriented projects are a = 4, b = 1.2, c = 2.5, d = .3.
Therefore, the effort and cost estimation equations are:
𝐴𝐼/𝑀𝐿 𝑝𝑟𝑜𝑗𝑒𝑐𝑡 𝑒𝑓𝑓𝑜𝑟𝑡 𝑎𝑝𝑝𝑙𝑖𝑒𝑑 𝐸𝐴 = 𝑎 × 𝑁𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝐴𝐼&𝑀𝐿 𝑆𝑒𝑟𝑣𝑖𝑐𝑒 𝑃𝑜𝑖𝑛𝑡𝑠 𝑏
× 𝑁𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝐴𝑢𝑡𝑜𝑚𝑎𝑡𝑒𝑑 𝐴𝐼&𝑀𝐿 𝐷𝑒𝑐𝑒𝑠𝑖𝑜𝑛 𝑃𝑜𝑖𝑛𝑡𝑠 ×
(𝑁𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝐻𝑢𝑚𝑎𝑛 𝐷𝑒𝑐𝑖𝑠𝑖𝑜𝑛 𝑃𝑜𝑖𝑛𝑡𝑠) (𝐻𝑢𝑚𝑎𝑛 𝑀𝑜𝑛𝑡ℎ𝑠) ---- (1)
𝐴𝐼/𝑀𝐿 𝑑𝑒𝑣𝑒𝑙𝑜𝑝𝑚𝑒𝑛𝑡 𝑡𝑖𝑚𝑒 𝐷𝑇 = 𝑐 × 𝐸𝑓𝑓𝑜𝑟𝑡 𝐴𝑝𝑝𝑙𝑖𝑒𝑑 𝑑
𝑀𝑜𝑛𝑡ℎ𝑠 ---- (2)
𝑁𝑢𝑚𝑏𝑒𝑟 𝑜𝑓𝐴𝐼&𝑀𝐿 & 𝑆𝑜𝑓𝑡𝑤𝑎𝑟𝑒 𝐸𝑛𝑔𝑖𝑛𝑒𝑒𝑟𝑠 𝑅𝑒𝑞𝑢𝑖𝑟𝑒𝑑 = 𝐸𝑓𝑓𝑜𝑟𝑡 𝐴𝑝𝑝𝑙𝑖𝑒𝑑 (𝐸𝐴) 𝐷𝑒𝑣𝑒𝑙𝑜𝑝𝑚𝑒𝑛𝑡 𝑇𝑖𝑚𝑒 (𝐷𝑇) ---- (3)
𝐴𝐼&𝑀𝐿 𝑠𝑖𝑧𝑒 =
0
𝑁
𝐴𝐼&𝑀𝐿 𝑓𝑒𝑎𝑡𝑢𝑟𝑒𝑠 × 𝐶𝑙𝑜𝑢𝑑 𝑐𝑜𝑛𝑠𝑡𝑎𝑛𝑡𝑠 (𝑚𝑜𝑑𝑖𝑓𝑖𝑒𝑑 𝐶𝑂𝐶𝑂𝑀𝑂) ×
0
𝑁
𝐴𝐼&𝑀𝐿 𝐴𝑢𝑡𝑜𝑚𝑎𝑡𝑒𝑑 𝐷𝑒𝑐𝑖𝑠𝑖𝑜𝑛 𝑃𝑜𝑖𝑛𝑡𝑠 ×
0
𝑁
𝐻𝑢𝑚𝑎𝑛 𝐷𝑒𝑐𝑖𝑠𝑖𝑜𝑛 𝑝𝑜𝑖𝑛𝑡𝑠 × 𝐴𝐼&𝑀𝐿 𝐴𝑙𝑔𝑜𝑟𝑖𝑡ℎ𝑚𝑖𝑐 𝐶𝑜𝑚𝑝𝑙𝑒𝑥𝑖𝑡𝑦
---- (4)
34. Strategic Software Engineering Framework for AI & ML Applications
AI Business: AI Strategies and success factors, Information Architecture (Ontologies), Knowledge Engineering, Domain-
Specific modelling & needs analysis, and Business Risk Analysis
Process: Business Process Driven Service Development Lifecycle (BPD-SDL)
AI Class Identification and Analysis (Conversational AI, Human Centred AI, Explainable AI, Responsible AI, Trustworthy AI
(CHERT AIs )
Methods and Design Principles: service components with soalML
SE Lifecycle for AI (SE4AI) and Reference Architecture for ML/AI Applications (REF4ML)
SE Tools (SAS, Visual Paradigm, BonitaSoft, Bizagi Studio, Tabulea, Mathematica, Azure/ML)
Application of AI in SE: SOSE4BD as a Service (SOSEaaS), BDaaS, Big Data Adoption Framework as a Service (BAaaS),
Software Engineering Analytics as a Service(SEAaaS), SE Prediction Model as a Service (SEPaaS), Bug Prediction as a
Service with Azure/ML (MLaaS), BD Metrics as a Service (BDMaaS)
SE4AI Adoption Models
Evaluation & Improvement
35. Reference Architecture for AI & ML Applications
(REF4AIML)
User Applications Services: Chatbots, Autonomous Driving, Image Recognition as a Service, Service Security & Safety, etc.
Analytics & Predictive Modelling
AI & Machine Learning Models
Data Acquisitions & Validation
Cloud, Edge, IoT, IIOT, Blockchain Services
Knowledge, Patterns, Solutions, & Reuse
AI Categories: Responsible AI, Explainable AI, Human-Centered & Trustworthy AI, and Cognitive & Conversational AI
REF4AIML Service Bus
Se
cu
rit
y
La
ye
r
37. BPMN Simulation: Performance Metrics for Chatbot Application
For 100 users accessing this simulated chatbot took approximately 0.17 seconds. In addition, there is a promising result that
shows about 98% of resource utilization for most of the tasks of Ai Scientists, AI security, Chatbots, Cloud resources,
Knowledge Discovery, Machine learning Analytics and AI models. In addition, we can also use the BPMN models in our cost
effort estimation equations to see the exact complexity and cost-benefit analysis.
38. Summary:
Q&A and
Thank You
• Artificial Intelligence and machine learning
applications have reached their adaptation
maturity as we have witnessed in all applications
and devices we use.
• However, we need a systematic approach for the
design, development, implementation, and testing
of AI products. Hence this article proposes a
software engineering framework for AI & ML
applications (SEF-AI&ML).
• The framework has been validated using a case
study on Chatbot a conversational AI using BPMN
modelling and simulation and the results show
validation of performance and resource
requirements for AI chatbot cloud-driven services
with 98% utilization and time efficiency.
• The results show a promising outcome for the
application of systematic software engineering
principles to achieve the desired AI quality.
39. Sommerville, I (2016) Software Engineering, 10th Edition, Pearson
Breu, R., Kuntzmann-Combelles, A., and Felderer, M (2014) New perspective on software quality, IEEE Software, January/February 2014
Bloomfield, R. et al. (2019) Disruptive Innovations and Disruptive Assurance: Assuring Machine Learning and Autonomy, IEEE Computer, August 2019.
Al Alamin, A., M and Uddin, G (2021) Quality assurance challenges for machine learning software applications during software development life cycle phases, 2021 IEEE International Conference on Autonomous Systems (ICAS), 11-13 August 2021, IEEE Proceedings, Montreal, QC, Canada
Ramachandran, M (2019) SOSE4BD: Service-oriented software engineering framework for big data applications. In: Proceedings of the 4th International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS. SciTePress, pp. 248-254. ISBN 9789897583698 DOI:
https://doi.org/10.5220/0007708702480254
Khomh, F et al. (2018) Software Engineering for Machine-Learning Applications, The Road Ahead, IEEE Software, September/October 2018
SEMLA (2018) The First Symposium on Software Engineering for Machine Learning Applications (SEMLA), http://semla.polymtl.ca/program/, Polytechnique Montreal, June 12 – 13, 2018
Rashid, E., Patnayak, S., and Bhattacherjee, V (2012) A Survey in the Area of Machine Learning and Its Application for Software Quality Prediction, ACM SIGSOFT Software Engineering Notes, September 2012 Volume 37 Number 5
Zhang, D and Tsai, J.J.P (2007) (editors), Advances in machine learning applications in software engineering, IGI
Microsoft (2018) “The Team Data Science Process,” https://docs.microsoft.com/enus/ azure/machine-learning/team-data-science-process/, accessed: 2018-09-24.
U. Fayyad, G. Piatetsky-Shapiro, and P. Smyth, “The KDD process for extracting useful knowledge from volumes of data,” Communications of the ACM, vol. 39, no. 11, pp. 27–34, 1996.
R. Wirth and J. Hipp, “CRISP-DM: Towards a standard process model for data mining,” in Proc. 4th Intl. Conference on Practical Applications of Knowledge Discovery and Data mining, 2000, pp. 29–39.
Amershi S, Begel A, Bird C, DeLine R, Gall H, Kamar E, Nagappan N, Nushi B, Zimmermann T (2019) Software Engineering for Machine Learning: A Case Study. International Conference on Software Engineering (ICSE 2019) - Software Engineering in Practice track
Colomo-Palacios, R (2019) Towards a Software Engineering Framework for the Design, Construction and Deployment of Machine Learning-Based Solutions in Digitalization Processes, Research & Innovation Forum 2019, Visvizi, A and Lytras, M. D (eds), Springer
Martínez-Fernández, S. et al. (2021) Software Engineering for AI-Based Systems: A Survey, https://arxiv.org/abs/2105.01984
Mahmood, Y., et. Al (2022) Software Effort Estimation Accuracy Prediction of Machine Learning Techniques: A Systematic Performance Evaluation, https://arxiv.org/ftp/arxiv/papers/2101/2101.10658.pdf, accessed on 02/05/22
Bencomo, N., et. Al. (2022) The Secret to Better AI and Better Software (Is Requirements Engineering), IEEE Software, January/February 2022
Ahmad, B. F., and Ibrahim, M. L (2022) Software Development Effort Estimation Techniques Using Long Short Term Memory, International Conference on Computer Science and Software Engineering CSASE, Duhok, Kurdistan Region – Iraq, 2022
https://www.simplilearn.com/resources
Ryan, M., and Stahl, B. C (2020) Artificial intelligence ethics guidelines for developers and users: clarifying their content and normative implications, AI Ethics Guidelines, https://www.emerald.com/insight/1477-996X.htm
R.Guizzardi, G.Amaral, G.Guizzardi and J.Mylopoulos (2020) Ethical Requirements for AI Systems, /https://www.researchgate.net/profile/Giancarlo-Guizzardi-2/publication/339886423_Ethical_Requirements_for_AI_Systems/links/5e6a76e9458515e555762ce0/Ethical-Requirements-for-
AI-Systems.pdf
SEERENE (2022) Study: AI for Software Engineering: AI-based approaches for the management of complex software projects, https://www.seerene.com/ai-for-software-engineering, Video Talk, https://www.youtube.com/watch?v=gRLJapTvj24&t=177s
SEI (2022) Artificial Intelligence Engineering, https://www.sei.cmu.edu/our-work/artificial-intelligence-engineering/
Barenkamp et al. (2020) Applications of AI in classical software engineering, AI Perspectives (2020) 2:1, https://doi.org/10.1186/s42467-020-00005-4
References