Quality Assurance Of Generative Dialog Models in an evolving Conversational Agent used for Swedish Language Practice

•

0 likes•53 views

Presented at CAIN22 - 1st Conference on AI Engineering – Software Engineering for AI Due to the migration megatrend, efficient and effective second- language acquisition is vital. One proposed solution involves AI- enabled conversational agents for person-centered interactive language practice. We present results from ongoing action research targeting quality assurance of proprietary generative dialog models trained for virtual job interviews. The action team elicited a set of 38 requirements for which we designed corresponding automated test cases for 15 of particular interest to the evolving solution. Our results show that six of the test case designs can detect meaningful differences between candidate models. While quality assurance of natural language processing applications is complex, we provide initial steps toward an automated framework for machine learning model selection in the context of an evolving conversational agent. Future work will focus on model selection in an MLOps setting.

Quality Assurance
Of
Generative Dialog Models
in an evolving
Conversational Agent
used for
Swedish Language Practice
May 16, 2022
Markus Borg, Johan Bengtsson,
Harald Österling, Alexander Hagelborn,
Isabella Gagner, Piotr Tomaszewski

Markus
Borg
Isabella
Gagner
Alexander
Hagelborn
Harald
Österling
Piotr
Tomaszewski
Johan
Bengtsson

Fundamental AI
Applied AI
Operational AI

Generative Dialog Model (GDM)
• produces human-like replies to user prompts
BlenderBot
• Facebook’s pretrained open domain GDM
• Emely is transfer-learned from BlenderBot for job interviews
Application-
specific
data

Swedish
Learner
UI
Speak
Speech to
Text
GDM
Eng-Swe
Translation
(I)
Text to
Speech
Listen
Toxic
Filter
Swe-Eng
Translation
Reject input
Emely Architecture
Component under Test

(Thompson et al., Translational Psychiatry, 10(1). 2020)

RQ1: What are the requirements on Emely's GDM?
RQ2: How can test cases be designed to verify them?
RQ3: How to automate them for the evolution of Emely?

“a disciplined process of
inquiry conducted by and
for those taking the action”
12

13
• Not participatory: Case study research
Alternatives for industry-academia collaboration
• Design Science Methodology = acquire knowledge through the design of artifacts
• Tech Transfer Research Methodology = handover of research results to industry
• Action Research = make a change in a socio-technical system

Standup meetings
Sprint planning
Shared Slack workspace
GitHub repo
Academic Researcher
AI Developer
Problem Owner
1. Diagnosing
2. Action
Planning
3. Action
Taking
4. Evaluating
5. Learning
Action Research Cycles
RQs

RQ1 – Requirements Engineering
1. Elicitation
• Interviews
• Market analysis
2. Specification
3. Analysis
• Organization
• Prioritization
4. Validation
We selected 15 for
test case design

RQ1 – Requirements Engineering
The GDM shall …
… provide replies with low n-gram repeatability.
answering
… provide coherent replies with respect to the ongoing dialog.
… be robust against prompts with incorrect word order.
intelligence
understanding

RQ2 – Test Design
The GDM shall …
… provide replies with low n-gram repeatability.
… provide coherent replies with respect to the ongoing dialog.
… be robust against prompts with incorrect word order.
answering
intelligence
understanding
Simple check – Count the n-grams
Pretrained sentence-BERT model for ”next sentence prediction”
Provide information… wait… Request the same information
Repeat the process with randomly swapped words

RQ3 – Test Implementation
(A) Blenderbot
(B) GDM
Under Test
(C)
Controlled
Test Data
p
Logs
Generation (D)
Analysis
• Emely v0.2, v0.3, v0.4
• BlenderBot

RQ3 – Test Implementation
answering
… provide replies with
low n-gram repeatability.
Repetition
metric

RQ3 – Test Implementation
… provide coherent replies with respect to the ongoing dialog.
intelligence
Dialogs with at least one reply that BERT considers random
Emely v02 – 122
Emely v03 – 79
Emely v04 – 71
BlenderBot – 114

RQ3 – Test Implementation
… be robust against prompts with incorrect word order.
understanding
None of the GDMs
even passed basic
memory tests…

Requirements on
GDMs that can be
resused

markus.borg@ri.se
@mrksbrg
mrksbrg.com
RISE Research Institutes of Sweden
AI quality assurance
needs to be tackled from
two directions
- aligned through
pipeline automation

Prompt engineering is the practice of designing text prompts to guide large language models towards generating specific, desired outputs without additional training. Carefully crafted prompts play a crucial role in extracting superior performance from language models and allowing them to excel at tasks like question answering, reasoning, and text generation. The effectiveness of prompt engineering is demonstrated in applications like ChatGPT, Google's Smart Reply, and AlphaGo. It is an important field that helps maximize models' potential while ensuring safety and performance for different domains.

Natural Language Processing - Research and Application Trends

Shreyas Suresh Rao

2021 04-04-google nmt

JAEMINJEONG5

The document discusses several papers on neural machine translation (NMT). It summarizes key points from various seminars on multilingual NMT models. The summaries include: 1) A multilingual NMT system introduces an artificial token to specify the target language, enabling translation between multiple languages with one model. 2) Multilingual models show comparable or state-of-the-art performance on several language pairs. They also enable zero-shot translation between language pairs without direct training data. 3) Additional experiments explore mixing various language pairs for training and the effects on translation quality, particularly for low-resource languages.

Behavior Driven Development with AngularJS & Jasmine

Remus Langu

This document discusses Behavior-Driven Development (BDD) and how it can improve software development. BDD is a methodology that uses examples in natural language to define desired software behaviors and tests those examples throughout development. It aims to bridge communication gaps between developers, testers, and business stakeholders. The document outlines BDD processes and how they differ from traditional waterfall and test-driven development. It also provides an example template for writing BDD scenarios in Gherkin, a domain-specific language.

LLM GPT-3: Language models are few-shot learners

Yan Xu

Shedding Light on Software Engineering-specific Metaphors and Idioms

Mia Mohammad Imran

Use of figurative language, such as metaphors and idioms, is common in our daily-life communications, and it can also be found in Software Engineering (SE) channels, such as comments on GitHub. Automatically interpreting figurative language is a challenging task, even with modern Large Language Models (LLMs), as it often involves subtle nuances. This is particularly true in the SE domain, where figurative language is frequently used to convey technical concepts, often bearing developer affect (e.g., 'spaghetti code). Surprisingly, there is a lack of studies on how figurative language in SE communications impacts the performance of automatic tools that focus on understanding developer communications, e.g., bug prioritization, incivility detection. Furthermore, it is an open question to what extent state-of-the-art LLMs interpret figurative expressions in domain-specific communication such as software engineering. To address this gap, we study the prevalence and impact of figurative language in SE communication channels. This study contributes to understanding the role of figurative language in SE, the potential of LLMs in interpreting them, and its impact on automated SE communication analysis. Our results demonstrate the effectiveness of fine-tuning LLMs with figurative language in SE and its potential impact on automated tasks that involve affect. We found that, among three state-of-the-art LLMs, the best improved fine-tuned versions have an average improvement of 6.66% on a GitHub emotion classification dataset, 7.07% on a GitHub incivility classification dataset, and 3.71% on a Bugzilla bug report prioritization dataset.

ODSC East: Effective Transfer Learning for NLP

indico data

Presented by indico co-founder Madison May at ODSC East. Abstract: Transfer learning, the practice of applying knowledge gained on one machine learning task to aid the solution of a second task, has seen historic success in the field of computer vision. The output representations of generic image classification models trained on ImageNet have been leveraged to build models that detect the presence of custom objects in natural images. Image classification tasks that would typically require hundreds of thousands of images can be tackled with mere dozens of training examples per class thanks to the use of these pretrained reprsentations. The field of natural language processing, however, has seen more limited gains from transfer learning, with most approaches limited to the use of pretrained word representations. In this talk, we explore parameter and data efficient mechanisms for transfer learning on text, and show practical improvements on real-world tasks. In addition, we demo the use of Enso, a newly open-sourced library designed to simplify benchmarking of transfer learning methods on a variety of target tasks. Enso provides tools for the fair comparison of varied feature representations and target task models as the amount of training data made available to the target model is incrementally increased.

The document describes a study that compared the effectiveness of two approaches to online learning - a custom course assembly approach that dynamically assembled learning objects, and a query engine approach. Subjects using the custom course assembly produced more extensive designs for a given task and performed better based on expert evaluations, even after accounting for differences in experience. The custom course approach may have led to better performance by encouraging focus, providing more relevant content, and creating a more organized learning experience.

A comprehensive guide to prompt engineering.pdf

StephenAmell4

Prompt engineering is the practice of designing and refining specific text prompts to guide transformer-based language models, such as Large Language Models (LLMs), in generating desired outputs. It involves crafting clear and specific instructions and allowing the model sufficient time to process information. By carefully engineering prompts, practitioners can harness the capabilities of LLMs to achieve different goals.

Naver learning to rank question answer pairs using hrde-ltc

NAVER Engineering

The automatic question answering (QA) task has long been considered a primary objective of artificial intelligence. Among the QA sub-systems, we focused on answer-ranking part. In particular, we investigated a novel neural network architecture with additional data clustering module to improve the performance in ranking answer candidates which are longer than a single sentence. This work can be used not only for the QA ranking task, but also to evaluate the relevance of next utterance with given dialogue generated from the dialogue model. In this talk, I'll present our research results (NAACL 2018), and also its potential use cases (i.e. fake news detection). Finally, I'll conclude by introducing some issues on previous research, and by introducing recent approach in academic.

An exploratory research on grammar checking of Bangla sentences using statist...

IJECEIAES

N-gram based language models are very popular and extensively used statistical methods for solving various natural language processing problems including grammar checking. Smoothing is one of the most effective techniques used in building a language model to deal with data sparsity problem. Kneser-Ney is one of the most prominently used and successful smoothing technique for language modelling. In our previous work, we presented a Witten-Bell smoothing based language modelling technique for checking grammatical correctness of Bangla sentences which showed promising results outperforming previous methods. In this work, we proposed an improved method using Kneser-Ney smoothing based n-gram language model for grammar checking and performed a comparative performance analysis between Kneser-Ney and Witten-Bell smoothing techniques for the same purpose. We also provided an improved technique for calculating the optimum threshold which further enhanced the the results. Our experimental results show that, Kneser-Ney outperforms Witten-Bell as a smoothing technique when used with n-gram LMs for checking grammatical correctness of Bangla sentences.

Natural language processing and transformer models

Ding Li

The document discusses several approaches for text classification using machine learning algorithms: 1. Count the frequency of individual words in tweets and sum for each tweet to create feature vectors for classification models like regression. However, this loses some word context information. 2. Use Bayes' rule and calculate word probabilities conditioned on class to perform naive Bayes classification. Laplacian smoothing is used to handle zero probabilities. 3. Incorporate word n-grams and context by calculating word probabilities within n-gram contexts rather than independently. This captures more linguistic information than the first two approaches.

Writing Machines: Detection and Stylometric Profiling

GeorgeMikros3

The document discusses techniques for detecting artificially generated text and summarizing key differences between human and AI writing styles. It outlines several statistical and linguistic features that can help discriminate between the two, such as average word length, sentence length, part-of-speech frequencies, sentiment analysis, and personal pronoun use. The document also examines recent research showing humans are not always accurate at distinguishing human and AI-generated text. Large language models like GPT-3 are able to mimic human writing styles closely, highlighting both the promise and risks of advanced AI systems.

Suggestion Generation for Specific Erroneous Part in a Sentence using Deep Le...

ijtsrd

This document presents a method for generating suggestions for specific erroneous parts of sentences in Indian languages like Malayalam using deep learning. The method uses recurrent neural networks with long short-term memory layers to train a model on input-output examples of sentences and their corrections. The model takes in preprocessed sentence data and generates a set of possible corrections for erroneous parts through multiple network layers. An analysis of the model shows that it can accurately generate suggestions for word length of three, but requires more data and study to handle the complex morphology and symbols of Malayalam. The performance of the method is limited by the hardware used and it could be improved with a more powerful system and additional training data.

IRJET- Survey on Deep Learning Approaches for Phrase Structure Identification...

IRJET Journal

This document discusses deep learning approaches for identifying phrase structures in sentences. It begins with an introduction to natural language processing and phrase structure grammar. Traditional n-gram and rule-based approaches to phrase structure identification are described. Recent deep learning methods for natural language tasks that have been applied to phrase structure identification are then summarized, including word embeddings, convolutional neural networks, recurrent neural networks and recursive neural networks. The document concludes that deep learning requires less manual feature engineering and has achieved good performance on many NLP tasks, but still has room for improvement, especially on tasks involving unlabeled data.

Graph-to-Text Generation and its Applications to Dialogue

Jinho Choi

The document discusses graph-to-text generation and its applications to dialogue systems. It provides an overview of current approaches to graph-to-text including rule-based, statistical, sequence-to-sequence and graph-to-sequence models. Recent advances use pretrained language models and graph neural networks. While current systems show promise, they still struggle with omissions, repetitions and unnatural language. The document proposes two threads of future work: exploring graph-to-text on dialogue data and implementing model improvements.

A brief primer on OpenAI's GPT-3

Ishan Jain

The GPT-3 model architecture is a transformer-based neural network that has been fed 45TB of text data. It is non-deterministic, in the sense that given the same input, multiple runs of the engine will return different responses. Also, it is trained on massive datasets that covered the entire web and contained 500B tokens, humongous 175 Billion parameters, a more than 100x increase over GPT-2, which was considered state-of-the-art technology with 1.5 billion parameters.

IRJET- Semantic Question Matching

IRJET Journal

This document presents a system for detecting semantically similar questions in online forums like Quora to reduce duplicate content. It proposes using natural language processing techniques like tagging questions with keywords, vectorizing text with Google News vectors, and calculating similarity with Word Mover's Distance. The system cleans and preprocesses questions before generating tags and calculating similarity between questions to identify duplicates. An evaluation of the system achieved accurate detection of matching and non-matching question pairs.

1066_multitask_prompted_training_en.pdf

ssusere320ca

This document summarizes a research paper that explores using multitask prompted training to enable zero-shot task generalization in large language models. The researchers developed a system to convert many natural language tasks into a prompted format. They then fine-tuned a pretrained model on a mixture of these prompted tasks, covering a wide variety of NLP tasks. The model achieved strong zero-shot performance on several benchmark datasets, often outperforming models that were larger in size. Training on more prompts per task consistently improved performance and reduced variability, demonstrating that multitask training can enable better generalization to new tasks without requiring massive scale models.

Analysis of the interaction between practices for introducing XP effectively

Makoto SAKAI

In this paper, we discuss interactions between XP (eXtreme Programming) practices. We discuss 2 case studies of introducing XP practices selectively from the 13 practices which are defined in XP, and we analyze how to select practices. Our analysis is based on interviews with developers. While it is difficult to introduce all the XP practices at once, our knowledge makes it easier to determine more effective combinations of practices.

APznzaalselifJKjGQdTCA51cF7bldYdFMvDcshM8opKFZ_ZaIV-dqkiLoIKIfhz2tS6Fw5UBk25u...

AishwaryaChemate

1) The document discusses various topics in natural language processing applications including machine translation techniques, sentiment analysis, question answering, text entailment, discourse processing, dialog systems, conversational agents, and natural language generation. 2) Machine translation techniques are discussed including rule-based translation, statistical machine translation, and examples of each. Statistical machine translation uses large corpora and probability to generate translations. 3) Other applications covered include sentiment analysis to determine sentiment in text, question answering systems, text entailment to determine entailment relationships, and discourse processing to analyze linguistic structures in text.

Reporting Metasystem Design and Penalization Strategy Best Practices (Present...

Intel® Software

This talk is intended to examine result-driven penalization and user reporting designs that members of the Fair Play Alliance including Intel, Riot Games, Tencent Game Security and Two Hat Security have successfully implemented. The talk will include examples that will outline how systems were implemented as well as a look at measurable results from those projects. One underpinning point is to analyze how those best practices can be conducive to reforming player behavior by focusing on providing timely feedback to players, and how penalization practices can be leveraged to produce the desired outcome of fostering productive interactions in games.

Survey of reasoning techniques with Language Model prompting

Sanjana Kothari

The document discusses various techniques for prompting language models to perform reasoning tasks. It presents a taxonomy that includes methods like single-stage and multi-stage prompting, as well as process optimization techniques involving self, iterative, and ensemble optimization. Different prompting strategies like few-shot, chain-of-thought, and instruction prompting are compared. Research on comparing language model performance based on scale and training corpus is overviewed. Future directions are identified, such as developing theoretical principles of reasoning, efficient and interpretable multimodal reasoning, and generalizable reasoning abilities.

[DSC Europe 23] Dmitry Ustalov - Design and Evaluation of Large Language Models

DataScienceConferenc1

As many organizations are bundling large language models (LLMs) in their products, they face the problem of rigorous model selection. This talk gives a data-centric understanding of how LLMs are built and evaluated. We will discuss the limitations of current models and pay special attention to the available evaluation protocols. How do we distinguish good models from the others? What tasks and datasets should we try or avoid? How do we incorporate feedback from our users? We will present the guidelines the attendees can use in their future experiments.

Are Neural Language Models Good Plagiarists? A Benchmark for Neural Paraphras...

JanPhilipWahle

The rise of language models such as BERT allows for high-quality text paraphrasing. This is a problem to academic integrity, as it is difficult to differentiate between original and machine-generated content. We propose a benchmark consisting of paraphrased articles using recent language models relying on the Transformer architecture. Our contribution fosters future research of paraphrase detection systems as it offers a large collection of aligned original and paraphrased documents, a study regarding its structure, classification experiments with state-of-the-art systems, and we make our findings publicly available.

How to build a GPT model.pdf

StephenAmell4

Sequential Reptile_Inter-Task Gradient Alignment for Multilingual Learning

MLAI2

Multilingual models jointly pretrained on multiple languages have achieved remarkable performance on various multilingual downstream tasks. Moreover, models finetuned on a single monolingual downstream task have shown to generalize to unseen languages. In this paper, we first show that it is crucial for those tasks to align gradients between them in order to maximize knowledge transfer while minimizing negative transfer. Despite its importance, the existing methods for gradient alignment either have a completely different purpose, ignore inter-task alignment, or aim to solve continual learning problems in rather inefficient ways. As a result of the misaligned gradients between tasks, the model suffers from severe negative transfer in the form of catastrophic forgetting of the knowledge acquired from the pretraining. To overcome the limitations, we propose a simple yet effective method that can efficiently align gradients between tasks. Specifically, we perform each inner-optimization by sequentially sampling batches from all the tasks, followed by a Reptile outer update. Thanks to the gradients aligned between tasks by our method, the model becomes less vulnerable to negative transfer and catastrophic forgetting. We extensively validate our method on various multi-task learning and zero-shot cross-lingual transfer tasks, where our method largely outperforms all the relevant baselines we consider.

Agility in Software 2.0 - Notebook Interfaces and MLOps with Buttresses and R...

Quality Assurance Of Generative Dialog Models in an evolving Conversational Agent used for Swedish Language Practice

Recommended

Recommended

More Related Content

Similar to Quality Assurance Of Generative Dialog Models in an evolving Conversational Agent used for Swedish Language Practice

Similar to Quality Assurance Of Generative Dialog Models in an evolving Conversational Agent used for Swedish Language Practice (20)

More from Markus Borg

More from Markus Borg (20)

Recently uploaded

Recently uploaded (20)

Quality Assurance Of Generative Dialog Models in an evolving Conversational Agent used for Swedish Language Practice