Advanced Retrieval Augmented Generation Techniques

1 | © Copyright 2024 Zilliz
1
1 | © Copyright 9/25/23 Zilliz
Speaker
Jiang Chen
Ecosystem & AI Platform
jiang.chen@zilliz.com
@jiangc1010

2
Fantastic RAG Techniques
And Where to Find Them
Jiang Chen @ Zilliz

3
LLMs are great, but …
You still need to battle hallucination
with retriever, just like the Niffler

4
The evolution of AI made the semantic search of
unstructured data possible
Search by Probability
Statistical analyses of common
datasets established the foundation for
processing unstructured data, e.g. NLP,
and image classification
AI Model Breakthrough
The advancements in BERT, ViT, CBT
etc. have revolutionized semantic
analysis across unstructured data
Vectorization
Word2Vec, CNNs, Deep Speech pioneered
unstructured data embeddings, mapping the
words, images, videos into high-dimensional
vectors

5
01 Review of RAG basics
CONTENTS
02 Advanced RAG techniques
RAG in action with Milvus Lite
03

6
01 Review of RAG basics

7
Why RAG?
RAG vs. LLM
- Knowledge of LLM is out-of-date
- LLM can not get your private knowledge
- Hallucinations
- Transparency and interpretability
RAG vs. Fine-tune
- Fine-tune is expensive
- Fine-tune spent much time
- RAG is pluggable

8

9
02 Advanced RAG techniques

10
First thing first
Measure it before you attempts to improve it!

11
Indexing
Query Retrieval Prompt&
Generation

12
Types of RAG Enhancement Techniques
● Divide & Conquer
○ Query Enhancement: better express or process the query intent.
○ Indexing Enhancement: data cleanup, better parser and chunking
○ Retriever Enhancement: more retrievers and hybrid search strategy
○ Generator Enhancement: prompt engineering and more powerful LLM
● Thinking outside the box
○ Agents? Other tools than retriever?

13
Query Enhancement

14

15

16
What are the differences in features
between Milvus and Zilliz Cloud?
Sub query1: What are the features of Milvus?
Sub query2: What are the features of Zilliz Cloud?

17

18
Indexing Enhancement

19
Good dishes come from good ingredients
• Data collection
• Data cleaning
• Parsing & Chunking
• DNN-native data?

20

21
Retriever Enhancement

22

23

24

25
Generator Enhancement

26

27

28
Agents!

29

30

31

32
03 RAG in action with Milvus Lite

33

34
Seamless integration with all popular AI toolkits

35
Simplify and streamline
the conversion of
unstructured data into
state-of-the-art vector
embeddings, using
intuitive UI and Restful
APIs.
Pipelines
Easy. High-quality. Scalable.
Simplify the workflow
for developers, from
converting
unstructured data into
searchable vectors to
retrieving them from
vector databases
Deliver excellence in
every phase of vector
search pipeline
development and
deployment,
regardless of their
expertise
Ensure scalability for
managing large
datasets and
high-throughput
queries, maintaining
high performance with
min. customization or
infra changes
Zilliz Cloud Pipelines

36
T H A N K Y O U

Advanced Retrieval Augmented Generation Techniques

More Related Content

What's hot

Similar to Advanced Retrieval Augmented Generation Techniques

More from Zilliz

Recently uploaded

Advanced Retrieval Augmented Generation Techniques