SlideShare a Scribd company logo
1 of 40
Beyond Write-reduction Consideration: A Wear-
leveling-enabled B+-tree Indexing Scheme over
an NVRAM-based Architecture
Speaker: Po-Chuan, Chen
Table of contents
• Abstract
• Introduction
• Background & Motivation
• Low-power memory technology
• B+-tree indexing scheme
• Related works
• Motivation
• Wear-leveling-aware B+-tree Scheme
• The overview of waB+ tree scheme
• Circular Node Structure
• Node-based Wear-leveling Strategy
• Global Wear-leveling Strategy
• Evaluation
• Conclusion
Abstract
• Non-volatile random-access memory (NVRAM)
 Feature : zero-static power consumption
 Nightmare : endurance
• Rethinking data management systems indexing scheme
• Usually using B+ tree indexing structure
• Prior studies focus on reducing the amount of write traffic to memory
Unfortunately
• Prior studies haven’t considered to extend the NVRAM lifespan
• All nodes within B+-tree indexing structure have different update
frequencies.
• This paper introduce “waB+ -tree”, it can evenly scatter the amount of
write traffic to the NVRAM cells.
Introduction
• The elements for build database and file systems
 B+ tree indexing scheme
 Effective on traditional storage devices
 Extensively applied
 Non-volatile random access memory
 Zero-static power consumption
 Fast read/write performance
 But short endurance
Prior studies focus on reducing write operation,
not on wear leveling problems
Problems
• Internode wear leveling problems :
• Hot leaves & cold internal nodes
• Intranode wear leveling problems :
• Shifting keys in a node
A wear-leveling-aware B+ tree indexing scheme
• waB+ tree has
 A circular node structure
 A node-based wear leveling strategies
 A global wear leveling strategies
• It can both solve wear leveling problems & reduce write traffic
Table of contents
• Abstract
• Introduction
• Background & Motivation
• Low-power memory technology
• B+-tree indexing scheme
• Related works
• Motivation
• Wear-leveling-aware B+-tree Scheme
• The overview of waB+ tree scheme
• Circular Node Structure
• Node-based Wear-leveling Strategy
• Global Wear-leveling Strategy
• Evaluation
• Conclusion
Low-power memory technology
STT-RAM屬於第二代MRAM技術,能夠解決傳統MRAM結構所存在的一些問題。
目前開發的大多數MRAM,都是通過使磁場改變磁化方向來寫入數據,而磁場則是由流經隧
道磁阻(TMR)元件附近導線的電流所產生的。其漏電功耗接近於零,這是它的主要優點
STT方法使用一種極化旋轉電流使磁位元翻轉,這種技術在降低功耗的同時可以增大容量。
Related work
• B+ -tree indexing :
 Overflow node structure (reduce PCM write traffic)
 Predictive tree called B^(p) tree
• Write reduction :
 Unsorted (counter) / Sorted (bitmap)
 PB+ -tree (insertion area, if full go to sorted area)
Although the above solutions effectively reduced the amount of write
traffic to NVRAM, they failed to resolve the wear leveling issue for
prolonging NVRAM’s lifetime
B+-tree Indexing Scheme
• Because B+-tree structures, will be frequently updated while data is
inserted or deleted.
• So, it have wear leveling problems.
• A B+-tree structure has different update frequencies at not only each
node but each tree level.
Problems
• Internode wear leveling problems :
• Hot leaves & cold internal nodes
• Intranode wear leveling problems :
• Shifting keys in a node
Wear leveling issue
Intranode wear leveling
Internode wear leveling
Challenges
 How to evenly distribute the write requests in a “sorted” node
structure ? intranode
 How to replace old with young nodes in the B+-tree indexing
scheme for extending NVRAM’s lifespan ? internode
Table of contents
• Abstract
• Introduction
• Background & Motivation
• Low-power memory technology
• B+-tree indexing scheme
• Related works
• Motivation
• Wear-leveling-aware B+-tree Scheme
• The overview of waB+ tree scheme
• Circular Node Structure
• Node-based Wear-leveling Strategy
• Global Wear-leveling Strategy
• Evaluation
• Conclusion
System architecture overview
 Circular Node :
• Reducing write requests
 Node-based WL :
• Evenly distributing the write request in a node
 Global WL :
• Prolonging the lifespan of NVRAM
System architecture overview
 Index area :
• Small size and contains a key and a data pointer
• Frequently update contains
 Data area :
• Big size
• For storing data
• Compared with index area, data area won’t wear
out soon
Circular Node Structure
• Goal : Moving the start point of insertion in a tree node for evenly
distributing the amount of write traffic generated by key movements
to each entry within a node.
The pivot is the position of the first insertion key in a node
The boundary is a pointer to indicate the position of the
largest or smallest key in a node.
Benefits
• The pivot point will reduce the number of shifting positions from n to
𝑛
2
on
average because the pivot divides a node space into two insertion area.
• The boundary pointer (i.e., BDRY) is the indicator to borrow the free
entries.
Larger than pivot right side, otherwise left side
To take free space …
the waB+ -tree scheme set the boundary pointer to the last (resp. first)
position of borrowed free entries in the left-side (resp. right-side) of
the pivot.
Node-based Wear-leveling Strategy
• Goal :
 The key stored in the pivot position is only altered when the node is
allocated, or the pivot key is deleted in the circular node structure.
 The entry storing metadata will be frequently updated because the bitmap
will be modified when a key is inserted/deleted into/from the node.
• Method : In order to resolve such intranode wear-leveling issue
How ?
• Node-based wear-leveling strategy will shift the metadata and pivot
to a new position for evenly distributing the amount of write traffic to
each entry when the node is reallocated.
P_n : new positions of pivot or metadata
P_s : start positions of pivot or metadata
T_allocated : how many times the node has been allocated
P_predefined : predefined number of shifting node
N_E : the totally number of entries within a node
Global Wear-leveling Strategy
• Goal : swap hot with cold nodes during node allocation.
• The global strategy will trigger the swapping process when the
amount of write traffic of the (to-be-allocated) free node is larger
than the threshold value derived from Equation.
AVG_writes : yje average amount of the write traffic to a memory cell
L_NVRAM : the lifespan of the NVRAM technology
For example
 A new node needs to be allocated
 Global strategy will estimate the amount of write traffic of the new node space
 Its amount of write traffic is larger than the value derived from Equation.
 The swapping process will be triggered to swap the new node with the (old) node
 The global wear-leveling strategy will move the cursor to the next to-be-swapped
node in the B+-tree structure.
By multiplying the new node’s allocation frequency and the
average amount of write traffic to an NVRAM cell.
The cursor through copying all keys and information from the old
node to the new node and modifying the pointer of the parent
node of the old node to reconnect with the new node.
The new cursor will move to
 The next right sibling
 The leftmost child node at the one lower level
 Reset to the root node of B+ -tree structure
Table of contents
• Abstract
• Introduction
• Background & Motivation
• Low-power memory technology
• B+-tree indexing scheme
• Related works
• Motivation
• Wear-leveling-aware B+-tree Scheme
• The overview of waB+ tree scheme
• Circular Node Structure
• Node-based Wear-leveling Strategy
• Global Wear-leveling Strategy
• Evaluation
• Conclusion
Experimental Enviorment
• Normal Distribution :
it contains the set of indexing key
requests collected from the randomly-
generating mechanism
• YCSB :
it’s a database testing tool to examine
the performance of NoSQL database
Results
• Write Distribution
• Insertion Performance
• Query Performance
• Write Statistics
• Advanced Analysis
Write Distribution (Normal Distribution)
Write Distribution (YCSB) wB+-Tree needs to maintain an
extra structure, namely slot array, to
record the sorted sequence of keys.
Normal Distribution
YCSB
Internode wear leveling
 B+ -tree
 PB+ -tree
 wB+ -tree
 waB+ -tree
Write counts (B+ -tree vs. waB+ -tree)
Write counts (wB+ -tree vs. waB+ -tree)
Write counts (PB+ -tree vs. waB+ -tree)
Internode wear leveling
Overhead analysis
Latency analysis
 Normal indexing key
reading/writing latency
 Boundary information and node
swapping latency
 Reading latency for pivot
comparison
Conclusion
• A wear-leveling-aware B+-tree indexing scheme (waB+-tree)
• Reducing the amount of write traffic to NVRAM storage and evenly
distribute the amount of write traffic to all memory cells
• Prolonging the lifespan of the NVRAM storage device by at least two
times

More Related Content

Similar to Beyond Write-reduction Consideration: A Wear-leveling-enabled B+-tree Indexing Scheme over an NVRAM-based Architecture.pptx

Leveling to the Last Mile: Near-zero-cost Bit Level Wear Leveling for PCM-bas...
Leveling to the Last Mile: Near-zero-cost Bit Level Wear Leveling for PCM-bas...Leveling to the Last Mile: Near-zero-cost Bit Level Wear Leveling for PCM-bas...
Leveling to the Last Mile: Near-zero-cost Bit Level Wear Leveling for PCM-bas...Po-Chuan Chen
 
Convolutional Neural Networks : Popular Architectures
Convolutional Neural Networks : Popular ArchitecturesConvolutional Neural Networks : Popular Architectures
Convolutional Neural Networks : Popular Architecturesananth
 
AWS re:Invent 2016| DAT318 | Migrating from RDBMS to NoSQL: How Sony Moved fr...
AWS re:Invent 2016| DAT318 | Migrating from RDBMS to NoSQL: How Sony Moved fr...AWS re:Invent 2016| DAT318 | Migrating from RDBMS to NoSQL: How Sony Moved fr...
AWS re:Invent 2016| DAT318 | Migrating from RDBMS to NoSQL: How Sony Moved fr...Amazon Web Services
 
Cvpr 2018 papers review (efficient computing)
Cvpr 2018 papers review (efficient computing)Cvpr 2018 papers review (efficient computing)
Cvpr 2018 papers review (efficient computing)DonghyunKang12
 
Cassandra CLuster Management by Japan Cassandra Community
Cassandra CLuster Management by Japan Cassandra CommunityCassandra CLuster Management by Japan Cassandra Community
Cassandra CLuster Management by Japan Cassandra CommunityHiromitsu Komatsu
 
Efficient node bootstrapping for decentralised shared-nothing Key-Value Stores
Efficient node bootstrapping for decentralised shared-nothing Key-Value StoresEfficient node bootstrapping for decentralised shared-nothing Key-Value Stores
Efficient node bootstrapping for decentralised shared-nothing Key-Value StoresHan Li
 
SBAC-PAD 2018: On the resilience of RTL NN accelerators fault characterizatio...
SBAC-PAD 2018: On the resilience of RTL NN accelerators fault characterizatio...SBAC-PAD 2018: On the resilience of RTL NN accelerators fault characterizatio...
SBAC-PAD 2018: On the resilience of RTL NN accelerators fault characterizatio...LEGATO project
 
Data Stream Management
Data Stream ManagementData Stream Management
Data Stream Managementk_tauhid
 
Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models (DB T...
Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models (DB T...Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models (DB T...
Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models (DB T...Spark Summit
 
Energy Efficient Clustering: Wireless Sensor Network
Energy Efficient Clustering: Wireless Sensor NetworkEnergy Efficient Clustering: Wireless Sensor Network
Energy Efficient Clustering: Wireless Sensor NetworkShivang Rana
 
Faster and smaller inverted indices with Treaps Research Paper
Faster and smaller inverted indices with Treaps Research PaperFaster and smaller inverted indices with Treaps Research Paper
Faster and smaller inverted indices with Treaps Research Papersameiralk
 
In datacenter performance analysis of a tensor processing unit
In datacenter performance analysis of a tensor processing unitIn datacenter performance analysis of a tensor processing unit
In datacenter performance analysis of a tensor processing unitJinwon Lee
 
6.1-Cassandra.ppt
6.1-Cassandra.ppt6.1-Cassandra.ppt
6.1-Cassandra.pptDanBarcan2
 

Similar to Beyond Write-reduction Consideration: A Wear-leveling-enabled B+-tree Indexing Scheme over an NVRAM-based Architecture.pptx (20)

Leveling to the Last Mile: Near-zero-cost Bit Level Wear Leveling for PCM-bas...
Leveling to the Last Mile: Near-zero-cost Bit Level Wear Leveling for PCM-bas...Leveling to the Last Mile: Near-zero-cost Bit Level Wear Leveling for PCM-bas...
Leveling to the Last Mile: Near-zero-cost Bit Level Wear Leveling for PCM-bas...
 
Convolutional Neural Networks : Popular Architectures
Convolutional Neural Networks : Popular ArchitecturesConvolutional Neural Networks : Popular Architectures
Convolutional Neural Networks : Popular Architectures
 
AWS re:Invent 2016| DAT318 | Migrating from RDBMS to NoSQL: How Sony Moved fr...
AWS re:Invent 2016| DAT318 | Migrating from RDBMS to NoSQL: How Sony Moved fr...AWS re:Invent 2016| DAT318 | Migrating from RDBMS to NoSQL: How Sony Moved fr...
AWS re:Invent 2016| DAT318 | Migrating from RDBMS to NoSQL: How Sony Moved fr...
 
Cvpr 2018 papers review (efficient computing)
Cvpr 2018 papers review (efficient computing)Cvpr 2018 papers review (efficient computing)
Cvpr 2018 papers review (efficient computing)
 
Aa sort-v4
Aa sort-v4Aa sort-v4
Aa sort-v4
 
Cassandra CLuster Management by Japan Cassandra Community
Cassandra CLuster Management by Japan Cassandra CommunityCassandra CLuster Management by Japan Cassandra Community
Cassandra CLuster Management by Japan Cassandra Community
 
Efficient node bootstrapping for decentralised shared-nothing Key-Value Stores
Efficient node bootstrapping for decentralised shared-nothing Key-Value StoresEfficient node bootstrapping for decentralised shared-nothing Key-Value Stores
Efficient node bootstrapping for decentralised shared-nothing Key-Value Stores
 
lect13_programmable_dp.pptx
lect13_programmable_dp.pptxlect13_programmable_dp.pptx
lect13_programmable_dp.pptx
 
Nbvtalkataitamimageprocessingconf
NbvtalkataitamimageprocessingconfNbvtalkataitamimageprocessingconf
Nbvtalkataitamimageprocessingconf
 
SBAC-PAD 2018: On the resilience of RTL NN accelerators fault characterizatio...
SBAC-PAD 2018: On the resilience of RTL NN accelerators fault characterizatio...SBAC-PAD 2018: On the resilience of RTL NN accelerators fault characterizatio...
SBAC-PAD 2018: On the resilience of RTL NN accelerators fault characterizatio...
 
Data Stream Management
Data Stream ManagementData Stream Management
Data Stream Management
 
Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models (DB T...
Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models (DB T...Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models (DB T...
Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models (DB T...
 
Energy Efficient Clustering: Wireless Sensor Network
Energy Efficient Clustering: Wireless Sensor NetworkEnergy Efficient Clustering: Wireless Sensor Network
Energy Efficient Clustering: Wireless Sensor Network
 
try
trytry
try
 
PD_Tcl_Examples
PD_Tcl_ExamplesPD_Tcl_Examples
PD_Tcl_Examples
 
Faster and smaller inverted indices with Treaps Research Paper
Faster and smaller inverted indices with Treaps Research PaperFaster and smaller inverted indices with Treaps Research Paper
Faster and smaller inverted indices with Treaps Research Paper
 
In datacenter performance analysis of a tensor processing unit
In datacenter performance analysis of a tensor processing unitIn datacenter performance analysis of a tensor processing unit
In datacenter performance analysis of a tensor processing unit
 
6.1-Cassandra.ppt
6.1-Cassandra.ppt6.1-Cassandra.ppt
6.1-Cassandra.ppt
 
Cassandra
CassandraCassandra
Cassandra
 
6.1-Cassandra.ppt
6.1-Cassandra.ppt6.1-Cassandra.ppt
6.1-Cassandra.ppt
 

More from Po-Chuan Chen

E-CORE: Emotion Correlation Enhanced Empathetic Dialogue Generation.pdf
E-CORE: Emotion Correlation Enhanced Empathetic Dialogue Generation.pdfE-CORE: Emotion Correlation Enhanced Empathetic Dialogue Generation.pdf
E-CORE: Emotion Correlation Enhanced Empathetic Dialogue Generation.pdfPo-Chuan Chen
 
Effective Structured Prompting by Meta-Learning and Representative Verbalizer...
Effective Structured Prompting by Meta-Learning and Representative Verbalizer...Effective Structured Prompting by Meta-Learning and Representative Verbalizer...
Effective Structured Prompting by Meta-Learning and Representative Verbalizer...Po-Chuan Chen
 
Quark: Controllable Text Generation with Reinforced [Un]learning.pdf
Quark: Controllable Text Generation with Reinforced [Un]learning.pdfQuark: Controllable Text Generation with Reinforced [Un]learning.pdf
Quark: Controllable Text Generation with Reinforced [Un]learning.pdfPo-Chuan Chen
 
Empathetic Dialogue Generation via Sensitive Emotion Recognition and Sensible...
Empathetic Dialogue Generation via Sensitive Emotion Recognition and Sensible...Empathetic Dialogue Generation via Sensitive Emotion Recognition and Sensible...
Empathetic Dialogue Generation via Sensitive Emotion Recognition and Sensible...Po-Chuan Chen
 
On the Effectiveness of Offline RL for Dialogue Response Generation.pdf
On the Effectiveness of Offline RL for Dialogue Response Generation.pdfOn the Effectiveness of Offline RL for Dialogue Response Generation.pdf
On the Effectiveness of Offline RL for Dialogue Response Generation.pdfPo-Chuan Chen
 
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transfor...
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transfor...GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transfor...
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transfor...Po-Chuan Chen
 
A Statistical Perspective on Retrieval-Based Models.pdf
A Statistical Perspective on Retrieval-Based Models.pdfA Statistical Perspective on Retrieval-Based Models.pdf
A Statistical Perspective on Retrieval-Based Models.pdfPo-Chuan Chen
 
A Neural Corpus Indexer for Document Retrieval.pdf
A Neural Corpus Indexer for Document Retrieval.pdfA Neural Corpus Indexer for Document Retrieval.pdf
A Neural Corpus Indexer for Document Retrieval.pdfPo-Chuan Chen
 
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning.pdf
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning.pdfAdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning.pdf
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning.pdfPo-Chuan Chen
 
LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attent...
LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attent...LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attent...
LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attent...Po-Chuan Chen
 
Active Retrieval Augmented Generation.pdf
Active Retrieval Augmented Generation.pdfActive Retrieval Augmented Generation.pdf
Active Retrieval Augmented Generation.pdfPo-Chuan Chen
 
Offline Reinforcement Learning for Informal Summarization in Online Domains.pdf
Offline Reinforcement Learning for Informal Summarization in Online Domains.pdfOffline Reinforcement Learning for Informal Summarization in Online Domains.pdf
Offline Reinforcement Learning for Informal Summarization in Online Domains.pdfPo-Chuan Chen
 
Cold_Start_Reinforcement_Learning_with_Softmax_Policy_Gradient.pdf
Cold_Start_Reinforcement_Learning_with_Softmax_Policy_Gradient.pdfCold_Start_Reinforcement_Learning_with_Softmax_Policy_Gradient.pdf
Cold_Start_Reinforcement_Learning_with_Softmax_Policy_Gradient.pdfPo-Chuan Chen
 
Image_to_Prompts.pdf
Image_to_Prompts.pdfImage_to_Prompts.pdf
Image_to_Prompts.pdfPo-Chuan Chen
 
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.pdf
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.pdfRetrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.pdf
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.pdfPo-Chuan Chen
 
Evaluating Parameter Efficient Learning for Generation.pdf
Evaluating Parameter Efficient Learning for Generation.pdfEvaluating Parameter Efficient Learning for Generation.pdf
Evaluating Parameter Efficient Learning for Generation.pdfPo-Chuan Chen
 
Off-Policy Deep Reinforcement Learning without Exploration.pdf
Off-Policy Deep Reinforcement Learning without Exploration.pdfOff-Policy Deep Reinforcement Learning without Exploration.pdf
Off-Policy Deep Reinforcement Learning without Exploration.pdfPo-Chuan Chen
 
A Mixture-of-Expert Approach to RL-based Dialogue Management.pdf
A Mixture-of-Expert Approach to RL-based Dialogue Management.pdfA Mixture-of-Expert Approach to RL-based Dialogue Management.pdf
A Mixture-of-Expert Approach to RL-based Dialogue Management.pdfPo-Chuan Chen
 
Is Reinforcement Learning (Not) for Natural Language Processing.pdf
Is Reinforcement Learning (Not) for Natural
Language Processing.pdfIs Reinforcement Learning (Not) for Natural
Language Processing.pdf
Is Reinforcement Learning (Not) for Natural Language Processing.pdfPo-Chuan Chen
 
HyperPrompt:Prompt-based Task-Conditioning of Transformerspdf
HyperPrompt:Prompt-based Task-Conditioning of TransformerspdfHyperPrompt:Prompt-based Task-Conditioning of Transformerspdf
HyperPrompt:Prompt-based Task-Conditioning of TransformerspdfPo-Chuan Chen
 

More from Po-Chuan Chen (20)

E-CORE: Emotion Correlation Enhanced Empathetic Dialogue Generation.pdf
E-CORE: Emotion Correlation Enhanced Empathetic Dialogue Generation.pdfE-CORE: Emotion Correlation Enhanced Empathetic Dialogue Generation.pdf
E-CORE: Emotion Correlation Enhanced Empathetic Dialogue Generation.pdf
 
Effective Structured Prompting by Meta-Learning and Representative Verbalizer...
Effective Structured Prompting by Meta-Learning and Representative Verbalizer...Effective Structured Prompting by Meta-Learning and Representative Verbalizer...
Effective Structured Prompting by Meta-Learning and Representative Verbalizer...
 
Quark: Controllable Text Generation with Reinforced [Un]learning.pdf
Quark: Controllable Text Generation with Reinforced [Un]learning.pdfQuark: Controllable Text Generation with Reinforced [Un]learning.pdf
Quark: Controllable Text Generation with Reinforced [Un]learning.pdf
 
Empathetic Dialogue Generation via Sensitive Emotion Recognition and Sensible...
Empathetic Dialogue Generation via Sensitive Emotion Recognition and Sensible...Empathetic Dialogue Generation via Sensitive Emotion Recognition and Sensible...
Empathetic Dialogue Generation via Sensitive Emotion Recognition and Sensible...
 
On the Effectiveness of Offline RL for Dialogue Response Generation.pdf
On the Effectiveness of Offline RL for Dialogue Response Generation.pdfOn the Effectiveness of Offline RL for Dialogue Response Generation.pdf
On the Effectiveness of Offline RL for Dialogue Response Generation.pdf
 
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transfor...
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transfor...GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transfor...
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transfor...
 
A Statistical Perspective on Retrieval-Based Models.pdf
A Statistical Perspective on Retrieval-Based Models.pdfA Statistical Perspective on Retrieval-Based Models.pdf
A Statistical Perspective on Retrieval-Based Models.pdf
 
A Neural Corpus Indexer for Document Retrieval.pdf
A Neural Corpus Indexer for Document Retrieval.pdfA Neural Corpus Indexer for Document Retrieval.pdf
A Neural Corpus Indexer for Document Retrieval.pdf
 
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning.pdf
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning.pdfAdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning.pdf
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning.pdf
 
LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attent...
LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attent...LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attent...
LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attent...
 
Active Retrieval Augmented Generation.pdf
Active Retrieval Augmented Generation.pdfActive Retrieval Augmented Generation.pdf
Active Retrieval Augmented Generation.pdf
 
Offline Reinforcement Learning for Informal Summarization in Online Domains.pdf
Offline Reinforcement Learning for Informal Summarization in Online Domains.pdfOffline Reinforcement Learning for Informal Summarization in Online Domains.pdf
Offline Reinforcement Learning for Informal Summarization in Online Domains.pdf
 
Cold_Start_Reinforcement_Learning_with_Softmax_Policy_Gradient.pdf
Cold_Start_Reinforcement_Learning_with_Softmax_Policy_Gradient.pdfCold_Start_Reinforcement_Learning_with_Softmax_Policy_Gradient.pdf
Cold_Start_Reinforcement_Learning_with_Softmax_Policy_Gradient.pdf
 
Image_to_Prompts.pdf
Image_to_Prompts.pdfImage_to_Prompts.pdf
Image_to_Prompts.pdf
 
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.pdf
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.pdfRetrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.pdf
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.pdf
 
Evaluating Parameter Efficient Learning for Generation.pdf
Evaluating Parameter Efficient Learning for Generation.pdfEvaluating Parameter Efficient Learning for Generation.pdf
Evaluating Parameter Efficient Learning for Generation.pdf
 
Off-Policy Deep Reinforcement Learning without Exploration.pdf
Off-Policy Deep Reinforcement Learning without Exploration.pdfOff-Policy Deep Reinforcement Learning without Exploration.pdf
Off-Policy Deep Reinforcement Learning without Exploration.pdf
 
A Mixture-of-Expert Approach to RL-based Dialogue Management.pdf
A Mixture-of-Expert Approach to RL-based Dialogue Management.pdfA Mixture-of-Expert Approach to RL-based Dialogue Management.pdf
A Mixture-of-Expert Approach to RL-based Dialogue Management.pdf
 
Is Reinforcement Learning (Not) for Natural Language Processing.pdf
Is Reinforcement Learning (Not) for Natural
Language Processing.pdfIs Reinforcement Learning (Not) for Natural
Language Processing.pdf
Is Reinforcement Learning (Not) for Natural Language Processing.pdf
 
HyperPrompt:Prompt-based Task-Conditioning of Transformerspdf
HyperPrompt:Prompt-based Task-Conditioning of TransformerspdfHyperPrompt:Prompt-based Task-Conditioning of Transformerspdf
HyperPrompt:Prompt-based Task-Conditioning of Transformerspdf
 

Recently uploaded

Double rodded leveling 1 pdf activity 01
Double rodded leveling 1 pdf activity 01Double rodded leveling 1 pdf activity 01
Double rodded leveling 1 pdf activity 01KreezheaRecto
 
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete RecordCCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete RecordAsst.prof M.Gokilavani
 
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdfONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdfKamal Acharya
 
Thermal Engineering Unit - I & II . ppt
Thermal Engineering  Unit - I & II . pptThermal Engineering  Unit - I & II . ppt
Thermal Engineering Unit - I & II . pptDineshKumar4165
 
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...Call Girls in Nagpur High Profile
 
Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night StandCall Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Standamitlee9823
 
Unleashing the Power of the SORA AI lastest leap
Unleashing the Power of the SORA AI lastest leapUnleashing the Power of the SORA AI lastest leap
Unleashing the Power of the SORA AI lastest leapRishantSharmaFr
 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXssuser89054b
 
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756dollysharma2066
 
Top Rated Call Girls In chittoor 📱 {7001035870} VIP Escorts chittoor
Top Rated Call Girls In chittoor 📱 {7001035870} VIP Escorts chittoorTop Rated Call Girls In chittoor 📱 {7001035870} VIP Escorts chittoor
Top Rated Call Girls In chittoor 📱 {7001035870} VIP Escorts chittoordharasingh5698
 
Thermal Engineering -unit - III & IV.ppt
Thermal Engineering -unit - III & IV.pptThermal Engineering -unit - III & IV.ppt
Thermal Engineering -unit - III & IV.pptDineshKumar4165
 
Intro To Electric Vehicles PDF Notes.pdf
Intro To Electric Vehicles PDF Notes.pdfIntro To Electric Vehicles PDF Notes.pdf
Intro To Electric Vehicles PDF Notes.pdfrs7054576148
 
Generative AI or GenAI technology based PPT
Generative AI or GenAI technology based PPTGenerative AI or GenAI technology based PPT
Generative AI or GenAI technology based PPTbhaskargani46
 
Booking open Available Pune Call Girls Pargaon 6297143586 Call Hot Indian Gi...
Booking open Available Pune Call Girls Pargaon  6297143586 Call Hot Indian Gi...Booking open Available Pune Call Girls Pargaon  6297143586 Call Hot Indian Gi...
Booking open Available Pune Call Girls Pargaon 6297143586 Call Hot Indian Gi...Call Girls in Nagpur High Profile
 
chapter 5.pptx: drainage and irrigation engineering
chapter 5.pptx: drainage and irrigation engineeringchapter 5.pptx: drainage and irrigation engineering
chapter 5.pptx: drainage and irrigation engineeringmulugeta48
 

Recently uploaded (20)

(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7
(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7
(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7
 
Double rodded leveling 1 pdf activity 01
Double rodded leveling 1 pdf activity 01Double rodded leveling 1 pdf activity 01
Double rodded leveling 1 pdf activity 01
 
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete RecordCCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
 
Water Industry Process Automation & Control Monthly - April 2024
Water Industry Process Automation & Control Monthly - April 2024Water Industry Process Automation & Control Monthly - April 2024
Water Industry Process Automation & Control Monthly - April 2024
 
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdfONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
 
Thermal Engineering Unit - I & II . ppt
Thermal Engineering  Unit - I & II . pptThermal Engineering  Unit - I & II . ppt
Thermal Engineering Unit - I & II . ppt
 
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
 
Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night StandCall Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Stand
 
Call Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort ServiceCall Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
 
Unleashing the Power of the SORA AI lastest leap
Unleashing the Power of the SORA AI lastest leapUnleashing the Power of the SORA AI lastest leap
Unleashing the Power of the SORA AI lastest leap
 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
 
(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7
(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7
(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7
 
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
 
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
 
Top Rated Call Girls In chittoor 📱 {7001035870} VIP Escorts chittoor
Top Rated Call Girls In chittoor 📱 {7001035870} VIP Escorts chittoorTop Rated Call Girls In chittoor 📱 {7001035870} VIP Escorts chittoor
Top Rated Call Girls In chittoor 📱 {7001035870} VIP Escorts chittoor
 
Thermal Engineering -unit - III & IV.ppt
Thermal Engineering -unit - III & IV.pptThermal Engineering -unit - III & IV.ppt
Thermal Engineering -unit - III & IV.ppt
 
Intro To Electric Vehicles PDF Notes.pdf
Intro To Electric Vehicles PDF Notes.pdfIntro To Electric Vehicles PDF Notes.pdf
Intro To Electric Vehicles PDF Notes.pdf
 
Generative AI or GenAI technology based PPT
Generative AI or GenAI technology based PPTGenerative AI or GenAI technology based PPT
Generative AI or GenAI technology based PPT
 
Booking open Available Pune Call Girls Pargaon 6297143586 Call Hot Indian Gi...
Booking open Available Pune Call Girls Pargaon  6297143586 Call Hot Indian Gi...Booking open Available Pune Call Girls Pargaon  6297143586 Call Hot Indian Gi...
Booking open Available Pune Call Girls Pargaon 6297143586 Call Hot Indian Gi...
 
chapter 5.pptx: drainage and irrigation engineering
chapter 5.pptx: drainage and irrigation engineeringchapter 5.pptx: drainage and irrigation engineering
chapter 5.pptx: drainage and irrigation engineering
 

Beyond Write-reduction Consideration: A Wear-leveling-enabled B+-tree Indexing Scheme over an NVRAM-based Architecture.pptx

  • 1. Beyond Write-reduction Consideration: A Wear- leveling-enabled B+-tree Indexing Scheme over an NVRAM-based Architecture Speaker: Po-Chuan, Chen
  • 2. Table of contents • Abstract • Introduction • Background & Motivation • Low-power memory technology • B+-tree indexing scheme • Related works • Motivation • Wear-leveling-aware B+-tree Scheme • The overview of waB+ tree scheme • Circular Node Structure • Node-based Wear-leveling Strategy • Global Wear-leveling Strategy • Evaluation • Conclusion
  • 3. Abstract • Non-volatile random-access memory (NVRAM)  Feature : zero-static power consumption  Nightmare : endurance • Rethinking data management systems indexing scheme • Usually using B+ tree indexing structure • Prior studies focus on reducing the amount of write traffic to memory
  • 4. Unfortunately • Prior studies haven’t considered to extend the NVRAM lifespan • All nodes within B+-tree indexing structure have different update frequencies. • This paper introduce “waB+ -tree”, it can evenly scatter the amount of write traffic to the NVRAM cells.
  • 5. Introduction • The elements for build database and file systems  B+ tree indexing scheme  Effective on traditional storage devices  Extensively applied  Non-volatile random access memory  Zero-static power consumption  Fast read/write performance  But short endurance Prior studies focus on reducing write operation, not on wear leveling problems
  • 6. Problems • Internode wear leveling problems : • Hot leaves & cold internal nodes • Intranode wear leveling problems : • Shifting keys in a node
  • 7. A wear-leveling-aware B+ tree indexing scheme • waB+ tree has  A circular node structure  A node-based wear leveling strategies  A global wear leveling strategies • It can both solve wear leveling problems & reduce write traffic
  • 8. Table of contents • Abstract • Introduction • Background & Motivation • Low-power memory technology • B+-tree indexing scheme • Related works • Motivation • Wear-leveling-aware B+-tree Scheme • The overview of waB+ tree scheme • Circular Node Structure • Node-based Wear-leveling Strategy • Global Wear-leveling Strategy • Evaluation • Conclusion
  • 10. Related work • B+ -tree indexing :  Overflow node structure (reduce PCM write traffic)  Predictive tree called B^(p) tree • Write reduction :  Unsorted (counter) / Sorted (bitmap)  PB+ -tree (insertion area, if full go to sorted area) Although the above solutions effectively reduced the amount of write traffic to NVRAM, they failed to resolve the wear leveling issue for prolonging NVRAM’s lifetime
  • 11. B+-tree Indexing Scheme • Because B+-tree structures, will be frequently updated while data is inserted or deleted. • So, it have wear leveling problems. • A B+-tree structure has different update frequencies at not only each node but each tree level.
  • 12. Problems • Internode wear leveling problems : • Hot leaves & cold internal nodes • Intranode wear leveling problems : • Shifting keys in a node
  • 13. Wear leveling issue Intranode wear leveling Internode wear leveling
  • 14. Challenges  How to evenly distribute the write requests in a “sorted” node structure ? intranode  How to replace old with young nodes in the B+-tree indexing scheme for extending NVRAM’s lifespan ? internode
  • 15. Table of contents • Abstract • Introduction • Background & Motivation • Low-power memory technology • B+-tree indexing scheme • Related works • Motivation • Wear-leveling-aware B+-tree Scheme • The overview of waB+ tree scheme • Circular Node Structure • Node-based Wear-leveling Strategy • Global Wear-leveling Strategy • Evaluation • Conclusion
  • 16. System architecture overview  Circular Node : • Reducing write requests  Node-based WL : • Evenly distributing the write request in a node  Global WL : • Prolonging the lifespan of NVRAM
  • 17. System architecture overview  Index area : • Small size and contains a key and a data pointer • Frequently update contains  Data area : • Big size • For storing data • Compared with index area, data area won’t wear out soon
  • 18. Circular Node Structure • Goal : Moving the start point of insertion in a tree node for evenly distributing the amount of write traffic generated by key movements to each entry within a node. The pivot is the position of the first insertion key in a node The boundary is a pointer to indicate the position of the largest or smallest key in a node.
  • 19. Benefits • The pivot point will reduce the number of shifting positions from n to 𝑛 2 on average because the pivot divides a node space into two insertion area. • The boundary pointer (i.e., BDRY) is the indicator to borrow the free entries. Larger than pivot right side, otherwise left side
  • 20. To take free space … the waB+ -tree scheme set the boundary pointer to the last (resp. first) position of borrowed free entries in the left-side (resp. right-side) of the pivot.
  • 21. Node-based Wear-leveling Strategy • Goal :  The key stored in the pivot position is only altered when the node is allocated, or the pivot key is deleted in the circular node structure.  The entry storing metadata will be frequently updated because the bitmap will be modified when a key is inserted/deleted into/from the node. • Method : In order to resolve such intranode wear-leveling issue
  • 22. How ? • Node-based wear-leveling strategy will shift the metadata and pivot to a new position for evenly distributing the amount of write traffic to each entry when the node is reallocated. P_n : new positions of pivot or metadata P_s : start positions of pivot or metadata T_allocated : how many times the node has been allocated P_predefined : predefined number of shifting node N_E : the totally number of entries within a node
  • 23. Global Wear-leveling Strategy • Goal : swap hot with cold nodes during node allocation. • The global strategy will trigger the swapping process when the amount of write traffic of the (to-be-allocated) free node is larger than the threshold value derived from Equation. AVG_writes : yje average amount of the write traffic to a memory cell L_NVRAM : the lifespan of the NVRAM technology
  • 24. For example  A new node needs to be allocated  Global strategy will estimate the amount of write traffic of the new node space  Its amount of write traffic is larger than the value derived from Equation.  The swapping process will be triggered to swap the new node with the (old) node  The global wear-leveling strategy will move the cursor to the next to-be-swapped node in the B+-tree structure. By multiplying the new node’s allocation frequency and the average amount of write traffic to an NVRAM cell. The cursor through copying all keys and information from the old node to the new node and modifying the pointer of the parent node of the old node to reconnect with the new node.
  • 25. The new cursor will move to  The next right sibling  The leftmost child node at the one lower level  Reset to the root node of B+ -tree structure
  • 26. Table of contents • Abstract • Introduction • Background & Motivation • Low-power memory technology • B+-tree indexing scheme • Related works • Motivation • Wear-leveling-aware B+-tree Scheme • The overview of waB+ tree scheme • Circular Node Structure • Node-based Wear-leveling Strategy • Global Wear-leveling Strategy • Evaluation • Conclusion
  • 27. Experimental Enviorment • Normal Distribution : it contains the set of indexing key requests collected from the randomly- generating mechanism • YCSB : it’s a database testing tool to examine the performance of NoSQL database
  • 28. Results • Write Distribution • Insertion Performance • Query Performance • Write Statistics • Advanced Analysis
  • 29. Write Distribution (Normal Distribution)
  • 30. Write Distribution (YCSB) wB+-Tree needs to maintain an extra structure, namely slot array, to record the sorted sequence of keys.
  • 32. YCSB
  • 33. Internode wear leveling  B+ -tree  PB+ -tree  wB+ -tree  waB+ -tree
  • 34. Write counts (B+ -tree vs. waB+ -tree)
  • 35. Write counts (wB+ -tree vs. waB+ -tree)
  • 36. Write counts (PB+ -tree vs. waB+ -tree)
  • 39. Latency analysis  Normal indexing key reading/writing latency  Boundary information and node swapping latency  Reading latency for pivot comparison
  • 40. Conclusion • A wear-leveling-aware B+-tree indexing scheme (waB+-tree) • Reducing the amount of write traffic to NVRAM storage and evenly distribute the amount of write traffic to all memory cells • Prolonging the lifespan of the NVRAM storage device by at least two times