June Webinar: How to Transfer Large Volumes of 
Small Files at Accelerated Speeds 
Chris Bailey
Agenda 
• The Problem: Transferring large volumes of small files 
• Test Case 
• Alternatives 
• Other Complementary Features 
• Questions 
2 | © Copyright FileCatalyst, 2013
The Problem: Transferring Large 
Volumes of Small Files 
• Each file needs set up/teardown 
• FTP sends PASV command followed by STOR 
command 
• Fine with large files, but with many small files it takes 
too long 
• Introduce latency and it is even worse 
3 | © Copyright FileCatalyst, 2013
Test Case 
• 37,000 files, 900 directories 
• FileZilla – Takes too long to wait for! 
• FileCatalyst HotFolder with Single Archive option – 
finishes quickly 
4 | © Copyright FileCatalyst, 2013
Alternatives 
• Zipping it yourself in manual, need to unzip other 
side 
• What if one file changes? Send it all again 
5 | © Copyright FileCatalyst, 2013
Other Complementary Features 
• Transfer cache – detects what has changed 
• File system monitoring 
6 | © Copyright FileCatalyst, 2013
Questions?

How to transfer large volumes of small files at accelerated speeds

  • 1.
    June Webinar: Howto Transfer Large Volumes of Small Files at Accelerated Speeds Chris Bailey
  • 2.
    Agenda • TheProblem: Transferring large volumes of small files • Test Case • Alternatives • Other Complementary Features • Questions 2 | © Copyright FileCatalyst, 2013
  • 3.
    The Problem: TransferringLarge Volumes of Small Files • Each file needs set up/teardown • FTP sends PASV command followed by STOR command • Fine with large files, but with many small files it takes too long • Introduce latency and it is even worse 3 | © Copyright FileCatalyst, 2013
  • 4.
    Test Case •37,000 files, 900 directories • FileZilla – Takes too long to wait for! • FileCatalyst HotFolder with Single Archive option – finishes quickly 4 | © Copyright FileCatalyst, 2013
  • 5.
    Alternatives • Zippingit yourself in manual, need to unzip other side • What if one file changes? Send it all again 5 | © Copyright FileCatalyst, 2013
  • 6.
    Other Complementary Features • Transfer cache – detects what has changed • File system monitoring 6 | © Copyright FileCatalyst, 2013
  • 7.