The data held in files can represent some of the most valuable assets that a business has. If this data is trapped in a file in a remote system then it loses value. IBM has recently updated its portfolio of Managed File Transfer offerings, simplifying choice for the business user and offering better value for money, while extending the access to this valuable data. Here about different managed file transfer use cases and suggested solutions
2. Please Note
IBM’s statements regarding its plans, directions, and intent are subject to change
or withdrawal without notice at IBM’s sole discretion.
Information regarding potential future products is intended to outline our general
product direction and it should not be relied on in making a purchasing decision.
The information mentioned regarding potential future products is not a
commitment, promise, or legal obligation to deliver any material, code or
functionality. Information about potential future products may not be incorporated
into any contract. The development, release, and timing of any future features or
functionality described for our products remains at our sole discretion.
Performance is based on measurements and projections using standard IBM
benchmarks in a controlled environment. The actual throughput or performance
that any user will experience will vary depending upon many factors, including
considerations such as the amount of multiprogramming in the user’s job stream,
the I/O configuration, the storage configuration, and the workload processed.
Therefore, no assurance can be given that an individual user will achieve results
similar to those stated here.
4. How do most organizations move files today?
FTP
• Typically File Transfer Protocol (FTP) is combined with writing
and maintaining homegrown code to address its limitations
Why is FTP use so widespread?
• FTP is widely available – Lowest common denominator
• Promises a quick fix – repent at leisure
• Simple concepts – low technical skills needed to get started
• FTP products seem “free”, simple, intuitive and ubiquitous
Legacy File Transfer products
• A combination of products often used to provide silo solutions
• Often based on proprietary versions of FTP protocol
• Can’t transport other forms of data besides files
• Usually well integrated with B2B but rarely able to work with the
rest of the IT infrastructure – especially with SOA
People
• From IT Staff to Business staff and even Security Personnel
• Using a combination of email, fax, phone, mail, memory keys…
Most organizations rely on a mix of home-grown code,
several legacy products and different technologies … and
even people!
5. Shortcomings of Basic FTP
Limited
Flexibility
Limited
Security
Limited visibility
and traceability
Limited
Reliability
Unreliable delivery – Lacking
checkpoint restart – Files can
be lost
Transfers can terminate
without notification or any
record – corrupt or partial
files can be accidentally used
File data can be unusable
after transfer – lack of
Character Set conversion
Often usernames and
passwords are sent with file –
as plain text!
Privacy, authentication and
encryption often not be
available
Non-repudiation often lacking
Transfers cannot be monitored and managed
centrally or remotely
Logging capabilities may be limited and may only
record transfers between directly connected systems
Cannot track the entire journey of files – not just from
one machine to the next but from the start of its
journey to its final destination
Changes to file transfers often require updates to many
ftp scripts that are typically scattered across machines
and require platform-specific skills to alter
All resources usually have to be available concurrently
Often only one ftp transfer can run at a time
Typically transfers cannot be prioritized
6. FTP introduces risks in data movement
Process Risk
Delays in transferring files impacts
collaboration with customers/partners
Integration files that are delayed impact SLAs
Failure of file delivery impacts the processes
themselves
Security Risk
Data encryption and governance of sensitive
information transmitted in files
Inability to apply corporate security policies to
person-initiated file transfers
No visibility over the type and sensitivity of the
data being transferred
No ability to support audit requirements
IBM’s Managed File Transfer solution addresses all of these risks
7. Who benefits from Managed File Transfer
Application Owners
• Producers and consumers of data held in files
• Application developers likely to own files, own code and own existing file transfer
mechanisms
• Increase reliability, improved timely access to data
Infrastructure owners
• Currently provide connectivity between systems, through middleware solutions
• Provide technical expertise to assist application owners
• Reduce recurring error handling and recovery, leverage middleware tools
CxOs
• Need to improve productivity of staff and IT
• Speed up business performance without impacting security
Customers
• Less risk of loss or exposure of data
• Improved business effectiveness and better, more accurate fulfilment
8. IBM MFT Vision
Accelerate and simplify governance of the growing volume of business-
critical data movement within and beyond the enterprise with Smarter MFT
Maximize the agility and performance of dynamic business networks by reducing
the complexity, risk, and cost of file transfer
Visibility
•Single view of transfer activity
•Transaction and business monitoring
•Dashboards, analytics, and scorecards
Usability & Management
•Persona-based, easy-to-use interfaces
•Unified control and configuration of
infrastructure
•Community on-boarding and coordination
Universal
standards
Universal
•Any transport, any protocol, and any
partner
•Global and cloud-enabled deployment
•Broad platform coverage and industry
standards
Security & Performance
•Assured delivery and high availability
•Protection of file data in transit and at rest
•Accelerated transport and low latency
Connectivity
•Integration with BPM to drive business processes
•Leveraging ESBs to enable service orientation
•SOA Registry/Repository for lifecycle governance
9. Comprehensive IBM Managed File Transfer
Monitor file transfer activity & SLAs
IBM® Sterling Control Center
Peer-to-peer file transfers via file
system
IBM® Sterling Connect:Direct®
Message Centric
Transfers
MQ MFT
Scope of this presentation
• A single packaged offering for IBM Managed File Transfer
• Sterling Connect:Direct and Sterling Control Center are now packaged with
IBM MQ Managed File Transfer as WebSphere Managed File Transfer
• IBM MQ Advanced is also enhanced with these additional capabilities
B2B Onboarding and file transfer via
mailboxing
IBM® Sterling File Gateway
Cloud service for B2B file exchange
IBM® Sterling File Transfer Service
10. IBM offers comprehensive MFT Capabilities
IBM MQ Managed File Transfer provides file
transfer optimized for data delivery across IBM MQ
networks
Sterling Connect Direct provides peer-to-peer file
transfer optimized for data delivery within and
between enterprises across Connect:Direct
protocol
Sterling Control Center Manage file transfer
activity across your file transfer servers including
Connect:Direct, FTP, MQ MFT and Sterling File
Gateway
Addressing multiple use cases and scenarios for both internal and multi-
enterprise file transfer
11. MQ V8 Advanced – Universal Messaging including
Managed File Transfer
WebSphere Managed
File Transfer
All functions available
for one single price
Sterling C:D
Sterling C:C
MQ V8
MQ Telemetry
MQ AMS
MQ MFT
Sterling C:D
Sterling C:C
MQ MFT
MQ Advanced V8 Enterprise Messaging with publish/subscribe and
queuing for any application, on any OS, using
any language
Connects applications reliably and securely to
send data anywhere to any solution
Extends application messaging to Mobile,
Internet of Things and Managed File Transfer
Single, simplified licensing to provide all the
capabilities to connect the business, and
maximize data value
Do more with your MQ investment, lowering
operational overheads, and raising efficiencies
Ensures all possible functions and capabilities
are available instantly to allow the business to
respond faster to changing needs
Moves data from anywhere to anywhere with
included end to end monitoring and management
MQ Advanced V8
Available as WebSphere Managed File
Transfer Service, or WebSphere Managed
File Transfer Managed Endpoints
12. A consolidated transport for both files and
messages
Traditional approaches to file transfer
result in parallel infrastructures
• One for files – typically built on FTP
• One for application messaging – based on
IBM MQ, or similar
High degree of duplication in creating
and maintaining the two
infrastructures
MQ MFT reuses the MQ network for
managed file transfer and yields
• Operational savings and simplification
• Reduced administration effort
• Reduced skills requirements and
maintenance
File Transfers
Application
Messaging
Consolidated Transport
for Messages & Files
13. Handling both files and messages across MQ MFT
One file to one message
MQ
MFT
One file to a group of messages
One message to one file
A group of messages (or all messages on the queue) to one file
File can be split based on:
• Size
• Binary delimiter
• Regular expression
• One message becomes one file
• Optionally, a delimiter can be
inserted between each message
used to compose the file
• One file becomes one message
MQ
MFT
MQ
MFT
MQ
MFT
14. Universal
messaging
backbone
IBM MQ Advanced V8 Architecture Summary
WebSphere Managed File Transfer
(Includes MQ MFT, Sterling C:D,
Sterling C:C)
• End-to-end audit trail across file transfers
• Reliable and efficient transfer of file data
regardless of size
• Centralized monitoring of transfer events
and management of transfers
MQ Advanced Message Security
Signs and encrypts data sent over MQ
to provide privacy and integrity
IBM MQ
Scalable, reliable, and efficient transport
for data
File-to-File
Message-to-File
File-to-Message
Message Level
Security
Mobile & M2M
Messaging
IBM MQ Telemetry
Lightweight, low power, low bandwidth
messaging to mobiles and sensors
15. A grocery retailer
IBM messaging backbone delivers transaction data to central hub in
near-real time
The need:
At this company, transaction data from more than 2,400 grocery stores
reached a central data warehouse via daily batch transfers, delaying
analysis and hampering theft prevention efforts.
The solution:
The company implemented an integrated message queuing
infrastructure that can transfer data from any store endpoint to the
central hub in near-real time
IBM MQ MFT software transfers files between the central hub and the
stores’ ESBs and in turn to other endpoint applications in the store.
The benefit:
Dramatically reduces time between customer transaction in
store and data reaching data warehouse
Provides a rock-solid messaging integration engine in a small footprint
Delivers a reliable infrastructure for transaction data and
file-based information
“WebSphere Message
Broker is rock-solid. It has
a relatively small footprint,
and it is a world-class
integration engine.”
—A software engineer,
grocery retailer
Solution components:
Software
IBM® Integration Bus
(formerly known as
IBM WebSphere®
Message Broker)
IBM MQ
IBM MQ Managed File
Transfer
16. IBM offers comprehensive MFT Capabilities
IBM MQ Managed File Transfer provides file
transfer optimized for data delivery across
WebSphere MQ networks
Sterling Connect Direct provides peer-to-peer file
transfer optimized for data delivery within and
between enterprises across Connect:Direct
protocol
Sterling Control Center Manage file transfer
activity across your file transfer servers including
Connect:Direct, FTP, MQ MFT and Sterling File
Gateway
Addressing multiple use cases and scenarios for both internal and multi-enterprise file transfer
17. IBM® Sterling Connect:Direct
• What it does
– High volume, large size, mission-critical file transfers
– Automation, retry-restart, for unattended operation, with never breached security
• What it allows clients to do
– Move files with confidence and upgrade unreliable, unsecured FTP
– Handle growth in data volume and size without increase in staff
• How do I know I need it?
– Regulatory, industry, or company security/compliance requirements continue to grow
– Business operations require assured delivery of critical data
Reliable and high performance solution for secure, point-to-point,
bulk data transfers
Peer-to-peer file transfers
IBM® Sterling Connect:Direct®
18. Detail: IBM® Sterling Connect:Direct
• MFT solution using peer-to-peer file transfer to move data across the
enterprise and between trading partners
• Remediates FTP and failed audits by adding security, monitoring, and
reliability without replacing FTP scripts
• High-volume, bulk data transfers for corporate-to-bank and financial
data connectivity
• Data movement across a broad range of platforms, including
mainframe, midrange, and distributed
• Small footprint, robust integration with 3rd party schedulers, and rapid
deployment
19. IBM Sterling Connect:Direct Delivers Significant
Value
• Assured, “lights out” data delivery
• Automatic recovery
• Optimized for performance and throughput
• Helps meet SLA’s with IBM Sterling Control Center integration
• High availability, cluster aware
Increased Customer Satisfaction
• Strong authentication and encryption
• Integration with existing security infrastructure
• Perimeter and firewall best practices
• Data integrity checking
• Customizable security exits
Solving Internal Security Mandates
• Extensive audit and logging (SOX)
• Can help meet industry requirements such as PCI and HIPAA
• Support for latest security standards and toolkits (FIPS, NIST SP800-131a)
Compliance with Regulatory Requirements
20. Sterling Connect:Direct Customer Reference
Sterling Connect:Direct provides the sheer capacity of
transfer rates that simply cannot be done manually, and
performs such tasks in a security-enhanced or security-
rich manner; efficiently, and quickly.
Scalability helping ensure Kookmin would be able to
handle peak demand and keep pace with volume growth.
Satisfies regulatory and industry requirements.
For Kookmin to remain competitive they needed to be
able to reallocate assets from an IT focus to a customer
focus and implement a system that will shift toward a
multi-specialist strategy of approaching customers.
They decided to implement Sterling Connect:Direct from
IBM for its ability to transfer high volumes and large files
with no defined limits on file sizes.
The scalability helped ensure that Kookmin would be
able to handle peak demand and keep pace as their
volume grew.
Customer Profile
Kookmin Bank merged with Housing &
Commercial Bank in 2001, making it the largest
bank by both asset value and market
capitalization in South Korea. Private banking
was launched late last year at Kookmin
in order to shift away from the company’s
traditional universal banking approach.
Challenge
Results
Solution
21. Trading Partner
Integrating IBM Sterling Connect:Direct and IBM
MQ MFT
MFT
Audit
Agent
IBM MQ
Agent Agent
C:D
Bridge
Agent
C:D
Node
C:D
Node
C:D
Node
C:D
Node
C:D
Audit
Reference
Inside the MFT audit trail…
The audit information for each MFT transfer
references related C:D audit information
The Connect:Direct Bridge
capability supports managed file
transfers that span MFT and
C:D with a joined up audit trail
22. Bridging MQ and C:D networks at a large publisher
Solution architecture for a large publisher using the C:D bridge as a way to consolidate its IT
infrastructure while still retaining the communication protocols used to communicate with
partners
MQ
Pain Points
Existing solution is a hodgepodge of
different data transports from different
vendors
Difficult to integrate existing applications,
built on MQ messaging, with file data
arriving from business partners
IBM’s MFT suite helps
Bridge the MQ and C:D environments
Leverage existing MQ skills and investment
Message-to-file and file-to-message
End-to-end visibility of files and messages
Modernize batch applications
Modernize MFT with RESTful Web 2.0
interfaces
Internal connectivity standardized
on an MQ-backbone
Existing MQ applications
Customer #1
Customer #2
Customer #n
…
C:D bridge
Customers
request that
publications
can be
submitted to
the publisher
via the C:D
protocol
Publisher
23. IBM offers comprehensive MFT Capabilities
IBM MQ Managed File Transfer provides file
transfer optimized for data delivery across
WebSphere MQ networks
Sterling Connect Direct provides peer-to-peer file
transfer optimized for data delivery within and
between enterprises across Connect:Direct
protocol
Sterling Control Center Manage file transfer
activity across your file transfer servers including
Connect:Direct, FTP, MQ MFT and Sterling File
Gateway
Addressing multiple use cases and scenarios for both internal and multi-enterprise file transfer
24. IBM® Sterling Control Center
Delivering higher levels of service for key integration and transfer services
What it does
• Consolidated logging, reporting, and analytics for all transfers and integration
processes
• Rule-driven service level management
• Alerts and notifications
• Configuration management
How it is delivered
• Java-based solution for management and visibility of the file transfer and B2B
integration infrastructure
• Engine, agents, and user consoles
• Interfaces to existing system management tools
25. IBM® Sterling Control Center
What it allows customers to do
• Have visibility into all file transfer activity including Sterling Connect:Direct and
IBM MQ MFT from a central console
• React to transfer events before they impact SLAs
• Easily provide compliance reporting and mobile monitoring
• Central configuration management for Sterling Connect:Direct® servers
How do I know I need it?
• Increasing numbers of transfers or B2B interactions are governed by SLAs
• Increasing compliance, governance and audit requirements
• Pressure to decrease IT operational cost for B2B or file transfer operations
What differentiates IBM Sterling?
• Product specific knowledge of file transfer events, business processes and SLAs
to build rules around
• Access from mobile devices
• Scale and performance – test environment with moderately-sized hardware
performed well with 5K servers producing 540K processes and 4.3M events
per day
26. IBM® Sterling Control Center value opportunity
Improved service level achievement
• Reduced fines due to missed SLA s
• Improved customer retention and reputation risk by proactively
addressing issues before an outage is declared
Improved operational efficiencies
• Reduced support costs though centralization
• Reduced support costs by reducing platform specific staff
• Reduce troubleshooting costs for B2B transfers by 90+%*
• Reduce average cost per transfer to troubleshoot to $.0392*
Auditability
• Reduced support costs tracking who-what-when
• Policy management helps proactively identify non-compliance
• Minimize fines by complying with privacy and SOX regulations
1Data points referenced in this presentation represent findings from an internal IBM Sterling research study - December 10, 2009
27. • Separate file processing and monitoring
• Visibility and notifications
• Secure connections
• Integration with enterprise management systems
• Separate file processing and monitoring
• Visibility and notifications
• Secure connections
• Integration with enterprise management systems
Enable good monitoring
practices
• Processes & process steps
• File transfers, inbound and outbound
• Complex monitoring scenarios
• Environment health , including for clusters
• Processes & process steps
• File transfers, inbound and outbound
• Complex monitoring scenarios
• Environment health , including for clusters
Provide visibility and
monitoring
• Centralized configuration audit information
• Single console to maintain all Connect:Direct
configs
• Centralized configuration audit information
• Single console to maintain all Connect:Direct
configs
Ensure compliance and
respond to audits
• Ad-hoc and scheduled reports
• Interoperability with 3rd party reporting tools
• Web console and mobile app
• Ad-hoc and scheduled reports
• Interoperability with 3rd party reporting tools
• Web console and mobile app
Track and publicize
results
Deliver higher levels of service with IBM Sterling
Control Center
28. IBM offers comprehensive MFT Capabilities
IBM MQ Managed File Transfer provides file
transfer optimized for data delivery across IBM MQ
networks.
Sterling Connect Direct provides peer-to-peer file
transfer optimized for data delivery within and
between enterprises across Connect:Direct
protocol
Sterling Control Center Manage file transfer
activity across your file transfer servers including
Connect:Direct, FTP, MQ MFT and Sterling File
Gateway
Addressing multiple use cases and scenarios for both internal and multi-enterprise file transfer
Available together today as WebSphere Managed File Transfer, or as
Sterling Connect:Direct Advanced. These entitlements are also combined
inside the IBM MQ Advanced offering
29. Proven to Meet the Most Demanding Business Requirements
Over 30 years of experience working with the world’s largest businesses
Over 4,700 customers – top 10 banking and financial services firms
File transfer backbone of the banking sector, processing billions of transactions each year
Comprehensive MFT Suite for Complete Range of Use Cases
Internal and external transport for automated and ad hoc file transfers
Integration of files with enterprise applications, services, and systems
Universal Connectivity, Dynamic Community, End-to-End Visibility
Interoperability between file transfer styles to enable seamless flow of data
Broad set of protocols, i.e. HTTP/S, FTP/, SFTP, C:D, MQ, AS1/2/3, EDI, EBICS, RosettaNet, etc.
Tight integration with ESB style of integration
Built on the Most Modern Technologies
Application of J2E, ESB, SOA, SOAP, Web Services, REST, AJAX, etc.
Leverages your existing skills and investments
Superior Consulting and Professional Services Expertise
Experienced in building MFT centers of excellence providing guidance in MFT best practices
Global deployment experience across industries
5/1/2014 IBM Confidential
IBM’s commitment to Managed File Transfer (MFT)
30. IBM has a 20 year track record of innovation in
Messaging
1990s 2000s 2010s
JMS
MQI
Assured
delivery
IBM
MQSeries
Multi-platform
Mobile
.NET
Common criteria
Eclipse
JMS 1.1
RCMS
IBM MQ
Low
Latency
V1.1
V2
V5
V5.1
V5.3
V2.1
V5.2
V6
V7
V7.0.1
SSL
SOAP
XML
IBM MQ
Managed File
Transfer
IBM
MQTT
HTTP
AJAX
REST
Web 2.0
Managed
File Transfer
Pub/sub
IBM MQ
Everyplace
IBM MQ
Advanced
Message
Security
V7.1
V7.5
Integrated
Messaging
Hypervisors
IBM MQ
Advanced
System Pattern
Application Pattern
IBM MQ
Advanced for
Developers
IBM
MessageSight
Multiple cluster
XMIT queue
Multi-instance
QMGR
IBM MQ
Low
Latency
V8
33. We Value Your Feedback
Don’t forget to submit your Impact session and speaker
feedback! Your feedback is very important to us – we use it to
continually improve the conference.
Use the Conference Mobile App or the online Agenda Builder to
quickly submit your survey
• Navigate to “Surveys” to see a view of surveys for sessions
you’ve attended
32