The document provides an overview of integration challenges in the investment banking technology space. It discusses the need for solutions that can address the front, middle, and back office across business lines. It then covers basics of integration including transport and data integration. Specific challenges with persisting complex data models and the argument for distributed architectures are summarized.
Best Practices in Migrating to MySQL - Part 1Ronald Bradford
This presentation to the Federal Government sector was a follow up on my successful "MySQL for the Oracle DBA Bootcamp". Best Practices in Migrating to MySQL was a focus on software applications running on Oracle and Microsoft SQL Server database products. Topic in this 4 hr workshop included:
1. Reasons to migrate to MySQL
2. Ideal application candidates
3. Migration process overview
4. Migration assistance tools
5. Specific migration issues
6. Ideals for minimizing future migrations
7. General MySQL Information
How nonprofits can build more community engagement by using a social media strategy based on Nonprofit Marketing Guide's Three Gs: Be Genuine, Generous, and Grateful.
This version was presented at the Philanthropy Midw
Horizontal Leadership Managing Change And ComplexityGunnar Westling
Often, complex challenges tend to fall between stools. Thus, to successfully cope with such challenges, you have to lead horizontally across internal and external boundaries.
Best Practices in Migrating to MySQL - Part 1Ronald Bradford
This presentation to the Federal Government sector was a follow up on my successful "MySQL for the Oracle DBA Bootcamp". Best Practices in Migrating to MySQL was a focus on software applications running on Oracle and Microsoft SQL Server database products. Topic in this 4 hr workshop included:
1. Reasons to migrate to MySQL
2. Ideal application candidates
3. Migration process overview
4. Migration assistance tools
5. Specific migration issues
6. Ideals for minimizing future migrations
7. General MySQL Information
How nonprofits can build more community engagement by using a social media strategy based on Nonprofit Marketing Guide's Three Gs: Be Genuine, Generous, and Grateful.
This version was presented at the Philanthropy Midw
Horizontal Leadership Managing Change And ComplexityGunnar Westling
Often, complex challenges tend to fall between stools. Thus, to successfully cope with such challenges, you have to lead horizontally across internal and external boundaries.
No, not Frodo. His will shredded like wet toilet paper. Gollum took the lava bath, destroyed the ring, and saved everyone from a 36" Dark Lord. Does he get any credit? Nooooooo. Nine-fingered Frodo is the hero. The ladies all swoon at Legolas and Aragorn. But not poor Gollum.
Internet marketers, and SEOs in particular, are a lot like Gollum: We're shunned. We don't get much sunlight. Our diet is awful. And we never get the credit for business success.
It's our fault. We're good at building rankings and building traffic. But we're terrible at demonstrating the value of our work. So we fling ourselves into the lava. Every single time.
No, not Frodo. His will shredded like wet toilet paper. Gollum took the lava bath, destroyed the ring, and saved everyone from a 36" Dark Lord. Does he get any credit? Nooooooo. Nine-fingered Frodo is the hero. The ladies all swoon at Legolas and Aragorn. But not poor Gollum.
Internet marketers, and SEOs in particular, are a lot like Gollum: We're shunned. We don't get much sunlight. Our diet is awful. And we never get the credit for business success.
It's our fault. We're good at building rankings and building traffic. But we're terrible at demonstrating the value of our work. So we fling ourselves into the lava. Every single time.
This presentation discusses Mule ESB and how to simplify integration. It briefly mentions a brief history of integration, information silos, SOA. It also highlights several integration patterns.
How real-time computing will transform supply chain decision-making
This presentation will provide a plain-English account of how real-time computing will transform supply chain decision-making and control. Peter Evans-Greenwood will illustrate the emerging leading practices with lessons learned from case studies, featuring clients across the globe.
The biggest challenge for today's supply chains is to be adaptive. While tremendous gains have been made over the last thirty years, today's applications are not as flexible as promised. New tools and techniques are required to capture and automate the non-linear, exception-rich, business logic that we currently rely on employees to deliver. Extending the technology stack will allow us to leverage the higher capacity of technology to deliver globally optimal solutions and to introduce innovations such as the moving warehouse into all our supply chains.
The Java Evolution Mismatch by Gil Tene, CTO at Azul SystemszuluJDK
The Java Evolution Mismatch by Gil Tene, CTO at Azul Systems
In this presentation, Azul Systems' CTO Gil Tene explains how the Java runtime platform eliminates the evolution mismatch and allows enterprises to consistently and reliably power their applications, making full use of modern server capabilities.
http://www.zuluJDK.org
http://www.azulsystems.com
@zuluJDK.org
The Java Evolution Mismatch - Why You Need a Better JVMAzul Systems Inc.
Functionality is great, but what about performance? Java started life as a toy platform and quickly became an enterprise tool. Early on, evolution in performance and scalability went hand in hand with functionality improvements. However, virtually all subsequent improvements to the Java platform were in features and scope, with basic performance remaining largely unchanged. The result is that modern Java apps are powerful and flexible, but their performance can be iffy. Application instances now have a hard time consuming even a small fraction of entry level modern servers without incurring unacceptable and detrimental effects. In this presentation, Azul CTO Gil Tene explains how the Zing Java runtime platform eliminates the evolution mismatch and allows enterprises to consistently and reliably power their applications, making full use of modern server capabilities.
Infrastrukturen til fremtidens løsninger
Kravene til din kablede infrastruktur øges hele tiden på grund af nye hastigheder og nye applikationer. Hastigheder på 10/40 Gbit Ethernet på kobber og 40/100/400 Gbit på fiber stiller krav til din installationen på samme måde som nye applikationer gør det. Det er bl.a. applikationer som Distribueret sensor netværk og LED belysning, indendørs mobildækning og nye PoE over WLAN standarder samt bygningsstyring.
(How) Does VA Smalltalk fit into today's IT landscapes?Joachim Tuchel
This talk gives a brief overview of today's most imprtant IT Trends, from rich client and rich internet applications to Web Services. Joachim Tuchel shows how VA Smalltalk and it's existing and upcoming features help developers integrate new and existing VA Smalltalk applications into these architectures.
This presentation was given by Joachim Tuchel at the VA Smalltalk Forum Europe 2008 in Frankfurt am Main.
JAX London 2015 - Architecting a Highly Scalable EnterpriseC24 Technologies
At JAX London, John took attendees on a journey where he explained that developers and architects need to consider the fundamentals if they want to design a truly scalable enterprise. That includes understanding the importance of network throughput, packet size, memory allocation and read write speeds. Only then can businesses deliver on a highly scalable architecture for a real-time data-driven future.
Similar to John Davies Last Minute Fill In For Sick Speaker (20)
The 10 Most Influential Leaders Guiding Corporate Evolution, 2024.pdfthesiliconleaders
In the recent edition, The 10 Most Influential Leaders Guiding Corporate Evolution, 2024, The Silicon Leaders magazine gladly features Dejan Štancer, President of the Global Chamber of Business Leaders (GCBL), along with other leaders.
Understanding User Needs and Satisfying ThemAggregage
https://www.productmanagementtoday.com/frs/26903918/understanding-user-needs-and-satisfying-them
We know we want to create products which our customers find to be valuable. Whether we label it as customer-centric or product-led depends on how long we've been doing product management. There are three challenges we face when doing this. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.
In this webinar, we won't focus on the research methods for discovering user-needs. We will focus on synthesis of the needs we discover, communication and alignment tools, and how we operationalize addressing those needs.
Industry expert Scott Sehlhorst will:
• Introduce a taxonomy for user goals with real world examples
• Present the Onion Diagram, a tool for contextualizing task-level goals
• Illustrate how customer journey maps capture activity-level and task-level goals
• Demonstrate the best approach to selection and prioritization of user-goals to address
• Highlight the crucial benchmarks, observable changes, in ensuring fulfillment of customer needs
Premium MEAN Stack Development Solutions for Modern BusinessesSynapseIndia
Stay ahead of the curve with our premium MEAN Stack Development Solutions. Our expert developers utilize MongoDB, Express.js, AngularJS, and Node.js to create modern and responsive web applications. Trust us for cutting-edge solutions that drive your business growth and success.
Know more: https://www.synapseindia.com/technology/mean-stack-development-company.html
Top mailing list providers in the USA.pptxJeremyPeirce1
Discover the top mailing list providers in the USA, offering targeted lists, segmentation, and analytics to optimize your marketing campaigns and drive engagement.
Navigating the world of forex trading can be challenging, especially for beginners. To help you make an informed decision, we have comprehensively compared the best forex brokers in India for 2024. This article, reviewed by Top Forex Brokers Review, will cover featured award winners, the best forex brokers, featured offers, the best copy trading platforms, the best forex brokers for beginners, the best MetaTrader brokers, and recently updated reviews. We will focus on FP Markets, Black Bull, EightCap, IC Markets, and Octa.
3.0 Project 2_ Developing My Brand Identity Kit.pptxtanyjahb
A personal brand exploration presentation summarizes an individual's unique qualities and goals, covering strengths, values, passions, and target audience. It helps individuals understand what makes them stand out, their desired image, and how they aim to achieve it.
B2B payments are rapidly changing. Find out the 5 key questions you need to be asking yourself to be sure you are mastering B2B payments today. Learn more at www.BlueSnap.com.
Event Report - SAP Sapphire 2024 Orlando - lots of innovation and old challengesHolger Mueller
Holger Mueller of Constellation Research shares his key takeaways from SAP's Sapphire confernece, held in Orlando, June 3rd till 5th 2024, in the Orange Convention Center.
Company Valuation webinar series - Tuesday, 4 June 2024FelixPerez547899
This session provided an update as to the latest valuation data in the UK and then delved into a discussion on the upcoming election and the impacts on valuation. We finished, as always with a Q&A
Implicitly or explicitly all competing businesses employ a strategy to select a mix
of marketing resources. Formulating such competitive strategies fundamentally
involves recognizing relationships between elements of the marketing mix (e.g.,
price and product quality), as well as assessing competitive and market conditions
(i.e., industry structure in the language of economics).
LA HUG - Video Testimonials with Chynna Morgan - June 2024Lital Barkan
Have you ever heard that user-generated content or video testimonials can take your brand to the next level? We will explore how you can effectively use video testimonials to leverage and boost your sales, content strategy, and increase your CRM data.🤯
We will dig deeper into:
1. How to capture video testimonials that convert from your audience 🎥
2. How to leverage your testimonials to boost your sales 💲
3. How you can capture more CRM data to understand your audience better through video testimonials. 📊
16. We can scale through distribution
• 100 Problems to solve?
• Send them to 100 machines!
• Serialise every object, send it over the network and then de-
serialise it again on the other side
• Good, we can scale but what about all that object serialisation?
• What about queries over distributed data
• Good if we can distribute the query but a real pain of the query doesn’t match the
distribution slice
• Dynamic load balancing can also be a pain
• When we move to a distributed system we take a hit with
the serialisation
17. Distributed vs. Single VM
• Throughput on a single VM on a 2-core box vs. the same
application distributed (unintelligently) on 4 2-core boxes
• x = number of threads (one thread uses roughly 100% of one core)
• y = throughput scaled to 100 being 1 core fully used
400
300
200
100
0
1 2 3 4 5 6 7 8
Single VM Distributed
18. Java vs. C/C++
• Most (80-85%) of banking applications are written in
Java
• The remaining languages include C & C++, Perl, C#,VB
• C and C++ still play a serious role in high performance
applications
• It’s not that it’s faster than Java, it’s just more predictable - no GC
• Java’s lack of “real time” is its biggest hindrance in HPC
• BEA and Sun have “real time” version but they are still a long way off
what we need
• 5ms to run the GC is still too long, today we’re struggling to get
under 20ms
19. A Derivatives Matching Engine - Example
• Extremely complex derivatives, in FpML need matching as
they come back from the DTCC
• Using ORM (Hibernate, iBatis etc.) is way too complex
• A database is too slow for transient data
• Put the trades into memory and match them using XPath
expressions
• 2 sets of 200,000 trades of roughly 15k each that’s 6 GBytes minimum
• Remember the GC problem and the serialisation delay?
• There’s really only one obvious solution to remain in the
market at this level
20. JavaSpaces
• While Azul can provide impressive acceleration to JEE
application servers to me that’s like putting nitro-injection
into a bus
• It will go faster but you need a lot of power to get it going in the first place
• JavaSpaces provide a much better platform for this level of
scalability
• JavaSpaces is part of Jini (from Sun) and is in fact older than JEE
• Blitz - Open source JavaSpaces implementation
• GigaSpaces
• Provides the perfect implementation of Master-Worker
pattern
21. Writing to the Space
DTCC
Input
GigaSpaces Grid
Bank
Input
• Strings from of data are inserted into the space, a local (pass
by reference) operation
• This requires relatively little complexity, just basic ESB
functionality
22. Matching
Matching
Worker
GigaSpaces Grid
• Now the clever bit
• Strings are read out of the Space and converted to Objects using IONA’s Artix Data
Services (formally C24’s Integration Objects) - This provides Java-Binding
functionality beyond XML such as CSVs, SWIFT, FIX etc. with full XPath 2.0
• The Object is assigned a matching template and the matching pair is sought
• Once the match is found (now of later) an event is kicked off
23. Output
Matched
GigaSpaces Grid Events
• This is relatively simple again
• The output is usually driven by events from matched pairs
• Results are usually written to a database but as XML not as an ugly relational entry
• The Output(s) sinks can be running in the same VM and once again the passing of the
data is by reference and not through serialisation (as in JMS or remote EJBs)
24. Another one of today’s problems
• Messages are more and more complex
• ISO-20022 and FpML
• Increasing volumes out strip Moore’s law
• Banks now ask for 100,000 per second on the trading floor
• Bad trading days can triple (3x) daily volumes
• Bad days used to be 2x but recent stock market “blips” have
produced 3x volumes
• New initiatives from regulatory bodies (i.e. European
Commission) add extra requirements, many of them
verging on the impossible
• MiFID, SEPA
25. SWIFT
• SWIFT is 3 things, a secure network, a
standards body and a connectivity provider
• It is used by over 8,000 banks (>80,000 nodes), in
over 200 countries handling over 15 million messages
a day (>2 billion/year)
• Mostly payments and securities, Europe is >65% of
the volume
• SWIFT is over 30 years old, has a systems availability
of 99.986% ( <1½ minutes/week) , they’ve NEVER
lost a message
• The figures are impressive but the messages are a
bastard!
• Around 330 types of message
• Over 400 complex types used in the messages
• Over 1000 complex validation rules
26. The SWIFT message
{1:F01DRESGB2LAXXX0548034693}{2:I541DRESDEFFXXXXN2}{3:{108:MT541}}{4:
:16R:GENL
:20C::SEME//FRTJ123REC2
:23G:NEWM
:16S:GENL
:16R:TRADDET
:98A::TRAD//20000519
:98A::SETT//20000524
:90A::DEAL//PRCT/101,001283
:35B:ISIN GB0987654321
•
:16S:TRADDET
This is one of the simpler messages
:16R:FIAC
:36B::SETT//FAMT/4000000,
:97A::SAFE//222S
:16S:FIAC
•
:16R:SETDET
:22F::SETR//TRAD
:16R:SETPRTY
It’s easy to parse into strings but there are
:95P::SELL//DEUTDEFF
:16S:SETPRTY
complex rules about how the fields relate to
:16R:SETPRTY
:95R::DEAG/CRST/456 one another
:16S:SETPRTY
•
:16R:SETPRTY
:95R::REAG/CRST/123
:16S:SETPRTY Constructing the message might also seem
simple but get it wrong and SWIFT will fine
:16R:SETPRTY
:95P::RECU//DRESDEFF
:16S:SETPRTY
:16R:SETPRTY
:95P::BUYR//MGTCDE55
you, big-time!
:97A::SAFE//111S
:16S:SETPRTY
:16R:SETPRTY
:95P::PSET//CRSTGB22
:16S:SETPRTY
:16R:AMT
:19A::SETT//GBP4047151,3
:16S:AMT
:16S:SETDET
-}
27. SWIFT MT to MX
• SWIFT are moving to XML, it’s based on ISO-20022
• ISO-20022 is not a message definition but a framework for creating
standards - it contains metadata
• Virtually every bank on the planet will have to migrate
their systems from “old” MT format (previous slide) to
new ISO-20022 messages
• To add to the pressure SEPA (Single European Payments
Area) initiative uses parts of ISO-20022
• This will happen sooner than SWIFT MX messages
• ISO-20022 is becoming a very important standard in the
banking world
28. A large client...
• This is the logical architecture of a large European
clearing house
• Most of the hard work is in transformation and
enrichment
29. High Performance Transformation
• Banks need a migration plan, SWIFT MT to SWIFT MX
and visa-versa
• The task is complex and the volumes can be large
• One message transformation alone has been estimated to take over
6 man-months coded by hand, there are over 300 messages in total
• Larger banks have around 2 million messages to
transform a day
• Windows can be short though, frequently batches of >100,000 arrive
and need to be out within 15 minutes
30. How we do it
• We use Java-binding
• We model the SWIFT message as if it were XML
• We have a customised parser that reads SWIFT
• It’s not looking for the < and > but for other character indicators
• Like JAXB, JIBX or Castor we now have complex Java
Beans that exactly represent the original SWIFT
message
• Apply some clever transformation and some
enrichment to this and the job is done
• Processed messages are stored in a database
31. Transformation
• Transformation needs a lot of business experience, the
section below is a “function” within a larger transform
32. The flow...
1. Message arrives on MQ from the SWIFT gateway
2. Into a Mule connector
3. Messages are routed and potentially load-balanced
4. Messages are parsed, transformed, enriched in the grid
• This is done using IONA’s Artix Data Services (ADS)
5. Finally transformed messages are loaded into a database
33. Scaling
• This is where GigaSpaces comes in...
• It adds a Spring 2 based container with huge scalability
34. Scaling
• This is where GigaSpaces comes in...
• It adds a Spring 2 based container with huge scalability
SWIFT
35. Scaling
• This is where GigaSpaces comes in...
• It adds a Spring 2 based container with huge scalability
SWIFT Mule
36. Scaling
• This is where GigaSpaces comes in...
• It adds a Spring 2 based container with huge scalability
SWIFT Mule
SWIFT
JavaSpace
37. Scaling
• This is where GigaSpaces comes in...
• It adds a Spring 2 based container with huge scalability
ADS
Worker
SWIFT Mule
SWIFT
JavaSpace
38. Scaling
• This is where GigaSpaces comes in...
• It adds a Spring 2 based container with huge scalability
ADS
Worker
SWIFT Mule
SWIFT
20022.xml
JavaSpace
39. Scaling
• This is where GigaSpaces comes in...
• It adds a Spring 2 based container with huge scalability
ADS
Worker
SWIFT Mule
SWIFT
20022.xml Mule
JavaSpace
40. Scaling
• This is where GigaSpaces comes in...
• It adds a Spring 2 based container with huge scalability
ADS
Worker ADS
Worker
SWIFT Mule
SWIFT
20022.xml Mule
JavaSpace
41. Scaling
• This is where GigaSpaces comes in...
• It adds a Spring 2 based container with huge scalability
ADS
Worker ADS
Worker
SWIFT Mule
SWIFT 20022.xml
SWIFT
SWIFT 20022.xml Mule
JavaSpace
20022.xml
20022.xml
SWIFT 20022.xml
SWIFT
SWIFT
20022.xml
42. Scaling
• This is where GigaSpaces comes in...
• It adds a Spring 2 based container with huge scalability
ADS
Worker ADS
Worker
SWIFT Mule
SWIFT 20022.xml
SWIFT
SWIFT 20022.xml Mule
JavaSpace
20022.xml
20022.xml
SWIFT 20022.xml
SWIFT
SWIFT
20022.xml
ADS
Worker ADS
ADS Worker
ADS
Worker Worker
43. Linear scalability
• The graph below is actual data from Azul after scaling
the number of threads on a 192 core box
• x axis is the number of worker threads
• y axis is SWIFT messages/second on the vega2 CPU
35000
31500
28000
24500
21000
17500
14000
10500
7000
3500
0
0 15 30 45 60 75 90 105 120 135 150