This document provides biographical information about Darach Eaves, including that he is currently the Chief Scientist at Push Technology and has previous experience at companies like Motorola, IONA, and JPMC. It notes that he has a BA and MSc in computer science from Trinity College Dublin.
Larry Smarr - Making Sense of Information Through Planetary Scale ComputingDiamond Exchange
"Brave New World" DiamondExchange
February 28 - March 3, 2009
Date: Sunday, March 1, 2009
Presenter: Larry Smarr
Presentation: Making Sense of Information Through Planetary Scale Computing
Lucene in the Cloud: Learn how GCE leveraged the power of search and Big Data...lucenerevolution
Presented by Seshu Simhadri | Global Computer Enterprises. See conference video - http://www.lucidimagination.com/devzone/events/conferences/lucene-revolution-2012
A leader in bringing innovative technologies to the Federal Government, GCE looks to open source tools to drive down cost and provide the foundation for building value-added services for its customers. This talk will discus GCE’s innovative use of Lucene/Solr combined with the GCE Big Data Cloud to open up access to Federal spending data. This data is in wide use across the Federal government, Federal contracting community, media and press, as well as Capitol Hill. GCE has utilized this toolset to deliver the type of capability that users typically only find in web consumer applications. This session will highlight the technical side of the challenge in implementing these tools across a large user community and data set in a Cloud environment.
- What is cloud computing; what are the economic implications for IT?
- Provide an Overview of the Windows Azure Platform and where it sits within “cloud computing”
- Azure and R&D usage scenarios
- How to get started with Azure
- Microsoft BizSpark
Larry Smarr - Making Sense of Information Through Planetary Scale ComputingDiamond Exchange
"Brave New World" DiamondExchange
February 28 - March 3, 2009
Date: Sunday, March 1, 2009
Presenter: Larry Smarr
Presentation: Making Sense of Information Through Planetary Scale Computing
Lucene in the Cloud: Learn how GCE leveraged the power of search and Big Data...lucenerevolution
Presented by Seshu Simhadri | Global Computer Enterprises. See conference video - http://www.lucidimagination.com/devzone/events/conferences/lucene-revolution-2012
A leader in bringing innovative technologies to the Federal Government, GCE looks to open source tools to drive down cost and provide the foundation for building value-added services for its customers. This talk will discus GCE’s innovative use of Lucene/Solr combined with the GCE Big Data Cloud to open up access to Federal spending data. This data is in wide use across the Federal government, Federal contracting community, media and press, as well as Capitol Hill. GCE has utilized this toolset to deliver the type of capability that users typically only find in web consumer applications. This session will highlight the technical side of the challenge in implementing these tools across a large user community and data set in a Cloud environment.
- What is cloud computing; what are the economic implications for IT?
- Provide an Overview of the Windows Azure Platform and where it sits within “cloud computing”
- Azure and R&D usage scenarios
- How to get started with Azure
- Microsoft BizSpark
Messaging becomes Data Distributions gets embedded event processing (not complex, made simple) - bending all the rules one benchmark at a time - Push Technology, Waratek and other things
The Windows Azure platform is a fairly feature rich environment. You can run your web applications there. You can run your data processing applications (services) there. But you don’t have to run your entire application there. You can run part of your application in “the cloud”, and part of your application on premise – giving you the best of both worlds. But why would you not put everything in the cloud? Perhaps you don’t need the massive computing power Windows Azure provides, but you would like a cheap an easily accessible data store. Maybe your application just isn’t ready, yet, to be run in the cloud. Whatever the reason, in this session you will learn the basics for creating a hybrid application which leverages various features of Windows Azure. You will see how to leverage Windows Azure’s rich features and APIs to extend your application to new heights.
Achieving genuine elastic multitenancy with the Waratek Cloud VM for Java : J...JAX London
John Matthew Holt, Waratek CTO, explains how Waratek Cloud VM for Java transforms the JVM with key Cloud characteristics including genuine multitenancy, granular elasticity, instant scalability, realtime metering and prioritization of resources by application, to futureproof your Java investment in the age of Cloud computing.
In this presentation we review the internal components of the SQL Azure Platform.
Regards,
Ing. Eduardo Castro Martinez, SQL Server MVP
http://comunidadwindows.org
http://ecastrom.blogspot.com
In this presentation we present SQL Azure under the hood, we explore the internal componentes and process involved in the SQL Azure Platform.
Regards
Ing. Eduardo Castro, SQL Server MVP
http://comunidadwindows.org
http://ecastrom.blogspot.com
This classic talk from 2002-03, captures some of the key traffic engineering and core network design strategies deployed by carriers from the early 1990's to early 2000's, and (now, in 2011!) provides a great historical perspective on how network cores have evolved. It will prove valuable for those looking to understand network evolution, and the operational principles and considerations behind it...
Jamie Clark's preso on cloud computing and legal issues at the OASIS International Cloud Symposium (#intcloudsymp) at Ditton Manor, Windsor, UK, October 2011
What is Cloud Computing? It can be defined as a web-based technology that remotely delivers computing resources, namely hardware, software and information as services over a network. Learn more about it here. http://www.microsoft.com/en-in/server-cloud/cloud-computing/default.aspx
Messaging becomes Data Distributions gets embedded event processing (not complex, made simple) - bending all the rules one benchmark at a time - Push Technology, Waratek and other things
The Windows Azure platform is a fairly feature rich environment. You can run your web applications there. You can run your data processing applications (services) there. But you don’t have to run your entire application there. You can run part of your application in “the cloud”, and part of your application on premise – giving you the best of both worlds. But why would you not put everything in the cloud? Perhaps you don’t need the massive computing power Windows Azure provides, but you would like a cheap an easily accessible data store. Maybe your application just isn’t ready, yet, to be run in the cloud. Whatever the reason, in this session you will learn the basics for creating a hybrid application which leverages various features of Windows Azure. You will see how to leverage Windows Azure’s rich features and APIs to extend your application to new heights.
Achieving genuine elastic multitenancy with the Waratek Cloud VM for Java : J...JAX London
John Matthew Holt, Waratek CTO, explains how Waratek Cloud VM for Java transforms the JVM with key Cloud characteristics including genuine multitenancy, granular elasticity, instant scalability, realtime metering and prioritization of resources by application, to futureproof your Java investment in the age of Cloud computing.
In this presentation we review the internal components of the SQL Azure Platform.
Regards,
Ing. Eduardo Castro Martinez, SQL Server MVP
http://comunidadwindows.org
http://ecastrom.blogspot.com
In this presentation we present SQL Azure under the hood, we explore the internal componentes and process involved in the SQL Azure Platform.
Regards
Ing. Eduardo Castro, SQL Server MVP
http://comunidadwindows.org
http://ecastrom.blogspot.com
This classic talk from 2002-03, captures some of the key traffic engineering and core network design strategies deployed by carriers from the early 1990's to early 2000's, and (now, in 2011!) provides a great historical perspective on how network cores have evolved. It will prove valuable for those looking to understand network evolution, and the operational principles and considerations behind it...
Jamie Clark's preso on cloud computing and legal issues at the OASIS International Cloud Symposium (#intcloudsymp) at Ditton Manor, Windsor, UK, October 2011
What is Cloud Computing? It can be defined as a web-based technology that remotely delivers computing resources, namely hardware, software and information as services over a network. Learn more about it here. http://www.microsoft.com/en-in/server-cloud/cloud-computing/default.aspx
Slides from my talk at Philly ETE looking at the Lambda Architecture (originating at twitter) critically from the perspective of someone viewing it from the financial (faster, higher volume, spikier data) domain
StreamBase - Embedded Erjang - Erlang User Group London - 20th April 2011darach
A presentation delivered to the Erlang User Group in London demonstrating how to embed the erjang implementation of erlang into the StreamBase CEP engine, enabling extending StreamBase with erlang based extensions.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
"Impact of front-end architecture on development cost", Viktor TurskyiFwdays
I have heard many times that architecture is not important for the front-end. Also, many times I have seen how developers implement features on the front-end just following the standard rules for a framework and think that this is enough to successfully launch the project, and then the project fails. How to prevent this and what approach to choose? I have launched dozens of complex projects and during the talk we will analyze which approaches have worked for me and which have not.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Accelerate your Kubernetes clusters with Varnish Caching
EFL Munich - February 2013 - "Conversational Big Data with Erlang"
1. EFL
Munich
February
2013
Copyright
Push
Technology
2012
2. • Distributed
Systems
/
HPC
guy.
• Chief
Scien*st
:-‐
at
Push
Technology
• Alumnus
of
:-‐
Motorola,
IONA,
BeOair,
JPMC,
StreamBase.
• School:
Trinity
College
Dublin.
-‐
BA
(Mod).
Comp.
Sci.+
-‐
M.Sc.
Networks
&
Distributed
Systems
• Responds
to:
Guinness,
Whisky
About
me?
Copyright
Push
Technology
2012
Darach@PushTechnology.com
3. Conversa[onal
Big
Data
with
Copyright
Push
Technology
2012
4. Big
Data.
The
most
important
V
is
Value.
• 4Vs:
• Volume
• “It’s
the
connec[ons
• Velocity
that
ma`er
most”
• Variety
-‐
David
Evans,
Cisco
• Variability
Copyright
Push
Technology
2012
8. Conversa[ons
M2M
M2H
Tradi[onal
Messaging
Bidirec[onal
Real
MQTT,
AMQP
Time
Data
Distribu[on
WebSockets
W3C
Server
Sent
Events
Copyright
Push
Technology
2012
9. Tradi[onal
Messaging
A
B
ba
bb
Producers ? Consumers
Pros
Cons
• Loosely
coupled.
• No
data
model.
Slinging
blobs
• All
you
can
eat
messaging
pa`erns
• Fast
producer,
slow
consumer?
Ouch.
• Familiar
• No
data
‘smarts’.
A
blob
is
a
blob.
Copyright
Push
Technology
2012
10. Invented
yonks
ago…
Before
the
InterWebs
For
‘reliable’
networks
For
machine
to
machine
Remember
DEC
Message
Queues?
-‐
That
basically.
Vomit!
Copyright
Push
Technology
2012
11. When
fallacies
were
simple
- The
network
is
reliable
- Latency
is
zero
- Bandwidth
is
infinite
- There
is
one
administrator
- Topology
does
not
change
- The
network
is
secure
- Transport
cost
is
zero
- The
network
is
homogeneous
Copyright
Push
Technology
2012
12. Then
in
1992,
this
happened:
The
phrase
‘surfing
the
internet’
was
coined
by
Jean
Poly.
First
SMS
sent
First
base.
Copyright
Push
Technology
2012
13. It
grew,
and
it
grew
Copyright
Push
Technology
2012
14. Then
in
2007,
this
happened:
The
god
phone:
Surfing
died.
Touching
happened.
Second
base
unlocked.
Copyright
Push
Technology
2012
15. Then
in
2007,
this
happened:
So
we
took
all
the
things
and
put
them
in
the
internet:
Cloud
happened.
So
we
could
touch
all
the
things.
Messaging
Apps
They
grew
and
they
grew
like
all
the
Hardware
good
things
do.
Virtualize
all
the
things
Services
Skills,
Special[es
Copyright
Push
Technology
2012
16. Then
in
2007,
this
happened:
And
it
grew
and
it
grew.
Like
all
the
good
things
do.
Messaging
Apps
Hardware
Virtualize
all
the
things
Services
Skills,
Special[es
Copyright
Push
Technology
2012
17. So
we
scaled
all
the
things
Big
data
is
fundamentally
about
extrac[ng
value,
understanding
implica[ons,
gaining
insight
so
we
can
learn
and
improve
con[nuously.
It’s
nothing
new.
big
DATA
Copyright
Push
Technology
2012
18. But,
problem:
The
bird,
basically.
Immediately
Inconsistent.
But,
Eventually
Consistent
…
Maybe.
Humans
Are
grumpy
IIBECM
Copyright
Push
Technology
2012
19. Stop.
- The
network
is
not
reliable
nor
is
it
cost
free.
- Latency
is
not
zero
nor
is
it
a
democracy.
- Bandwidth
is
not
infinite
nor
predictable
especially
the
last
mile!
- There
is
not
only
one
administrator
trust,
rela[onships
are
key
- Topology
does
change
It
should,
however,
converge
eventually
- The
network
is
not
secure
nor
is
the
data
that
flows
through
it
- Transport
cost
is
not
zero
but
what
you
don’t
do
is
free
- The
network
is
not
homogeneous
nor
is
it
smart
Copyright
Push
Technology
2012
20. Look.
- What
and
How
are
what
geeks
do.
- Why
gets
you
paid
- Business
Value
and
Trust
dictate
What
and
How
-
Policies,
Events
and
Content
implements
Business
Value
- Science
basically.
But
think
like
a
carpenter:
- Measure
twice.
Cut
once.
Copyright
Push
Technology
2012
21. Listen.
-
Every
nuance
comes
with
a
set
of
tradeoffs.
-
Choosing
the
right
ones
can
be
hard,
but
it
pays
off.
-
Context,
Environment
are
cri[cal
-
Break
all
the
rules,
one
benchmark
at
a
[me.
-
Benchmark
Driven
Development
Copyright
Push
Technology
2012
22. Ac[on:
Data
Distribu[on
Messaging
remixed
around:
Relevance
-‐
Queue
depth
for
conflatable
data
should
be
0
or
1.
No
more
Responsiveness
-‐
Use
HTTP/REST
for
things.
Stream
the
li`le
things
Timeliness
-‐
It’s
rela[ve.
M2M
!=
M2H.
Context
-‐
Packed
binary,
deltas
mostly,
snapshot
on
subscribe.
Environment-‐
Don’t
send
1M
1K
events
to
a
mobile
phone
with
0.5mbps.
Copyright
Push
Technology
2012
23. Ac[on.
Virtualize
Client
Queues
A
B
ba
bb
Buffer
Producers Bloat
Consumers
Nuance:
Client
telemetry.
Tradeoff:
Durable
subscrip[ons
harder
Copyright
Push
Technology
2012
24. Ac[on.
Add
data
caching
A
B
ba x
bb x
Producers
Is it a Consumers
cache?
One
hop
closer
to
the
edge
…
Copyright
Push
Technology
2012
25. Ac[on.
Exploit
data
structure
A
B Snapshot Delta
ba x
bb x
Producers State! Consumers
Snapshot
recovery.
Deltas
or
Changes
mostly.
Conserves
bandwidth
Copyright
Push
Technology
2012
26. Ac[on.
Behaviors
A
B
ba x
bb x
X The
Producers
topic is Consumers
the
cloud!
Extensible.
Nuance?
Roll
your
own
protocols.
Tradeoff?
3rd
party
code
in
the
engine
:/
Copyright
Push
Technology
2012
27. Ac[on.
Structural
Confla[on
A
B
ba x
bb x
X
Producers
Current Consumers
data!
+
Ensures
only
current
+
consistent
data
is
distributed.
Ac[vely
soaks
up
bloat.
Extensible!
Copyright
Push
Technology
2012
33. Benchmark
Models
Box A Box B
Throughput
(Worst
case)
Latency
(Best
case)
• Ramp
clients
con[nuously
• Really
simple.
1
client
• 100
messages
per
second
per
client
• Ping
–
Pong.
Measure
RTT
[me.
• Payload:
125
..
2000
bytes
• Payload:
125
..
2000
bytes
• Message
style
vs
with
confla[on
Copyright
Push
Technology
2012
34. Throughput.
Non-‐conflated
• Cold
start
server
• Ramp
750
clients
‘simultaneously’
at
5
second
intervals
• 5
minute
benchmark
dura[on
• Clients
onboarded
linearly
un[l
IO
(here)
or
compute
satura[on
occurs.
• What
the
‘server’
sees
Copyright
Push
Technology
2012
35. Throughput.
Non-‐conflated
• What
the
‘client’
sees
• At
and
beyond
satura[on
of
some
resource?
• Things
break!
• New
connec[ons
fail.
Good.
• Long
established
connec[ons
ok.
• Recent
connec[ons
[meout
and
client
connec[ons
are
dropped.
Good.
• Diffusion
handles
smaller
message
sizes
more
gracefully
• Back-‐pressure
‘waveform’
can
be
tuned
out.
Or,
you
could
use
structural
confla[on!
Copyright
Push
Technology
2012
36. Throughput.
Replace-‐conflated
• Cold
start
server
• Ramp
750
clients
‘simultaneously’
at
5
second
intervals
• 5
minute
benchmark
dura[on
• Clients
onboarded
linearly
un[l
IO
(here)
or
compute
satura[on
occurs.
• Takes
longer
to
saturate
than
non-‐
conflated
case
• Handles
more
concurrent
connec[ons
• Again,
‘server’
view
Copyright
Push
Technology
2012
37. Throughput.
Replace-‐Conflated
• What
the
‘client’
sees
• Once
satura[on
occurs
Diffusion
adapts
ac[vely
by
degrading
messages
per
second
per
client
• This
is
good.
Soak
up
the
peaks
through
fairer
distribu[on
of
data.
• Handles
spikes
in
number
of
connec[ons,
volume
of
data
or
satura[on
of
other
resources
using
a
single
load
adap[ve
mechanism
Copyright
Push
Technology
2012
38. Throughput.
Stats
• Data
/
(Data
+
Overhead)?
• 1.09
GB/Sec
payload
at
satura[on.
• 10Ge
offers
theore[c
of
1.25GB/Sec.
• Ballpark
87.2%
of
traffic
represents
business
data.
• Benefits?
• Op[mize
for
business
value
of
distributed
data.
• Most
real-‐world
high-‐frequency
real-‐[me
data
is
recoverable
• Stock
prices,
Gaming
odds
• Don’t
use
confla[on
for
transac[onal
data,
natch!
Copyright
Push
Technology
2012
39. Latency
(Best
case)
• Cold
start
server
• 1
solitary
client
• 5
minute
benchmark
dura[on
• Measure
ping-‐pong
round
trip
[me
• Results
vary
by
network
card
make,
model,
OS
and
Diffusion
tuning.
Copyright
Push
Technology
2012
40. Latency.
Round
Trip
Stats
• Sub-‐millisecond
at
the
99.99%
percen[le
• As
low
as
15
microseconds
• On
average
significantly
sub
100
microseconds
for
small
data
Copyright
Push
Technology
2012
41. Latency.
Single
Hop
Stats
• Sub
500
microseconds
at
the
99.99%
percen[le
• As
low
as
8
microseconds
• On
average
significantly
sub
50
microseconds
for
small
data
Copyright
Push
Technology
2012
42. Latency
in
perspec[ve
~ ~
125 1000
bytes bytes
(avg) (avg)
2.4 us 5.0 us 8.0 us 50.0 us
• 2.4
us.
A
tuned
benchmark
in
C
with
low
latency
10Ge
NIC,
with
kernel
bypass,
with
FPGA
accelera[on
• 5.0
us.
A
basic
java
benchmark
–
as
good
as
it
gets
in
java
• Diffusion
is
measurably
‘moving
to
the
le{’
release
on
release
• We’ve
been
ac[vely
tracking
and
con[nuously
improving
since
4.0
Copyright
Push
Technology
2012
44. CEP,
basically
w w S
C Q
w w
What
is
eep.erl?
• Add
aggregate
func[ons
and
window
opera[ons
to
Erlang
• Separate
context
(window)
from
computa[on
(aggregate
fn)
• 4
window
types:
tumbling,
sliding,
periodic,
monotonic
• Process
oriented.
• Fast
enough.
J
Copyright
Push
Technology
2012
45. Aggregate
Func[ons
What
is
an
aggregate
func*on?
• A
func[on
that
computes
values
over
events.
• The
cost
of
calcula[ons
are
ammor[zed
per
event
• Just
follow
the
above
recipe
• Example:
Aggregate
2M
events
(equity
prices),
send
to
GPU
on
emit,
receive
2M
op[ons
put/call
prices
as
a
result.
Copyright
Push
Technology
2012
47. Tumbling
Windows
x() x() x() x()
emit()
x() x() x() x() emit()
1 2 3 4
x() x() x() x()
emit()
2 3 4 5
init()
2 3 4 5
init()
init()
t0 t1 t2 t3 t4 t5 t6 t7 t8 t9 t10 t11 ...
What
is
a
tumbling
window?
• Every
N
events,
give
me
an
average
of
the
last
N
events
• Does
not
overlap
windows
• ‘Closing’
a
window,
‘Emits’
a
result
(the
average)
• Closing
a
window,
Opens
a
new
window
Copyright
Push
Technology
2012
54. Monotonic
Windows
my my my
x() x() x() x()
emit()
x() x() x() x() emit()
1 2 3 4
x() x() x() x()
emit()
2 3 4 5
init()
2 3 4 5
init()
init()
t0 t1 t2 t3 ...
What
is
a
monotonic
window?
• Driven
mad
by
‘wall
clock
[me’?
Need
a
logical
clock?
• No
worries.
Provide
your
own
clock!
Eg.
Vector
clock
Copyright
Push
Technology
2012