Organisations are becoming Event Driven based on streaming technologies and adopting Data Mesh and Event Mesh architectures. As this becomes pervasive, so do the challenges around runtime governance and lifecycle management. For example, do you know what streams exist, who is producing and consuming them? What is the effect of upstream changes? How is this information kept up to date, and how do people collaborate efficiently across distributed teams and environments? Ever wish you had a way to view and visualize graphically the relationships between schemas, topics and applications? In this talk we will show you how to do that and get more value from your Kafka Streaming infrastructure using an Event Portal - an API portal specialized for event streams and publish/subscribe patterns. Join us to see how you can discover event streams from your Kafka clusters, import them to a catalog to see alongside other enterprise event streams and leverage code gen capabilities to ease development.

1. Mesh-ing around with Streams
across the Enterprise
Phil Scanlon

2. Streams
Everywhere
2
© Solace
Proprietary & Confidential

3. Does your enterprise look like this?
JSON, XML, Plain Text…
IoT/Device Management
Producers
Consumers
Connectors
Stream
Processors
Avro
Schema Registry
Existing Application Infrastructure
…

4. Data Mesh meet Event Mesh
JSON, XML, Plain Text…
IoT/Device Management
Producers
Consumers
Connectors
Stream
Processors
Avro
Schema Registry
Existing Application Infrastructure
…

5. Data Mesh meet Event Mesh
JSON, XML, Plain Text…
IoT/Device Management
Producers
Consumers
Connectors
Stream
Processors
Avro
Schema Registry
Existing Application Infrastructure
…
?
?
?

6. Data Mesh meet Event Mesh
• Data Mesh
– Solve the democratisation of data
ownership across the enterprise
– Evolved out of the analytical domain
– Data changes are events
– Log Style Event Broker
• Event Mesh
– An architectural layer to decouple applications,
allowing events to flow across the enterprise
– Evolved out of the transactional / middleware
domain, exist in IOT
– Events can carry data
– Queue / Pub-Sub style Event Broker
• Both
– Monolith to microservices
– De-centralise / distribute compute

7. So…
Have lots of
event-driven
applications
Investigate event portal technology
Have (or need
to define) a lot of
event streams
Want to
manage events
as easily as you
manage APIs
...if you have Apache Kafka...
and

8. Event Portal
8
© Solace
Proprietary & Confidential

9. Event Management is Like API Management
RESTful Architecture
API
Portal
Design-time
APIs, Schemas,
Applications
?
Design-time
Events, Schemas,
Applications
Event
Portal
Event-Driven Architecture
• Catalog/
Document
• Discover
• Share/Reuse
• Analyze, Extend
& Design
• Generate Code
Publishers Subscribers
Event
Brokers
Run-time
Events &
Services
Clients Providers
API
Gateway
Run-time
APIs &
Services

10. Single place to design, create, catalog, visualize, discover, share, secure and
manage all your KAFKA event streams within your ecosystem
Event portal for Kafka
Event Portal
Mainframe
/SAP
Distributed
Apps
IoT
Microservices
Serverless
Event Brokers
Designer & Catalog
Runtime
Discovery
Extensible Agent Framework*
Audit Metrics*

11. • Document and Track:
– Topics, schemas
– Event meshes
– Business moment of event
– Pub/sub interface for each
app/integration
– Owners and points of contact
– Changes and revisions
– Track single source of truth
• Expose Events
– Increase ROI on existing Event Types
– See what’s available for consumption
– Decrease integration time
– Expose and create Event API Products
Catalog Events & Schemas
Increase Productivity Through Reuse
11
© Solace
Proprietary & Confidential
Publishers
Subscribers
Event
Portal
Event
Broker

12. • Design event flows using
PubSub+ features you know
– Describe each app’s
event-driven interface
– Topic address variables and
enumeration for rich naming
– Wildcards let consumers subscribe
to exactly/only what they want
• Collaborative design
– Consistency: One source of info for
architects and developers
– Productivity: Code generation keeps
focus on business logic/value
• Ensure Best Practices of:
– Topic taxonomy
– Visible descriptions
– Defined owners and point of contact
Microservices Design Tooling:
Increase Productivity Through Consistency & Best Practices
12
© Solace
Proprietary & Confidential
Model client
delivery endpoints
with wildcard topic
subscriptions
Click an event to expose
“Topic Address” including
hierarchies and variables
Export AsyncAPI
spec to generate
code or docs
Automatically
Rendered
Event Relationships

13. • Find the events you didn’t
even know existed
– High value events can be exposed
across the enterprise through
event API products
– They can be lifecycle managed
• Get rid of what
you don’t need!
– Events that are not consumed can
be deprecated or can be an
opportunity for new consumption
• Understand data access
and consumption
Discover your Kafka Runtime
Share and Reuse Internally and Externally
13
© Solace
Proprietary & Confidential
Run a discovery agent against your broker to
discover events, schemas and app interactions
1
Use discovered data to visualize, evolve and
share your events, internally and externally
4
Upload discovered data
into PubSub+ Event Portal
2
Associate events, endpoints and
subscriptions with app and app domains
3

14. Get the Most Out of Your EDA Investment with the Right
Event Management Tooling
14
© Solace
Proprietary & Confidential
Let architects and developers
work together more efficiently
with tools for shared analysis,
understanding and design
Gain the power to track changes
and audit deviations while
defining and enforcing
sophisticated security policies
Let internal and external audiences
create value-added services
Based on a catalog of events the
same way they use APIs you expose
Collaboration &
Productivity
Visibility &
Control
Sharing &
Reuse

15. Demo
15
© Solace
Proprietary & Confidential

16. That’s Possible