Building and deploying microservices with event sourcing, CQRS and Docker (Be...Chris Richardson
In this talk we share our experiences developing and deploying a microservices-based application. You will learn about the distributed data management challenges that arise in a microservices architecture. We will describe how we solved them using event sourcing to reliably publish events that drive eventually consistent workflows and pdate CQRS-based views. You will also learn how we build and deploy the application using a Jenkins-based deployment pipeline that creates Docker images that run on Amazon EC2.
This talk was given at the Berlin Microxchg conference and the Munich microservices meetup.
Developing microservices with aggregates (SpringOne platform, #s1p)Chris Richardson
The Domain Model pattern is a great way to develop complex business logic. Unfortunately, a typical domain model is a tangled, birds nest of classes. It can’t be decomposed into microservices. Moreover, business logic often relies on ACID transactions to maintain consistency.
Fortunately, there is a solution to this problem: aggregates. An aggregate is an often overlooked modeling concept from the must read book Domain Driven Design. In this talk you will learn how aggregates enable you to develop business logic for the modern world of microservices and NoSQL. We will describe how to use aggregates to design modular business logic that can be partitioned into microservices. You will learn how aggregates enable you to use eventual consistency instead of ACID. We will describe the design of a microservice that is built using aggregates, and Spring Cloud.
Handling Eventual Consistency in JVM Microservices with Event Sourcing (javao...Chris Richardson
This is the talk that the Kenny Bastani and I gave at JavaOne 2016.
When you’re building JVM applications in a microservice architecture, managing state becomes a distributed systems problem. Instead of being able to manage state as transactions inside the boundaries of a single monolithic application, a microservice must be able to manage consistency by using transactions that are distributed across a network of many different applications and databases. This session explores the problems of data consistency and high availability in JVM-based microservices and how to use event sourcing to solve these problems.
Building and deploying microservices with event sourcing, CQRS and Docker (Be...Chris Richardson
In this talk we share our experiences developing and deploying a microservices-based application. You will learn about the distributed data management challenges that arise in a microservices architecture. We will describe how we solved them using event sourcing to reliably publish events that drive eventually consistent workflows and pdate CQRS-based views. You will also learn how we build and deploy the application using a Jenkins-based deployment pipeline that creates Docker images that run on Amazon EC2.
This talk was given at the Berlin Microxchg conference and the Munich microservices meetup.
Developing microservices with aggregates (SpringOne platform, #s1p)Chris Richardson
The Domain Model pattern is a great way to develop complex business logic. Unfortunately, a typical domain model is a tangled, birds nest of classes. It can’t be decomposed into microservices. Moreover, business logic often relies on ACID transactions to maintain consistency.
Fortunately, there is a solution to this problem: aggregates. An aggregate is an often overlooked modeling concept from the must read book Domain Driven Design. In this talk you will learn how aggregates enable you to develop business logic for the modern world of microservices and NoSQL. We will describe how to use aggregates to design modular business logic that can be partitioned into microservices. You will learn how aggregates enable you to use eventual consistency instead of ACID. We will describe the design of a microservice that is built using aggregates, and Spring Cloud.
Handling Eventual Consistency in JVM Microservices with Event Sourcing (javao...Chris Richardson
This is the talk that the Kenny Bastani and I gave at JavaOne 2016.
When you’re building JVM applications in a microservice architecture, managing state becomes a distributed systems problem. Instead of being able to manage state as transactions inside the boundaries of a single monolithic application, a microservice must be able to manage consistency by using transactions that are distributed across a network of many different applications and databases. This session explores the problems of data consistency and high availability in JVM-based microservices and how to use event sourcing to solve these problems.
A rework of metade's slides at http://www.slideshare.net/metade/linked-data-on-the-bbc for a SAMT 2009 Industry Day presentation.
Details several linked data projects going on at the BBC, and why/how we do it.
Gary Gale, Yahoo! Geo Technologies gave a fantastic presentation at the Telematics Update Telematics Munich 2009 Conference & Exhibition.
This presentation was so well received by our automotive, web and mobile industry audience, that it had to be shared.
In September 2019 I spoke at the SciCAR conference in Dortmund, Germany about the experiences of working in a country with well developed open data policies — and the dangers it presents for data journalists.
Tomorrows smart cities will work like magicRick Robinson
When I was a teenager, I spent my monthly allowance visiting this basement shop in a London Alley near Oxford Street … at the time, it was the only place in the whole of the UK to buy *really* cutting-edge European Death Metal music.
Technology has changed our world so much over the last two decades that my youth seems like ancient history; but over the next two decades, the changes that will become possible as technology develops will be even more striking; and it may even be hard to recognise the way that we interact with our future world as "human behaviour" as we understand it now.
As consumer technologies such as social media, open data and smartphones evolve through the next-generation of "human/computer interfaces", the incredible power of future technology will be put into the hands of individuals and small businesses. By opening up cities' digital infrastructure to them, business and government can help people and cities to help themselves.
Mashups & Data Visualizations: The New Breed of Web ApplicationsDarlene Fichter
Web 2.0 is opening the doors to tools and toolkits for do-it-yourself (DIY) programming that requires no knowledge about programming. Find out what mashups are and how libraries are making use of them to create rich, new information services and content. Look at some of the intriguing and robust new data visualization tools, such as IBM’s alphworks, swivel, gapminder (bought by Google), etc. that can put the power of spreadsheets online for everyone in your organization to present their information as tag clouds, bar and pie charts, bubble maps, and more.
Presented by Darlene Fichter October 31, 2007 at Internet Librarian 2007
Presenter: Stuart Macdonald
Presentation first given at Open Knowledge Scotland event at Inspace in Edinburgh, 13 May 2010.
EDINA project to create an online crowdsourcing tool which will combine data from digitised Scottish Post Office Directories (PODs) with contemporaneous historical maps
Web 2.0 Setting The Stage For Extending Our Reach: Resource Guidekennbicknell
A resource guide that accompanies the PowerPoint presentation on Web 2.0 tools and resources delivered during a workshop for L.A. As Subject members, March 24, 2009.
Presentation guiding attendees (real life and online) through the Be2Awards and ConstrucTALKs event held on 9 February 2011 at the Building Centre, London WC1, during London social media week.
Adding Value to Cultural Heritage - Olaf Janssen lecturing for the course "Di...Olaf Janssen
Olaf Janssen lecturing for the course "Digital Access to Cultural Heritage" at Leiden University, the Netherlands, 3-3-2011
In this humurous presentation I give an overview of the history of digital services in the National Library of the Netherlands (KB), and the internal & external problems the current KB services infrastructure is faced with. I present 4 different solutions to these problems. Using the BMICE-model (www.bmice.nl), I how heritage institutions can add value to their services.
A rework of metade's slides at http://www.slideshare.net/metade/linked-data-on-the-bbc for a SAMT 2009 Industry Day presentation.
Details several linked data projects going on at the BBC, and why/how we do it.
Gary Gale, Yahoo! Geo Technologies gave a fantastic presentation at the Telematics Update Telematics Munich 2009 Conference & Exhibition.
This presentation was so well received by our automotive, web and mobile industry audience, that it had to be shared.
In September 2019 I spoke at the SciCAR conference in Dortmund, Germany about the experiences of working in a country with well developed open data policies — and the dangers it presents for data journalists.
Tomorrows smart cities will work like magicRick Robinson
When I was a teenager, I spent my monthly allowance visiting this basement shop in a London Alley near Oxford Street … at the time, it was the only place in the whole of the UK to buy *really* cutting-edge European Death Metal music.
Technology has changed our world so much over the last two decades that my youth seems like ancient history; but over the next two decades, the changes that will become possible as technology develops will be even more striking; and it may even be hard to recognise the way that we interact with our future world as "human behaviour" as we understand it now.
As consumer technologies such as social media, open data and smartphones evolve through the next-generation of "human/computer interfaces", the incredible power of future technology will be put into the hands of individuals and small businesses. By opening up cities' digital infrastructure to them, business and government can help people and cities to help themselves.
Mashups & Data Visualizations: The New Breed of Web ApplicationsDarlene Fichter
Web 2.0 is opening the doors to tools and toolkits for do-it-yourself (DIY) programming that requires no knowledge about programming. Find out what mashups are and how libraries are making use of them to create rich, new information services and content. Look at some of the intriguing and robust new data visualization tools, such as IBM’s alphworks, swivel, gapminder (bought by Google), etc. that can put the power of spreadsheets online for everyone in your organization to present their information as tag clouds, bar and pie charts, bubble maps, and more.
Presented by Darlene Fichter October 31, 2007 at Internet Librarian 2007
Presenter: Stuart Macdonald
Presentation first given at Open Knowledge Scotland event at Inspace in Edinburgh, 13 May 2010.
EDINA project to create an online crowdsourcing tool which will combine data from digitised Scottish Post Office Directories (PODs) with contemporaneous historical maps
Web 2.0 Setting The Stage For Extending Our Reach: Resource Guidekennbicknell
A resource guide that accompanies the PowerPoint presentation on Web 2.0 tools and resources delivered during a workshop for L.A. As Subject members, March 24, 2009.
Presentation guiding attendees (real life and online) through the Be2Awards and ConstrucTALKs event held on 9 February 2011 at the Building Centre, London WC1, during London social media week.
Adding Value to Cultural Heritage - Olaf Janssen lecturing for the course "Di...Olaf Janssen
Olaf Janssen lecturing for the course "Digital Access to Cultural Heritage" at Leiden University, the Netherlands, 3-3-2011
In this humurous presentation I give an overview of the history of digital services in the National Library of the Netherlands (KB), and the internal & external problems the current KB services infrastructure is faced with. I present 4 different solutions to these problems. Using the BMICE-model (www.bmice.nl), I how heritage institutions can add value to their services.
Similar to Linking bbc.co.uk to the linked data cloud (20)
My presentation at the 2nd London Linked Data meet up.
Introduces Wildlife Finder (http://www.bbc.co.uk/wildlifefinder): the types of resources it describes and the ontology used to describe it.
www@20 what does the history of the web tell us about its future?Tom Scott
Following my invitation to speak at the WWW@20 celebrations - this is my attempt to squash the interesting bits into a somewhat coherent 15min presentation.
An overview of of the BBC's work on exposing an API for programme metadata as presented at XTech08. More information on the Radio Labs blog: http://www.bbc.co.uk/blogs/radiolabs/2008/05/helping_machines_play_with_pro.shtml
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
2. Linked Data “The web done right”
Tim Berners-Lee
Linked Data cloud diagram http://www4.wiwiss.fu-berlin.de/bizer/pub/lod-datasets_2009-03-05_colored.png
3. Use URIs to identify things
not only documents
How it works: The Web http://flickr.com/photos/danbri/2415237566/
4. Use HTTP URIs - globally unique names that
anyone can dereference
Colon Slash Slash http://www.flickr.com/photos/jeffsmallwood/299208539/
5. Provide useful information [in RDF] when someone
looks up a URI
Information Desk http://www.flickr.com/photos/metropol2/149294506/
6. Include links to other URIs to let people discover
related information
Links http://www.flickr.com/photos/ravages/2831688538/
7. But why?
Good Question http://www.flickr.com/photos/emagic/56206868/
8. Make computers human literate
Liverpool Street station crowd blur http://www.flickr.com/photos/victoriapeckham/164175205/
9. Free information from data silos
Silos http://www.flickr.com/photos/bottleleaf/2218990208/
10. Linked Data at the BBC
Test Card X http://www.flickr.com/photos/marksmanuk/3098983708/
11. One page per programme, artist, species and
habitat
Internet http://www.flickr.com/photos/transkamp/54371294/
Linking Open Data is a grassroots project to use web technologies to expose data on the web. It is for many people synonymous with the semantic web - and while this isn’t quite true. It does, as far as I’m concerned, represent a very large subset of the semantic web project.
Although, curiously, it can also be thought of as the ‘the web done right’ - the web as it was originally designed to be.
But what is it?
Well it can be described with 4 simple rules.
The web was designed to be a web of things, not just a web of documents.
Those documents make assertions about things in the real world but that doesn’t mean the identifiers can only be used to identify web documents.
Just as a passport or driving license, in the real world, can be thought of as identifiers for people so URI can be used as identifiers for people, concepts or things on the web.
Minting URIs for things rather than pages helps make the web more human literate because it means we are identifying those things that people care about.
The beauty of the web is its ubiquitous nature - the fact it is decentralised and able to function on any platform. This is because of TimBL’s key invention the HTTP URI.
URI’s are globally unique, open to all and decentralised.
Don’t go using DOI or any other identifier - on the web all you need is an HTTP URI.
And obviously you need to provide some information at that URI. When people dereference it you need to give them some data - ideally as RDF as well as HTML.
Providing the data as RDF means that machines can process that information for people to use. Making it more useful.
And of course you also need to provide links to other resources so people can continue their journey.
And that means contextual links to other resources elsewhere on the web, not just your site.
And that’s it. Pretty simple.
And I would argue that, other than the RDF bit, these principles should be followed for any website - they just make sense.
Before the Web people still networked their computers - but to access that network you needed to know about the network, the routing and the computers themselves.
For those in their late 30s you’ll probably remember the film War Games - because this was filmed before the Web they had to find and connect to each computer and know about the computer’s location. If you remember, they plugged their phone into a modem and phoned up the computer.
The joy of the web is because it adds a level of abstraction - freeing you from the networking, routing and server location and letting you focus on the document.
Following the principles of Linked Data allows us to add a further level of abstraction - freeing us from the document and letting us focus on the things, people and stuff that matters to people.
It helps us design a system that is more human literate, and more useful.
This is possible because we are identifying real world stuff and the relationships between them.
Of course there are other ways of achieving this - lots of sites now provide APIs which is good just not great.
Each of those APIs tend to be proprietary and specific to the site. As a result there’s an overhead every time someone wants to add that data source.
These APIs give you access to the silo - but the silo still remains.
Using RDF and LOD means there is a generic method to access data on the web.
So what are we doing at the BBC?
First up it’s worth pointing out the obvious, the BBC is a big place and so it would be wrong to assume that everything we’re doing online is following these principles. But there’s quite a lot of stuff going on.
So what do we have?
Well the BBC’s programme support, music discovery and, soon, natural history content are all adopting these principles.
In other words persistent HTTP URIs that can be dereferenced to HTML, RDF, JSON and mobile views for programmes, artists, species and habitats.
That means a page for every programme brand the BBC broadcasts on TV and Radio.
Separate, addressable episode pages
Soon we’ll have pages about individual concepts within the natural history domain - like species.
And we have separate pages for every artist the BBC plays on the new music site.
But resources are webpages - web pages are documents. We wanted HTTP URIs for every concept - and an individual page is made up of multiple resource, multiple concepts.
So for example the previous artist page transcludes this resource - but the resource also has it’s own URI.
If it doesn’t have a URI it’s not on the web.
And news stories by artist.
Remember there’s only one web so we only have one URI for a resource but a number of different representation for that resource.
So the URI for this programme is:
bbc.co.uk/programmes/b00ht655#programme
Through content negotiation we are able to server an HTML
RDF...
...or mobile document to represent that programme.
We then need to link all of this stuff up within the BBC.
So that, for example, you can go from a tracklist on an episode page of Jo Whiley on the Radio 1 site to the U2 artist page and them from there to all episodes of Chris Evans which have played U2.
Or from an episode of Nature’s great events to the page about Brown Bears to all BBC TV programmes about Brown Bears.
But obviously the BBC is only one corner of the web. So we also need to link with the rest of the web.
So for example here are all the URI we know about that are about an artist. Note this set is also at a URI.
Because we’re thinking on a webscale we’ve started to think about the web as a CMS.
Where URIs already exist to represent that concept we using it rather than minting our own.
So the new music site transcludes and links back to Wikipedia to provide biographical information about an artist.
Rather than minting our own URI for artist biographic info we use wikipedia’s.
Likewise when we want to add music metadata to the music site we add MusicBrainz.