SimpleReach is a social intelligence tool for content creators. In order to handle both the data ingestion and data volume, we've employed Cassandra to store, process and aid in the display and organization of that data. We've learned a lot of lessons along the way about the right and wrong things to do both with data in general and with Cassandra in particular. These are some of those lessons.
Use voice recognition with Alexa to control your home [JavaOne]Johan Janssen
Slides of my Alexa session at JavaOne 2017
Session description
What if you’re eating and having a discussion about a certain topic? Searching on your phone would mean that your food gets cold. Or what if you’re lying on the couch without your phone and want to control the lights? The voice recognition service called Alexa can solve those issues. This presentation shows you how to integrate Alexa into your home automation setup with openHAB (used as an example). This enables you to control your lights and everything else with your voice. You can use Alexa with almost any software and hardware. Last but not least, the presentation shows you how to create your own skills in Java to add functionality to Alexa. The skills are deployed with Maven to AWS Lambda as a serverless application.
Having been a user of Cassandra since 0.2 and a production user since 1.0, I’ve seen it, been there, done that and somehow survived. These are tales of learning when to ignore best practices, how to break rules, and knowing when and how to come up with strategies to push the limits of Cassandra.
Eric Lubow discussed key questions to consider when building an infrastructure architecture. He outlined questions around where systems will live, how data will move and be stored, and how to ensure systems can be maintained and scaled. Lubow emphasized the importance of monitoring systems to understand if anything is wrong and highlighted lessons learned from SimpleReach's architecture evolution.
This document discusses polyglottany, which refers to using multiple programming languages and data storage technologies together. It advocates choosing the right tool for each job based on factors like data structure, query patterns, and performance needs. The document outlines SimpleReach's use of Cassandra, MongoDB, Redis, and Infobright and ties them together with a service-oriented architecture and internal API. It acknowledges challenges like expertise, data consistency, and complexity but argues polyglottany allows using the best technology for each task.
Eric Lubow discussed the challenges his company SimpleReach faced when using Cassandra counters at scale to track metrics for their content analytics platform. SimpleReach processes huge volumes of data, writing 250,000-300,000 counter values per second. Early on they encountered performance issues with counters but were able to optimize their implementation through techniques like pre-aggregating writes, using counter batches, extensive monitoring, upgrading hardware, and tuning Cassandra and JVM settings. Upgrading to Cassandra 2.1 also helped improve counter performance.
Message Architectures in Distributed Systems - Data Day Texas 2013-01-11Eric Lubow
Message architectures are an important part of a distributed system. They are often overlooked because the prevailing sentiment is that the storage and processing engines are the important parts.
Micro Services - Neither Micro Nor ServiceEberhard Wolff
Micro Services are a new approach to software architecture. This presentation discusses how small they should be - and wether they are really service - in the SOA sense.
This document discusses microservices and their advantages and disadvantages. Microservices are small, independent units that work together to form an application. They allow for independent deployment and use of different technologies. While this improves scalability and agility, it also introduces challenges around distributed systems, refactoring code between services, and operating at scale. The key is to start with a functional architecture and limit communication between services.
Use voice recognition with Alexa to control your home [JavaOne]Johan Janssen
Slides of my Alexa session at JavaOne 2017
Session description
What if you’re eating and having a discussion about a certain topic? Searching on your phone would mean that your food gets cold. Or what if you’re lying on the couch without your phone and want to control the lights? The voice recognition service called Alexa can solve those issues. This presentation shows you how to integrate Alexa into your home automation setup with openHAB (used as an example). This enables you to control your lights and everything else with your voice. You can use Alexa with almost any software and hardware. Last but not least, the presentation shows you how to create your own skills in Java to add functionality to Alexa. The skills are deployed with Maven to AWS Lambda as a serverless application.
Having been a user of Cassandra since 0.2 and a production user since 1.0, I’ve seen it, been there, done that and somehow survived. These are tales of learning when to ignore best practices, how to break rules, and knowing when and how to come up with strategies to push the limits of Cassandra.
Eric Lubow discussed key questions to consider when building an infrastructure architecture. He outlined questions around where systems will live, how data will move and be stored, and how to ensure systems can be maintained and scaled. Lubow emphasized the importance of monitoring systems to understand if anything is wrong and highlighted lessons learned from SimpleReach's architecture evolution.
This document discusses polyglottany, which refers to using multiple programming languages and data storage technologies together. It advocates choosing the right tool for each job based on factors like data structure, query patterns, and performance needs. The document outlines SimpleReach's use of Cassandra, MongoDB, Redis, and Infobright and ties them together with a service-oriented architecture and internal API. It acknowledges challenges like expertise, data consistency, and complexity but argues polyglottany allows using the best technology for each task.
Eric Lubow discussed the challenges his company SimpleReach faced when using Cassandra counters at scale to track metrics for their content analytics platform. SimpleReach processes huge volumes of data, writing 250,000-300,000 counter values per second. Early on they encountered performance issues with counters but were able to optimize their implementation through techniques like pre-aggregating writes, using counter batches, extensive monitoring, upgrading hardware, and tuning Cassandra and JVM settings. Upgrading to Cassandra 2.1 also helped improve counter performance.
Message Architectures in Distributed Systems - Data Day Texas 2013-01-11Eric Lubow
Message architectures are an important part of a distributed system. They are often overlooked because the prevailing sentiment is that the storage and processing engines are the important parts.
Micro Services - Neither Micro Nor ServiceEberhard Wolff
Micro Services are a new approach to software architecture. This presentation discusses how small they should be - and wether they are really service - in the SOA sense.
This document discusses microservices and their advantages and disadvantages. Microservices are small, independent units that work together to form an application. They allow for independent deployment and use of different technologies. While this improves scalability and agility, it also introduces challenges around distributed systems, refactoring code between services, and operating at scale. The key is to start with a functional architecture and limit communication between services.
A short talk on Elixir adoption in RabbitMQ, a multi-protocol open source messaging broker: the motivation, how it compares to Erlang for our needs, and what we've learnt about 1 year into it.
Premature optimisation: The Root of All EvilFabio Akita
Presentation for the 18th Encontro Locaweb in Curitiba in May, iMasters' DevCommerce and Open Spree Conference in June. It's about how most developers think wrong whey they are making decisions about technologies to choose.
DevCommerce Conference 2016: Performance, anti-patterns e stacks pra desenvol...iMasters
Fabio Akita, Co-Founder da Codeminer 42, palestrou sobre "Performance, anti-patterns e stacks pra desenvolver e-commerce, com cases reais", no DevCommerce Conference 2016.
O DevCommerce Conference 2016 aconteceu nos dias 06 e 07 de junho de 2016, no Hotel Tivoli em São Paulo-SP http://devcommerce2016.imasters.com.br/
This document discusses canary analysis, which is a deployment process where a new change is gradually rolled out to production with checkpoints to examine the new systems versus the old systems and make go/no-go decisions. It proposes using canary analysis to test software releases by routing a small percentage of traffic to new servers and comparing metrics like error rates and requests per second between the new and old servers before fully deploying the new release. The document provides advice on automating canary analysis, focusing on relative metrics, ignoring outliers, balancing fidelity with customer impact, and letting application owners choose when differences are acceptable.
TDC2016SP - Otimização Prematura: a Raíz de Todo o Maltdc-globalcode
I. The document discusses the concept of premature optimization being the root of all evil in software development.
II. It provides examples of strategies to focus on first making software work correctly before optimizing, such as using open source software, cloud services, and prioritizing maintainability over performance.
III. The document emphasizes that developers should identify key priorities and metrics before optimizing code, as unnecessary early optimizations can decrease code quality and maintainability.
Your Goat Antifragiled My Snowflake!: Demystifying DevOps Jargon - ChefConf 2015Chef
From ChefConf 2015.
https://youtu.be/OU3F_UU-Jpc
Are you a cow, a pet, a canary, or a unicorn? Do you prefer blue/green, or red/green/refactor? Who the heck is Brent?
Welcome to DevOps, where we are all about breaking down walls. But, we've created a private dialect, full of familiar words with unfamiliar meanings, and in-jokes upon in-jokes. Many newcomers wish there was a glossary for the movement. Time to be inclusive!
In this fun session, we'll go over some of the more unintuitive terms (being a goat is a good thing!) and the backstories behind them. We'll have an extended audience participation segment in which you can ask about words you've heard.
Anshum Gupta is an Apache Lucene/Solr committer who works at Lucidworks. He discusses the history and capabilities of Apache Lucene, an open source information retrieval library, and Apache Solr, an enterprise search platform built on Lucene. Solr has over 8 million downloads and is used by many large companies for search capabilities including indexing, faceting, auto-complete, and scalability to handle large datasets. Major updates in Solr 5 include improved performance, security features, and analytics capabilities.
Testing Variability-Intensive Systems, tutorial SPLC 2017, part IXavierDevroey
The document discusses testing techniques for variability-intensive systems. It provides an overview of model-based techniques to test such systems, considering both structural and behavioral concerns. The tutorial is divided into two parts: Part I covers sampling techniques for selecting sample configurations to test from a feature model, including a discussion of applying these techniques to the JHipster case study. Part II introduces behavior modeling and behavior-driven test case selection techniques, and how to concretize test cases. An open discussion session concludes the tutorial.
Micro Service – The New Architecture ParadigmEberhard Wolff
The document discusses microservices as a new software architecture paradigm. It defines microservices as small, independent processes that work together to form an application. The key benefits of microservices are that they allow for easier, faster deployment of features since each service is its own deployment unit and teams can deploy independently without integration. However, the document also notes challenges of microservices such as increased communication overhead, difficulty of code reuse across services, and managing dependencies between many different services. It concludes that microservices are best for projects where time to market is important and continuous delivery is a priority.
Presentation at my company to all the Interns about What DevOps is to me and why I'm passionate about it.
NOTE: Liberally gathered stuffs from the internetz. If I did something wrong by doing so or by you let's chat. I want to work with you to make it better :)
The document discusses using dashboards and information radiators to track key metrics and provide visibility. It provides examples of metrics that could be tracked, such as requests per second and installs per minute. It also discusses Kafka, a tool for building real-time data pipelines and streaming applications, and how it provides high-throughput, persistent, publish-subscribe messaging capabilities. The document recommends not flying blind, checking out Kafka, and being creative with dashboards and information radiators.
Dockercon USA 2016 - Immutable Awesomeness John Willis
This document discusses immutable infrastructure and how it relates to containerization and DevOps practices. It provides background on immutable infrastructure and how concepts like golden images, virtual desktop infrastructure, and infrastructure as code enable an immutable model. The document outlines principles for immutable delivery around variety, velocity, variability and visibility in the supply chain. It also discusses how Docker and containers support immutable models through tools like infrastructure templates and one-way deployment flows from development to production.
Immutable Awesomeness by John Willis and Josh CormanDocker, Inc.
This presentation will show the combination of two ideas that can create 2 to 3 order of magnitude efficiencies in service delivery. We will discuss an example used in an insurance company that has experienced these efficiencies. Josh Corman will present the concept of using Open Source and Toyota Supply Chain principles as a weapon for eliminating operational costs of service delivery. By applying first order principles like fewer suppliers (e.g, less logging frameworks) and image manifests (i.e., bill of materials) he will show how an organization can cut down on bugs and issue resolution times. John Willis will then cover how these principles fit like peanut butter and chocolate when used in an immutable delivery model based on Docker. This presentation was the third highest rated session at the 2015 Devops Enterprise Summit.
Damon Edwards, co-founder of Rundeck, presentation at Nexus Conf 2018 on how Security teams can help Operations and, in turn, help themselves.
See a Demo of Rundeck Enterprise :
https://www.rundeck.com/see-demo
--or--
Download Rundeck Open Source here:
https://rundeck.com/open-source
Connect:
Stack Overflow community: https://stackoverflow.com/questions/tagged/rundeck
Github: https://github.com/rundeck/rundeck/issues
Twitter: https://twitter.com/Rundeck
Facebook: https://www.facebook.com/RundeckInc/
LinkedIn: www.linkedin.com › company › rundeck-inc
Programming quantum computers in Q# (Techorama NL 2018)Rolf Huisman
How does one model quantum computing problems in Micrsoft Q#. One first needs to learn what quantum computing is. Code is part of the public library which can be found under; https://github.com/Microsoft/Quantum
The document discusses various data science applications at Bol.com including measuring user interactions on the website, forecasting product demand, and building recommendation systems. It provides examples and details for each application. For measuring, it notes Bol is able to process user event data with a 1-2 second lag compared to 25-30 seconds for another company. For recommendations, it highlights improvements from moving the service to the cloud including faster response times and being able to generate new predictions in 30 minutes instead of 24 hours. For forecasting demand, it outlines the process and techniques used including starting small, experimenting fast, and scaling up over time using various machine learning models and cloud technologies.
The document summarizes a DevOps 2016 Summit agenda. It includes presentations on Kubernetes DevOps by Ray Tsang from Google, DevOps powered by containers by Glenn West from Red Hat, Docker by a speaker from MediaTek, using Elasticsearch, Logstash and Kibana for log centralization and visualization, IoT Docker DevOps by Linker Network Software, shaking up culture with automation by a Yahoo Japan speaker, monitoring by a speaker from Gogolook, Chinese infrastructure by Sammy Lin, continuous integration/delivery by a speaker from Vpon, and what DevOps is through building on lean and agile practices.
Maruthi Prithivirajan, Head of ASEAN & IN Solution Architecture, Neo4j
Get an inside look at the latest Neo4j innovations that enable relationship-driven intelligence at scale. Learn more about the newest cloud integrations and product enhancements that make Neo4j an essential choice for developers building apps with interconnected data and generative AI.
Removing Uninteresting Bytes in Software FuzzingAftab Hussain
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
A short talk on Elixir adoption in RabbitMQ, a multi-protocol open source messaging broker: the motivation, how it compares to Erlang for our needs, and what we've learnt about 1 year into it.
Premature optimisation: The Root of All EvilFabio Akita
Presentation for the 18th Encontro Locaweb in Curitiba in May, iMasters' DevCommerce and Open Spree Conference in June. It's about how most developers think wrong whey they are making decisions about technologies to choose.
DevCommerce Conference 2016: Performance, anti-patterns e stacks pra desenvol...iMasters
Fabio Akita, Co-Founder da Codeminer 42, palestrou sobre "Performance, anti-patterns e stacks pra desenvolver e-commerce, com cases reais", no DevCommerce Conference 2016.
O DevCommerce Conference 2016 aconteceu nos dias 06 e 07 de junho de 2016, no Hotel Tivoli em São Paulo-SP http://devcommerce2016.imasters.com.br/
This document discusses canary analysis, which is a deployment process where a new change is gradually rolled out to production with checkpoints to examine the new systems versus the old systems and make go/no-go decisions. It proposes using canary analysis to test software releases by routing a small percentage of traffic to new servers and comparing metrics like error rates and requests per second between the new and old servers before fully deploying the new release. The document provides advice on automating canary analysis, focusing on relative metrics, ignoring outliers, balancing fidelity with customer impact, and letting application owners choose when differences are acceptable.
TDC2016SP - Otimização Prematura: a Raíz de Todo o Maltdc-globalcode
I. The document discusses the concept of premature optimization being the root of all evil in software development.
II. It provides examples of strategies to focus on first making software work correctly before optimizing, such as using open source software, cloud services, and prioritizing maintainability over performance.
III. The document emphasizes that developers should identify key priorities and metrics before optimizing code, as unnecessary early optimizations can decrease code quality and maintainability.
Your Goat Antifragiled My Snowflake!: Demystifying DevOps Jargon - ChefConf 2015Chef
From ChefConf 2015.
https://youtu.be/OU3F_UU-Jpc
Are you a cow, a pet, a canary, or a unicorn? Do you prefer blue/green, or red/green/refactor? Who the heck is Brent?
Welcome to DevOps, where we are all about breaking down walls. But, we've created a private dialect, full of familiar words with unfamiliar meanings, and in-jokes upon in-jokes. Many newcomers wish there was a glossary for the movement. Time to be inclusive!
In this fun session, we'll go over some of the more unintuitive terms (being a goat is a good thing!) and the backstories behind them. We'll have an extended audience participation segment in which you can ask about words you've heard.
Anshum Gupta is an Apache Lucene/Solr committer who works at Lucidworks. He discusses the history and capabilities of Apache Lucene, an open source information retrieval library, and Apache Solr, an enterprise search platform built on Lucene. Solr has over 8 million downloads and is used by many large companies for search capabilities including indexing, faceting, auto-complete, and scalability to handle large datasets. Major updates in Solr 5 include improved performance, security features, and analytics capabilities.
Testing Variability-Intensive Systems, tutorial SPLC 2017, part IXavierDevroey
The document discusses testing techniques for variability-intensive systems. It provides an overview of model-based techniques to test such systems, considering both structural and behavioral concerns. The tutorial is divided into two parts: Part I covers sampling techniques for selecting sample configurations to test from a feature model, including a discussion of applying these techniques to the JHipster case study. Part II introduces behavior modeling and behavior-driven test case selection techniques, and how to concretize test cases. An open discussion session concludes the tutorial.
Micro Service – The New Architecture ParadigmEberhard Wolff
The document discusses microservices as a new software architecture paradigm. It defines microservices as small, independent processes that work together to form an application. The key benefits of microservices are that they allow for easier, faster deployment of features since each service is its own deployment unit and teams can deploy independently without integration. However, the document also notes challenges of microservices such as increased communication overhead, difficulty of code reuse across services, and managing dependencies between many different services. It concludes that microservices are best for projects where time to market is important and continuous delivery is a priority.
Presentation at my company to all the Interns about What DevOps is to me and why I'm passionate about it.
NOTE: Liberally gathered stuffs from the internetz. If I did something wrong by doing so or by you let's chat. I want to work with you to make it better :)
The document discusses using dashboards and information radiators to track key metrics and provide visibility. It provides examples of metrics that could be tracked, such as requests per second and installs per minute. It also discusses Kafka, a tool for building real-time data pipelines and streaming applications, and how it provides high-throughput, persistent, publish-subscribe messaging capabilities. The document recommends not flying blind, checking out Kafka, and being creative with dashboards and information radiators.
Dockercon USA 2016 - Immutable Awesomeness John Willis
This document discusses immutable infrastructure and how it relates to containerization and DevOps practices. It provides background on immutable infrastructure and how concepts like golden images, virtual desktop infrastructure, and infrastructure as code enable an immutable model. The document outlines principles for immutable delivery around variety, velocity, variability and visibility in the supply chain. It also discusses how Docker and containers support immutable models through tools like infrastructure templates and one-way deployment flows from development to production.
Immutable Awesomeness by John Willis and Josh CormanDocker, Inc.
This presentation will show the combination of two ideas that can create 2 to 3 order of magnitude efficiencies in service delivery. We will discuss an example used in an insurance company that has experienced these efficiencies. Josh Corman will present the concept of using Open Source and Toyota Supply Chain principles as a weapon for eliminating operational costs of service delivery. By applying first order principles like fewer suppliers (e.g, less logging frameworks) and image manifests (i.e., bill of materials) he will show how an organization can cut down on bugs and issue resolution times. John Willis will then cover how these principles fit like peanut butter and chocolate when used in an immutable delivery model based on Docker. This presentation was the third highest rated session at the 2015 Devops Enterprise Summit.
Damon Edwards, co-founder of Rundeck, presentation at Nexus Conf 2018 on how Security teams can help Operations and, in turn, help themselves.
See a Demo of Rundeck Enterprise :
https://www.rundeck.com/see-demo
--or--
Download Rundeck Open Source here:
https://rundeck.com/open-source
Connect:
Stack Overflow community: https://stackoverflow.com/questions/tagged/rundeck
Github: https://github.com/rundeck/rundeck/issues
Twitter: https://twitter.com/Rundeck
Facebook: https://www.facebook.com/RundeckInc/
LinkedIn: www.linkedin.com › company › rundeck-inc
Programming quantum computers in Q# (Techorama NL 2018)Rolf Huisman
How does one model quantum computing problems in Micrsoft Q#. One first needs to learn what quantum computing is. Code is part of the public library which can be found under; https://github.com/Microsoft/Quantum
The document discusses various data science applications at Bol.com including measuring user interactions on the website, forecasting product demand, and building recommendation systems. It provides examples and details for each application. For measuring, it notes Bol is able to process user event data with a 1-2 second lag compared to 25-30 seconds for another company. For recommendations, it highlights improvements from moving the service to the cloud including faster response times and being able to generate new predictions in 30 minutes instead of 24 hours. For forecasting demand, it outlines the process and techniques used including starting small, experimenting fast, and scaling up over time using various machine learning models and cloud technologies.
The document summarizes a DevOps 2016 Summit agenda. It includes presentations on Kubernetes DevOps by Ray Tsang from Google, DevOps powered by containers by Glenn West from Red Hat, Docker by a speaker from MediaTek, using Elasticsearch, Logstash and Kibana for log centralization and visualization, IoT Docker DevOps by Linker Network Software, shaking up culture with automation by a Yahoo Japan speaker, monitoring by a speaker from Gogolook, Chinese infrastructure by Sammy Lin, continuous integration/delivery by a speaker from Vpon, and what DevOps is through building on lean and agile practices.
Maruthi Prithivirajan, Head of ASEAN & IN Solution Architecture, Neo4j
Get an inside look at the latest Neo4j innovations that enable relationship-driven intelligence at scale. Learn more about the newest cloud integrations and product enhancements that make Neo4j an essential choice for developers building apps with interconnected data and generative AI.
Removing Uninteresting Bytes in Software FuzzingAftab Hussain
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Speck&Tech
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
A tale of scale & speed: How the US Navy is enabling software delivery from l...sonjaschweigert1
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!SOFTTECHHUB
As the digital landscape continually evolves, operating systems play a critical role in shaping user experiences and productivity. The launch of Nitrux Linux 3.5.0 marks a significant milestone, offering a robust alternative to traditional systems such as Windows 11. This article delves into the essence of Nitrux Linux 3.5.0, exploring its unique features, advantages, and how it stands as a compelling choice for both casual users and tech enthusiasts.
Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank
Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
“An Outlook of the Ongoing and Future Relationship between Blockchain Technologies and Process-aware Information Systems.” Invited talk at the joint workshop on Blockchain for Information Systems (BC4IS) and Blockchain for Trusted Data Sharing (B4TDS), co-located with with the 36th International Conference on Advanced Information Systems Engineering (CAiSE), 3 June 2024, Limassol, Cyprus.
UiPath Test Automation using UiPath Test Suite series, part 5DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 5. In this session, we will cover CI/CD with devops.
Topics covered:
CI/CD with in UiPath
End-to-end overview of CI/CD pipeline with Azure devops
Speaker:
Lyndsey Byblow, Test Suite Sales Engineer @ UiPath, Inc.
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...Zilliz
Join us to introduce Milvus Lite, a vector database that can run on notebooks and laptops, share the same API with Milvus, and integrate with every popular GenAI framework. This webinar is perfect for developers seeking easy-to-use, well-integrated vector databases for their GenAI apps.
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slackshyamraj55
Discover the seamless integration of RPA (Robotic Process Automation), COMPOSER, and APM with AWS IDP enhanced with Slack notifications. Explore how these technologies converge to streamline workflows, optimize performance, and ensure secure access, all while leveraging the power of AWS IDP and real-time communication via Slack notifications.
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
Building RAG with self-deployed Milvus vector database and Snowpark Container...Zilliz
This talk will give hands-on advice on building RAG applications with an open-source Milvus database deployed as a docker container. We will also introduce the integration of Milvus with Snowpark Container Services.
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
How to Get CNIC Information System with Paksim Ga.pptxdanishmna97
Pakdata Cf is a groundbreaking system designed to streamline and facilitate access to CNIC information. This innovative platform leverages advanced technology to provide users with efficient and secure access to their CNIC details.
14. Why?
• Heavier READ loads vs heavier write loads
100 Million Events Eric Lubow @elubow
15. Why?
• Heavier READ loads vs heavier write loads
• Data relationships may be less important
100 Million Events Eric Lubow @elubow
16. Why?
• Heavier READ loads vs heavier write loads
• Data relationships may be less important
• Different aspects of a system have different requirements
100 Million Events Eric Lubow @elubow
17. Why?
• Heavier READ loads vs heavier write loads
• Data relationships may be less important
• Different aspects of a system have different requirements
• Know your compromises
100 Million Events Eric Lubow @elubow
19. Cassandra
• Large data volume ingestion
100 Million Events Eric Lubow @elubow
20. Cassandra
• Large data volume ingestion
• Really fast writes to many locations (eventual consistency)
100 Million Events Eric Lubow @elubow
21. Cassandra
• Large data volume ingestion
• Really fast writes to many locations (eventual consistency)
• Query by column groups within rows
100 Million Events Eric Lubow @elubow
22. Cassandra
• Large data volume ingestion
• Really fast writes to many locations (eventual consistency)
• Query by column groups within rows
• Range queries in Hive (Slice predicate ranges)
100 Million Events Eric Lubow @elubow
23. Cassandra
• Large data volume ingestion
• Really fast writes to many locations (eventual consistency)
• Query by column groups within rows
• Range queries in Hive (Slice predicate ranges)
• Fault tolerant
100 Million Events Eric Lubow @elubow
25. What Mistakes?
• Manage how many servers?
100 Million Events Eric Lubow @elubow
26. What Mistakes?
• Manage how many servers?
• Re-inventing the wheel (Helenus)
100 Million Events Eric Lubow @elubow
27. What Mistakes?
• Manage how many servers?
• Re-inventing the wheel (Helenus)
• Composites Rock
100 Million Events Eric Lubow @elubow
28. What Mistakes?
• Manage how many servers?
• Re-inventing the wheel (Helenus)
• Composites Rock
• Snapshots before drop keyspace
100 Million Events Eric Lubow @elubow
29. What Mistakes?
• Manage how many servers?
• Re-inventing the wheel (Helenus)
• Composites Rock
• Snapshots before drop keyspace
• How many experts does it take to run a cluster?
100 Million Events Eric Lubow @elubow
30. What Mistakes?
• Manage how many servers?
• Re-inventing the wheel (Helenus)
• Composites Rock
• Snapshots before drop keyspace
• How many experts does it take to run a cluster?
• You can tune Cassandra?!?
100 Million Events Eric Lubow @elubow
32. Server Management
• Hand tools - AWS, csshx
Cluster SSH
100 Million Events Eric Lubow @elubow
33. Server Management
• Hand tools - AWS, csshx
• Configuration Management
Cluster SSH
100 Million Events Eric Lubow @elubow
34. Server Management
• Hand tools - AWS, csshx
• Configuration Management
• Monitoring and Alerting Tools Cluster SSH
100 Million Events Eric Lubow @elubow
35. Server Management
• Hand tools - AWS, csshx
• Configuration Management
• Monitoring and Alerting Tools Cluster SSH
• Performance
100 Million Events Eric Lubow @elubow
36. Server Management
• Hand tools - AWS, csshx
• Configuration Management
• Monitoring and Alerting Tools Cluster SSH
• Performance
• Security
100 Million Events Eric Lubow @elubow
44. Data Patterns
• Storage is cheap
100 Million Events Eric Lubow @elubow
45. Data Patterns
• Storage is cheap
• Composites are WAY better than underscores
100 Million Events Eric Lubow @elubow
46. Data Patterns
• Storage is cheap
• Composites are WAY better than underscores
• Beyond UTF8Type
100 Million Events Eric Lubow @elubow
47. Data Patterns
• Storage is cheap
• Composites are WAY better than underscores
• Beyond UTF8Type
• Timestamps as LongType
100 Million Events Eric Lubow @elubow
49. Safety Mechanisms
• Snapshots before dropping keyspaces
100 Million Events Eric Lubow @elubow
50. Safety Mechanisms
• Snapshots before dropping keyspaces
• Authorization and authentication
100 Million Events Eric Lubow @elubow
51. Safety Mechanisms
• Snapshots before dropping keyspaces
• Authorization and authentication
• (Limit) Direct access to the data store
100 Million Events Eric Lubow @elubow
53. Expertise
• What happens when you need help?
100 Million Events Eric Lubow @elubow
54. Expertise
• What happens when you need help?
• How do you become an expert?
100 Million Events Eric Lubow @elubow
55. Expertise
• What happens when you need help?
• How do you become an expert?
• What happens when you need more experts?
100 Million Events Eric Lubow @elubow
57. Tunables
• Replication factor and read_repair_chance
100 Million Events Eric Lubow @elubow
58. Tunables
• Replication factor and read_repair_chance
• Phi Convict and RPC timeout for AWS or DC separation
100 Million Events Eric Lubow @elubow
59. Tunables
• Replication factor and read_repair_chance
• Phi Convict and RPC timeout for AWS or DC separation
• MAX_HEAP_SIZE and HEAP_NEWSIZE (Analytics vs Realtime)
100 Million Events Eric Lubow @elubow
60. Future
• Priam
• Asgard
• Curator
• Work for ?
• Hastur
100 Million Events Eric Lubow @elubow
62. Summary
• Learn from others mistakes
100 Million Events Eric Lubow @elubow
63. Summary
• Learn from others mistakes
• Tuning and data patterns
100 Million Events Eric Lubow @elubow
64. Summary
• Learn from others mistakes
• Tuning and data patterns
• It’s ok to re-invent the wheel
100 Million Events Eric Lubow @elubow
65. Summary
• Learn from others mistakes
• Tuning and data patterns
• It’s ok to re-invent the wheel
• Applications for/with Cassandra
100 Million Events Eric Lubow @elubow
67. Questions are guaranteed in life.
Answers aren’t.
Eric Lubow
@elubow
elubow@simplereach.com
Thank you.
Editor's Notes
\n
\n
\n
\n
\n
\n
SimpleReach is a social intelligence tool for content creators. We track everything social action, on every major network, across the entire web in real-time. That means every like, tweet, pin, stumble and many more.\n