Ignite@DevOpsDays - Why devs need ops

•

5 likes•9,288 views

A 5 minute talk given at DevOpsDays Goteborg wherein I declare that devs and ops need to work together because their skills mesh nicely.

Technology

Why Devs needs
Ops
Or MP’s, Crowds and failure

Saturday, 15 October 2011

Copyright © Steve Bell 2009

MP’s Expenses
Saturday, 15 October 2011

Simon Willison
“You can now build working
software in less time than it
takes to have the meeting to
describe it”
Photo courtesy of Tom Coates

Saturday, 15 October 2011

Prototyping
• 1 Meeting = 6 people * 1 hour = 6 hours
• 1 prototype = 1 dev * 6 hours = 6 hours!
• New Software Development Stacks for
Rapid development
• Django, Rails, Node.js, Lift, Moustache,
Play, .NET MVC Scalatra...

Saturday, 15 October 2011

Example
• MP’s Expenses
• 1 Developer/ 1 Week
• 1 Designer / 2 Days
• 1 SysAdmin / 1 Day
• EC2 - £50
• Live 10 days after work started
Saturday, 15 October 2011

Not always roses

• Prototype code does not scale
• Prototyping devs don’t think of everything
• ...(or even anything!)

Saturday, 15 October 2011

Crash #1
• Default Conﬁgs
• Our default
• 50 apache children
• 30 MySQL connections
• This isn’t going to work well!

Saturday, 15 October 2011

ORM’s suck mkay
• Pages.object.ﬁlter
(votes__isnull=True).distinct.count
• SELECT COUNT(DISTINCT ...) FROM
‘expenses’ LEFT OUTER JOIN ‘vote’ ON
(...)
WHERE ‘vote.id’ IS NULL

Saturday, 15 October 2011

Crash #2
• The code was bad, the SQL was really bad
• but it takes a sysadmin to point out...
• DB using 135% of CPU
• DB and Apaches on the same box = bad
idea

Saturday, 15 October 2011

How to migrate a DB
• There’s a lot of tools
• It could be quite an effort
• It’s really broken now
• SysAdmins are really evil (especially
@pnasrat)

Saturday, 15 October 2011

How to migrate a DB

• ssh mps-live “mysqldump mp_expenses” |
sed ‘s/ENGINE=MyISAM/ENGINE=InnoDB/
g’ | sed ‘s/CHARSET=latin1/
CHARSET=utf8/g’ | ssh mysql-big “mysql -u
root mp_expenses”

Saturday, 15 October 2011

Next time

• Things our sysadmin would have suggested
if he’d heard about the project prior to the
day of release

Saturday, 15 October 2011

httpperf /
apachebench / curl
+forloop

Saturday, 15 October 2011

Squid/Varnish

Saturday, 15 October 2011

So why didn’t we?

• “SysAdmins slow us down”
• “SysAdmins ask difﬁcult questions”
• “SysAdmins want to puppet everything”

Saturday, 15 October 2011

What do we know now

• “SysAdmins ask the right questions”
• “SysAdmins want repeatability”
• “SysAdmins know some gnarly stuff”
• “SysAdmins can make us go faster”

Saturday, 15 October 2011

DevOps
• Sometimes what you need is not a
“SysAdmin”
• Uptime is important
• What you need is “Crash Mat Arranger”
• Recovering from failure fast is important

Saturday, 15 October 2011

This document discusses the challenges of installing and managing Drupal websites. It notes that installing Drupal requires configuring many complex server components. Updating Drupal sites and testing code changes can also be difficult. The document then introduces Pantheon, a hosting platform that aims to simplify Drupal management. Pantheon handles server configuration, provides automatic updates and backups, and integrates testing and version control into the developer workflow. The conclusion invites the reader to try out Pantheon's beta platform.

MySQL Sandbox - A toolkit for productive laziness

Giuseppe Maxia

Core Data in Motion

Lori Olson

Have you tried to use CoreData in RubyMotion, only to get lost in the quagmire of simplistic or confusing examples, DSL's and gems? Have you been asking yourself these questions: Do I have to use XCode to create a CoreData model?; How do relationships work in code work anyway?; How do I pre-load data into my CoreData store?; What is an NSFetchedResultsController, and why do I need one? We'll delve into each of these questions, and review the surprisingly simple, elegant solutions that RubyMotion can provide.

Vlad Zelinschi - Embrace Native JavaScript (the anti-plugins talk) - Codecamp...

Codecamp Romania

The document discusses the use of plugins in JavaScript development. It notes that while plugins can improve development speed, they can negatively impact performance and introduce dependencies. The document recommends using native JavaScript APIs instead of plugins when possible, as native code is often faster and avoids unnecessary dependencies. It also recommends dropping jQuery in favor of native alternatives for DOM manipulation, events, and animations in modern browsers that support these features natively.

Devops With Boxfuse and Shippable

Andrew Schwabe

Core Data in RubyMotion #inspect

Lori Olson

Milkyway@home rcos presentation_4_8_2011

mskmoorthy

The document discusses the Milkyway@Home distributed computing project which uses volunteer computing to work on simulations of the structure of the Milky Way galaxy, including tidal streams and N-body simulations. It also discusses development of iOS and mobile apps for the project, optimizations made to the CAL++ code to speed up simulations, issues that arose from updating the project's Subversion server software, plans to implement simulations using the Lua programming language, and work done on GPU implementations of the N-body problem.

Journey to 1000 tests a day

Bruce McLeod

This document provides a history of JavaScript development from 1995 to the present. It describes how JavaScript evolved from a scripting language created in 10 days for Netscape (Mocha/LiveScript) to an industry standard (ECMAScript). It outlines major developments like Node.js, npm, and the rise of JavaScript modules/tooling. It recommends choosing technologies based on your specific needs rather than trends, investing in great tooling, and continuing to learn as the ecosystem rapidly changes.

Python to go

Weng Wei

The author explains why they switched from primarily using Python to primarily using Go for serious projects. Some key reasons include that Go has better performance, code quality, testing, and concurrency features compared to Python. While Python is still good for hobby projects, Go enforces error handling, has built-in profiling tools, and makes deployment easier due to compiling to a single binary.

PuppetCamp SEA 1 - The State of Puppet

Walter Heck

James Turnbull, VP of Tech Operations at Puppetlabs, started off the day with a very interesting and informative talk about the past, current and future of Puppet. He showed they have a strong link to their community and plan to keep it that way. He explained that they grew from very small to 70+ people over the last year, and that brings some issues with it. They are very dedicated to fixing those issues though, and hope to improve things moving towards the future.

[Rakuten TechConf2014] [C-2] Big Data for eBooks and eReaders

Rakuten Group, Inc.

This document discusses Kobo's use of big data analytics for ebooks and ereaders. It describes how Kobo uses technologies like Hadoop, Storm, and Solix to process, store, and analyze streaming data from ebooks. Kobo's big data team analyzes this data to power search and recommendations functions, perform content analysis tasks like related items and adult content filtering, and extract metadata from books to link to online information. Kobo's optimization of webpage layouts also utilizes big data approaches to test configurations and maximize user engagement.

Ten years later

Cristian Vat

This document discusses the history and evolution of JavaScript over the past 23 years, from its origins in 1995 to the present. It focuses on key events like the standardization of ECMAScript, the introduction of AJAX, jQuery, and how Google Chrome and technologies like V8, Node.js, and WebAssembly have driven JavaScript's widespread adoption and improved performance. JavaScript has gone from an experimental scripting language to being ubiquitous across the web and in applications through technologies like Electron.

Godoggo

mskmoorthy

The document discusses potential new features and improvements for a Go game recording and artificial intelligence program. It describes rewriting an existing Go board recognition library in C++, improving grid detection methods, developing features for scoring and broadcasting games, and creating a searchable database for game records. It also outlines challenges for developing a Go AI, including board representation, Monte Carlo evaluation techniques, pattern matching, and integrating different strategic modules.

ReactJS Code Impact

Raymond McDermott

Alternative Mapping on iOS

Development Seed

This document discusses alternatives to Apple's MapKit framework for mapping on iOS. It proposes using SQLite databases and the MBTiles format to store tile-based map images, which compresses large numbers of tiles into smaller file sizes. It also describes evaluating the open source route-me framework for tile-based mapping on iOS, though notes it has its own conventions and could be refactored. The goal is to create a customizable and lightweight mapping solution for iOS outside of MapKit.

Clojure slides

mcohen01

Preserve order amid change and change amid order. Languages vary in power and more powerful languages allow things that are possible but not necessarily easy or interesting. Immutable objects are simpler, inherently thread-safe, and make great building blocks. Classes should be immutable unless there is a good reason for mutability. Modeling with immutable values rather than mutable objects avoids many concurrency issues.

How I Learned To Stop Worrying & Love HTML5

Dale Cruse

The document is a presentation about HTML5. It defines HTML5 as both old and new, discussing elements that are still supported and new elements added. It addresses common myths around HTML5 like it being a Flash killer. The presentation outlines advantages of HTML5 for different roles like publishers, designers, and developers. It provides examples of how to implement semantic HTML5 elements and multimedia. Finally, it recommends resources for learning more about HTML5 like books, websites, and events.

Through Meteor to the stars - Developing full-stack SPA's with meteor.js

Wekoslav Stefanovski

You've successfully learned all the ins and outs of Javascript, and can code up a website's front-end in minutes. Great. But, you always had to rely on some pesky back-end developers, with their weird way of speaking, using their weird server languages... Well, not any more - With meteor.js, you can create, build and deploy a completely complete website using only Javascript - and all from your favorite editor. Come and see the magic!

Things you should know if you plan to ship a game

DevGAMM Conference

Customizing the custom loop wordcamp 2012-jeff

Jeff Marx

The New JavaScript: ES6

Rob Eisenberg

This year ECMA International will be ratifying the biggest update to the JavaScript language in its history. In this talk we'll look at key features already appearing in browsers as well as those coming in the near future. We'll also explore how you can begin leveraging the power of ES6 across all browsers today. If you haven't looked at JavaScript recently, you soon realize that a bigger, better world awaits.

The "Run Anywhere" Mindset

DevOpsDays DFW

WordPress Development Environments

Josh Cummings

This document discusses tools for creating a WordPress development environment. It covers common development setups like LAMP/LEMP stacks, tools for local development like text editors and version control, and options for setting up a local environment like MAMP, native Linux/Mac stacks, Virtual Machines with Vagrant/VVV, and containers with Docker. The goals are to choose tools that allow for effective collaboration, testing, and deploying code across different environments.

EclipseCon Europe 2011

Sigasi

This document discusses using the Xtext framework to build an Eclipse-based integrated development environment (IDE) for digital hardware design using VHDL. It describes implementing a VHDL grammar, scoping, autocompletion, formatting and testing. Key challenges included debugging the declarative scoping approach, improving autocomplete beyond the grammar, customizing formatting, and addressing performance issues for large files. Overall Xtext provided a good starting point but significant custom work was still required to build the IDE.

Irb Tips and Tricks

John McCaffrey

Reef - ESUG 2010

Esteban Lorenzano

Scaling

Òscar Vilaplana

Node.js Patterns and Opinions

IsaacSchlueter

Node.js: Patterns and Opinions discusses Node.js principles and best practices. It emphasizes that Node.js is built on JavaScript and uses non-blocking I/O with callbacks to handle requests asynchronously. It recommends avoiding slowness, ignoring errors, and focusing on portability, small modular parts, and an open community approach. The future of Node.js involves continued improvements to core modules like HTTP and new versions of underlying technologies.

Using AWS, Terraform, and Ansible to Automate Splunk at Scale

Data Works MD

The DreamPort Splunk Project; How We Use AWS, Terraform, and Ansible to Automate Everything About a Splunk Cluster At DreamPort, we use cloud platforms, infrastructure-as-code tooling, configuration tools, automation software, and container technologies to very quickly design, develop, and prototype projects. This particular talk focuses on the tools used to deploy and configure a Splunk cluster for a particular project we recently ran. We will cover the deployment, configuration, and orchestration of a large 16 node Splunk cluster using tools that are a core set to DreamPort's cloud infrastructure toolbox; AWS, Terraform, Ansible, and Docker. It is recommended that attendees have a general understanding of AWS, Linux, Splunk, and Docker, and know about automation tools such as Terraform and Ansible. Attendees will learn how to use AWS, Terraform, Ansible, and Docker to deploy a large Splunk cluster, how to use Ansible to orchestrate and manage the Splunk cluster, and how to use Ansible to orchestrate and manage the Splunk cluster. ------------------------------------------------- Bill Cawthra is a Principal Cloud Infrastructure Architect for CyberPoint, managing project-related cloud systems and platforms. He works primarily on the AWS platform, using various automation tools to rapidly deploy and manage infrastructure. Bill has over 18 years of experience in computers and technology, working in a range of fields, including construction, DoD, health care, and social media.

What's hot

DownTheRabbitHole.js – How to Stay Sane in an Insane Ecosystem

FITC

Python to go

Weng Wei

PuppetCamp SEA 1 - The State of Puppet

Walter Heck

[Rakuten TechConf2014] [C-2] Big Data for eBooks and eReaders

Ten years later

Godoggo

ReactJS Code Impact

Alternative Mapping on iOS

Development Seed

Clojure slides

mcohen01

How I Learned To Stop Worrying & Love HTML5

Dale Cruse

Through Meteor to the stars - Developing full-stack SPA's with meteor.js

Wekoslav Stefanovski

Things you should know if you plan to ship a game

DevGAMM Conference

Customizing the custom loop wordcamp 2012-jeff

Jeff Marx

The New JavaScript: ES6

Rob Eisenberg

The "Run Anywhere" Mindset

DevOpsDays DFW

WordPress Development Environments

Josh Cummings

EclipseCon Europe 2011

Irb Tips and Tricks

Reef - ESUG 2010

Scaling

What's hot (20)

DownTheRabbitHole.js – How to Stay Sane in an Insane Ecosystem

Python to go

PuppetCamp SEA 1 - The State of Puppet

[Rakuten TechConf2014] [C-2] Big Data for eBooks and eReaders

Ten years later

Godoggo

ReactJS Code Impact

Alternative Mapping on iOS

Clojure slides

How I Learned To Stop Worrying & Love HTML5

Through Meteor to the stars - Developing full-stack SPA's with meteor.js

Things you should know if you plan to ship a game

Customizing the custom loop wordcamp 2012-jeff

The New JavaScript: ES6

The "Run Anywhere" Mindset

WordPress Development Environments

EclipseCon Europe 2011

Irb Tips and Tricks

Reef - ESUG 2010

Scaling

Similar to Ignite@DevOpsDays - Why devs need ops

Node.js Patterns and Opinions

IsaacSchlueter

Using AWS, Terraform, and Ansible to Automate Splunk at Scale

Data Works MD

Observability will not fix your Broken Monitoring ,Ignite

Kris Buytaert

This document summarizes a presentation about observability given by Kris Buytaert. The presentation discusses how adopting new observability tools alone will not fix underlying issues with broken monitoring. It provides an example of a large organization that spent a year moving to Prometheus but ended up managing two toolsets without achieving real observability. The presentation recommends first fixing existing monitoring, creating a single source of truth, automating configuration, improving alerts, and learning from metrics before adopting new observability tools. It emphasizes focusing on the goals for observability and involving relevant teams to understand real needs.

Scaling a High Traffic Web Application: Our Journey from Java to PHP

120bi

What makes an application scale? What should you worry about early on and what can wait? Over the last 3 years, Achievers has learned many lessons and gained fundamental knowledge on scaling our SaaS platform. CTO Dr. Aris Zakinthinos will present and discuss the decisions we’ve made including language choice, server architecture, and much more; join us while we share tips, tricks, and things to absolutely avoid. Throughout the evening you will have the opportunity to talk to the development team behind the Achievers Platform and ask questions on scaling best practices.

Scaling High Traffic Web Applications

Achievers Tech

Yet Another Dan Kaminsky Talk (Black Ops 2014)

Dan Kaminsky

The document is a transcript of a talk by Dan Kaminsky about various cybersecurity topics. Some key points: - Hard drives are essentially their own computers with direct access to system memory, so malware on a hard drive can be highly persistent. - Random number generators are often insecure by default due to lack of entropy. This leads to issues like easily crackable passwords. - A new library called Liburandy aims to make random numbers secure by default by hijacking standard functions and backing them with cryptographically secure sources of randomness. - Humans are better at remembering stories than random bits, so representing passwords as memorable stories could improve security and usability.

All Your IOPS Are Belong To Us - A Pinteresting Case Study in MySQL Performan...

Ernie Souhrada

Have you ever thought that your SSD storage just doesn't seem anywhere near as fast as advertised? What if I told you that a couple of small changes to your Linux servers had the potential to more than double the amount of throughput your MySQL servers could handle while simultaneously reducing query response time by around 50 percent? It's not a dream, Neo. If you're still in a traditional data center and/or your MySQL footprint lives on spinning rust, then you might want to take the blue pill, attend a different session, and believe whatever you want to believe. However, if your server footprint runs inside Amazon Web Services or if you use SSDs in any fashion, I invite you to take the red pill and come with me on a journey down the rabbit hole, where we'll discuss such things as the Linux block IO driver, CPU starvation, and interrupt handling, using real-world query performance data from the primary MySQL data stores at Pinterest to illustrate the effect.

Can i Get C# for Free ?

Welly Tambunan

Dev ops lessons learned - Michael Collins

Devopsdays

The document discusses lessons learned from trying to implement DevOps in a rapidly growing company. Some key lessons include: (1) being able to clearly articulate what DevOps means for both individuals and the organization; (2) trusting developers and providing them with what they need; and (3) starting DevOps efforts with a focus on development environments rather than just production. The document also emphasizes focusing on toolchains rather than individual tools, using a service delivery pipeline approach, and ensuring good communication and hiring practices.

Monitoring is easy, why are we so bad at it presentation

Theo Schlossnagle

Php johannesburg meetup - talk 2014 - scaling php in the enterprise

Sarel van der Walt

This document discusses scaling PHP applications for enterprise environments. It provides tips on optimizing various aspects of PHP applications and infrastructure to improve scalability. These include optimizing databases, caching, background tasks, frameworks, monitoring, and more. Specific technologies and strategies mentioned include Redis, memcached, haproxy, MySQL optimization techniques like archiving, and moving work to the client side where possible using techniques like AngularJS.

Building a Startup in .NET

Marcelo Calbucci

Serverless Toronto helps Startups

Daniel Zivkovic

Serverless Architectures enable scalable and cost-effective apps to be built faster, so they can dramatically increase the odds of Your Startup's Success! In "Startups + Serverless = Match made in Heaven" meetup, www.ServerlessToronto.org members discussed how to help Entrepreneurs push their businesses up to "other side of the teeterboard" (without failing) using the Serverless technologies: https://www.youtube.com/watch?v=1SqfJo47kMA

Load testing, Lessons learnt and Loadzen - Martin Buhr at DevTank - 31st Janu...

Loadzen

Keeping MongoDB Data Safe

Tony Tam

This document discusses various strategies for backing up MongoDB data to keep it safe. It recommends: 1. Using mongodump for simple backups that can restore quickly but may be inconsistent. 2. Setting up replication for high availability, but also using mongodump for backups and testing restore processes. 3. Taking snapshots of the data files for consistent backups, but this requires downtime and gaps can occur between snapshots. 4. Using the oplog for incremental, continuous backups to avoid gaps without downtime using tools like the Wordnik Admin Tools. Testing backups is strongly recommended.

PyData Texas 2015 Keynote

Peter Wang

This document summarizes Peter Wang's keynote speech at PyData Texas 2015. It begins by looking back at the history and growth of PyData conferences over the past 3 years. It then discusses some of the main data science challenges companies currently face. The rest of the speech focuses on the role of Python in data science, how the technology landscape has evolved, and PyData's mission to empower scientists to explore, analyze, and share their data.

Hadoop Demystified + Automation Smackdown! Austin JUG June 24 2014

datafundamentals

This document discusses two approaches to ETL jobs in Hadoop: a manual "special snowflake" approach and an automated approach. The manual approach involves a team spending a year copying and pasting code for 15 jobs. This leads to spaghetti code and is not sustainable. The automated approach involves designing reusable templates and rules to automate the ETL process. This frees up the developer Brent to focus on design rather than manual work. It results in code that is clean, consistent, easy to maintain and passes the "10 minute test" of being idempotent. The document demonstrates generating ETL code from metadata and deploying the automated jobs to Hadoop.

Hacklu2011 tricaud

stricaud

This document discusses how visualization can help make IT security possible when dealing with large scale infrastructure. It describes some common security tools like antivirus software, firewalls, and intrusion detection systems that are used but have limitations. The document then introduces parallel coordinate visualization as a tool that can help analyze large volumes of log and event data to help detect unknown attacks and behaviors. It provides examples of how parallel coordinates could be used to visualize and analyze squid proxy logs, Apache logs, and OpenVPN tunnels. The conclusion is that traditional visualization often fails at scale but parallel coordinates enables analyzing large datasets to find the unknown and understand logs better.

My site is slow

hernanibf

Drupal is a powerful and flexible platform to build websites with rich funcionalities without building almost anything from scratch. This flexibility brought by the usage of a powerful framework and the work of a super active community can abstract people to understand what is Drupal doing behind the scenes. Most of performance talks regarding Drupal focus on aspects like infrastructure changes, caching strategies, and comparison of performance between modules or platforms. Unfortunately when performance problems occur, development teams also follow several strategies to replace several aspects in their platforms, jump directly to look for slow queries before trying really to understand where is the bottleneck. However, most of the times what really needs to be done is to look to what the application is doing and understanding why is it taking so long to do it. Drupal is a platform used by million of websites worldwide and its performance is easy to measure and compare. At Acquia we have done dozens of performance assessments, and even if we usually face the same problems, sometimes we found weird situations that are only possible to be detected when measured. Measuring and profiling is the only way to understand performance problems in a site and provide valid fixes. In this talk I will explain how to detect problems regarding performance in Drupal, using simple modules like devel, profilers like XhProf and looking to logs to understand the impact done on the application.

What Drove Wordnik Non-Relational?

DATAVERSITY

Wordnik migrated from a MySQL database to a MongoDB non-relational database for 5 key reasons: speed, stability, scaling, simplicity, and their data needs. They tested multiple NoSQL solutions over 8 weeks before selecting MongoDB. The migration process required iterating their object mapping and data access patterns. They used a temporary switch to migrate production data with zero downtime. Performance optimization involved moving to physical data centers and pre-fetching on updates.

Similar to Ignite@DevOpsDays - Why devs need ops (20)

Node.js Patterns and Opinions

Using AWS, Terraform, and Ansible to Automate Splunk at Scale

Observability will not fix your Broken Monitoring ,Ignite

Scaling a High Traffic Web Application: Our Journey from Java to PHP

Scaling High Traffic Web Applications

Yet Another Dan Kaminsky Talk (Black Ops 2014)

All Your IOPS Are Belong To Us - A Pinteresting Case Study in MySQL Performan...

Can i Get C# for Free ?

Dev ops lessons learned - Michael Collins

Monitoring is easy, why are we so bad at it presentation

Php johannesburg meetup - talk 2014 - scaling php in the enterprise

Building a Startup in .NET

Serverless Toronto helps Startups

Load testing, Lessons learnt and Loadzen - Martin Buhr at DevTank - 31st Janu...

Keeping MongoDB Data Safe

PyData Texas 2015 Keynote

Hadoop Demystified + Automation Smackdown! Austin JUG June 24 2014

Hacklu2011 tricaud

My site is slow

What Drove Wordnik Non-Relational?

Recently uploaded

Christine's Product Research Presentation.pptx

christinelarrosa

"Choosing proper type of scaling", Olena Syrota

Fwdays

Apps Break Data

Ivo Velitchkov

How information systems are built or acquired puts information, which is what they should be about, in a secondary place. Our language adapted accordingly, and we no longer talk about information systems but applications. Applications evolved in a way to break data into diverse fragments, tightly coupled with applications and expensive to integrate. The result is technical debt, which is re-paid by taking even bigger "loans", resulting in an ever-increasing technical debt. Software engineering and procurement practices work in sync with market forces to maintain this trend. This talk demonstrates how natural this situation is. The question is: can something be done to reverse the trend?

[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...

Jason Yip

The typical problem in product engineering is not bad strategy, so much as “no strategy”. This leads to confusion, lack of motivation, and incoherent action. The next time you look for a strategy and find an empty space, instead of waiting for it to be filled, I will show you how to fill it in yourself. If you’re wrong, it forces a correction. If you’re right, it helps create focus. I’ll share how I’ve approached this in the past, both what works and lessons for what didn’t work so well.

Demystifying Knowledge Management through Storytelling

Enterprise Knowledge

The Department of Veteran Affairs (VA) invited Taylor Paschal, Knowledge & Information Management Consultant at Enterprise Knowledge, to speak at a Knowledge Management Lunch and Learn hosted on June 12, 2024. All Office of Administration staff were invited to attend and received professional development credit for participating in the voluntary event. The objectives of the Lunch and Learn presentation were to: - Review what KM ‘is’ and ‘isn’t’ - Understand the value of KM and the benefits of engaging - Define and reflect on your “what’s in it for me?” - Share actionable ways you can participate in Knowledge - - Capture & Transfer

inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill

LizaNolte

HERE IS YOUR WEBINAR CONTENT! 'Mastering Customer Journey Management with Dr. Graham Hill'. We hope you find the webinar recording both insightful and enjoyable. In this webinar, we explored essential aspects of Customer Journey Management and personalization. Here’s a summary of the key insights and topics discussed: Key Takeaways: Understanding the Customer Journey: Dr. Hill emphasized the importance of mapping and understanding the complete customer journey to identify touchpoints and opportunities for improvement. Personalization Strategies: We discussed how to leverage data and insights to create personalized experiences that resonate with customers. Technology Integration: Insights were shared on how inQuba’s advanced technology can streamline customer interactions and drive operational efficiency.

Y-Combinator seed pitch deck template PP

c5vrf27qcz

Essentials of Automations: Exploring Attributes & Automation Parameters

Safe Software

Building automations in FME Flow can save time, money, and help businesses scale by eliminating data silos and providing data to stakeholders in real-time. One essential component to orchestrating complex automations is the use of attributes & automation parameters (both formerly known as “keys”). In fact, it’s unlikely you’ll ever build an Automation without using these components, but what exactly are they? Attributes & automation parameters enable the automation author to pass data values from one automation component to the next. During this webinar, our FME Flow Specialists will cover leveraging the three types of these output attributes & parameters in FME Flow: Event, Custom, and Automation. As a bonus, they’ll also be making use of the Split-Merge Block functionality. You’ll leave this webinar with a better understanding of how to maximize the potential of automations by making use of attributes & automation parameters, with the ultimate goal of setting your enterprise integration workflows up on autopilot.

Lee Barnes - Path to Becoming an Effective Test Automation Engineer.pdf

leebarnesutopia

So… you want to become a Test Automation Engineer (or hire and develop one)? While there’s quite a bit of information available about important technical and tool skills to master, there’s not enough discussion around the path to becoming an effective Test Automation Engineer that knows how to add VALUE. In my experience this had led to a proliferation of engineers who are proficient with tools and building frameworks but have skill and knowledge gaps, especially in software testing, that reduce the value they deliver with test automation. In this talk, Lee will share his lessons learned from over 30 years of working with, and mentoring, hundreds of Test Automation Engineers. Whether you’re looking to get started in test automation or just want to improve your trade, this talk will give you a solid foundation and roadmap for ensuring your test automation efforts continuously add value. This talk is equally valuable for both aspiring Test Automation Engineers and those managing them! All attendees will take away a set of key foundational knowledge and a high-level learning path for leveling up test automation skills and ensuring they add value to their organizations.

GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph

Neo4j

Poznań ACE event - 19.06.2024 Team 24 Wrapup slidedeck

FilipTomaszewski5

Discover the Unseen: Tailored Recommendation of Unwatched Content

ScyllaDB

The session shares how JioCinema approaches ""watch discounting."" This capability ensures that if a user watched a certain amount of a show/movie, the platform no longer recommends that particular content to the user. Flawless operation of this feature promotes the discover of new content, improving the overall user experience. JioCinema is an Indian over-the-top media streaming service owned by Viacom18.

"NATO Hackathon Winner: AI-Powered Drug Search", Taras Kloba

Fwdays

This is a session that details how PostgreSQL's features and Azure AI Services can be effectively used to significantly enhance the search functionality in any application. In this session, we'll share insights on how we used PostgreSQL to facilitate precise searches across multiple fields in our mobile application. The techniques include using LIKE and ILIKE operators and integrating a trigram-based search to handle potential misspellings, thereby increasing the search accuracy. We'll also discuss how the azure_ai extension on PostgreSQL databases in Azure and Azure AI Services were utilized to create vectors from user input, a feature beneficial when users wish to find specific items based on text prompts. While our application's case study involves a drug search, the techniques and principles shared in this session can be adapted to improve search functionality in a wide range of applications. Join us to learn how PostgreSQL and Azure AI can be harnessed to enhance your application's search capability.

GNSS spoofing via SDR (Criptored Talks 2024)

Javier Junquera

In the realm of cybersecurity, offensive security practices act as a critical shield. By simulating real-world attacks in a controlled environment, these techniques expose vulnerabilities before malicious actors can exploit them. This proactive approach allows manufacturers to identify and fix weaknesses, significantly enhancing system security. This presentation delves into the development of a system designed to mimic Galileo's Open Service signal using software-defined radio (SDR) technology. We'll begin with a foundational overview of both Global Navigation Satellite Systems (GNSS) and the intricacies of digital signal processing. The presentation culminates in a live demonstration. We'll showcase the manipulation of Galileo's Open Service pilot signal, simulating an attack on various software and hardware systems. This practical demonstration serves to highlight the potential consequences of unaddressed vulnerabilities, emphasizing the importance of offensive security practices in safeguarding critical infrastructure.

From Natural Language to Structured Solr Queries using LLMs

Sease

This talk draws on experimentation to enable AI applications with Solr. One important use case is to use AI for better accessibility and discoverability of the data: while User eXperience techniques, lexical search improvements, and data harmonization can take organizations to a good level of accessibility, a structural (or “cognitive” gap) remains between the data user needs and the data producer constraints. That is where AI – and most importantly, Natural Language Processing and Large Language Model techniques – could make a difference. This natural language, conversational engine could facilitate access and usage of the data leveraging the semantics of any data source. The objective of the presentation is to propose a technical approach and a way forward to achieve this goal. The key concept is to enable users to express their search queries in natural language, which the LLM then enriches, interprets, and translates into structured queries based on the Solr index’s metadata. This approach leverages the LLM’s ability to understand the nuances of natural language and the structure of documents within Apache Solr. The LLM acts as an intermediary agent, offering a transparent experience to users automatically and potentially uncovering relevant documents that conventional search methods might overlook. The presentation will include the results of this experimental work, lessons learned, best practices, and the scope of future work that should improve the approach and make it production-ready.

LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...

DanBrown980551

This LF Energy webinar took place June 20, 2024. It featured: -Alex Thornton, LF Energy -Hallie Cramer, Google -Daniel Roesler, UtilityAPI -Henry Richardson, WattTime In response to the urgency and scale required to effectively address climate change, open source solutions offer significant potential for driving innovation and progress. Currently, there is a growing demand for standardization and interoperability in energy data and modeling. Open source standards and specifications within the energy sector can also alleviate challenges associated with data fragmentation, transparency, and accessibility. At the same time, it is crucial to consider privacy and security concerns throughout the development of open source platforms. This webinar will delve into the motivations behind establishing LF Energy’s Carbon Data Specification Consortium. It will provide an overview of the draft specifications and the ongoing progress made by the respective working groups. Three primary specifications will be discussed: -Discovery and client registration, emphasizing transparent processes and secure and private access -Customer data, centering around customer tariffs, bills, energy usage, and full consumption disclosure -Power systems data, focusing on grid data, inclusive of transmission and distribution networks, generation, intergrid power flows, and market settlement data

A Deep Dive into ScyllaDB's Architecture

ScyllaDB

Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians

Neo4j

"$10 thousand per minute of downtime: architecture, queues, streaming and fin...

Fwdays

Direct losses from downtime in 1 minute = $5-$10 thousand dollars. Reputation is priceless. As part of the talk, we will consider the architectural strategies necessary for the development of highly loaded fintech solutions. We will focus on using queues and streaming to efficiently work and manage large amounts of data in real-time and to minimize latency. We will focus special attention on the architectural patterns used in the design of the fintech system, microservices and event-driven architecture, which ensure scalability, fault tolerance, and consistency of the entire system.

PRODUCT LISTING OPTIMIZATION PRESENTATION.pptx

christinelarrosa

Recently uploaded (20)

Christine's Product Research Presentation.pptx

"Choosing proper type of scaling", Olena Syrota

Apps Break Data

[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...

Demystifying Knowledge Management through Storytelling

inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill

Y-Combinator seed pitch deck template PP

Essentials of Automations: Exploring Attributes & Automation Parameters

Lee Barnes - Path to Becoming an Effective Test Automation Engineer.pdf

GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph

Poznań ACE event - 19.06.2024 Team 24 Wrapup slidedeck

Discover the Unseen: Tailored Recommendation of Unwatched Content

"NATO Hackathon Winner: AI-Powered Drug Search", Taras Kloba

GNSS spoofing via SDR (Criptored Talks 2024)

From Natural Language to Structured Solr Queries using LLMs

LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...

A Deep Dive into ScyllaDB's Architecture

Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians

"$10 thousand per minute of downtime: architecture, queues, streaming and fin...

PRODUCT LISTING OPTIMIZATION PRESENTATION.pptx

Ignite@DevOpsDays - Why devs need ops

1. Why Devs needs Ops Or MP’s, Crowds and failure Saturday, 15 October 2011

3. Saturday, 15 October 2011

4. Simon Willison “You can now build working software in less time than it takes to have the meeting to describe it” Photo courtesy of Tom Coates Saturday, 15 October 2011

5. Prototyping • 1 Meeting = 6 people * 1 hour = 6 hours • 1 prototype = 1 dev * 6 hours = 6 hours! • New Software Development Stacks for Rapid development • Django, Rails, Node.js, Lift, Moustache, Play, .NET MVC Scalatra... Saturday, 15 October 2011

6. Example • MP’s Expenses • 1 Developer/ 1 Week • 1 Designer / 2 Days • 1 SysAdmin / 1 Day • EC2 - £50 • Live 10 days after work started Saturday, 15 October 2011

7. Not always roses • Prototype code does not scale • Prototyping devs don’t think of everything • ...(or even anything!) Saturday, 15 October 2011

8. Crash #1 • Default Conﬁgs • Our default • 50 apache children • 30 MySQL connections • This isn’t going to work well! Saturday, 15 October 2011

9. Saturday, 15 October 2011

10. Saturday, 15 October 2011

11. ORM’s suck mkay • Pages.object.ﬁlter (votes__isnull=True).distinct.count • SELECT COUNT(DISTINCT ...) FROM ‘expenses’ LEFT OUTER JOIN ‘vote’ ON (...) WHERE ‘vote.id’ IS NULL Saturday, 15 October 2011

12. Crash #2 • The code was bad, the SQL was really bad • but it takes a sysadmin to point out... • DB using 135% of CPU • DB and Apaches on the same box = bad idea Saturday, 15 October 2011

13. How to migrate a DB • There’s a lot of tools • It could be quite an effort • It’s really broken now • SysAdmins are really evil (especially @pnasrat) Saturday, 15 October 2011

14. How to migrate a DB • ssh mps-live “mysqldump mp_expenses” | sed ‘s/ENGINE=MyISAM/ENGINE=InnoDB/ g’ | sed ‘s/CHARSET=latin1/ CHARSET=utf8/g’ | ssh mysql-big “mysql -u root mp_expenses” Saturday, 15 October 2011

15. Next time • Things our sysadmin would have suggested if he’d heard about the project prior to the day of release Saturday, 15 October 2011

16. httpperf / apachebench / curl +forloop Saturday, 15 October 2011

17. Squid/Varnish Saturday, 15 October 2011

18. So why didn’t we? • “SysAdmins slow us down” • “SysAdmins ask difﬁcult questions” • “SysAdmins want to puppet everything” Saturday, 15 October 2011

19. What do we know now • “SysAdmins ask the right questions” • “SysAdmins want repeatability” • “SysAdmins know some gnarly stuff” • “SysAdmins can make us go faster” Saturday, 15 October 2011

20. DevOps • Sometimes what you need is not a “SysAdmin” • Uptime is important • What you need is “Crash Mat Arranger” • Recovering from failure fast is important Saturday, 15 October 2011

Ignite@DevOpsDays - Why devs need ops

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Ignite@DevOpsDays - Why devs need ops

Similar to Ignite@DevOpsDays - Why devs need ops (20)

Recently uploaded

Recently uploaded (20)

Ignite@DevOpsDays - Why devs need ops