Video and slides synchronized, mp3 and slide download available at http://bit.ly/XCxzIh.
Frank Harris and Nellwyn Thomas present the deployment process used by Etsy based on experiments. Filmed at qconsf.com.
Frank Harris is a Product Manager on Search, Recommendations and Data at Etsy. Previously, he was a Sr. UX Designer at Google focusing on payments and commerce. @hirefrank Nellwyn Thomas is an analyst on the Data team at Etsy, where she works closely with product, marketing, and engineering to scout, build, instrument and improve Etsy’s product portfolio. @nellwyn
Building the Ideal Stack for Machine LearningSingleStore
Machine Learning is not new, but its application across memory-optimized distributed systems has led to an explosion in both the number and capability of its uses. Pandora develops personalized content recommendations with machine learning algorithms, Tesla has produced the first widely distributed autonomous vehicle, and Amazon uses autonomous robots to move packages within its warehouses and even deliver packages. When coupled with real-time data, advanced analytics approaches like machine learning and deep learning create immediate business opportunities.
Machine learning has never been more accessible—if your data pipelines support real-time analysis. Attendees will learn tools and techniques for integrating machine learning models across industries and organizations. Steven Camiña, MemSQL Product Manager, will walk through critical technologies needed in your technology ecosystem, including Python, Apache Kafka, Apache Spark, and a real-time database.
Building the Ideal Stack for Machine LearningSingleStore
Machine Learning is not new, but its application across memory-optimized distributed systems has led to an explosion in both the number and capability of its uses. Pandora develops personalized content recommendations with machine learning algorithms, Tesla has produced the first widely distributed autonomous vehicle, and Amazon uses autonomous robots to move packages within its warehouses and even deliver packages. When coupled with real-time data, advanced analytics approaches like machine learning and deep learning create immediate business opportunities.
Machine learning has never been more accessible—if your data pipelines support real-time analysis. Attendees will learn tools and techniques for integrating machine learning models across industries and organizations. Steven Camiña, MemSQL Product Manager, will walk through critical technologies needed in your technology ecosystem, including Python, Apache Kafka, Apache Spark, and a real-time database.
Streaming a Million Likes/Second: Real-Time Interactions on Live VideoC4Media
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/39NIjLV.
Akhilesh Gupta does a technical deep-dive into how Linkedin uses the Play/Akka Framework and a scalable distributed system to enable live interactions like likes/comments at massive scale at extremely low costs across multiple data centers. Filmed at qconlondon.com.
Akhilesh Gupta is the technical lead for LinkedIn's Real-time delivery infrastructure and LinkedIn Messaging. He has been working on the revamp of LinkedIn’s offerings to instant, real-time experiences. Before this, he was the head of engineering for the Ride Experience program at Uber Technologies in San Francisco.
Next Generation Client APIs in Envoy MobileC4Media
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2x0Fav8.
Jose Nino guides the audience through the journey of Mobile APIs at Lyft. He focuses on how the team has reaped the benefits of API generation to experiment with the network transport layer. He also discusses recent developments the team has made with Envoy Mobile and the roadmap ahead. Filmed at qconlondon.com.
Jose Nino works as a Software Engineer at Lyft.
Software Teams and Teamwork Trends Report Q1 2020C4Media
How do we cope with an environment that has been radically disrupted, where people are suddenly thrust into remote work in a chaotic state? What are the emerging good practices and new ideas that are shaping the way in which software development teams work? What can we do to make the workplace a more secure and diverse one while increasing the productivity of our teams? This report aims to assist technical leaders in making mid- to long-term decisions that will have a positive impact on their organisations and teams and help individual contributors find the practices, approaches, tools, techniques, and frameworks that can help them get a better experience at work - irrespective of where they are working from.
Understand the Trade-offs Using Compilers for Java ApplicationsC4Media
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2QCmmJ0.
Mark Stoodley examines some of the strengths and weaknesses of the different Java compilation technologies, if one was to apply them in isolation. Stoodley discusses how production JVMs are assembling a combination of these tools that work together to provide excellent performance across the large spectrum of applications written in Java and JVM based languages. Filmed at qconsf.com.
Mark Stoodley joined IBM Canada to build Java JIT compilers for production use and led the team that delivered AOT compilation in the IBM SDK for Java 6. He spent the last five years leading the effort to open source nearly 4.3 million lines of source code from the IBM J9 Java Virtual Machine to create the two open source projects Eclipse OMR and Eclipse OpenJ9, and now co-leads both projects.
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2y2yPiS.
Colin McCabe talks about the ongoing effort to replace the use of Zookeeper in Kafka: why they want to do it and how it will work. He discusses the limitations they have found and how Kafka benefits both in terms of stability and scalability by bringing consensus in house. He talks about their progress, what work is remaining, and how contributors can help. Filmed at qconsf.com.
Colin McCabe is a Kafka committer at Confluent, working on the scalability and extensibility of Kafka. Previously, he worked on the Hadoop Distributed Filesystem and the Ceph Filesystem.
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2SXXXiD.
Katharina Probst talks about what it means to act like an owner and why teams need ownership to be high-performing. When team members, regardless of whether they have a formal leadership role or not, act like owners, magical things can happen. She shares ideas that we can apply to our own work, and talks about how to recognize when we don’t live up to our own expectations of acting like an owner. Filmed at qconsf.com.
Katharina Probst is a Senior Engineering Leader, Kubernetes & SaaS at Google. Before this, she was leading engineering teams at Netflix, being responsible for the Netflix API, which helps bring Netflix streaming to millions of people around the world. Prior to joining Netflix, she was in the cloud computing team at Google, where she saw cloud computing from the provider side.
Does Java Need Inline Types? What Project Valhalla Can Bring to JavaC4Media
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2T04Lw4.
Sergey Kuksenko talks about the performance benefits inline types bring to Java and how to exploit them. Inline/value types are the key part of experimental project Valhalla, which should bring new abilities to the Java language. Filmed at qconsf.com.
Sergey Kuksenko is a Java Performance Engineer at Oracle working on a variety of Java and JVM performance enhancements. He started working as Java Engineer in 1996 and as Java Performance Engineer in 2005. He has had a passion for exploring how Java works on modern hardware.
Do you need service meshes in your tech stack?
This on-line guide aims to answer pertinent questions for software architects and technical leaders, such as: what is a service mesh?, do I need a service mesh?, how do I evaluate the different service mesh offerings? In software architecture, a service mesh is a dedicated infrastructure layer for facilitating service-to-service communications between microservices, often using a sidecar proxy.
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2UgQ3BU.
Christie Wilson describes what to expect from CI/CD in 2019, and how Tekton is helping bring that to as many tools as possible, such as Jenkins X and Prow. Wilson talks about Tekton itself and performs a live demo that shows how cloud native CI/CD can help debug, surface and fix mistakes faster. Filmed at qconsf.com.
Christie Wilson is a software engineer at Google, currently leading the Tekton project. Over the past decade, she has worked in the mobile, financial and video game industries. Prior to working at Google she led a team of software developers to build load testing tools for AAA video game titles, and founded the Vancouver chapter of PyLadies.
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2S7lDiS.
Sasha Rosenbaum shows how a CI/CD pipeline for Machine Learning can greatly improve both productivity and reliability. Filmed at qconsf.com.
Sasha Rosenbaum is a Program Manager on the Azure DevOps engineering team, focused on improving the alignment of the product with open source software. She is a co-organizer of the DevOps Days Chicago and the DeliveryConf conferences, and recently published a book on Serverless computing in Azure with .NET.
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/36epVKg.
Todd Montgomery discusses the techniques and lessons learned from implementing Aeron Cluster. His focus is on how Raft can be implemented on Aeron, minimizing the network round trip overhead, and comparing single process to a fully distributed cluster. Filmed at qconsf.com.
Todd Montgomery is a networking hacker who has researched, designed, and built numerous protocols, messaging-oriented middleware systems, and real-time data systems, done research for NASA, contributed to the IETF and IEEE, and co-founded two startups. He currently works as an independent consultant and is active in several open source projects.
Architectures That Scale Deep - Regaining Control in Deep SystemsC4Media
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2FWc5Sk.
Ben Sigelman talks about "Deep Systems", their common properties and re-introduces the fundamentals of control theory from the 1960s, including the original conceptualizations of Observability & Controllability. He uses examples from Google & other companies to illustrate how deep systems have damaged people's ability to observe software, and what needs to be done in order to regain control. Filmed at qconsf.com.
Ben Sigelman is a co-founder and the CEO at LightStep, a co-creator of Dapper (Google’s distributed tracing system), and co-creator of the OpenTracing and OpenTelemetry projects (both part of the CNCF). His work and interests gravitate towards observability, especially where microservices, high transaction volumes, and large engineering organizations are involved.
ML in the Browser: Interactive Experiences with Tensorflow.jsC4Media
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/39SddUL.
Victor Dibia provides a friendly introduction to machine learning, covers concrete steps on how front-end developers can create their own ML models and deploy them as part of web applications. He discusses his experience building Handtrack.js - a library for prototyping real time hand tracking interactions in the browser. Filmed at qconsf.com.
Victor Dibia is a Research Engineer with Cloudera’s Fast Forward Labs. Prior to this, he was a Research Staff Member at the IBM TJ Watson Research Center, New York. His research interests are at the intersection of human computer interaction, computational social science, and applied AI.
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2s9T3Vl.
Colin Eberhardt looks at some of the internals of WebAssembly, explores how it works “under the hood”, and looks at how to create a (simple) compiler that targets this runtime. Filmed at qconsf.com.
Colin Eberhardt is the Technology Director at Scott Logic, a UK-based software consultancy where they create complex application for their financial services clients. He is an avid technology enthusiast, spending his evenings contributing to open source projects, writing blog posts and learning as much as he can.
User & Device Identity for Microservices @ Netflix ScaleC4Media
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2S9tOgy.
Satyajit Thadeshwar provides useful insights on how Netflix implemented a secure, token-agnostic, identity solution that works with services operating at a massive scale. He shares some of the lessons learned from this process, both from architectural diagrams and code. Filmed at qconsf.com.
Satyajit Thadeshwar is an engineer on the Product Edge Access Services team at Netflix, where he works on some of the most critical services focusing on user and device authentication. He has more than a decade of experience building fault-tolerant and highly scalable, distributed systems.
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2Ezs08q.
Justin Ryan talks about Netflix’ scalability issues and some of the ways they addressed it. He shares successes they’ve had from unintuitively partitioning computation into multiple services to get better runtime characteristics. He introduces us to useful probabilistic data structures, innovative bi-directional data passing, open-source projects available from Netflix that make this all possible. Filmed at qconsf.com.
Justin Ryan is Playback Edge Engineering at Netflix. He works on some of the most critical services at Netflix, specifically focusing on user and device authentication. Years of building developer tools has also given him a healthy set of opinions on developer productivity.
Make Your Electron App Feel at Home EverywhereC4Media
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2Z4ZJjn.
Kilian Valkhof discusses the process of making an Electron app feel at home on all three platforms: Windows, MacOS and Linux, making devs aware of the pitfalls and how to avoid them. Filmed at qconsf.com.
Kilian Valkhof is a Front-end Developer & User-experience Designer at Firstversionist. He writes about various topics, from design to machine learning, on his personal website, kilianvalkhof.com and is a frequent contributer to open source software. He is part of the Electron governance team that oversees the development of the Electron framework.
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/344PnB1.
Steve Klabnik goes over the deep details of how async/await works in Rust, covering concepts like coroutines, generators, stack-less vs stack-ful, "pinning", and more. Filmed at qconsf.com.
Steve Klabnik is on the core team of Rust, leads the documentation team, and is an author of "The Rust Programming Language." He is a frequent speaker at conferences and is a prolific open source contributor, previously working on projects such as Ruby and Ruby on Rails.
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2OUz6dt.
Chris Riccomini talks about the current state-of-the-art in data pipelines and data warehousing, and shares some of the solutions to current problems dealing with data streaming and warehousing. Filmed at qconsf.com.
Chris Riccomini works as a Software Engineer at WePay.
Automated Testing for Terraform, Docker, Packer, Kubernetes, and MoreC4Media
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2rm4hFD.
Yevgeniy Brikman talks about how to write automated tests for infrastructure code, including the code written for use with tools such as Terraform, Docker, Packer, and Kubernetes. Topics covered include: unit tests, integration tests, end-to-end tests, dependency injection, test parallelism, retries and error handling, static analysis, property testing and CI / CD for infrastructure code. Filmed at qconsf.com.
Yevgeniy Brikman is the co-founder of Gruntwork, a company that provides DevOps as a Service. He is the author of two books published by O'Reilly Media: Hello, Startup and Terraform: Up & Running. Previously, he worked as a software engineer at LinkedIn, TripAdvisor, Cisco Systems, and Thomson Financial.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Streaming a Million Likes/Second: Real-Time Interactions on Live VideoC4Media
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/39NIjLV.
Akhilesh Gupta does a technical deep-dive into how Linkedin uses the Play/Akka Framework and a scalable distributed system to enable live interactions like likes/comments at massive scale at extremely low costs across multiple data centers. Filmed at qconlondon.com.
Akhilesh Gupta is the technical lead for LinkedIn's Real-time delivery infrastructure and LinkedIn Messaging. He has been working on the revamp of LinkedIn’s offerings to instant, real-time experiences. Before this, he was the head of engineering for the Ride Experience program at Uber Technologies in San Francisco.
Next Generation Client APIs in Envoy MobileC4Media
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2x0Fav8.
Jose Nino guides the audience through the journey of Mobile APIs at Lyft. He focuses on how the team has reaped the benefits of API generation to experiment with the network transport layer. He also discusses recent developments the team has made with Envoy Mobile and the roadmap ahead. Filmed at qconlondon.com.
Jose Nino works as a Software Engineer at Lyft.
Software Teams and Teamwork Trends Report Q1 2020C4Media
How do we cope with an environment that has been radically disrupted, where people are suddenly thrust into remote work in a chaotic state? What are the emerging good practices and new ideas that are shaping the way in which software development teams work? What can we do to make the workplace a more secure and diverse one while increasing the productivity of our teams? This report aims to assist technical leaders in making mid- to long-term decisions that will have a positive impact on their organisations and teams and help individual contributors find the practices, approaches, tools, techniques, and frameworks that can help them get a better experience at work - irrespective of where they are working from.
Understand the Trade-offs Using Compilers for Java ApplicationsC4Media
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2QCmmJ0.
Mark Stoodley examines some of the strengths and weaknesses of the different Java compilation technologies, if one was to apply them in isolation. Stoodley discusses how production JVMs are assembling a combination of these tools that work together to provide excellent performance across the large spectrum of applications written in Java and JVM based languages. Filmed at qconsf.com.
Mark Stoodley joined IBM Canada to build Java JIT compilers for production use and led the team that delivered AOT compilation in the IBM SDK for Java 6. He spent the last five years leading the effort to open source nearly 4.3 million lines of source code from the IBM J9 Java Virtual Machine to create the two open source projects Eclipse OMR and Eclipse OpenJ9, and now co-leads both projects.
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2y2yPiS.
Colin McCabe talks about the ongoing effort to replace the use of Zookeeper in Kafka: why they want to do it and how it will work. He discusses the limitations they have found and how Kafka benefits both in terms of stability and scalability by bringing consensus in house. He talks about their progress, what work is remaining, and how contributors can help. Filmed at qconsf.com.
Colin McCabe is a Kafka committer at Confluent, working on the scalability and extensibility of Kafka. Previously, he worked on the Hadoop Distributed Filesystem and the Ceph Filesystem.
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2SXXXiD.
Katharina Probst talks about what it means to act like an owner and why teams need ownership to be high-performing. When team members, regardless of whether they have a formal leadership role or not, act like owners, magical things can happen. She shares ideas that we can apply to our own work, and talks about how to recognize when we don’t live up to our own expectations of acting like an owner. Filmed at qconsf.com.
Katharina Probst is a Senior Engineering Leader, Kubernetes & SaaS at Google. Before this, she was leading engineering teams at Netflix, being responsible for the Netflix API, which helps bring Netflix streaming to millions of people around the world. Prior to joining Netflix, she was in the cloud computing team at Google, where she saw cloud computing from the provider side.
Does Java Need Inline Types? What Project Valhalla Can Bring to JavaC4Media
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2T04Lw4.
Sergey Kuksenko talks about the performance benefits inline types bring to Java and how to exploit them. Inline/value types are the key part of experimental project Valhalla, which should bring new abilities to the Java language. Filmed at qconsf.com.
Sergey Kuksenko is a Java Performance Engineer at Oracle working on a variety of Java and JVM performance enhancements. He started working as Java Engineer in 1996 and as Java Performance Engineer in 2005. He has had a passion for exploring how Java works on modern hardware.
Do you need service meshes in your tech stack?
This on-line guide aims to answer pertinent questions for software architects and technical leaders, such as: what is a service mesh?, do I need a service mesh?, how do I evaluate the different service mesh offerings? In software architecture, a service mesh is a dedicated infrastructure layer for facilitating service-to-service communications between microservices, often using a sidecar proxy.
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2UgQ3BU.
Christie Wilson describes what to expect from CI/CD in 2019, and how Tekton is helping bring that to as many tools as possible, such as Jenkins X and Prow. Wilson talks about Tekton itself and performs a live demo that shows how cloud native CI/CD can help debug, surface and fix mistakes faster. Filmed at qconsf.com.
Christie Wilson is a software engineer at Google, currently leading the Tekton project. Over the past decade, she has worked in the mobile, financial and video game industries. Prior to working at Google she led a team of software developers to build load testing tools for AAA video game titles, and founded the Vancouver chapter of PyLadies.
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2S7lDiS.
Sasha Rosenbaum shows how a CI/CD pipeline for Machine Learning can greatly improve both productivity and reliability. Filmed at qconsf.com.
Sasha Rosenbaum is a Program Manager on the Azure DevOps engineering team, focused on improving the alignment of the product with open source software. She is a co-organizer of the DevOps Days Chicago and the DeliveryConf conferences, and recently published a book on Serverless computing in Azure with .NET.
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/36epVKg.
Todd Montgomery discusses the techniques and lessons learned from implementing Aeron Cluster. His focus is on how Raft can be implemented on Aeron, minimizing the network round trip overhead, and comparing single process to a fully distributed cluster. Filmed at qconsf.com.
Todd Montgomery is a networking hacker who has researched, designed, and built numerous protocols, messaging-oriented middleware systems, and real-time data systems, done research for NASA, contributed to the IETF and IEEE, and co-founded two startups. He currently works as an independent consultant and is active in several open source projects.
Architectures That Scale Deep - Regaining Control in Deep SystemsC4Media
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2FWc5Sk.
Ben Sigelman talks about "Deep Systems", their common properties and re-introduces the fundamentals of control theory from the 1960s, including the original conceptualizations of Observability & Controllability. He uses examples from Google & other companies to illustrate how deep systems have damaged people's ability to observe software, and what needs to be done in order to regain control. Filmed at qconsf.com.
Ben Sigelman is a co-founder and the CEO at LightStep, a co-creator of Dapper (Google’s distributed tracing system), and co-creator of the OpenTracing and OpenTelemetry projects (both part of the CNCF). His work and interests gravitate towards observability, especially where microservices, high transaction volumes, and large engineering organizations are involved.
ML in the Browser: Interactive Experiences with Tensorflow.jsC4Media
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/39SddUL.
Victor Dibia provides a friendly introduction to machine learning, covers concrete steps on how front-end developers can create their own ML models and deploy them as part of web applications. He discusses his experience building Handtrack.js - a library for prototyping real time hand tracking interactions in the browser. Filmed at qconsf.com.
Victor Dibia is a Research Engineer with Cloudera’s Fast Forward Labs. Prior to this, he was a Research Staff Member at the IBM TJ Watson Research Center, New York. His research interests are at the intersection of human computer interaction, computational social science, and applied AI.
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2s9T3Vl.
Colin Eberhardt looks at some of the internals of WebAssembly, explores how it works “under the hood”, and looks at how to create a (simple) compiler that targets this runtime. Filmed at qconsf.com.
Colin Eberhardt is the Technology Director at Scott Logic, a UK-based software consultancy where they create complex application for their financial services clients. He is an avid technology enthusiast, spending his evenings contributing to open source projects, writing blog posts and learning as much as he can.
User & Device Identity for Microservices @ Netflix ScaleC4Media
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2S9tOgy.
Satyajit Thadeshwar provides useful insights on how Netflix implemented a secure, token-agnostic, identity solution that works with services operating at a massive scale. He shares some of the lessons learned from this process, both from architectural diagrams and code. Filmed at qconsf.com.
Satyajit Thadeshwar is an engineer on the Product Edge Access Services team at Netflix, where he works on some of the most critical services focusing on user and device authentication. He has more than a decade of experience building fault-tolerant and highly scalable, distributed systems.
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2Ezs08q.
Justin Ryan talks about Netflix’ scalability issues and some of the ways they addressed it. He shares successes they’ve had from unintuitively partitioning computation into multiple services to get better runtime characteristics. He introduces us to useful probabilistic data structures, innovative bi-directional data passing, open-source projects available from Netflix that make this all possible. Filmed at qconsf.com.
Justin Ryan is Playback Edge Engineering at Netflix. He works on some of the most critical services at Netflix, specifically focusing on user and device authentication. Years of building developer tools has also given him a healthy set of opinions on developer productivity.
Make Your Electron App Feel at Home EverywhereC4Media
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2Z4ZJjn.
Kilian Valkhof discusses the process of making an Electron app feel at home on all three platforms: Windows, MacOS and Linux, making devs aware of the pitfalls and how to avoid them. Filmed at qconsf.com.
Kilian Valkhof is a Front-end Developer & User-experience Designer at Firstversionist. He writes about various topics, from design to machine learning, on his personal website, kilianvalkhof.com and is a frequent contributer to open source software. He is part of the Electron governance team that oversees the development of the Electron framework.
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/344PnB1.
Steve Klabnik goes over the deep details of how async/await works in Rust, covering concepts like coroutines, generators, stack-less vs stack-ful, "pinning", and more. Filmed at qconsf.com.
Steve Klabnik is on the core team of Rust, leads the documentation team, and is an author of "The Rust Programming Language." He is a frequent speaker at conferences and is a prolific open source contributor, previously working on projects such as Ruby and Ruby on Rails.
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2OUz6dt.
Chris Riccomini talks about the current state-of-the-art in data pipelines and data warehousing, and shares some of the solutions to current problems dealing with data streaming and warehousing. Filmed at qconsf.com.
Chris Riccomini works as a Software Engineer at WePay.
Automated Testing for Terraform, Docker, Packer, Kubernetes, and MoreC4Media
Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2rm4hFD.
Yevgeniy Brikman talks about how to write automated tests for infrastructure code, including the code written for use with tools such as Terraform, Docker, Packer, and Kubernetes. Topics covered include: unit tests, integration tests, end-to-end tests, dependency injection, test parallelism, retries and error handling, static analysis, property testing and CI / CD for infrastructure code. Filmed at qconsf.com.
Yevgeniy Brikman is the co-founder of Gruntwork, a company that provides DevOps as a Service. He is the author of two books published by O'Reilly Media: Hello, Startup and Terraform: Up & Running. Previously, he worked as a software engineer at LinkedIn, TripAdvisor, Cisco Systems, and Thomson Financial.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Epistemic Interaction - tuning interfaces to provide information for AI support
Etsy’s Product Development with Continuous Experimentation
1. Etsy’s Product
Development with
Continuous
Experimentation
November 8th, 2012
QCon San Francisco
Thursday, November 8, 12
2. Watch the video with slide
synchronization on InfoQ.com!
http://www.infoq.com/presentations
/Etsy-Deployment
InfoQ.com: News & Community Site
• 750,000 unique visitors/month
• Published in 4 languages (English, Chinese, Japanese and Brazilian
Portuguese)
• Post content from our QCon conferences
• News 15-20 / week
• Articles 3-4 / week
• Presentations (videos) 12-15 / week
• Interviews 2-3 / week
• Books 1 / month
3. Presented at QCon San Francisco
www.qconsf.com
Purpose of QCon
- to empower software development by facilitating the spread of
knowledge and innovation
Strategy
- practitioner-driven conference designed for YOU: influencers of
change and innovation in your teams
- speakers and topics driving the evolution and innovation
- connecting and catalyzing the influencers and innovators
Highlights
- attended by more than 12,000 delegates since 2007
- held in 9 cities worldwide
4. Frank Harris
Group Product Manager, Search & Data
frank@etsy.com
@hirefrank
Nellwyn Thomas
Staff Data Analyst
nellwyn@etsy.com
@nellwyn
Thursday, November 8, 12
5. Deploy
Experiment
Example
Takeaways
Thursday, November 8, 12
7. The world’s
handmade
and vintage
marketplace.
Thursday, November 8, 12
8. Buy Sell Registry Community Blogs Mobile Gift Cards Help
Register Sign In Search for items and shops Search Cart
Browse
Introducing Etsy Gift Cards,
Art
the choose-your-own-adventure gift!
Home & Living
Let the Giving Begin
Jewelry
Women
Handpicked Items See more Picked by violasboutique
Men
Kids
Weddings
Vintage
Supplies
Accessories for iPhone Set of 4 Damaged Goods Or… Embroidered Hoop "Merry Ch… Advent calendar zakka style … Needle Felted Gnome, green…
airyobsessions $25.00 USD merriweathe… $50.00 USD arch190 $77.17 USD feltjar $15.00 USD
Holidays
Daily Finds Email
Get gift ideas, editors' picks &
fresh trends in your inbox.
Enter your email
modern ceramic Star bowl ca… Mistletoe Art print of original … Disturbance - Modern Pillow … Modern Christmas Tree Lino…
Sign Up
OneClayBead $9.00 USD TheJoyofColor $21.00 USD ClothandINK $36.00 USD RetroModer… $20.00 USD
See our other newsletters.
More Ways to Shop
Categories
Gift Cards
Colors
Treasury
Shop Local Christmas Stocking. Large St… Joy Holiday Decor, Christma… Glass Christmas Tree Ornam… Christmas Ornament Photogr…
bluestitchha… $28.00 USD AppleWhite $42.00 USD thewhitepep… $13.50 USD Raceytay $15.00 USD
Thursday, November 8, 12
9. Buy Sell Registry Community Blogs Mobile Gift Cards Help
Register Sign In leather ipad sleeve Search Cart
All Items leather ipad sleeve 1,714 items Sort by: Relevancy
Handmade 1,710
Ships to United States ×
Vintage 3
Supplies 4
Sponsored
Handmade
Bags and Purses 1,290
Accessories 329
Geekery 86
Needlecraft 1
Everything Else 1
Vintage
Bags and Purses 3
Brown Burgundy Stingray Le… New IPad 3 and 4 Full case … HUGE SALE World Traveler … Leather Canvas 13-inch Lapt…
Yehia $299.00 USD PicasoLab $68.00 USD lovetojournal… $53.55 USD xmhazel $39.00 USD
Show Only
Your Favorites
Accepts Etsy Gift Cards
Shop Location
All locations
Enter location ►
Ships to United States Leather Ipad Sleeve/ Case/ E… Buckled leather iPad sleeve … Distressed thick brown leathe… 4mm Thick Tan Leather iPad …
Change BayTowneL… $74.00 USD LUSCIOUSL… $99.00 USD sord $68.00 USD FleurdeLeather $79.00 USD
Price
All prices
$ to $ ►
Leather iPad Sleeve / Case - … Leather Ipad Sleeve/ Case/ F… Hand Stitched Tan Leather Ip… Brown Faux Leather iPad Sle…
LWleatherw… $84.00 USD giordanoart $75.00 USD zassicleather $100.00 USD begforabag $35.00 USD
Thursday, November 8, 12
10. Buy Sell Registry Community Blogs Mobile Gift Cards Help
Register Sign In Search for items and shops Search Cart
Home › BayTowneLeatherUSA › IPAD Cases
$74.00 USD Only 1 available
Like this item?
Favorite
Add it to your favorites to revisit it later.
Add to Cart
Leather Ipad Sleeve/ Case/ Envelope/ Folio for IPAD 2 or 3. Full
Grain Veg Tan Leather. Handmade by BayTowneLeatherUSA. Favorite
Shop
BayTowneLeatherUSA
BayTowneLeatherUSA
38
items
Add shop to favorites
See who favorites this shop
Shop owner
Roger
Marion, Illinois, United States
Favorites
Circle
Feedback: 27, 100% pos.
This luxurious/rugged and well built IPAD case will protect your IPAD in style. Or you can use
it as a folio to carry your necessities . Luxurious enough for use at the office, and rugged Contact
enough for use on the trail.
Made of beautiful - rugged 5/6 oz. Premium veg tan leather (which will break in beautifully) ; it
will develop a wonderful natural patina over time as only full grain veg tan leather can do. Item
(Gets better with age)
Add item to favorites
***I make these cases ONE BY ONE as orders are received*** See who favorites this item
Thursday, November 8, 12
11. Over 15M
items from
800k shops in
150 countries
Thursday, November 8, 12
12. 1.4B
pageviews
per month
Thursday, November 8, 12
13. 40M unique
visitors per
month
Thursday, November 8, 12
24. Buy Sell Registry Community Blogs Mobile Gift Cards Help
Register Sign In Search for items and shops Search Cart
Similar items 35 Sort by: Relevancy
vintage × rubber stamp × office × supply × Add
2 Vintage Rubber Stamps -
1960's - Crown Rubber Stamp
Co - Justrite Stamp Co - Back
to School
Vintage Price Stamp, Garvey… I can provide samples... Very… Very vintage French desk sta… Vintage Rubber Stamp Symb…
ThisCharmingManCave
SummerHoli… $35.00 USD Mademoisell… $19.95 USD Mademoisell… $14.95 USD ArtfulVintage $13.00 USD
Favorite
Show Only
Your Favorites
Accepts Etsy Gift Cards
Shop Location
Rubber Stamp Holder Vintage Wooden and Rubber… Vintage Crown Bank Teller D… Vintage Crown Ledger Line D…
All locations
susantique $24.00 USD mrbarnes5 $9.00 USD SydVintage $4.99 USD SydVintage $1.99 USD
Enter location ►
Ships to
United States ►
Price
All prices
$ to $ ►
Fab large vintage commercial… Vintage Crown Bank Teller D… Vintage Crown Ledger Line D… Vintage Crown Custom Dual …
Thursday, November 8, 12
25. Enter location ►
Ships to
United States ►
Price
All prices
$ to $ ►
Fab large vintage commercial… Vintage Crown Bank Teller D… Vintage Crown Ledger Line D… Vintage Crown Custom Dual …
Mademoisell… $29.00 USD SydVintage $5.99 USD SydVintage $2.99 USD SydVintage $4.99 USD
Petite Dark Oak Antique Woo… Shaded Metal Fastener Clip … Standard Rubber Stamp Hold… Vintage Crown Club Dater D…
TimelessBy… $12.50 USD kawaiigoodies $2.95 USD RosebudsOr… $24.95 USD SydVintage $6.99 USD
vintage office funk ... WOOD… VTG rubber stamp Printing Ki… Vintage Wooden Rubber Sta… Rubber Stamp Bag National …
Inktiques $12.00 USD dagutzyone $20.00 USD oliday $18.50 USD ThreeOldKeys $11.00 USD
Vintage Crown Club Dater D… Vintage Crown Club Dater D… Vintage Crown Club Dater D… Vintage Crown Club Dater D…
Thursday, November 8, 12 SydVintage $5.99 USD SydVintage $3.99 USD SydVintage $6.99 USD SydVintage $5.99 USD
26. Vintage Crown Club Dater D… Vintage Crown Club Dater D… Vintage Crown Club Dater D… Vintage Crown Club Dater D…
SydVintage $5.99 USD SydVintage $3.99 USD SydVintage $6.99 USD SydVintage $5.99 USD
Vintage Crown Club Dater D… Vintage Crown Club Dater D… Vintage Carter's Rubber Sta… Vintage Office Rubber Stamp…
SydVintage $5.99 USD SydVintage $5.99 USD SydVintage $3.99 USD Vintageworks $18.00 USD
Vintage Office Stamp with Si… Dial a phrase stamp with 12 … Vintage Candy Commission … Vintage Rubber Stamp Makin…
alifewelllived $8.00 USD FunsizeCrea… $9.95 USD CaprockVint… $6.00 USD heretoforem… $25.00 USD
Vintage Jennifer Rubber Stamp Vintage Pullman Shipping Di… Ultra mini French or Europea…
Thursday, November 8, 12 iSpyVintage $12.00 USD SydVintage $9.99 USD kawaiigoodies $4.95 USD
43. Deploy
Experiment
Example
Takeaways
Thursday, November 8, 12
44. Buy Sell Registry Community Blogs Mobile Gift Cards Help
Register Sign In Search for items and shops Search Cart
Home › BayTowneLeatherUSA › IPAD Cases
$74.00 USD Only 1 available
Like this item?
Favorite
Add it to your favorites to revisit it later.
Add to Cart
Leather Ipad Sleeve/ Case/ Envelope/ Folio for IPAD 2 or 3. Full
Grain Veg Tan Leather. Handmade by BayTowneLeatherUSA. Favorite
Shop
BayTowneLeatherUSA
BayTowneLeatherUSA
38
items
Add shop to favorites
See who favorites this shop
Shop owner
Roger
Marion, Illinois, United States
Favorites
Circle
Feedback: 27, 100% pos.
This luxurious/rugged and well built IPAD case will protect your IPAD in style. Or you can use
it as a folio to carry your necessities . Luxurious enough for use at the office, and rugged Contact
enough for use on the trail.
Made of beautiful - rugged 5/6 oz. Premium veg tan leather (which will break in beautifully) ; it
will develop a wonderful natural patina over time as only full grain veg tan leather can do. Item
(Gets better with age)
Add item to favorites
***I make these cases ONE BY ONE as orders are received*** See who favorites this item
Thursday, November 8, 12
46. Buy Sell Registry Community Blogs Mobile Gift Cards Help
Register Sign In Search for items and shops Search Cart
Home › BayTowneLeatherUSA › IPAD Cases
$74.00 USD Only 1 available
Like this item?
Favorite
Add it to your favorites to revisit it later.
Add to Cart
Leather Ipad Sleeve/ Case/ Envelope/ Folio for IPAD 2 or 3. Full
Grain Veg Tan Leather. Handmade by BayTowneLeatherUSA. Favorite
Shop
BayTowneLeatherUSA
BayTowneLeatherUSA
38
items
Add shop to favorites
See who favorites this shop
Shop owner
Roger
Marion, Illinois, United States
Favorites
Circle
Feedback: 27, 100% pos.
This luxurious/rugged and well built IPAD case will protect your IPAD in style. Or you can use
it as a folio to carry your necessities . Luxurious enough for use at the office, and rugged Contact
enough for use on the trail.
Made of beautiful - rugged 5/6 oz. Premium veg tan leather (which will break in beautifully) ; it
will develop a wonderful natural patina over time as only full grain veg tan leather can do. Item
(Gets better with age)
Add item to favorites
***I make these cases ONE BY ONE as orders are received*** See who favorites this item
Thursday, November 8, 12
47. How do we
know if this
theory is
right?
Thursday, November 8, 12
48. Buy Sell Registry Community Blogs Mobile Gift Cards Help
Register Sign In Search for items and shops Search Cart
Similar Items See more
Leather Ipad Sleeve/ Case/ E… Leather Ipad Sleeve/ Case/ E… Leather Document Case, Foli… Leather ipad case. Handstitc… Buckled leather iPad sleeve …
BayTowneL… $74.00 USD BayTowneL… $74.00 USD BayTowneL… $94.00 USD StudioFi $55.00 USD LUSCIOUSL… $99.00 USD
Home › BayTowneLeatherUSA › IPAD Cases
$74.00 USD Only 1 available
Like this item?
Favorite
Add it to your favorites to revisit it later.
Add to Cart
Leather Ipad Sleeve/ Case/ Envelope/ Folio for IPAD 2 or 3. Full
Grain Veg Tan Leather. Handmade by BayTowneLeatherUSA. Favorite
Shop
BayTowneLeatherUSA
BayTowneLeatherUSA
38
items
Add shop to favorites
See who favorites this shop
Thursday, November 8, 12
49. Buy Sell Registry Community Blogs Mobile Gift Cards Help
Register Sign In Search for items and shops Search Cart
Home › AHeirloom › About
Shop Sections
Shop home 73 items
US Cutting Boards 49
Custom Request 1 AHeirloom Like 470
Making it digital and heartwarming since 2010
Extra Heart or Star 1
Country Cutting Board 5
About AHeirloom
Island.Districts 4
Skewers 2
Engraving 3
Ball Park Series 4
Shop Owner
Amy Stringer-Mowat
Brooklyn, New York,
United States
Contact
Favorites
Circles: 269
Thursday, November 8, 12 pos.
Feedback: 2208, 100% some boards ready to be packed for the weekly shipments from deep inside brooklyn, NY
50. Amy Stringer-Mowat
Brooklyn, New York,
United States
Contact
Favorites
Circles: 269
Feedback: 2208, 100% pos. some boards ready to be packed for the weekly shipments from deep inside brooklyn, NY
Shop Info
AHeirloom
Opened on Oct 14, 2009 Accidental Entrepreneurship...
About
Brooklyn based husband and wife, Amy Stringer-Mowat and Bill
Policies Mowat, made their first cutting boards for their own wedding. It is
Request custom item rumored that the groom was actually finishing the boards on the day of
16817 sales the wedding... The two wanted a personalized and sentimental way to
5182 admirers display cheese, and came up with state-shaped cutting boards for each
of their home states (Michigan and Connecticut), with hearts on their William Henry Mowat III
Actions Owner, Maker, Designer
hometowns. Delightfully, other people wanted the boards and they are
Add to favorites William Henry Mowat III aka 'Bill'
now made for all fifty states. Each board is made in the USA of bamboo. is the man behind those nice,
See who favorites this borderlines and the smooth
AHeirloom listed their original state shaped cutting boards on Etsy in finish. His years of experience
Tweet May of 2010. with fabrication helps to speed
the process along and keep the
Report this shop to Etsy boards moving down the line. A
modern day Henry Ford.
Our Background
Amy and Bill met at Amy’s birthday party when both were getting their
Masters in Architecture at Columbia University. Bill walked by, wished
Amy a simple and sweet “Happy Birthday,” and the two have been Amy Stringer-… Henry Winslo…
collaborating off and on ever since.
Thursday, November 8, 12
51. Our Background
Amy and Bill met at Amy’s birthday party when both were getting their
Masters in Architecture at Columbia University. Bill walked by, wished
Amy a simple and sweet “Happy Birthday,” and the two have been Amy Stringer-… Henry Winslo…
collaborating off and on ever since.
The love of food, design and housewares began with Amy's work at
Zingerman's Delicatessen in the mid 90's and also with Monmouth
Coffee Company, in London England. Merging these interests with
Bill's background in design, his years of experience with project
management and skill at fabrication, have made for a good
combination on their latest venture.
Today, Amy manages the AHeirloom family business and takes care of
the firm’s newest member, Henry, born in September of 2011. Bill
handles the production of their orders and is a partner in a successful
fabrication shop in Williamsburgh, Brooklyn.
Our philosophy
AHeirloom believe in their small business and manufacturing in the
United States. The pieces are designed to be cherished and passed
down -- to engage those who use them and resonate with each use.
Their quality comes not only from the design and materials, but from
Amy and Bill’s belief in new manufacturing techniques. Whether
things are made by hand or by machine, they can be timeless -- like
these cutting boards, which serve as reminders of where you came
Thursday, November 8, 12
60. Listing Page Experiment
Results
• listing page views (++)
• searches (++)
• home page views (+)
• checkouts (+)!
* affect on that listing you landed on (?)
Thursday, November 8, 12
61. Listing Page Experiment
Next Steps
• we do more analysis
• we try more variants
• we think about how to expand
• we invest more resources
Thursday, November 8, 12
62. Deploy
Experiment
Example
Takeaways
Thursday, November 8, 12
63. Make it easy to
deploy. Invest in
tooling.
Thursday, November 8, 12
64. Validate ideas
with quantitative
& qualitative data
early and often.
Thursday, November 8, 12
65. Allow for time to
react and iterate
based on what
you learn.
Thursday, November 8, 12
66. Questions?
Learn more
etsy.com/careers
github.com/etsy
Frank Harris
frank@etsy.com
@hirefrank
Nellwyn Thomas
nellwyn@etsy.com
@nellwyn
Thursday, November 8, 12