挖财的互联网金融技术实践与探索@upyun opentalk
•
2 likes•1,596 views
1. The document discusses the exploration of financial technology by Waicai, an Internet finance company. It focuses on how Waicai is not just an accounting app, but explores areas like microservices, messaging, asynchronous programming, immutability, security, redundancy, and reactive systems. 2. The key techniques discussed include separating systems into microservices, using message passing, designing everything asynchronously, making systems immutable by using Kafka as journals, implementing security everywhere through interception, bulkheads and monitoring, and ensuring redundancy through clustering and commercial solutions. 3. The document advocates for applying concepts like separation, messaging, asynchrony, immutability, security, and redundancy everywhere as the company grows from handling individual
Report
Share
Report
Share
Download to read offline
Recommended
Scala the-good-parts
This document summarizes some of the good parts of the Scala language based on feedback from Java developers who have used Scala. It highlights features like type inference, expression syntax everywhere, case classes, pattern matching, functions, the ecosystem including REPL, libraries, frameworks and tools, concurrency with actors, and the strengths of the type system. It also provides some warnings about using features like implicits and annotations wisely.
Architecture patterns and practices
This document provides a summary of an architecture talk given by WangFuqiang on July 14, 2013. It discusses various architecture principles and patterns, including consistency, layering, isolation, immutability, clustering, buffering, asynchronous programming, throttling, caching, and more. It emphasizes managing dependencies wisely and applying these principles and patterns to scale systems both vertically and horizontally.
SBT Made Simple
If you think SBT is complex, then you should read this.
SBT is really simple as long as you get to know it.
More Than Java Concurrency
This document summarizes a presentation about concurrency models beyond what is available in Java. It discusses share-state concurrency using locks and synchronization in Java. It also covers share-nothing concurrency using the actor model and message passing. Additionally, it discusses software transactional memory and data-flow concurrency. The presentation provides examples and case studies of applying these different concurrency approaches.
Martial arts
The document discusses several types of martial arts including boxing, free combat, wrestling, jujitsu, karate, taekwondo, muay thai, jeet kune do, tai chi. It outlines some of their key attributes and techniques. These martial arts have different focuses like combat, sport, self-defense, balance, meditation. The document also suggests that mixed martial arts and new hybrid styles may be the future of martial arts.
Gold investment types introduction
The document introduces various gold investment options such as physical gold, gold futures contracts, and gold funds. It discusses the pros and cons of each option, including their liquidity, risks, costs, and purposes for speculation or delivery. Risk analysis is provided for high and low risk options. The document also covers gold investment concepts and poses questions for discussion.
Scala funbyexample
The document discusses the benefits of exercise for mental health. Regular physical activity can help reduce anxiety and depression and improve mood and cognitive functioning. Exercise causes chemical changes in the brain that may help protect against mental illness and improve symptoms.
Recommended
Scala the-good-parts
This document summarizes some of the good parts of the Scala language based on feedback from Java developers who have used Scala. It highlights features like type inference, expression syntax everywhere, case classes, pattern matching, functions, the ecosystem including REPL, libraries, frameworks and tools, concurrency with actors, and the strengths of the type system. It also provides some warnings about using features like implicits and annotations wisely.
Architecture patterns and practices
This document provides a summary of an architecture talk given by WangFuqiang on July 14, 2013. It discusses various architecture principles and patterns, including consistency, layering, isolation, immutability, clustering, buffering, asynchronous programming, throttling, caching, and more. It emphasizes managing dependencies wisely and applying these principles and patterns to scale systems both vertically and horizontally.
SBT Made Simple
If you think SBT is complex, then you should read this.
SBT is really simple as long as you get to know it.
More Than Java Concurrency
This document summarizes a presentation about concurrency models beyond what is available in Java. It discusses share-state concurrency using locks and synchronization in Java. It also covers share-nothing concurrency using the actor model and message passing. Additionally, it discusses software transactional memory and data-flow concurrency. The presentation provides examples and case studies of applying these different concurrency approaches.
Martial arts
The document discusses several types of martial arts including boxing, free combat, wrestling, jujitsu, karate, taekwondo, muay thai, jeet kune do, tai chi. It outlines some of their key attributes and techniques. These martial arts have different focuses like combat, sport, self-defense, balance, meditation. The document also suggests that mixed martial arts and new hybrid styles may be the future of martial arts.
Gold investment types introduction
The document introduces various gold investment options such as physical gold, gold futures contracts, and gold funds. It discusses the pros and cons of each option, including their liquidity, risks, costs, and purposes for speculation or delivery. Risk analysis is provided for high and low risk options. The document also covers gold investment concepts and poses questions for discussion.
Scala funbyexample
The document discusses the benefits of exercise for mental health. Regular physical activity can help reduce anxiety and depression and improve mood and cognitive functioning. Exercise causes chemical changes in the brain that may help protect against mental illness and improve symptoms.
Richard Johnson, high performance fuzzing
This document discusses techniques for improving the performance of fuzzing programs. It explains that most CPU cycles in fuzzing are wasted on program loading and initialization rather than actual fuzzing. The document recommends optimizing target selection to minimize code size, using smaller input files, and selecting mutators that are most likely to trigger new code paths. It also discusses using techniques like in-memory fuzzing and thin wrappers to improve efficiency. Overall it emphasizes the importance of quantitative and qualitative analysis to optimize fuzzer designs and strategies.
Entrepreneurship3
This document summarizes the experiences of Feng Yanwen in technology entrepreneurship. It discusses the companies he has founded, including Willmobile, and the lessons learned around development processes, tools, scalability, hosting, and entrepreneurship. Key points include choosing the right framework for a project, using agile development methods, planning for scalability from the start, and understanding burn rate and operations costs when starting a business.
Transactions and Concurrency Control Patterns
Transactions and Concurrency Control Patterns by Vlad Mihalcea
Transactions and Concurrency Control are very of paramount importance when it comes to enterprise systems data integrity. However, this topic is very tough since you have to understand the inner workings of the database system, its concurrency control design choices (e.g. 2PL, MVCC), transaction isolation levels and locking schemes.
In this presentation, I’m going to explain what data anomalies can happen depending on the transaction isolation level, with references to Oracle, SQL Server, PostgreSQL, and MySQL.
I will also demonstrate that database transactions are not enough, especially for multi-request web flows. For this reason, I’m going to present multiple application-level transaction patterns based on both optimistic and pessimistic locking mechanisms.
Last, I’m going to talk about Concurrency Control strategies used in the Hibernate second-level caching mechanism, which can boost performance without compromising strong consistency.
Devignition 2011
The document discusses the polyglot capabilities of JBoss AS 7 through projects like TorqueBox and Immutant. TorqueBox allows Ruby applications to run on JBoss AS 7, providing services like web applications, background jobs, messaging, and more through integration with Java libraries. Similarly, Immutant aims to enable Clojure applications to run on JBoss AS 7 with analogous services. The goal is to leverage JBoss AS 7 as a platform while allowing developers to choose the best programming language for the task.
You wanna crypto in AEM
This document introduces cryptography concepts like encryption, integrity protection, and digital signatures. It discusses how Adobe Experience Manager (AEM) implements cryptography to encrypt tokens and protect against CSRF attacks. Specifically, AEM uses JSON Web Tokens (JWTs) to encapsulate tokens, signs them with an HMAC key for integrity, and includes the token in non-GET requests to prevent CSRF without requiring changes to application code or dependencies on server-side sessions. Developers do not need to handle the CSRF token explicitly in their JavaScript code.
Building a Bank out of Microservices (NDC Sydney, August 2016)
From April 2014, Tyro Payments assigned more than half of it's Engineering team to developing and deploying a bespoke core banking system. Over the course of 18 months we shipped 21 new services and a new mobile app, as well as integrating with new external partners and Tyro's existing systems.
In this talk I presented a case study of the project, covering:
• the core tenets and some of the more interesting aspects of our architecture;
• why we were well positioned to use microservices for this greenfield work;
• the decisions we made that turned out well and the ones that didn't;
• security (we know a bit about that);
• testing (we do lots of it);
• deployment;
• how the system and the team is evolving.
Continues Deployment - Tech Talk week
The document discusses continuous deployment practices at Outbrain, an online content recommendation company. It emphasizes the importance of short feedback loops between code changes and user exposure through practices like deploying new code multiple times daily and testing code changes automatically before deployment. Infrastructure is codified and deployment is automated using tools like Chef to further streamline the process.
Mitigating CSRF with two lines of codes
This presentation was used in OWASP Taiwan Week 2017 at Taipei & Kaohsiung. It talks about what Cross Site Request Forgery is, what are different ways to prevent it. And how it can be mitigated with OWASP CSRF Protector with just two lines of codes.
Securing Web Applications with Token Authentication
In this presentation, Java Developer Evangelist Micah Silverman demystifies HTTP Authentication and explains how the Next Big Thing - Token Authentication - can be used to secure web applications on the JVM, REST APIs, and 'unsafe' clients while supporting security best practices and even improving your application's performance and scale.
Topics Covered:
Security Concerns for Modern Web Apps
Cross-Site Scripting Prevention
Working with 'Untrusted Clients'
Securing API endpoints
Cookies
Man in the Middle (MitM) Attacks
Cross-Site Request Forgery
Session ID Problems
Token Authentication
JWTs
Working with the JJWT library
End-to-end example with Spring Boot
DevOps 2016 summit
The document summarizes a DevOps 2016 Summit agenda. It includes presentations on Kubernetes DevOps by Ray Tsang from Google, DevOps powered by containers by Glenn West from Red Hat, Docker by a speaker from MediaTek, using Elasticsearch, Logstash and Kibana for log centralization and visualization, IoT Docker DevOps by Linker Network Software, shaking up culture with automation by a Yahoo Japan speaker, monitoring by a speaker from Gogolook, Chinese infrastructure by Sammy Lin, continuous integration/delivery by a speaker from Vpon, and what DevOps is through building on lean and agile practices.
Let's Encrypt failures
Description of a lot of things that went wrong, when we increased the scale of the deployment of Let's Encrypt
Cqcon2015
This document discusses cryptography and security in Adobe Experience Manager (AEM). It introduces the presenters Damien Antipa and Antonio Sanso and defines cryptography. It then discusses encryption, integrity protection, and different cryptographic techniques like AES, RSA, HMAC, and JSON Web Tokens. The document also covers use cases for AEM like encapsulating tokens and preventing CSRF attacks. It explains how CSRF protection works transparently in AEM using JSON Web Tokens signed with an HMAC key to ensure integrity and allow caching.
May2010 cq53-worldwide-tour
The document discusses enabling an agile organization. It notes that in a non-agile organization, marketing is separated from development which causes delays. An agile approach allows for continuous improvements, learning from each user interaction, and defining user segments in real-time. This enables rapid development through fast sprints in the cloud without large upfront infrastructure costs. An agile, cloud-hosted approach allowed Newsweek.com to launch within 5 weeks with scalability and no data center build out costs.
Resilient Event Driven Systems With Kafka
Talk at Craft conf 2018 on how to build resilient event driven systems with Kafka. Walks through an example of building notifications feature for chat app Stride.
Secure my ng-app
This document provides a checklist and overview of basic security practices for securing an AngularJS application. It discusses securing the server, preventing man-in-the-middle attacks with HTTPS, preventing XSS with input sanitization, preventing XSRF with anti-CSRF tokens, and preventing JSON injection. The document also provides code examples and explanations of authentication, authorization, escaping user input, and implementing other security best practices in AngularJS.
HBaseConAsia2019 Keynote
Keynote given by Duo Zhang of Xiaomi and Chunhui Shen of Alibab
Track 1: Internals
https://open.mi.com/conference/hbasecon-asia-2019
THE COMMUNITY EVENT FOR APACHE HBASE™
July 20th, 2019 - Sheraton Hotel, Beijing, China
https://hbase.apache.org/hbaseconasia-2019/
Service Meshes Made Easy
This document provides an overview of Consul and Consul Connect for service mesh. It begins with a brief history of applications moving from monoliths to microservices and the need for a service mesh. It then explains what Consul is, including its key features like service discovery, configuration, and segmentation. The document demonstrates Consul Connect through a live demo of a Sock Shop application deployed on Kubernetes with Consul and Ambassador. It concludes with additional best practices and resources for using Consul in production environments.
Bluemix paas 기반 saas 개발 사례
The document discusses various topics related to developing successful cloud services, including microservices architecture, Platform as a Service (PaaS), multi-tenancy, and DevOps. It defines a successful service as one that offers subscription-based delivery according to an international survey. Characteristics of successful services include automation, monetization through subscriptions, implementation using techniques like mashups and multi-tenancy, and using microservices focusing on separation of concerns. The document outlines a journey to developing successful services and discusses related topics like operational automation, revenue generation, implementation approaches, and microservices.
Process Matters (Cloud2Days / Java2Days conference))
Damon Edwards presentation from Java2Days / Cloud2Days conference on October 7, 2010 in Sofia Bulgaria.
GeeCON Microservices 2015 scaling micro services at gilt
An evolution of the talk I gave at CraftConf earlier this year, talking about software architecture and micro-services at Gilt. Some new additions include ownership, service discovery and service anatomy.
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift
Overview
Dive into the world of anomaly detection on edge devices with our comprehensive hands-on tutorial. This SlideShare presentation will guide you through the entire process, from data collection and model training to edge deployment and real-time monitoring. Perfect for those looking to implement robust anomaly detection systems on resource-constrained IoT/edge devices.
Key Topics Covered
1. Introduction to Anomaly Detection
- Understand the fundamentals of anomaly detection and its importance in identifying unusual behavior or failures in systems.
2. Understanding Edge (IoT)
- Learn about edge computing and IoT, and how they enable real-time data processing and decision-making at the source.
3. What is ArgoCD?
- Discover ArgoCD, a declarative, GitOps continuous delivery tool for Kubernetes, and its role in deploying applications on edge devices.
4. Deployment Using ArgoCD for Edge Devices
- Step-by-step guide on deploying anomaly detection models on edge devices using ArgoCD.
5. Introduction to Apache Kafka and S3
- Explore Apache Kafka for real-time data streaming and Amazon S3 for scalable storage solutions.
6. Viewing Kafka Messages in the Data Lake
- Learn how to view and analyze Kafka messages stored in a data lake for better insights.
7. What is Prometheus?
- Get to know Prometheus, an open-source monitoring and alerting toolkit, and its application in monitoring edge devices.
8. Monitoring Application Metrics with Prometheus
- Detailed instructions on setting up Prometheus to monitor the performance and health of your anomaly detection system.
9. What is Camel K?
- Introduction to Camel K, a lightweight integration framework built on Apache Camel, designed for Kubernetes.
10. Configuring Camel K Integrations for Data Pipelines
- Learn how to configure Camel K for seamless data pipeline integrations in your anomaly detection workflow.
11. What is a Jupyter Notebook?
- Overview of Jupyter Notebooks, an open-source web application for creating and sharing documents with live code, equations, visualizations, and narrative text.
12. Jupyter Notebooks with Code Examples
- Hands-on examples and code snippets in Jupyter Notebooks to help you implement and test anomaly detection models.
More Related Content
Similar to 挖财的互联网金融技术实践与探索@upyun opentalk
Richard Johnson, high performance fuzzing
This document discusses techniques for improving the performance of fuzzing programs. It explains that most CPU cycles in fuzzing are wasted on program loading and initialization rather than actual fuzzing. The document recommends optimizing target selection to minimize code size, using smaller input files, and selecting mutators that are most likely to trigger new code paths. It also discusses using techniques like in-memory fuzzing and thin wrappers to improve efficiency. Overall it emphasizes the importance of quantitative and qualitative analysis to optimize fuzzer designs and strategies.
Entrepreneurship3
This document summarizes the experiences of Feng Yanwen in technology entrepreneurship. It discusses the companies he has founded, including Willmobile, and the lessons learned around development processes, tools, scalability, hosting, and entrepreneurship. Key points include choosing the right framework for a project, using agile development methods, planning for scalability from the start, and understanding burn rate and operations costs when starting a business.
Transactions and Concurrency Control Patterns
Transactions and Concurrency Control Patterns by Vlad Mihalcea
Transactions and Concurrency Control are very of paramount importance when it comes to enterprise systems data integrity. However, this topic is very tough since you have to understand the inner workings of the database system, its concurrency control design choices (e.g. 2PL, MVCC), transaction isolation levels and locking schemes.
In this presentation, I’m going to explain what data anomalies can happen depending on the transaction isolation level, with references to Oracle, SQL Server, PostgreSQL, and MySQL.
I will also demonstrate that database transactions are not enough, especially for multi-request web flows. For this reason, I’m going to present multiple application-level transaction patterns based on both optimistic and pessimistic locking mechanisms.
Last, I’m going to talk about Concurrency Control strategies used in the Hibernate second-level caching mechanism, which can boost performance without compromising strong consistency.
Devignition 2011
The document discusses the polyglot capabilities of JBoss AS 7 through projects like TorqueBox and Immutant. TorqueBox allows Ruby applications to run on JBoss AS 7, providing services like web applications, background jobs, messaging, and more through integration with Java libraries. Similarly, Immutant aims to enable Clojure applications to run on JBoss AS 7 with analogous services. The goal is to leverage JBoss AS 7 as a platform while allowing developers to choose the best programming language for the task.
You wanna crypto in AEM
This document introduces cryptography concepts like encryption, integrity protection, and digital signatures. It discusses how Adobe Experience Manager (AEM) implements cryptography to encrypt tokens and protect against CSRF attacks. Specifically, AEM uses JSON Web Tokens (JWTs) to encapsulate tokens, signs them with an HMAC key for integrity, and includes the token in non-GET requests to prevent CSRF without requiring changes to application code or dependencies on server-side sessions. Developers do not need to handle the CSRF token explicitly in their JavaScript code.
Building a Bank out of Microservices (NDC Sydney, August 2016)
From April 2014, Tyro Payments assigned more than half of it's Engineering team to developing and deploying a bespoke core banking system. Over the course of 18 months we shipped 21 new services and a new mobile app, as well as integrating with new external partners and Tyro's existing systems.
In this talk I presented a case study of the project, covering:
• the core tenets and some of the more interesting aspects of our architecture;
• why we were well positioned to use microservices for this greenfield work;
• the decisions we made that turned out well and the ones that didn't;
• security (we know a bit about that);
• testing (we do lots of it);
• deployment;
• how the system and the team is evolving.
Continues Deployment - Tech Talk week
The document discusses continuous deployment practices at Outbrain, an online content recommendation company. It emphasizes the importance of short feedback loops between code changes and user exposure through practices like deploying new code multiple times daily and testing code changes automatically before deployment. Infrastructure is codified and deployment is automated using tools like Chef to further streamline the process.
Mitigating CSRF with two lines of codes
This presentation was used in OWASP Taiwan Week 2017 at Taipei & Kaohsiung. It talks about what Cross Site Request Forgery is, what are different ways to prevent it. And how it can be mitigated with OWASP CSRF Protector with just two lines of codes.
Securing Web Applications with Token Authentication
In this presentation, Java Developer Evangelist Micah Silverman demystifies HTTP Authentication and explains how the Next Big Thing - Token Authentication - can be used to secure web applications on the JVM, REST APIs, and 'unsafe' clients while supporting security best practices and even improving your application's performance and scale.
Topics Covered:
Security Concerns for Modern Web Apps
Cross-Site Scripting Prevention
Working with 'Untrusted Clients'
Securing API endpoints
Cookies
Man in the Middle (MitM) Attacks
Cross-Site Request Forgery
Session ID Problems
Token Authentication
JWTs
Working with the JJWT library
End-to-end example with Spring Boot
DevOps 2016 summit
The document summarizes a DevOps 2016 Summit agenda. It includes presentations on Kubernetes DevOps by Ray Tsang from Google, DevOps powered by containers by Glenn West from Red Hat, Docker by a speaker from MediaTek, using Elasticsearch, Logstash and Kibana for log centralization and visualization, IoT Docker DevOps by Linker Network Software, shaking up culture with automation by a Yahoo Japan speaker, monitoring by a speaker from Gogolook, Chinese infrastructure by Sammy Lin, continuous integration/delivery by a speaker from Vpon, and what DevOps is through building on lean and agile practices.
Let's Encrypt failures
Description of a lot of things that went wrong, when we increased the scale of the deployment of Let's Encrypt
Cqcon2015
This document discusses cryptography and security in Adobe Experience Manager (AEM). It introduces the presenters Damien Antipa and Antonio Sanso and defines cryptography. It then discusses encryption, integrity protection, and different cryptographic techniques like AES, RSA, HMAC, and JSON Web Tokens. The document also covers use cases for AEM like encapsulating tokens and preventing CSRF attacks. It explains how CSRF protection works transparently in AEM using JSON Web Tokens signed with an HMAC key to ensure integrity and allow caching.
May2010 cq53-worldwide-tour
The document discusses enabling an agile organization. It notes that in a non-agile organization, marketing is separated from development which causes delays. An agile approach allows for continuous improvements, learning from each user interaction, and defining user segments in real-time. This enables rapid development through fast sprints in the cloud without large upfront infrastructure costs. An agile, cloud-hosted approach allowed Newsweek.com to launch within 5 weeks with scalability and no data center build out costs.
Resilient Event Driven Systems With Kafka
Talk at Craft conf 2018 on how to build resilient event driven systems with Kafka. Walks through an example of building notifications feature for chat app Stride.
Secure my ng-app
This document provides a checklist and overview of basic security practices for securing an AngularJS application. It discusses securing the server, preventing man-in-the-middle attacks with HTTPS, preventing XSS with input sanitization, preventing XSRF with anti-CSRF tokens, and preventing JSON injection. The document also provides code examples and explanations of authentication, authorization, escaping user input, and implementing other security best practices in AngularJS.
HBaseConAsia2019 Keynote
Keynote given by Duo Zhang of Xiaomi and Chunhui Shen of Alibab
Track 1: Internals
https://open.mi.com/conference/hbasecon-asia-2019
THE COMMUNITY EVENT FOR APACHE HBASE™
July 20th, 2019 - Sheraton Hotel, Beijing, China
https://hbase.apache.org/hbaseconasia-2019/
Service Meshes Made Easy
This document provides an overview of Consul and Consul Connect for service mesh. It begins with a brief history of applications moving from monoliths to microservices and the need for a service mesh. It then explains what Consul is, including its key features like service discovery, configuration, and segmentation. The document demonstrates Consul Connect through a live demo of a Sock Shop application deployed on Kubernetes with Consul and Ambassador. It concludes with additional best practices and resources for using Consul in production environments.
Bluemix paas 기반 saas 개발 사례
The document discusses various topics related to developing successful cloud services, including microservices architecture, Platform as a Service (PaaS), multi-tenancy, and DevOps. It defines a successful service as one that offers subscription-based delivery according to an international survey. Characteristics of successful services include automation, monetization through subscriptions, implementation using techniques like mashups and multi-tenancy, and using microservices focusing on separation of concerns. The document outlines a journey to developing successful services and discusses related topics like operational automation, revenue generation, implementation approaches, and microservices.
Process Matters (Cloud2Days / Java2Days conference))
Damon Edwards presentation from Java2Days / Cloud2Days conference on October 7, 2010 in Sofia Bulgaria.
GeeCON Microservices 2015 scaling micro services at gilt
An evolution of the talk I gave at CraftConf earlier this year, talking about software architecture and micro-services at Gilt. Some new additions include ownership, service discovery and service anatomy.
Similar to 挖财的互联网金融技术实践与探索@upyun opentalk (20)
Building a Bank out of Microservices (NDC Sydney, August 2016)
Building a Bank out of Microservices (NDC Sydney, August 2016)
Securing Web Applications with Token Authentication
Securing Web Applications with Token Authentication
Process Matters (Cloud2Days / Java2Days conference))
Process Matters (Cloud2Days / Java2Days conference))
GeeCON Microservices 2015 scaling micro services at gilt
GeeCON Microservices 2015 scaling micro services at gilt
Recently uploaded
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift
Overview
Dive into the world of anomaly detection on edge devices with our comprehensive hands-on tutorial. This SlideShare presentation will guide you through the entire process, from data collection and model training to edge deployment and real-time monitoring. Perfect for those looking to implement robust anomaly detection systems on resource-constrained IoT/edge devices.
Key Topics Covered
1. Introduction to Anomaly Detection
- Understand the fundamentals of anomaly detection and its importance in identifying unusual behavior or failures in systems.
2. Understanding Edge (IoT)
- Learn about edge computing and IoT, and how they enable real-time data processing and decision-making at the source.
3. What is ArgoCD?
- Discover ArgoCD, a declarative, GitOps continuous delivery tool for Kubernetes, and its role in deploying applications on edge devices.
4. Deployment Using ArgoCD for Edge Devices
- Step-by-step guide on deploying anomaly detection models on edge devices using ArgoCD.
5. Introduction to Apache Kafka and S3
- Explore Apache Kafka for real-time data streaming and Amazon S3 for scalable storage solutions.
6. Viewing Kafka Messages in the Data Lake
- Learn how to view and analyze Kafka messages stored in a data lake for better insights.
7. What is Prometheus?
- Get to know Prometheus, an open-source monitoring and alerting toolkit, and its application in monitoring edge devices.
8. Monitoring Application Metrics with Prometheus
- Detailed instructions on setting up Prometheus to monitor the performance and health of your anomaly detection system.
9. What is Camel K?
- Introduction to Camel K, a lightweight integration framework built on Apache Camel, designed for Kubernetes.
10. Configuring Camel K Integrations for Data Pipelines
- Learn how to configure Camel K for seamless data pipeline integrations in your anomaly detection workflow.
11. What is a Jupyter Notebook?
- Overview of Jupyter Notebooks, an open-source web application for creating and sharing documents with live code, equations, visualizations, and narrative text.
12. Jupyter Notebooks with Code Examples
- Hands-on examples and code snippets in Jupyter Notebooks to help you implement and test anomaly detection models.
Main news related to the CCS TSI 2023 (2023/1695)
An English 🇬🇧 translation of a presentation to the speech I gave about the main changes brought by CCS TSI 2023 at the biggest Czech conference on Communications and signalling systems on Railways, which was held in Clarion Hotel Olomouc from 7th to 9th November 2023 (konferenceszt.cz). Attended by around 500 participants and 200 on-line followers.
The original Czech 🇨🇿 version of the presentation can be found here: https://www.slideshare.net/slideshow/hlavni-novinky-souvisejici-s-ccs-tsi-2023-2023-1695/269688092 .
The videorecording (in Czech) from the presentation is available here: https://youtu.be/WzjJWm4IyPk?si=SImb06tuXGb30BEH .
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
Predictive maintenance is a proactive approach that anticipates equipment failures before they happen. At the forefront of this innovative strategy is Artificial Intelligence (AI), which brings unprecedented precision and efficiency. AI in predictive maintenance is transforming industries by reducing downtime, minimizing costs, and enhancing productivity.
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-und-domino-lizenzkostenreduzierung-in-der-welt-von-dlau/
DLAU und die Lizenzen nach dem CCB- und CCX-Modell sind für viele in der HCL-Community seit letztem Jahr ein heißes Thema. Als Notes- oder Domino-Kunde haben Sie vielleicht mit unerwartet hohen Benutzerzahlen und Lizenzgebühren zu kämpfen. Sie fragen sich vielleicht, wie diese neue Art der Lizenzierung funktioniert und welchen Nutzen sie Ihnen bringt. Vor allem wollen Sie sicherlich Ihr Budget einhalten und Kosten sparen, wo immer möglich. Das verstehen wir und wir möchten Ihnen dabei helfen!
Wir erklären Ihnen, wie Sie häufige Konfigurationsprobleme lösen können, die dazu führen können, dass mehr Benutzer gezählt werden als nötig, und wie Sie überflüssige oder ungenutzte Konten identifizieren und entfernen können, um Geld zu sparen. Es gibt auch einige Ansätze, die zu unnötigen Ausgaben führen können, z. B. wenn ein Personendokument anstelle eines Mail-Ins für geteilte Mailboxen verwendet wird. Wir zeigen Ihnen solche Fälle und deren Lösungen. Und natürlich erklären wir Ihnen das neue Lizenzmodell.
Nehmen Sie an diesem Webinar teil, bei dem HCL-Ambassador Marc Thomas und Gastredner Franz Walder Ihnen diese neue Welt näherbringen. Es vermittelt Ihnen die Tools und das Know-how, um den Überblick zu bewahren. Sie werden in der Lage sein, Ihre Kosten durch eine optimierte Domino-Konfiguration zu reduzieren und auch in Zukunft gering zu halten.
Diese Themen werden behandelt
- Reduzierung der Lizenzkosten durch Auffinden und Beheben von Fehlkonfigurationen und überflüssigen Konten
- Wie funktionieren CCB- und CCX-Lizenzen wirklich?
- Verstehen des DLAU-Tools und wie man es am besten nutzt
- Tipps für häufige Problembereiche, wie z. B. Team-Postfächer, Funktions-/Testbenutzer usw.
- Praxisbeispiele und Best Practices zum sofortigen Umsetzen
Skybuffer SAM4U tool for SAP license adoption
Manage and optimize your license adoption and consumption with SAM4U, an SAP free customer software asset management tool.
SAM4U, an SAP complimentary software asset management tool for customers, delivers a detailed and well-structured overview of license inventory and usage with a user-friendly interface. We offer a hosted, cost-effective, and performance-optimized SAM4U setup in the Skybuffer Cloud environment. You retain ownership of the system and data, while we manage the ABAP 7.58 infrastructure, ensuring fixed Total Cost of Ownership (TCO) and exceptional services through the SAP Fiori interface.
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean Lotus cyber threat actors represent a sophisticated, persistent, and politically motivated group that poses a significant risk to organizations and individuals in the Southeast Asian region. Their continuous evolution and adaptability underscore the need for robust cybersecurity measures and international cooperation to identify and mitigate the threats posed by such advanced persistent threat groups.
Trusted Execution Environment for Decentralized Process Mining
Presentation of the paper "Trusted Execution Environment for Decentralized Process Mining" given during the CAiSE 2024 Conference in Cyprus on June 7, 2024.
Choosing The Best AWS Service For Your Website + API.pptx
Have you ever been confused by the myriad of choices offered by AWS for hosting a website or an API?
Lambda, Elastic Beanstalk, Lightsail, Amplify, S3 (and more!) can each host websites + APIs. But which one should we choose?
Which one is cheapest? Which one is fastest? Which one will scale to meet our needs?
Join me in this session as we dive into each AWS hosting service to determine which one is best for your scenario and explain why!
Artificial Intelligence for XMLDevelopment
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
Fueling AI with Great Data with Airbyte Webinar
This talk will focus on how to collect data from a variety of sources, leveraging this data for RAG and other GenAI use cases, and finally charting your course to productionalization.
Operating System Used by Users in day-to-day life.pptx
Dive into the realm of operating systems (OS) with Pravash Chandra Das, a seasoned Digital Forensic Analyst, as your guide. 🚀 This comprehensive presentation illuminates the core concepts, types, and evolution of OS, essential for understanding modern computing landscapes.
Beginning with the foundational definition, Das clarifies the pivotal role of OS as system software orchestrating hardware resources, software applications, and user interactions. Through succinct descriptions, he delineates the diverse types of OS, from single-user, single-task environments like early MS-DOS iterations, to multi-user, multi-tasking systems exemplified by modern Linux distributions.
Crucial components like the kernel and shell are dissected, highlighting their indispensable functions in resource management and user interface interaction. Das elucidates how the kernel acts as the central nervous system, orchestrating process scheduling, memory allocation, and device management. Meanwhile, the shell serves as the gateway for user commands, bridging the gap between human input and machine execution. 💻
The narrative then shifts to a captivating exploration of prominent desktop OSs, Windows, macOS, and Linux. Windows, with its globally ubiquitous presence and user-friendly interface, emerges as a cornerstone in personal computing history. macOS, lauded for its sleek design and seamless integration with Apple's ecosystem, stands as a beacon of stability and creativity. Linux, an open-source marvel, offers unparalleled flexibility and security, revolutionizing the computing landscape. 🖥️
Moving to the realm of mobile devices, Das unravels the dominance of Android and iOS. Android's open-source ethos fosters a vibrant ecosystem of customization and innovation, while iOS boasts a seamless user experience and robust security infrastructure. Meanwhile, discontinued platforms like Symbian and Palm OS evoke nostalgia for their pioneering roles in the smartphone revolution.
The journey concludes with a reflection on the ever-evolving landscape of OS, underscored by the emergence of real-time operating systems (RTOS) and the persistent quest for innovation and efficiency. As technology continues to shape our world, understanding the foundations and evolution of operating systems remains paramount. Join Pravash Chandra Das on this illuminating journey through the heart of computing. 🌟
Best 20 SEO Techniques To Improve Website Visibility In SERP
Boost your website's visibility with proven SEO techniques! Our latest blog dives into essential strategies to enhance your online presence, increase traffic, and rank higher on search engines. From keyword optimization to quality content creation, learn how to make your site stand out in the crowded digital landscape. Discover actionable tips and expert insights to elevate your SEO game.
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI, built on the robust SAP Business Technology Platform (SAP BTP), is the latest and most advanced version of our AI development, reaffirming our commitment to delivering top-tier AI solutions. Skybuffer AI harnesses all the innovative capabilities of the SAP BTP in the AI domain, from Conversational AI to cutting-edge Generative AI and Retrieval-Augmented Generation (RAG). It also helps SAP customers safeguard their investments into SAP Conversational AI and ensure a seamless, one-click transition to SAP Business AI.
With Skybuffer AI, various AI models can be integrated into a single communication channel such as Microsoft Teams. This integration empowers business users with insights drawn from SAP backend systems, enterprise documents, and the expansive knowledge of Generative AI. And the best part of it is that it is all managed through our intuitive no-code Action Server interface, requiring no extensive coding knowledge and making the advanced AI accessible to more users.
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays, June 2024 with Maria Copot 20
Recently uploaded (20)
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Trusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process Mining
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Operating System Used by Users in day-to-day life.pptx
Operating System Used by Users in day-to-day life.pptx
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
挖财的互联网金融技术实践与探索@upyun opentalk
- 2. 大连 杭州 阿里 挖财 金融 互联网 互联网金融
- 4. branch “互联⺴⽹网” branch “⾦金融” just merge, then we get “互联⺴⽹网⾦金融”?
- 5. WE ARE STILL THEN FOLLOWING …
- 7. [ Micro ] Services Everywhere SETTLEMENT
- 8. Scale MySQL For Cashflow Cobar != CobarClient Naming Consistency Sucks Here
- 14. 3. Async Everywhere Latency, latency, latency
- 17. Push is NOT so reliable _ Poll lives long
- 18. Async Is Not Enough, Non-blocking Matters • adbcj - < https://github.com/mheath/adbcj >
- 20. Kafka As The Big Journals • expiration after 1 month(default is 1 week) • topics with hierarchy • replicas first, partitions if needed • http senders, tcp receivers
- 21. Traveling Back… • Logging,Logging,Logging… • Trace Tables • Event Sourcing • Akka Persistence
- 26. Guess, Why We Don’t Use Kafka Partitions Heavily? Separation != Isolation
- 28. do u mean IDS?
- 29. From Zero to One
- 30. From One To Many zabbix fluentd flume
- 32. ! " # fallback direction
- 35. Where U Going?
- 37. Storage • Taming MySQL As Per Our Needs • Async Replication • Multi-write • Resort to proper commercial solutions • If you are fucking rich ;-)
- 38. Computation • Binary Star • Zookeeper As coordination service • Clustering • Zookeeper/DNS As Service Registry Service • Raft/Paxos if great, but we can’t manage it well yet.
- 39. 7. Reactive Everywhere Final Destination
- 40. –I don’t fucking know who said it. “No man ever steps in the same river twice”
- 42. still expecting funny&amazing guys to JOIN US! Thank you~ 让简历砸来得更猛烈些吧~, amen~ yunshi [在] wacai [点儿] com