Recommended
More Related Content
Similar to Dubbo in Internet Finance Industry
Similar to Dubbo in Internet Finance Industry (20)
Recently uploaded
Recently uploaded (20)
Dubbo in Internet Finance Industry
- 2. Dubbo in the Internet Finance Industry June 23, 2018
- 3. Contents 01 02 03 Current Platform Status Using Dubbo for a Microservice Architectu Dubbo Experience Sharing
- 6. Shanghai Rongzhijia Financial Information Service Co., Ltd. Leading IT service provider in the Chinese consumer finance industry Built the first Chinese Internet loan search platform——the Jiedianqian app Average daily loan applications: 500,000 Total loans made: RMB15 billion
- 7. Core Technology Data About Data Registered users: 30+ million Average daily applications: 500+ thousand Average daily interface calls: 60+ million Core records: 10 billion Servers: 800+ Data volume: 10+ TB
- 8. Using Dubbo for a Microservice Architecture02
- 9. Using Dubbo for a Microservice Architecture war war DB DB Nginx redis war war DB Nginx redis war service service service war DB Nginx redis war service service service DB DB 2015 2018
- 10. Initial Platform war DB End of 2015 Solutions: • Used MySQL with Tomcat. • Used MyBatis with Spring to construct the business system. • Inter-system business sharing directly depended on databases. Problems: • Services were suspended each time a new version was released, affecting the user experience, operations, and agent postings. • High access volumes resulted in a large number of time- outs. Using Dubbo for a Microservice Architecture
- 11. DB war Nginx redis war Initial Platform Solutions: • Introduced Nginx as a reverse proxy to solve the service suspension problem occurred in version releases. • Introduced Redis for session sharing. Problems: • The system contained a large volume of duplicate code with serious coupling. • Any change may introduce new bugs and increase the regression testing volume. • The system quality was decreased, with bugs occurred frequently online. 2016 Using Dubbo for a Microservice Architecture
- 12. Technical Differences Between Dubbo and Spring Cloud Using Dubbo for a Microservice Architecture
- 13. "Semi" Microservice Stage Solutions: • Spilt up services based on domain models and businesses. • Introduced Dubbo to start service-based development. Problems: • Any poorly-performing SQL statement in the system could cause the Dubbo thread pool to overflow and the system to crash. • Database performance decreased, and alarms were often generated for 99% of CPU utilization. • Each programmer has a different coding style, making maintenance difficult and causing system instability. 2017 war DB Nginx redis war service service service Using Dubbo for a Microservice Architecture
- 14. Prepared a Microservice Tool Generate read/write isolated databases automatically Generate unit tests automatically Generate code frameworks automatically Generate PO DTO objects directly Generate POM dependency automatically Using Dubbo for a Microservice Architecture
- 15. ManagerImplR ManagerImplW Code Structure and Calling Relationships Controller back(war) basic( jar) IManger MangerImpl Facade IService Servi ceImpl IMangerR IMangerW DAOR DAOW WR Using Dubbo for a Microservice Architecture
- 16. Microservice Stage Solutions: • Code is generated automatically with a consistent style. • Each service corresponds to a unique database with read/write isolated. • Introduced throttling, fuses, and other techniques to ensure service stability. Problems: • Distributed transaction solution • Aggregate log query 2018 war DB Nginx redis war service service service DB DB Using Dubbo for a Microservice Architecture
- 17. Business Architecture (simplified) APP M Station H5 Public Account PCFront Access Gateway User Center Product Center Order Center Finance Center Payment CenterBusiness … User Product Order Payment Routing Directory Service Basic Services Comment Shortlink Message Message Routing Promotion Ranking Service … MYSQL Redis HBase HDFS ESData Storage Hive Public Platform Configurati on Center Monitoring Center Security Center Log Center Scheduling Center Binlog Configurati on Service A/B Behavior Data Search Ranking s User Tags User Portraits Data Center Operation Reports Using Dubbo for a Microservice Architecture
- 18. System Access Interaction Process App H5 Nginx API API Business LocalCache Business LocalCache Gateway Cluster … Business Cluster Service Service Service Service Service … Service Cluster Business LocalCache Business LocalCache Business Cluster RemoteCache Cluster Master Slave DAL Con figu rati on Cen ter Global Call Trace Using Dubbo for a Microservice Architecture
- 20. Development Process Dubbo Experience Sharing Testing PrereleaseDevelopment Production
- 21. Prerelease and Production Compatibility Dubbo Experience Sharing C Production ZK P1 P2 C Production ZK P1 P2 C Prerelease group P2 groupNote: Code is environment independent. 1. Used groups to isolate the production and prerelease environments. 2. Defined versions and groups in the Configuration Center.
- 22. Service Permission Control zk consumer provide Extended functions based on Dubbo Filter interface • Automatic access to Configuration Center • IP address access restrictions • Restrictions for access in the specified method • Automatic warning for unauthorized connections Problems: • Consumers can connect to any service provider during registration • Consumers can directly connect to service providers • Consumers can perform any operation on the services provided by service providers zk consumer provide Auth oriza tion Dubbo Experience Sharing
- 23. Concurrent Service Processing Sped Up Access User Service Product Service Attribute Service Verificatio n Service Tag Service Order Service Ranking Service User Behavior Black Mirror Service Version Service Counter Service Precision Marketing Dubbo Experience Sharing
- 24. Service Servic e Concurrent Service Processing Sped Up Access Service Service Service Business Servic e Business Aggregation ExecutorService Servic e Service Business Aggregation Service eses es Dubbo Experience Sharing
- 25. Fuse Function Requirements Fuse Fuse Time Window Error Rate Manual Intervention Active Alarm Dubbo Experience Sharing
- 26. Needs: •Simulate a successful payment •Simulate a failed registration •Simulate all status values •Simulate delays and exceptions •…… Requirements: •No additional programming required •No code intrusion •Easy to simulate •……
- 27. Mock Platform Dubbo Experience Sharing Consumer Provider Filter Mock Platform http request http response
- 28. Dubbo MonitorService Extension • Tps • Elapsed • Concurrent • … Monitoring Platform
- 29. Microservice Platform Framework Dubbo Experience Sharing Registry Consumer Provider Container register invoke notify subscribe Permission Platform Mock Platform Monitoring Platform
- 30. Log Retrieval Platform KAFKASystem A FLUME System B FLUME System C FLUME Log Platform Alarm Platform Real-time Computing Rule Engine
- 31. THANKS ALL