Submit Search
Upload
8月27日pmcaff分享
•
0 likes
•
494 views
Song Hou
Follow
姨搜大数据风控系统,原理以及如何建设,还包括两个案例,体现出姨搜是如何帮助我们的用户提升风控能力的。
Read less
Read more
Internet
Report
Share
Report
Share
1 of 25
Download now
Download to read offline
Recommended
APNIC Hackathon The Lord of IPv6
APNIC Hackathon The Lord of IPv6
Siena Perry
APNIC Hackathon Poke Prefix
APNIC Hackathon Poke Prefix
Siena Perry
How to build analytics for 100bn logs a month with ClickHouse. By Vadim Tkach...
How to build analytics for 100bn logs a month with ClickHouse. By Vadim Tkach...
Valery Tkachenko
Log Files
Log Files
Heinrich Hartmann
Kafka Summit NYC 2017 - Data Processing at LinkedIn with Apache Kafka
Kafka Summit NYC 2017 - Data Processing at LinkedIn with Apache Kafka
confluent
Cron in der Cloud - Die Top 10 Hitparade
Cron in der Cloud - Die Top 10 Hitparade
QAware GmbH
Strata Hadoop Hopsworks
Strata Hadoop Hopsworks
Jim Dowling
Scalable and Reliable Logging at Pinterest
Scalable and Reliable Logging at Pinterest
Krishna Gade
Recommended
APNIC Hackathon The Lord of IPv6
APNIC Hackathon The Lord of IPv6
Siena Perry
APNIC Hackathon Poke Prefix
APNIC Hackathon Poke Prefix
Siena Perry
How to build analytics for 100bn logs a month with ClickHouse. By Vadim Tkach...
How to build analytics for 100bn logs a month with ClickHouse. By Vadim Tkach...
Valery Tkachenko
Log Files
Log Files
Heinrich Hartmann
Kafka Summit NYC 2017 - Data Processing at LinkedIn with Apache Kafka
Kafka Summit NYC 2017 - Data Processing at LinkedIn with Apache Kafka
confluent
Cron in der Cloud - Die Top 10 Hitparade
Cron in der Cloud - Die Top 10 Hitparade
QAware GmbH
Strata Hadoop Hopsworks
Strata Hadoop Hopsworks
Jim Dowling
Scalable and Reliable Logging at Pinterest
Scalable and Reliable Logging at Pinterest
Krishna Gade
DOD 2016 - Stefan Thies - Monitoring and Log Management for Docker Swarm and...
DOD 2016 - Stefan Thies - Monitoring and Log Management for Docker Swarm and...
PROIDEA
Splunk and node
Splunk and node
Glenn Block
From my sql to postgresql using kafka+debezium
From my sql to postgresql using kafka+debezium
Clement Demonchy
Singer, Pinterest's Logging Infrastructure
Singer, Pinterest's Logging Infrastructure
Discover Pinterest
DC Spark bake off - Realtime TCP Packet Analysis using Spark and Azure Event ...
DC Spark bake off - Realtime TCP Packet Analysis using Spark and Azure Event ...
Silvio Fiorito
Real-world Streaming Architectures
Real-world Streaming Architectures
confluent
You Must Construct Additional Pipelines: Pub-Sub on Kafka at Blizzard
You Must Construct Additional Pipelines: Pub-Sub on Kafka at Blizzard
confluent
Flink Forward Berlin 2017: Steffen Hausmann - Build a Real-time Stream Proces...
Flink Forward Berlin 2017: Steffen Hausmann - Build a Real-time Stream Proces...
Flink Forward
2015 moloch recipes
2015 moloch recipes
Geoffrey Crespin
Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!
Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!
confluent
Kafka Summit NYC 2017 - Venice: A Distributed Database on top of Kafka
Kafka Summit NYC 2017 - Venice: A Distributed Database on top of Kafka
confluent
Kafka Summit SF 2017 - Query the Application, Not a Database: “Interactive Qu...
Kafka Summit SF 2017 - Query the Application, Not a Database: “Interactive Qu...
confluent
Kafka. seattle data science and data engineering meetup
Kafka. seattle data science and data engineering meetup
Abhishek Goswami
Kiwipycon2011 async-with-gevent-redis
Kiwipycon2011 async-with-gevent-redis
alexdong
Building Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EU
Building Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EU
Yaron Haviv
Hadoop World 2011: Storing and Indexing Social Media Content in the Hadoop Ec...
Hadoop World 2011: Storing and Indexing Social Media Content in the Hadoop Ec...
Cloudera, Inc.
Monitoring and scaling postgres at datadog
Monitoring and scaling postgres at datadog
Seth Rosenblum
Apache HBase at Airbnb
Apache HBase at Airbnb
HBaseCon
Upgrading from-hdp-21-to-hdp-24
Upgrading from-hdp-21-to-hdp-24
wyukawa
Presto Strata Hadoop SJ 2016 short talk
Presto Strata Hadoop SJ 2016 short talk
kbajda
How to improve ELK log pipeline performance
How to improve ELK log pipeline performance
Steven Shim
Common Sense Performance Indicators in the Cloud
Common Sense Performance Indicators in the Cloud
Nick Gerner
More Related Content
What's hot
DOD 2016 - Stefan Thies - Monitoring and Log Management for Docker Swarm and...
DOD 2016 - Stefan Thies - Monitoring and Log Management for Docker Swarm and...
PROIDEA
Splunk and node
Splunk and node
Glenn Block
From my sql to postgresql using kafka+debezium
From my sql to postgresql using kafka+debezium
Clement Demonchy
Singer, Pinterest's Logging Infrastructure
Singer, Pinterest's Logging Infrastructure
Discover Pinterest
DC Spark bake off - Realtime TCP Packet Analysis using Spark and Azure Event ...
DC Spark bake off - Realtime TCP Packet Analysis using Spark and Azure Event ...
Silvio Fiorito
Real-world Streaming Architectures
Real-world Streaming Architectures
confluent
You Must Construct Additional Pipelines: Pub-Sub on Kafka at Blizzard
You Must Construct Additional Pipelines: Pub-Sub on Kafka at Blizzard
confluent
Flink Forward Berlin 2017: Steffen Hausmann - Build a Real-time Stream Proces...
Flink Forward Berlin 2017: Steffen Hausmann - Build a Real-time Stream Proces...
Flink Forward
2015 moloch recipes
2015 moloch recipes
Geoffrey Crespin
Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!
Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!
confluent
Kafka Summit NYC 2017 - Venice: A Distributed Database on top of Kafka
Kafka Summit NYC 2017 - Venice: A Distributed Database on top of Kafka
confluent
Kafka Summit SF 2017 - Query the Application, Not a Database: “Interactive Qu...
Kafka Summit SF 2017 - Query the Application, Not a Database: “Interactive Qu...
confluent
Kafka. seattle data science and data engineering meetup
Kafka. seattle data science and data engineering meetup
Abhishek Goswami
Kiwipycon2011 async-with-gevent-redis
Kiwipycon2011 async-with-gevent-redis
alexdong
Building Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EU
Building Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EU
Yaron Haviv
Hadoop World 2011: Storing and Indexing Social Media Content in the Hadoop Ec...
Hadoop World 2011: Storing and Indexing Social Media Content in the Hadoop Ec...
Cloudera, Inc.
Monitoring and scaling postgres at datadog
Monitoring and scaling postgres at datadog
Seth Rosenblum
Apache HBase at Airbnb
Apache HBase at Airbnb
HBaseCon
Upgrading from-hdp-21-to-hdp-24
Upgrading from-hdp-21-to-hdp-24
wyukawa
Presto Strata Hadoop SJ 2016 short talk
Presto Strata Hadoop SJ 2016 short talk
kbajda
What's hot
(20)
DOD 2016 - Stefan Thies - Monitoring and Log Management for Docker Swarm and...
DOD 2016 - Stefan Thies - Monitoring and Log Management for Docker Swarm and...
Splunk and node
Splunk and node
From my sql to postgresql using kafka+debezium
From my sql to postgresql using kafka+debezium
Singer, Pinterest's Logging Infrastructure
Singer, Pinterest's Logging Infrastructure
DC Spark bake off - Realtime TCP Packet Analysis using Spark and Azure Event ...
DC Spark bake off - Realtime TCP Packet Analysis using Spark and Azure Event ...
Real-world Streaming Architectures
Real-world Streaming Architectures
You Must Construct Additional Pipelines: Pub-Sub on Kafka at Blizzard
You Must Construct Additional Pipelines: Pub-Sub on Kafka at Blizzard
Flink Forward Berlin 2017: Steffen Hausmann - Build a Real-time Stream Proces...
Flink Forward Berlin 2017: Steffen Hausmann - Build a Real-time Stream Proces...
2015 moloch recipes
2015 moloch recipes
Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!
Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!
Kafka Summit NYC 2017 - Venice: A Distributed Database on top of Kafka
Kafka Summit NYC 2017 - Venice: A Distributed Database on top of Kafka
Kafka Summit SF 2017 - Query the Application, Not a Database: “Interactive Qu...
Kafka Summit SF 2017 - Query the Application, Not a Database: “Interactive Qu...
Kafka. seattle data science and data engineering meetup
Kafka. seattle data science and data engineering meetup
Kiwipycon2011 async-with-gevent-redis
Kiwipycon2011 async-with-gevent-redis
Building Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EU
Building Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EU
Hadoop World 2011: Storing and Indexing Social Media Content in the Hadoop Ec...
Hadoop World 2011: Storing and Indexing Social Media Content in the Hadoop Ec...
Monitoring and scaling postgres at datadog
Monitoring and scaling postgres at datadog
Apache HBase at Airbnb
Apache HBase at Airbnb
Upgrading from-hdp-21-to-hdp-24
Upgrading from-hdp-21-to-hdp-24
Presto Strata Hadoop SJ 2016 short talk
Presto Strata Hadoop SJ 2016 short talk
Similar to 8月27日pmcaff分享
How to improve ELK log pipeline performance
How to improve ELK log pipeline performance
Steven Shim
Common Sense Performance Indicators in the Cloud
Common Sense Performance Indicators in the Cloud
Nick Gerner
Threat hunting on the wire
Threat hunting on the wire
InfoSec Addicts
The Design, Implementation and Open Source Way of Apache Pegasus
The Design, Implementation and Open Source Way of Apache Pegasus
acelyc1112009
Stream Processing with Apache Kafka and .NET
Stream Processing with Apache Kafka and .NET
confluent
Introduction to real time big data with Apache Spark
Introduction to real time big data with Apache Spark
Taras Matyashovsky
Top 5 mistakes when writing Streaming applications
Top 5 mistakes when writing Streaming applications
hadooparchbook
The Top Five Mistakes Made When Writing Streaming Applications with Mark Grov...
The Top Five Mistakes Made When Writing Streaming Applications with Mark Grov...
Databricks
Making HTML5 Mobile Games Indistinguishable from Native Apps
Making HTML5 Mobile Games Indistinguishable from Native Apps
FITC
Serverless spark
Serverless spark
MamathaBusi
What is Apache Kafka and What is an Event Streaming Platform?
What is Apache Kafka and What is an Event Streaming Platform?
confluent
Spark Saturday: Spark SQL & DataFrame Workshop with Apache Spark 2.3
Spark Saturday: Spark SQL & DataFrame Workshop with Apache Spark 2.3
Databricks
Zero to 1 Billion+ Records: A True Story of Learning & Scaling GameChanger
Zero to 1 Billion+ Records: A True Story of Learning & Scaling GameChanger
MongoDB
Application Security Workshop
Application Security Workshop
Priyanka Aash
Ingesting hdfs intosolrusingsparktrimmed
Ingesting hdfs intosolrusingsparktrimmed
whoschek
Streaming in Practice - Putting Apache Kafka in Production
Streaming in Practice - Putting Apache Kafka in Production
confluent
GPU-Accelerating UDFs in PySpark with Numba and PyGDF
GPU-Accelerating UDFs in PySpark with Numba and PyGDF
Keith Kraus
Stage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI Integration
Databricks
Seattle Spark Meetup Mobius CSharp API
Seattle Spark Meetup Mobius CSharp API
shareddatamsft
Stream processing on mobile networks
Stream processing on mobile networks
pbelko82
Similar to 8月27日pmcaff分享
(20)
How to improve ELK log pipeline performance
How to improve ELK log pipeline performance
Common Sense Performance Indicators in the Cloud
Common Sense Performance Indicators in the Cloud
Threat hunting on the wire
Threat hunting on the wire
The Design, Implementation and Open Source Way of Apache Pegasus
The Design, Implementation and Open Source Way of Apache Pegasus
Stream Processing with Apache Kafka and .NET
Stream Processing with Apache Kafka and .NET
Introduction to real time big data with Apache Spark
Introduction to real time big data with Apache Spark
Top 5 mistakes when writing Streaming applications
Top 5 mistakes when writing Streaming applications
The Top Five Mistakes Made When Writing Streaming Applications with Mark Grov...
The Top Five Mistakes Made When Writing Streaming Applications with Mark Grov...
Making HTML5 Mobile Games Indistinguishable from Native Apps
Making HTML5 Mobile Games Indistinguishable from Native Apps
Serverless spark
Serverless spark
What is Apache Kafka and What is an Event Streaming Platform?
What is Apache Kafka and What is an Event Streaming Platform?
Spark Saturday: Spark SQL & DataFrame Workshop with Apache Spark 2.3
Spark Saturday: Spark SQL & DataFrame Workshop with Apache Spark 2.3
Zero to 1 Billion+ Records: A True Story of Learning & Scaling GameChanger
Zero to 1 Billion+ Records: A True Story of Learning & Scaling GameChanger
Application Security Workshop
Application Security Workshop
Ingesting hdfs intosolrusingsparktrimmed
Ingesting hdfs intosolrusingsparktrimmed
Streaming in Practice - Putting Apache Kafka in Production
Streaming in Practice - Putting Apache Kafka in Production
GPU-Accelerating UDFs in PySpark with Numba and PyGDF
GPU-Accelerating UDFs in PySpark with Numba and PyGDF
Stage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI Integration
Seattle Spark Meetup Mobius CSharp API
Seattle Spark Meetup Mobius CSharp API
Stream processing on mobile networks
Stream processing on mobile networks
Recently uploaded
✂️ 👅 Independent Andheri Escorts With Room Vashi Call Girls 💃 9004004663
✂️ 👅 Independent Andheri Escorts With Room Vashi Call Girls 💃 9004004663
Call Girls Mumbai
Rohini Sector 6 Call Girls Delhi 9999965857 @Sabina Saikh No Advance
Rohini Sector 6 Call Girls Delhi 9999965857 @Sabina Saikh No Advance
Call Girls In Delhi Whatsup 9873940964 Enjoy Unlimited Pleasure
horny (9316020077 ) Goa Call Girls Service by VIP Call Girls in Goa
horny (9316020077 ) Goa Call Girls Service by VIP Call Girls in Goa
sexy call girls service in goa
Challengers I Told Ya ShirtChallengers I Told Ya Shirt
Challengers I Told Ya ShirtChallengers I Told Ya Shirt
rahman018755
Russian Call girls in Dubai +971563133746 Dubai Call girls
Russian Call girls in Dubai +971563133746 Dubai Call girls
stephieert
SEO Growth Program-Digital optimization Specialist
SEO Growth Program-Digital optimization Specialist
KHM Anwar
Call Girls In South Ex 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SERVICE
Call Girls In South Ex 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SERVICE
Call Girls In Delhi Whatsup 9873940964 Enjoy Unlimited Pleasure
10.pdfMature Call girls in Dubai +971563133746 Dubai Call girls
10.pdfMature Call girls in Dubai +971563133746 Dubai Call girls
stephieert
Call Girls In Sukhdev Vihar Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Sukhdev Vihar Delhi 💯Call Us 🔝8264348440🔝
soniya singh
'Future Evolution of the Internet' delivered by Geoff Huston at Everything Op...
'Future Evolution of the Internet' delivered by Geoff Huston at Everything Op...
APNIC
VIP 7001035870 Find & Meet Hyderabad Call Girls Dilsukhnagar high-profile Cal...
VIP 7001035870 Find & Meet Hyderabad Call Girls Dilsukhnagar high-profile Cal...
aditipandeya
VIP 7001035870 Find & Meet Hyderabad Call Girls LB Nagar high-profile Call Girl
VIP 7001035870 Find & Meet Hyderabad Call Girls LB Nagar high-profile Call Girl
aditipandeya
Best VIP Call Girls Noida Sector 75 Call Me: 8448380779
Best VIP Call Girls Noida Sector 75 Call Me: 8448380779
Delhi Call girls
Russian Call girl in Ajman +971563133746 Ajman Call girl Service
Russian Call girl in Ajman +971563133746 Ajman Call girl Service
gwenoracqe6
Delhi Call Girls Rohini 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Rohini 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
shivangimorya083
Top Rated Pune Call Girls Daund ⟟ 6297143586 ⟟ Call Me For Genuine Sex Servi...
Top Rated Pune Call Girls Daund ⟟ 6297143586 ⟟ Call Me For Genuine Sex Servi...
Call Girls in Nagpur High Profile
Call Girls In Model Towh Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Model Towh Delhi 💯Call Us 🔝8264348440🔝
soniya singh
AlbaniaDreamin24 - How to easily use an API with Flows
AlbaniaDreamin24 - How to easily use an API with Flows
Thierry TROUIN ☁
Enjoy Night⚡Call Girls Dlf City Phase 3 Gurgaon >༒8448380779 Escort Service
Enjoy Night⚡Call Girls Dlf City Phase 3 Gurgaon >༒8448380779 Escort Service
Delhi Call girls
Dwarka Sector 26 Call Girls | Delhi | 9999965857 🫦 Vanshika Verma More Our Se...
Dwarka Sector 26 Call Girls | Delhi | 9999965857 🫦 Vanshika Verma More Our Se...
Call Girls In Delhi Whatsup 9873940964 Enjoy Unlimited Pleasure
Recently uploaded
(20)
✂️ 👅 Independent Andheri Escorts With Room Vashi Call Girls 💃 9004004663
✂️ 👅 Independent Andheri Escorts With Room Vashi Call Girls 💃 9004004663
Rohini Sector 6 Call Girls Delhi 9999965857 @Sabina Saikh No Advance
Rohini Sector 6 Call Girls Delhi 9999965857 @Sabina Saikh No Advance
horny (9316020077 ) Goa Call Girls Service by VIP Call Girls in Goa
horny (9316020077 ) Goa Call Girls Service by VIP Call Girls in Goa
Challengers I Told Ya ShirtChallengers I Told Ya Shirt
Challengers I Told Ya ShirtChallengers I Told Ya Shirt
Russian Call girls in Dubai +971563133746 Dubai Call girls
Russian Call girls in Dubai +971563133746 Dubai Call girls
SEO Growth Program-Digital optimization Specialist
SEO Growth Program-Digital optimization Specialist
Call Girls In South Ex 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SERVICE
Call Girls In South Ex 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SERVICE
10.pdfMature Call girls in Dubai +971563133746 Dubai Call girls
10.pdfMature Call girls in Dubai +971563133746 Dubai Call girls
Call Girls In Sukhdev Vihar Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Sukhdev Vihar Delhi 💯Call Us 🔝8264348440🔝
'Future Evolution of the Internet' delivered by Geoff Huston at Everything Op...
'Future Evolution of the Internet' delivered by Geoff Huston at Everything Op...
VIP 7001035870 Find & Meet Hyderabad Call Girls Dilsukhnagar high-profile Cal...
VIP 7001035870 Find & Meet Hyderabad Call Girls Dilsukhnagar high-profile Cal...
VIP 7001035870 Find & Meet Hyderabad Call Girls LB Nagar high-profile Call Girl
VIP 7001035870 Find & Meet Hyderabad Call Girls LB Nagar high-profile Call Girl
Best VIP Call Girls Noida Sector 75 Call Me: 8448380779
Best VIP Call Girls Noida Sector 75 Call Me: 8448380779
Russian Call girl in Ajman +971563133746 Ajman Call girl Service
Russian Call girl in Ajman +971563133746 Ajman Call girl Service
Delhi Call Girls Rohini 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Rohini 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Top Rated Pune Call Girls Daund ⟟ 6297143586 ⟟ Call Me For Genuine Sex Servi...
Top Rated Pune Call Girls Daund ⟟ 6297143586 ⟟ Call Me For Genuine Sex Servi...
Call Girls In Model Towh Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Model Towh Delhi 💯Call Us 🔝8264348440🔝
AlbaniaDreamin24 - How to easily use an API with Flows
AlbaniaDreamin24 - How to easily use an API with Flows
Enjoy Night⚡Call Girls Dlf City Phase 3 Gurgaon >༒8448380779 Escort Service
Enjoy Night⚡Call Girls Dlf City Phase 3 Gurgaon >༒8448380779 Escort Service
Dwarka Sector 26 Call Girls | Delhi | 9999965857 🫦 Vanshika Verma More Our Se...
Dwarka Sector 26 Call Girls | Delhi | 9999965857 🫦 Vanshika Verma More Our Se...
8月27日pmcaff分享
1.
songhou@creditease.cn 1
2.
1. 2. 3. 4. 5. 2
3.
1. • P2P • • 3
4.
1. 2. 3. 4. 5. 4
5.
2. 1. 2. 3. 4. 5
6.
2.1 6
7.
2.2 • • • 7
8.
2.3 • • - - • - - - 8
9.
2.4 • • • -> -> •
-> -> - - - • 9
10.
1. 2. 3. 4. 5. 10
11.
3. 1. 2. 3. 4. 11
12.
3.1 12 risk model data data
13.
3.2 13 Query Engine crawler controller REST Client DB HDFS File KG web front REST Client realtime source realtime/batch extractionrealtime inserts commands web trace batch processing Web crawlers logging . . . . . . . . . . . . Kafka spark streaming web
extraction config online knowledge processing offline complex reasoning entity retrieve graph traverse full text search KG repository batch logging partners Query Engine data integration
14.
3.3 14
15.
3.4 15 Spark / MR Yarn Hadoop
16.
1. 2. 3. 4. 5. 16
17.
4. 1. 2. 17
18.
4.1 • - 3000 - 30 - • - - - - 18
19.
4.1 • NLP • • Albus • 19
20.
4.2 • - - - - • - - - 20
21.
4.2 • • • Pentaho dashboard 21
22.
1. 2. 3. 4. 5. 22
23.
5. • • • • 23
24.
• • jianmindong@creditease.cn 24
25.
Thanks Q & A 25 songhou@creditease.cn http://housong.github.io
Download now