SlideShare a Scribd company logo
1 of 11
Download to read offline
Blog内容挖掘与分析的技术挑战
Technical challenge of Blog mining and analysis

                   余敏玮 (Denis) @ CIC Tech

                   中文网志年会(2008) @ 广州
                   CN Blogger Conference (2008) @ GuangZhou
中国社交网络的规模 (CHINA SOCIAL MEDIA DOMINATES THE WORLD)


  互联网用户
                                                                              220 Million1                      253 Million2
  (Number of Internet users)

  每周上网时间
  博客数                                                                          74 Million5
                                                                                7 Hrs2                            14 Hrs1
                                                                                                                107 Million6
  (Avg. time spent online per week)
  Number of bloggers5,6

     个人意见想法的表达5
  互联网用户每周看电视的时间
  (Avg.have expressedusers spend
     “I time Internet personal
                                                                               31 hours3
                                                                                  56%                             9 hours4
                                                                                                                    72%
     opinions and/or written about
  watching TV per week)
       myself online”

      我可以表达线下不能表达的见解5
  互联网渗透率
                                                                                    73%1                             19%2
  (Internet Penetration) say and do
      “Online I feel free to                                                         32%                              73%
       things I wouldn’t do or say offline”

       参与博客讨论的宽带用户百分比5
       Percentage broadband users                                                    28%                               47%
       commenting blog, chat room,
       listserv or forum

   Data Source: 1)The 22nd Statistical Survey Report on the Internet Development in China by CNNIC, July 2008. 2) Nielsen Netraitings, July 2008.
                3) “Whichever Screen, People Are Watching”, The New York Times, July 2008. 4) China Academy of Social Sciences。
                5) IAC and JWT, November 2007. 6) Boston Consulting Group, July 2008.                                                               2
博客的社会价值 (Social Value of Blog)


                                                            Sample Quote: 祈福 / Pray (link)
                                                            5月12日的汶川地震让我们这一辈子都会刻骨铭
                                                            心,这也是我第一次亲身经历地震,这次的损失
                                                            惨重,但这并不可怕,只要我们有重建家园的决
                                                            心就行,让我们都为灾区人民祈福吧!!
     Prayer: Let’s pray for the victims that                We will never forget the earthquake that
     everything will be recovered and rebuilt.              occurred on May 12th, 2008 and even though it
                                                            caused a huge amount of damage, as long as
                                                            we have the resolution to rebuild the homes,
                                                            then it is not so frightening. Let us pray for the
                                                            people living in the earthquake area!


     Prayer: My heart is broken, all I can do is
     pray for the other victims.                          In the wake of the catastrophe, blogs became a
                                                          platform for grieving and prayer for the victims
                                                          and their families. Popular blog sites like Sina
   Typing keyword “pray + earthquake” on                  blog, Sohu blog, Blogbus all have hundreds of
   NetEase Blog search, yields more than
                                                          thousands of entries discussing and sharing
   53,000 blog articles on praying. (link)
                                                          personal accounts and feelings towards the
                                                          tragic event.


                                                                                                                               3
                                     See more information about the cases, you can refer to IWOM watch Special Edition, May 2008
自然语言分析技术
来自中文的挑战 (Challenges from Chinese language)



      中文分词             比较                复杂的词义

      乒乓球拍卖完了
      乒乓球 / 拍卖 / 完了                      这瓶洗发水,适合头
                       品牌1 比 品牌2 差       发很干的人用
      乒乓球拍 / 卖完了
                       品牌1 不比 品牌2 的差多少
                       品牌1 比 品牌2 好
                                         用了这瓶洗发水,头
                       品牌1 比 品牌2 好不了多少
      喜欢开宝马的人                            发变得很干
      喜欢{开宝马的人}
      {喜欢开宝马}的人

  •   几种分析模型
      – 基于关键字分析的模型
      – 基于机器学习的模型
      – 基于关键字以及语法分析的模型




                                                     4
自然语言分析技术
来自中文的挑战 (Challenges from Chinese language)

  网络口语: 打酱油,俯卧撑…




                                                    5
自然语言分析技术
•   内容归类
    – 行业/品牌/产品
      • 同义词,别名, 类别树
    – 情感分析
      • 用户表达情感的各种方式




                      行业
                      行业
                           品牌 1
                           品牌 1
                                  产品 1
                                  产品 1
                                  产品 2
                                  产品 2
                           品牌 2
                           品牌 2
                                  产品 3
                                  产品 3
                                  产品 4
                                  产品 4
                                         6
数据计算,聚合以及分析 (Data Process)                                           数据计算,聚合以及分析
   •   数据需要从多维度进行聚合和分析
       Data need be aggregated and analyzed in different angles
        – 每月有多少博客文章讨论每一个品牌
           How many articles talk about each brand each month
        – 每周有多少人讨论每个品牌产品
           How many people talk about each product each week
        – 在某一个月中谈论某一个品牌最多的10个博客是谁?
           What’s the top 10 people talk about a particular brand
   •   解决方案: OLAP多维数据仓库 (快速/灵活的数据分析支持)
       Solution: OLAP data cube (Fast / Flexible data analysis support)
                     时间维度 (年/月/日)
                      Time Dimension




                                                            ct
                                                            du
                                                        /P 品
                                                          ro
                                                   ra /产
                                                / B 品牌
                                                     nd
                                              ry /
                                            st 业
                                          du 行
                                       In




                                                  博主 Blogger                       7
数据计算,聚合以及分析




                             化妆品
博客1              运动服饰
            手机


                      汽车
博客2              手机
           笔记本


                      股票
博客3         笔记本
      手机




对于博客:博客个人属性分析
对于品牌:博客行业关注度分析



                                         8
数据展示/可视化

挖掘更多数据的价值
Making MORE sense of the data




                                           9
总结

                      中文分析存在巨大挑战, 技
技术已经相当成熟
                      术还未非常成熟




    数据来源             文本挖掘
   Data Source      Text Mining




     数据分析           数据可视化
   Data Analysis Data Visualization




OLAP解决方案              多种技术可以运用, 取决于具
                      体的分析目标

                                           10
OUR BLOGS:

Company Blog: http://www.seeisee.com (Chinese)
CEO Blog:            http://www.seeisee.com/sam (English)



    Tech Blog:                                     http://blog.csdn.net/cictech

OUR WEBSITE:                                                             Thank You
www.cicdata.com


CONTACT US:
info@cicdata.com


   This document is for private commercial use only. Distribution
   to third parties and/or publication in whole or in part is strictly
   prohibited without expressed written consent of CIC.


   本文件是针对CIC客户的相关品牌和企业的商业文件。未经CIC
   的书面许可, 本文件或文件中的任何内容不得转交给第三方,
   同时也不得发表本文件或文件中的任何内容。

More Related Content

What's hot

كتاب تعليم الفلاش
كتاب تعليم الفلاشكتاب تعليم الفلاش
كتاب تعليم الفلاشnansyrigan
 
تركيب سيرفر ومجلة ومنتدي
تركيب سيرفر ومجلة ومنتديتركيب سيرفر ومجلة ومنتدي
تركيب سيرفر ومجلة ومنتديnansyrigan
 
توافق نامه خريد و فروش اينترنتي سهام
توافق نامه خريد و فروش اينترنتي سهامتوافق نامه خريد و فروش اينترنتي سهام
توافق نامه خريد و فروش اينترنتي سهامahmad soodavar
 
أحكام الاستحاضة والإفرازات المهبلية في الفقه الإسلامي หนังสือ
أحكام الاستحاضة والإفرازات المهبلية في الفقه الإسلامي หนังสือأحكام الاستحاضة والإفرازات المهبلية في الفقه الإسلامي หนังสือ
أحكام الاستحاضة والإفرازات المهبلية في الفقه الإسلامي หนังสือMuhammadrusdee Almaarify
 
アジャイル事例紹介 —夜のおしごと編—
アジャイル事例紹介 —夜のおしごと編—アジャイル事例紹介 —夜のおしごと編—
アジャイル事例紹介 —夜のおしごと編—Fumihiko Kinoshita
 
커리어특강자료_글로벌커리어 및 인공지능 커리어
커리어특강자료_글로벌커리어 및 인공지능 커리어커리어특강자료_글로벌커리어 및 인공지능 커리어
커리어특강자료_글로벌커리어 및 인공지능 커리어IBM HongKong
 
الكتاب: البرهان في علوم القرآن
الكتاب: البرهان في علوم القرآنالكتاب: البرهان في علوم القرآن
الكتاب: البرهان في علوم القرآنbafgeeeeee
 
kharid va foroosh interneti
kharid va foroosh internetikharid va foroosh interneti
kharid va foroosh internetiahmad soodavar
 
Abc U12 L22 Te Dg 100708
Abc U12 L22 Te Dg 100708Abc U12 L22 Te Dg 100708
Abc U12 L22 Te Dg 100708guest1846c0
 
داستانهايي از امام زمان1
داستانهايي از امام زمان1داستانهايي از امام زمان1
داستانهايي از امام زمان1Mohammad Hossein
 
wall of apartheid
wall of apartheidwall of apartheid
wall of apartheiddiafayyad
 
داستانهايي از امام زمان2
داستانهايي از امام زمان2داستانهايي از امام زمان2
داستانهايي از امام زمان2Mohammad Hossein
 
自作言語でお絵描き
自作言語でお絵描き自作言語でお絵描き
自作言語でお絵描きuchan_nos
 

What's hot (18)

Business
BusinessBusiness
Business
 
كتاب تعليم الفلاش
كتاب تعليم الفلاشكتاب تعليم الفلاش
كتاب تعليم الفلاش
 
Manabeh
ManabehManabeh
Manabeh
 
تركيب سيرفر ومجلة ومنتدي
تركيب سيرفر ومجلة ومنتديتركيب سيرفر ومجلة ومنتدي
تركيب سيرفر ومجلة ومنتدي
 
توافق نامه خريد و فروش اينترنتي سهام
توافق نامه خريد و فروش اينترنتي سهامتوافق نامه خريد و فروش اينترنتي سهام
توافق نامه خريد و فروش اينترنتي سهام
 
أحكام الاستحاضة والإفرازات المهبلية في الفقه الإسلامي หนังสือ
أحكام الاستحاضة والإفرازات المهبلية في الفقه الإسلامي หนังสือأحكام الاستحاضة والإفرازات المهبلية في الفقه الإسلامي หนังสือ
أحكام الاستحاضة والإفرازات المهبلية في الفقه الإسلامي หนังสือ
 
アジャイル事例紹介 —夜のおしごと編—
アジャイル事例紹介 —夜のおしごと編—アジャイル事例紹介 —夜のおしごと編—
アジャイル事例紹介 —夜のおしごと編—
 
커리어특강자료_글로벌커리어 및 인공지능 커리어
커리어특강자료_글로벌커리어 및 인공지능 커리어커리어특강자료_글로벌커리어 및 인공지능 커리어
커리어특강자료_글로벌커리어 및 인공지능 커리어
 
Bi12 pa-001
Bi12 pa-001Bi12 pa-001
Bi12 pa-001
 
الكتاب: البرهان في علوم القرآن
الكتاب: البرهان في علوم القرآنالكتاب: البرهان في علوم القرآن
الكتاب: البرهان في علوم القرآن
 
kharid va foroosh interneti
kharid va foroosh internetikharid va foroosh interneti
kharid va foroosh interneti
 
Abc U12 L22 Te Dg 100708
Abc U12 L22 Te Dg 100708Abc U12 L22 Te Dg 100708
Abc U12 L22 Te Dg 100708
 
داستانهايي از امام زمان1
داستانهايي از امام زمان1داستانهايي از امام زمان1
داستانهايي از امام زمان1
 
wall of apartheid
wall of apartheidwall of apartheid
wall of apartheid
 
Aiin Nameh
Aiin NamehAiin Nameh
Aiin Nameh
 
داستانهايي از امام زمان2
داستانهايي از امام زمان2داستانهايي از امام زمان2
داستانهايي از امام زمان2
 
自作言語でお絵描き
自作言語でお絵描き自作言語でお絵描き
自作言語でお絵描き
 
It Flyer Page08
It Flyer Page08It Flyer Page08
It Flyer Page08
 

Viewers also liked

Promotion Mockups
Promotion MockupsPromotion Mockups
Promotion Mockupsguest51cd34
 
T Levesque Resume 10 2008
T Levesque Resume 10 2008T Levesque Resume 10 2008
T Levesque Resume 10 2008guest72081d
 
Ags Group Benefits Consulting 2011
Ags Group Benefits Consulting 2011Ags Group Benefits Consulting 2011
Ags Group Benefits Consulting 2011mjgion
 
Technical challenge of Blog mining and analysis
Technical challenge of Blog mining and analysisTechnical challenge of Blog mining and analysis
Technical challenge of Blog mining and analysisDenis Yu
 

Viewers also liked (6)

Promotion Mockups
Promotion MockupsPromotion Mockups
Promotion Mockups
 
T Levesque Resume 10 2008
T Levesque Resume 10 2008T Levesque Resume 10 2008
T Levesque Resume 10 2008
 
Ags Group Benefits Consulting 2011
Ags Group Benefits Consulting 2011Ags Group Benefits Consulting 2011
Ags Group Benefits Consulting 2011
 
Axpo Dez09
Axpo Dez09Axpo Dez09
Axpo Dez09
 
Technical challenge of Blog mining and analysis
Technical challenge of Blog mining and analysisTechnical challenge of Blog mining and analysis
Technical challenge of Blog mining and analysis
 
Chameleon CMS
Chameleon CMSChameleon CMS
Chameleon CMS
 

Similar to Chinese Blogger Conference CIC Presentation Slides

Windows 7兼容性系列课程(5):Windows 7徽标认证
Windows 7兼容性系列课程(5):Windows 7徽标认证Windows 7兼容性系列课程(5):Windows 7徽标认证
Windows 7兼容性系列课程(5):Windows 7徽标认证Chui-Wen Chiu
 
Richard Databoard
Richard DataboardRichard Databoard
Richard Databoard巍 陆
 
20070920173805
2007092017380520070920173805
200709201738055045033
 
網路、設計、使用者經驗
網路、設計、使用者經驗網路、設計、使用者經驗
網路、設計、使用者經驗Charles (XXC) Chen
 
油魚與鱈魚分辨
油魚與鱈魚分辨油魚與鱈魚分辨
油魚與鱈魚分辨k11k
 
Webken 03: Project Design for Optimaizing User Experience
Webken 03: Project Design for Optimaizing User ExperienceWebken 03: Project Design for Optimaizing User Experience
Webken 03: Project Design for Optimaizing User ExperienceNobuya Sato
 
12.2008 Trendbird Monthly Trend Report Sample
12.2008 Trendbird  Monthly Trend Report Sample12.2008 Trendbird  Monthly Trend Report Sample
12.2008 Trendbird Monthly Trend Report Samplewebtel125
 
Google Summer Of Code 2008
Google Summer Of Code 2008Google Summer Of Code 2008
Google Summer Of Code 2008Byeongweon Moon
 
Republic 1 2
Republic 1 2Republic 1 2
Republic 1 2huquanwei
 
請幫我修電腦.Pdf
請幫我修電腦.Pdf請幫我修電腦.Pdf
請幫我修電腦.Pdf瑋強 王
 
創業家研習營-7分鐘創意簡報技巧,Mr.6劉威麟
創業家研習營-7分鐘創意簡報技巧,Mr.6劉威麟創業家研習營-7分鐘創意簡報技巧,Mr.6劉威麟
創業家研習營-7分鐘創意簡報技巧,Mr.6劉威麟taiwanweb20
 
081210 Idcon 04 Itoh Peopleservice
081210 Idcon 04 Itoh Peopleservice081210 Idcon 04 Itoh Peopleservice
081210 Idcon 04 Itoh PeopleserviceHiroki Itoh
 
設計思考研究演講 07.11
設計思考研究演講 07.11設計思考研究演講 07.11
設計思考研究演講 07.11NTUST
 
Prototyping Web Metaphors 20090418
Prototyping Web Metaphors 20090418Prototyping Web Metaphors 20090418
Prototyping Web Metaphors 20090418Charles (XXC) Chen
 
網絡宣教與牧養教牧講座
網絡宣教與牧養教牧講座網絡宣教與牧養教牧講座
網絡宣教與牧養教牧講座Charles Mok
 

Similar to Chinese Blogger Conference CIC Presentation Slides (20)

Wiki and KM
Wiki and KMWiki and KM
Wiki and KM
 
Windows 7兼容性系列课程(5):Windows 7徽标认证
Windows 7兼容性系列课程(5):Windows 7徽标认证Windows 7兼容性系列课程(5):Windows 7徽标认证
Windows 7兼容性系列课程(5):Windows 7徽标认证
 
Richard Databoard
Richard DataboardRichard Databoard
Richard Databoard
 
20070920173805
2007092017380520070920173805
20070920173805
 
網路、設計、使用者經驗
網路、設計、使用者經驗網路、設計、使用者經驗
網路、設計、使用者經驗
 
IA & UCD/UXD
IA & UCD/UXDIA & UCD/UXD
IA & UCD/UXD
 
油魚與鱈魚分辨
油魚與鱈魚分辨油魚與鱈魚分辨
油魚與鱈魚分辨
 
Webken 03: Project Design for Optimaizing User Experience
Webken 03: Project Design for Optimaizing User ExperienceWebken 03: Project Design for Optimaizing User Experience
Webken 03: Project Design for Optimaizing User Experience
 
ICT4KMT-20081225
ICT4KMT-20081225ICT4KMT-20081225
ICT4KMT-20081225
 
12.2008 Trendbird Monthly Trend Report Sample
12.2008 Trendbird  Monthly Trend Report Sample12.2008 Trendbird  Monthly Trend Report Sample
12.2008 Trendbird Monthly Trend Report Sample
 
Google Summer Of Code 2008
Google Summer Of Code 2008Google Summer Of Code 2008
Google Summer Of Code 2008
 
Republic 1 2
Republic 1 2Republic 1 2
Republic 1 2
 
請幫我修電腦.Pdf
請幫我修電腦.Pdf請幫我修電腦.Pdf
請幫我修電腦.Pdf
 
創業家研習營-7分鐘創意簡報技巧,Mr.6劉威麟
創業家研習營-7分鐘創意簡報技巧,Mr.6劉威麟創業家研習營-7分鐘創意簡報技巧,Mr.6劉威麟
創業家研習營-7分鐘創意簡報技巧,Mr.6劉威麟
 
081210 Idcon 04 Itoh Peopleservice
081210 Idcon 04 Itoh Peopleservice081210 Idcon 04 Itoh Peopleservice
081210 Idcon 04 Itoh Peopleservice
 
設計思考研究演講 07.11
設計思考研究演講 07.11設計思考研究演講 07.11
設計思考研究演講 07.11
 
Prototyping Web Metaphors 20090418
Prototyping Web Metaphors 20090418Prototyping Web Metaphors 20090418
Prototyping Web Metaphors 20090418
 
20081123-web2.0class
20081123-web2.0class20081123-web2.0class
20081123-web2.0class
 
Sysbiobook
SysbiobookSysbiobook
Sysbiobook
 
網絡宣教與牧養教牧講座
網絡宣教與牧養教牧講座網絡宣教與牧養教牧講座
網絡宣教與牧養教牧講座
 

Recently uploaded

IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoTAnalytics
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1DianaGray10
 
What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024Stephanie Beckett
 
UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2DianaGray10
 
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...FIDO Alliance
 
Designing for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at ComcastDesigning for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at ComcastUXDXConf
 
ECS 2024 Teams Premium - Pretty Secure
ECS 2024   Teams Premium - Pretty SecureECS 2024   Teams Premium - Pretty Secure
ECS 2024 Teams Premium - Pretty SecureFemke de Vroome
 
A Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System StrategyA Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System StrategyUXDXConf
 
AI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekAI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekCzechDreamin
 
Syngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon
 
Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024Enterprise Knowledge
 
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...FIDO Alliance
 
Powerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaPowerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaCzechDreamin
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyJohn Staveley
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceSamy Fodil
 
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...FIDO Alliance
 
Agentic RAG What it is its types applications and implementation.pdf
Agentic RAG What it is its types applications and implementation.pdfAgentic RAG What it is its types applications and implementation.pdf
Agentic RAG What it is its types applications and implementation.pdfChristopherTHyatt
 
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfFIDO Alliance
 
Optimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through ObservabilityOptimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through ObservabilityScyllaDB
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Patrick Viafore
 

Recently uploaded (20)

IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1
 
What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024
 
UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2
 
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
 
Designing for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at ComcastDesigning for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at Comcast
 
ECS 2024 Teams Premium - Pretty Secure
ECS 2024   Teams Premium - Pretty SecureECS 2024   Teams Premium - Pretty Secure
ECS 2024 Teams Premium - Pretty Secure
 
A Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System StrategyA Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System Strategy
 
AI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekAI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří Karpíšek
 
Syngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdf
 
Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024
 
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
 
Powerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaPowerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara Laskowska
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John Staveley
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM Performance
 
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
 
Agentic RAG What it is its types applications and implementation.pdf
Agentic RAG What it is its types applications and implementation.pdfAgentic RAG What it is its types applications and implementation.pdf
Agentic RAG What it is its types applications and implementation.pdf
 
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
 
Optimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through ObservabilityOptimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through Observability
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024
 

Chinese Blogger Conference CIC Presentation Slides

  • 1. Blog内容挖掘与分析的技术挑战 Technical challenge of Blog mining and analysis 余敏玮 (Denis) @ CIC Tech 中文网志年会(2008) @ 广州 CN Blogger Conference (2008) @ GuangZhou
  • 2. 中国社交网络的规模 (CHINA SOCIAL MEDIA DOMINATES THE WORLD) 互联网用户 220 Million1 253 Million2 (Number of Internet users) 每周上网时间 博客数 74 Million5 7 Hrs2 14 Hrs1 107 Million6 (Avg. time spent online per week) Number of bloggers5,6 个人意见想法的表达5 互联网用户每周看电视的时间 (Avg.have expressedusers spend “I time Internet personal 31 hours3 56% 9 hours4 72% opinions and/or written about watching TV per week) myself online” 我可以表达线下不能表达的见解5 互联网渗透率 73%1 19%2 (Internet Penetration) say and do “Online I feel free to 32% 73% things I wouldn’t do or say offline” 参与博客讨论的宽带用户百分比5 Percentage broadband users 28% 47% commenting blog, chat room, listserv or forum Data Source: 1)The 22nd Statistical Survey Report on the Internet Development in China by CNNIC, July 2008. 2) Nielsen Netraitings, July 2008. 3) “Whichever Screen, People Are Watching”, The New York Times, July 2008. 4) China Academy of Social Sciences。 5) IAC and JWT, November 2007. 6) Boston Consulting Group, July 2008. 2
  • 3. 博客的社会价值 (Social Value of Blog) Sample Quote: 祈福 / Pray (link) 5月12日的汶川地震让我们这一辈子都会刻骨铭 心,这也是我第一次亲身经历地震,这次的损失 惨重,但这并不可怕,只要我们有重建家园的决 心就行,让我们都为灾区人民祈福吧!! Prayer: Let’s pray for the victims that We will never forget the earthquake that everything will be recovered and rebuilt. occurred on May 12th, 2008 and even though it caused a huge amount of damage, as long as we have the resolution to rebuild the homes, then it is not so frightening. Let us pray for the people living in the earthquake area! Prayer: My heart is broken, all I can do is pray for the other victims. In the wake of the catastrophe, blogs became a platform for grieving and prayer for the victims and their families. Popular blog sites like Sina Typing keyword “pray + earthquake” on blog, Sohu blog, Blogbus all have hundreds of NetEase Blog search, yields more than thousands of entries discussing and sharing 53,000 blog articles on praying. (link) personal accounts and feelings towards the tragic event. 3 See more information about the cases, you can refer to IWOM watch Special Edition, May 2008
  • 4. 自然语言分析技术 来自中文的挑战 (Challenges from Chinese language) 中文分词 比较 复杂的词义 乒乓球拍卖完了 乒乓球 / 拍卖 / 完了 这瓶洗发水,适合头 品牌1 比 品牌2 差 发很干的人用 乒乓球拍 / 卖完了 品牌1 不比 品牌2 的差多少 品牌1 比 品牌2 好 用了这瓶洗发水,头 品牌1 比 品牌2 好不了多少 喜欢开宝马的人 发变得很干 喜欢{开宝马的人} {喜欢开宝马}的人 • 几种分析模型 – 基于关键字分析的模型 – 基于机器学习的模型 – 基于关键字以及语法分析的模型 4
  • 5. 自然语言分析技术 来自中文的挑战 (Challenges from Chinese language) 网络口语: 打酱油,俯卧撑… 5
  • 6. 自然语言分析技术 • 内容归类 – 行业/品牌/产品 • 同义词,别名, 类别树 – 情感分析 • 用户表达情感的各种方式 行业 行业 品牌 1 品牌 1 产品 1 产品 1 产品 2 产品 2 品牌 2 品牌 2 产品 3 产品 3 产品 4 产品 4 6
  • 7. 数据计算,聚合以及分析 (Data Process) 数据计算,聚合以及分析 • 数据需要从多维度进行聚合和分析 Data need be aggregated and analyzed in different angles – 每月有多少博客文章讨论每一个品牌 How many articles talk about each brand each month – 每周有多少人讨论每个品牌产品 How many people talk about each product each week – 在某一个月中谈论某一个品牌最多的10个博客是谁? What’s the top 10 people talk about a particular brand • 解决方案: OLAP多维数据仓库 (快速/灵活的数据分析支持) Solution: OLAP data cube (Fast / Flexible data analysis support) 时间维度 (年/月/日) Time Dimension ct du /P 品 ro ra /产 / B 品牌 nd ry / st 业 du 行 In 博主 Blogger 7
  • 8. 数据计算,聚合以及分析 化妆品 博客1 运动服饰 手机 汽车 博客2 手机 笔记本 股票 博客3 笔记本 手机 对于博客:博客个人属性分析 对于品牌:博客行业关注度分析 8
  • 10. 总结 中文分析存在巨大挑战, 技 技术已经相当成熟 术还未非常成熟 数据来源 文本挖掘 Data Source Text Mining 数据分析 数据可视化 Data Analysis Data Visualization OLAP解决方案 多种技术可以运用, 取决于具 体的分析目标 10
  • 11. OUR BLOGS: Company Blog: http://www.seeisee.com (Chinese) CEO Blog: http://www.seeisee.com/sam (English) Tech Blog: http://blog.csdn.net/cictech OUR WEBSITE: Thank You www.cicdata.com CONTACT US: info@cicdata.com This document is for private commercial use only. Distribution to third parties and/or publication in whole or in part is strictly prohibited without expressed written consent of CIC. 本文件是针对CIC客户的相关品牌和企业的商业文件。未经CIC 的书面许可, 本文件或文件中的任何内容不得转交给第三方, 同时也不得发表本文件或文件中的任何内容。