SlideShare a Scribd company logo
1 of 11
Download to read offline
Blog内容挖掘与分析的技术挑战
Technical challenge of Blog mining and analysis

                   余敏玮 (Denis) @ CIC Tech

                   中文网志年会(2008) @ 广州
                   CN Blogger Conference (2008) @ GuangZhou
中国社交网络的规模 (CHINA SOCIAL MEDIA DOMINATES THE WORLD)


  互联网用户
                                                                              220 Million1                      253 Million2
  (Number of Internet users)

  每周上网时间
  博客数                                                                          74 Million5
                                                                                7 Hrs2                            14 Hrs1
                                                                                                                107 Million6
  (Avg. time spent online per week)
  Number of bloggers5,6

     个人意见想法的表达5
  互联网用户每周看电视的时间
  (Avg.have expressedusers spend
     “I time Internet personal
                                                                               31 hours3
                                                                                  56%                             9 hours4
                                                                                                                    72%
     opinions and/or written about
  watching TV per week)
       myself online”

      我可以表达线下不能表达的见解5
  互联网渗透率
                                                                                    73%1                             19%2
  (Internet Penetration) say and do
      “Online I feel free to                                                         32%                              73%
       things I wouldn’t do or say offline”

       参与博客讨论的宽带用户百分比5
       Percentage broadband users                                                    28%                               47%
       commenting blog, chat room,
       listserv or forum

   Data Source: 1)The 22nd Statistical Survey Report on the Internet Development in China by CNNIC, July 2008. 2) Nielsen Netraitings, July 2008.
                3) “Whichever Screen, People Are Watching”, The New York Times, July 2008. 4) China Academy of Social Sciences。
                5) IAC and JWT, November 2007. 6) Boston Consulting Group, July 2008.                                                               2
博客的社会价值 (Social Value of Blog)


                                                            Sample Quote: 祈福 / Pray (link)
                                                            5月12日的汶川地震让我们这一辈子都会刻骨铭
                                                            心,这也是我第一次亲身经历地震,这次的损失
                                                            惨重,但这并不可怕,只要我们有重建家园的决
                                                            心就行,让我们都为灾区人民祈福吧!!
     Prayer: Let’s pray for the victims that                We will never forget the earthquake that
     everything will be recovered and rebuilt.              occurred on May 12th, 2008 and even though it
                                                            caused a huge amount of damage, as long as
                                                            we have the resolution to rebuild the homes,
                                                            then it is not so frightening. Let us pray for the
                                                            people living in the earthquake area!


     Prayer: My heart is broken, all I can do is
     pray for the other victims.                          In the wake of the catastrophe, blogs became a
                                                          platform for grieving and prayer for the victims
                                                          and their families. Popular blog sites like Sina
   Typing keyword “pray + earthquake” on                  blog, Sohu blog, Blogbus all have hundreds of
   NetEase Blog search, yields more than
                                                          thousands of entries discussing and sharing
   53,000 blog articles on praying. (link)
                                                          personal accounts and feelings towards the
                                                          tragic event.


                                                                                                                               3
                                     See more information about the cases, you can refer to IWOM watch Special Edition, May 2008
自然语言分析技术
来自中文的挑战 (Challenges from Chinese language)



      中文分词             比较                复杂的词义

      乒乓球拍卖完了
      乒乓球 / 拍卖 / 完了                      这瓶洗发水,适合头
                       品牌1 比 品牌2 差       发很干的人用
      乒乓球拍 / 卖完了
                       品牌1 不比 品牌2 的差多少
                       品牌1 比 品牌2 好
                                         用了这瓶洗发水,头
                       品牌1 比 品牌2 好不了多少
      喜欢开宝马的人                            发变得很干
      喜欢{开宝马的人}
      {喜欢开宝马}的人

  •   几种分析模型
      – 基于关键字分析的模型
      – 基于机器学习的模型
      – 基于关键字以及语法分析的模型




                                                     4
自然语言分析技术
来自中文的挑战 (Challenges from Chinese language)

  网络口语: 打酱油,俯卧撑…




                                                    5
自然语言分析技术
•   内容归类
    – 行业/品牌/产品
      • 同义词,别名, 类别树
    – 情感分析
      • 用户表达情感的各种方式




                      行业
                      行业
                           品牌 1
                           品牌 1
                                  产品 1
                                  产品 1
                                  产品 2
                                  产品 2
                           品牌 2
                           品牌 2
                                  产品 3
                                  产品 3
                                  产品 4
                                  产品 4
                                         6
数据计算,聚合以及分析 (Data Process)                                           数据计算,聚合以及分析
   •   数据需要从多维度进行聚合和分析
       Data need be aggregated and analyzed in different angles
        – 每月有多少博客文章讨论每一个品牌
           How many articles talk about each brand each month
        – 每周有多少人讨论每个品牌产品
           How many people talk about each product each week
        – 在某一个月中谈论某一个品牌最多的10个博客是谁?
           What’s the top 10 people talk about a particular brand
   •   解决方案: OLAP多维数据仓库 (快速/灵活的数据分析支持)
       Solution: OLAP data cube (Fast / Flexible data analysis support)
                     时间维度 (年/月/日)
                      Time Dimension




                                                            ct
                                                            du
                                                        /P 品
                                                          ro
                                                   ra /产
                                                / B 品牌
                                                     nd
                                              ry /
                                            st 业
                                          du 行
                                       In




                                                  博主 Blogger                       7
数据计算,聚合以及分析




                             化妆品
博客1              运动服饰
            手机


                      汽车
博客2              手机
           笔记本


                      股票
博客3         笔记本
      手机




对于博客:博客个人属性分析
对于品牌:博客行业关注度分析



                                         8
数据展示/可视化

挖掘更多数据的价值
Making MORE sense of the data




                                           9
总结

                      中文分析存在巨大挑战, 技
技术已经相当成熟
                      术还未非常成熟




    数据来源             文本挖掘
   Data Source      Text Mining




     数据分析           数据可视化
   Data Analysis Data Visualization




OLAP解决方案              多种技术可以运用, 取决于具
                      体的分析目标

                                           10
OUR BLOGS:

Company Blog: http://www.seeisee.com (Chinese)
CEO Blog:            http://www.seeisee.com/sam (English)



    Tech Blog:                                     http://blog.csdn.net/cictech

OUR WEBSITE:                                                             Thank You
www.cicdata.com


CONTACT US:
info@cicdata.com


   This document is for private commercial use only. Distribution
   to third parties and/or publication in whole or in part is strictly
   prohibited without expressed written consent of CIC.


   本文件是针对CIC客户的相关品牌和企业的商业文件。未经CIC
   的书面许可, 本文件或文件中的任何内容不得转交给第三方,
   同时也不得发表本文件或文件中的任何内容。

More Related Content

What's hot

كتاب تعليم الفلاش
كتاب تعليم الفلاشكتاب تعليم الفلاش
كتاب تعليم الفلاشnansyrigan
 
تركيب سيرفر ومجلة ومنتدي
تركيب سيرفر ومجلة ومنتديتركيب سيرفر ومجلة ومنتدي
تركيب سيرفر ومجلة ومنتديnansyrigan
 
توافق نامه خريد و فروش اينترنتي سهام
توافق نامه خريد و فروش اينترنتي سهامتوافق نامه خريد و فروش اينترنتي سهام
توافق نامه خريد و فروش اينترنتي سهامahmad soodavar
 
أحكام الاستحاضة والإفرازات المهبلية في الفقه الإسلامي หนังสือ
أحكام الاستحاضة والإفرازات المهبلية في الفقه الإسلامي หนังสือأحكام الاستحاضة والإفرازات المهبلية في الفقه الإسلامي หนังสือ
أحكام الاستحاضة والإفرازات المهبلية في الفقه الإسلامي หนังสือMuhammadrusdee Almaarify
 
アジャイル事例紹介 —夜のおしごと編—
アジャイル事例紹介 —夜のおしごと編—アジャイル事例紹介 —夜のおしごと編—
アジャイル事例紹介 —夜のおしごと編—Fumihiko Kinoshita
 
커리어특강자료_글로벌커리어 및 인공지능 커리어
커리어특강자료_글로벌커리어 및 인공지능 커리어커리어특강자료_글로벌커리어 및 인공지능 커리어
커리어특강자료_글로벌커리어 및 인공지능 커리어IBM HongKong
 
الكتاب: البرهان في علوم القرآن
الكتاب: البرهان في علوم القرآنالكتاب: البرهان في علوم القرآن
الكتاب: البرهان في علوم القرآنbafgeeeeee
 
kharid va foroosh interneti
kharid va foroosh internetikharid va foroosh interneti
kharid va foroosh internetiahmad soodavar
 
Abc U12 L22 Te Dg 100708
Abc U12 L22 Te Dg 100708Abc U12 L22 Te Dg 100708
Abc U12 L22 Te Dg 100708guest1846c0
 
داستانهايي از امام زمان1
داستانهايي از امام زمان1داستانهايي از امام زمان1
داستانهايي از امام زمان1Mohammad Hossein
 
wall of apartheid
wall of apartheidwall of apartheid
wall of apartheiddiafayyad
 
داستانهايي از امام زمان2
داستانهايي از امام زمان2داستانهايي از امام زمان2
داستانهايي از امام زمان2Mohammad Hossein
 
自作言語でお絵描き
自作言語でお絵描き自作言語でお絵描き
自作言語でお絵描きuchan_nos
 

What's hot (18)

Business
BusinessBusiness
Business
 
كتاب تعليم الفلاش
كتاب تعليم الفلاشكتاب تعليم الفلاش
كتاب تعليم الفلاش
 
Manabeh
ManabehManabeh
Manabeh
 
تركيب سيرفر ومجلة ومنتدي
تركيب سيرفر ومجلة ومنتديتركيب سيرفر ومجلة ومنتدي
تركيب سيرفر ومجلة ومنتدي
 
توافق نامه خريد و فروش اينترنتي سهام
توافق نامه خريد و فروش اينترنتي سهامتوافق نامه خريد و فروش اينترنتي سهام
توافق نامه خريد و فروش اينترنتي سهام
 
أحكام الاستحاضة والإفرازات المهبلية في الفقه الإسلامي หนังสือ
أحكام الاستحاضة والإفرازات المهبلية في الفقه الإسلامي หนังสือأحكام الاستحاضة والإفرازات المهبلية في الفقه الإسلامي หนังสือ
أحكام الاستحاضة والإفرازات المهبلية في الفقه الإسلامي หนังสือ
 
アジャイル事例紹介 —夜のおしごと編—
アジャイル事例紹介 —夜のおしごと編—アジャイル事例紹介 —夜のおしごと編—
アジャイル事例紹介 —夜のおしごと編—
 
커리어특강자료_글로벌커리어 및 인공지능 커리어
커리어특강자료_글로벌커리어 및 인공지능 커리어커리어특강자료_글로벌커리어 및 인공지능 커리어
커리어특강자료_글로벌커리어 및 인공지능 커리어
 
Bi12 pa-001
Bi12 pa-001Bi12 pa-001
Bi12 pa-001
 
الكتاب: البرهان في علوم القرآن
الكتاب: البرهان في علوم القرآنالكتاب: البرهان في علوم القرآن
الكتاب: البرهان في علوم القرآن
 
kharid va foroosh interneti
kharid va foroosh internetikharid va foroosh interneti
kharid va foroosh interneti
 
Abc U12 L22 Te Dg 100708
Abc U12 L22 Te Dg 100708Abc U12 L22 Te Dg 100708
Abc U12 L22 Te Dg 100708
 
داستانهايي از امام زمان1
داستانهايي از امام زمان1داستانهايي از امام زمان1
داستانهايي از امام زمان1
 
wall of apartheid
wall of apartheidwall of apartheid
wall of apartheid
 
Aiin Nameh
Aiin NamehAiin Nameh
Aiin Nameh
 
داستانهايي از امام زمان2
داستانهايي از امام زمان2داستانهايي از امام زمان2
داستانهايي از امام زمان2
 
自作言語でお絵描き
自作言語でお絵描き自作言語でお絵描き
自作言語でお絵描き
 
It Flyer Page08
It Flyer Page08It Flyer Page08
It Flyer Page08
 

Viewers also liked

Promotion Mockups
Promotion MockupsPromotion Mockups
Promotion Mockupsguest51cd34
 
T Levesque Resume 10 2008
T Levesque Resume 10 2008T Levesque Resume 10 2008
T Levesque Resume 10 2008guest72081d
 
Ags Group Benefits Consulting 2011
Ags Group Benefits Consulting 2011Ags Group Benefits Consulting 2011
Ags Group Benefits Consulting 2011mjgion
 
Technical challenge of Blog mining and analysis
Technical challenge of Blog mining and analysisTechnical challenge of Blog mining and analysis
Technical challenge of Blog mining and analysisDenis Yu
 

Viewers also liked (6)

Promotion Mockups
Promotion MockupsPromotion Mockups
Promotion Mockups
 
T Levesque Resume 10 2008
T Levesque Resume 10 2008T Levesque Resume 10 2008
T Levesque Resume 10 2008
 
Ags Group Benefits Consulting 2011
Ags Group Benefits Consulting 2011Ags Group Benefits Consulting 2011
Ags Group Benefits Consulting 2011
 
Axpo Dez09
Axpo Dez09Axpo Dez09
Axpo Dez09
 
Technical challenge of Blog mining and analysis
Technical challenge of Blog mining and analysisTechnical challenge of Blog mining and analysis
Technical challenge of Blog mining and analysis
 
Chameleon CMS
Chameleon CMSChameleon CMS
Chameleon CMS
 

Similar to Chinese Blogger Conference CIC Presentation Slides

Windows 7兼容性系列课程(5):Windows 7徽标认证
Windows 7兼容性系列课程(5):Windows 7徽标认证Windows 7兼容性系列课程(5):Windows 7徽标认证
Windows 7兼容性系列课程(5):Windows 7徽标认证Chui-Wen Chiu
 
Richard Databoard
Richard DataboardRichard Databoard
Richard Databoard巍 陆
 
20070920173805
2007092017380520070920173805
200709201738055045033
 
網路、設計、使用者經驗
網路、設計、使用者經驗網路、設計、使用者經驗
網路、設計、使用者經驗Charles (XXC) Chen
 
油魚與鱈魚分辨
油魚與鱈魚分辨油魚與鱈魚分辨
油魚與鱈魚分辨k11k
 
Webken 03: Project Design for Optimaizing User Experience
Webken 03: Project Design for Optimaizing User ExperienceWebken 03: Project Design for Optimaizing User Experience
Webken 03: Project Design for Optimaizing User ExperienceNobuya Sato
 
12.2008 Trendbird Monthly Trend Report Sample
12.2008 Trendbird  Monthly Trend Report Sample12.2008 Trendbird  Monthly Trend Report Sample
12.2008 Trendbird Monthly Trend Report Samplewebtel125
 
Google Summer Of Code 2008
Google Summer Of Code 2008Google Summer Of Code 2008
Google Summer Of Code 2008Byeongweon Moon
 
Republic 1 2
Republic 1 2Republic 1 2
Republic 1 2huquanwei
 
請幫我修電腦.Pdf
請幫我修電腦.Pdf請幫我修電腦.Pdf
請幫我修電腦.Pdf瑋強 王
 
創業家研習營-7分鐘創意簡報技巧,Mr.6劉威麟
創業家研習營-7分鐘創意簡報技巧,Mr.6劉威麟創業家研習營-7分鐘創意簡報技巧,Mr.6劉威麟
創業家研習營-7分鐘創意簡報技巧,Mr.6劉威麟taiwanweb20
 
081210 Idcon 04 Itoh Peopleservice
081210 Idcon 04 Itoh Peopleservice081210 Idcon 04 Itoh Peopleservice
081210 Idcon 04 Itoh PeopleserviceHiroki Itoh
 
設計思考研究演講 07.11
設計思考研究演講 07.11設計思考研究演講 07.11
設計思考研究演講 07.11NTUST
 
Prototyping Web Metaphors 20090418
Prototyping Web Metaphors 20090418Prototyping Web Metaphors 20090418
Prototyping Web Metaphors 20090418Charles (XXC) Chen
 
網絡宣教與牧養教牧講座
網絡宣教與牧養教牧講座網絡宣教與牧養教牧講座
網絡宣教與牧養教牧講座Charles Mok
 

Similar to Chinese Blogger Conference CIC Presentation Slides (20)

Wiki and KM
Wiki and KMWiki and KM
Wiki and KM
 
Windows 7兼容性系列课程(5):Windows 7徽标认证
Windows 7兼容性系列课程(5):Windows 7徽标认证Windows 7兼容性系列课程(5):Windows 7徽标认证
Windows 7兼容性系列课程(5):Windows 7徽标认证
 
Richard Databoard
Richard DataboardRichard Databoard
Richard Databoard
 
20070920173805
2007092017380520070920173805
20070920173805
 
網路、設計、使用者經驗
網路、設計、使用者經驗網路、設計、使用者經驗
網路、設計、使用者經驗
 
IA & UCD/UXD
IA & UCD/UXDIA & UCD/UXD
IA & UCD/UXD
 
油魚與鱈魚分辨
油魚與鱈魚分辨油魚與鱈魚分辨
油魚與鱈魚分辨
 
Webken 03: Project Design for Optimaizing User Experience
Webken 03: Project Design for Optimaizing User ExperienceWebken 03: Project Design for Optimaizing User Experience
Webken 03: Project Design for Optimaizing User Experience
 
ICT4KMT-20081225
ICT4KMT-20081225ICT4KMT-20081225
ICT4KMT-20081225
 
12.2008 Trendbird Monthly Trend Report Sample
12.2008 Trendbird  Monthly Trend Report Sample12.2008 Trendbird  Monthly Trend Report Sample
12.2008 Trendbird Monthly Trend Report Sample
 
Google Summer Of Code 2008
Google Summer Of Code 2008Google Summer Of Code 2008
Google Summer Of Code 2008
 
Republic 1 2
Republic 1 2Republic 1 2
Republic 1 2
 
請幫我修電腦.Pdf
請幫我修電腦.Pdf請幫我修電腦.Pdf
請幫我修電腦.Pdf
 
創業家研習營-7分鐘創意簡報技巧,Mr.6劉威麟
創業家研習營-7分鐘創意簡報技巧,Mr.6劉威麟創業家研習營-7分鐘創意簡報技巧,Mr.6劉威麟
創業家研習營-7分鐘創意簡報技巧,Mr.6劉威麟
 
081210 Idcon 04 Itoh Peopleservice
081210 Idcon 04 Itoh Peopleservice081210 Idcon 04 Itoh Peopleservice
081210 Idcon 04 Itoh Peopleservice
 
設計思考研究演講 07.11
設計思考研究演講 07.11設計思考研究演講 07.11
設計思考研究演講 07.11
 
Prototyping Web Metaphors 20090418
Prototyping Web Metaphors 20090418Prototyping Web Metaphors 20090418
Prototyping Web Metaphors 20090418
 
20081123-web2.0class
20081123-web2.0class20081123-web2.0class
20081123-web2.0class
 
Sysbiobook
SysbiobookSysbiobook
Sysbiobook
 
網絡宣教與牧養教牧講座
網絡宣教與牧養教牧講座網絡宣教與牧養教牧講座
網絡宣教與牧養教牧講座
 

Recently uploaded

Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsNanddeep Nachan
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Zilliz
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdfSandro Moreira
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityWSO2
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamUiPathCommunity
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Orbitshub
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxRemote DBA Services
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Bhuvaneswari Subramani
 

Recently uploaded (20)

Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 

Chinese Blogger Conference CIC Presentation Slides

  • 1. Blog内容挖掘与分析的技术挑战 Technical challenge of Blog mining and analysis 余敏玮 (Denis) @ CIC Tech 中文网志年会(2008) @ 广州 CN Blogger Conference (2008) @ GuangZhou
  • 2. 中国社交网络的规模 (CHINA SOCIAL MEDIA DOMINATES THE WORLD) 互联网用户 220 Million1 253 Million2 (Number of Internet users) 每周上网时间 博客数 74 Million5 7 Hrs2 14 Hrs1 107 Million6 (Avg. time spent online per week) Number of bloggers5,6 个人意见想法的表达5 互联网用户每周看电视的时间 (Avg.have expressedusers spend “I time Internet personal 31 hours3 56% 9 hours4 72% opinions and/or written about watching TV per week) myself online” 我可以表达线下不能表达的见解5 互联网渗透率 73%1 19%2 (Internet Penetration) say and do “Online I feel free to 32% 73% things I wouldn’t do or say offline” 参与博客讨论的宽带用户百分比5 Percentage broadband users 28% 47% commenting blog, chat room, listserv or forum Data Source: 1)The 22nd Statistical Survey Report on the Internet Development in China by CNNIC, July 2008. 2) Nielsen Netraitings, July 2008. 3) “Whichever Screen, People Are Watching”, The New York Times, July 2008. 4) China Academy of Social Sciences。 5) IAC and JWT, November 2007. 6) Boston Consulting Group, July 2008. 2
  • 3. 博客的社会价值 (Social Value of Blog) Sample Quote: 祈福 / Pray (link) 5月12日的汶川地震让我们这一辈子都会刻骨铭 心,这也是我第一次亲身经历地震,这次的损失 惨重,但这并不可怕,只要我们有重建家园的决 心就行,让我们都为灾区人民祈福吧!! Prayer: Let’s pray for the victims that We will never forget the earthquake that everything will be recovered and rebuilt. occurred on May 12th, 2008 and even though it caused a huge amount of damage, as long as we have the resolution to rebuild the homes, then it is not so frightening. Let us pray for the people living in the earthquake area! Prayer: My heart is broken, all I can do is pray for the other victims. In the wake of the catastrophe, blogs became a platform for grieving and prayer for the victims and their families. Popular blog sites like Sina Typing keyword “pray + earthquake” on blog, Sohu blog, Blogbus all have hundreds of NetEase Blog search, yields more than thousands of entries discussing and sharing 53,000 blog articles on praying. (link) personal accounts and feelings towards the tragic event. 3 See more information about the cases, you can refer to IWOM watch Special Edition, May 2008
  • 4. 自然语言分析技术 来自中文的挑战 (Challenges from Chinese language) 中文分词 比较 复杂的词义 乒乓球拍卖完了 乒乓球 / 拍卖 / 完了 这瓶洗发水,适合头 品牌1 比 品牌2 差 发很干的人用 乒乓球拍 / 卖完了 品牌1 不比 品牌2 的差多少 品牌1 比 品牌2 好 用了这瓶洗发水,头 品牌1 比 品牌2 好不了多少 喜欢开宝马的人 发变得很干 喜欢{开宝马的人} {喜欢开宝马}的人 • 几种分析模型 – 基于关键字分析的模型 – 基于机器学习的模型 – 基于关键字以及语法分析的模型 4
  • 5. 自然语言分析技术 来自中文的挑战 (Challenges from Chinese language) 网络口语: 打酱油,俯卧撑… 5
  • 6. 自然语言分析技术 • 内容归类 – 行业/品牌/产品 • 同义词,别名, 类别树 – 情感分析 • 用户表达情感的各种方式 行业 行业 品牌 1 品牌 1 产品 1 产品 1 产品 2 产品 2 品牌 2 品牌 2 产品 3 产品 3 产品 4 产品 4 6
  • 7. 数据计算,聚合以及分析 (Data Process) 数据计算,聚合以及分析 • 数据需要从多维度进行聚合和分析 Data need be aggregated and analyzed in different angles – 每月有多少博客文章讨论每一个品牌 How many articles talk about each brand each month – 每周有多少人讨论每个品牌产品 How many people talk about each product each week – 在某一个月中谈论某一个品牌最多的10个博客是谁? What’s the top 10 people talk about a particular brand • 解决方案: OLAP多维数据仓库 (快速/灵活的数据分析支持) Solution: OLAP data cube (Fast / Flexible data analysis support) 时间维度 (年/月/日) Time Dimension ct du /P 品 ro ra /产 / B 品牌 nd ry / st 业 du 行 In 博主 Blogger 7
  • 8. 数据计算,聚合以及分析 化妆品 博客1 运动服饰 手机 汽车 博客2 手机 笔记本 股票 博客3 笔记本 手机 对于博客:博客个人属性分析 对于品牌:博客行业关注度分析 8
  • 10. 总结 中文分析存在巨大挑战, 技 技术已经相当成熟 术还未非常成熟 数据来源 文本挖掘 Data Source Text Mining 数据分析 数据可视化 Data Analysis Data Visualization OLAP解决方案 多种技术可以运用, 取决于具 体的分析目标 10
  • 11. OUR BLOGS: Company Blog: http://www.seeisee.com (Chinese) CEO Blog: http://www.seeisee.com/sam (English) Tech Blog: http://blog.csdn.net/cictech OUR WEBSITE: Thank You www.cicdata.com CONTACT US: info@cicdata.com This document is for private commercial use only. Distribution to third parties and/or publication in whole or in part is strictly prohibited without expressed written consent of CIC. 本文件是针对CIC客户的相关品牌和企业的商业文件。未经CIC 的书面许可, 本文件或文件中的任何内容不得转交给第三方, 同时也不得发表本文件或文件中的任何内容。