SlideShare a Scribd company logo
Research of Intelligent Media Computing
and its Application
Dr. Xiangyang XUE
Professor & Vice Dean, School of
Computer Science
Outline

 Introduction of School of Computer Science
 Research Topics in our Laboratory
     RT1 Natural Language Processing
     RT2 Multimodal Dialog
     RT3 Image Classification
     RT4 Cross-Media Search

 Assistant Living Technologies in Future Home
     APP1 IPTV ~ video search engine
     APP2 Robot ~ multimodal dialog




 2009-5-21                       2        FDU - Xiangyang XUE
School – Staff Members & Students



      Staff Members

       Totally   160 staff members
         19 full professors
         39 associate professors         Students(full time)

                                             Undergraduates: 1100
                                             Master students: 400
                                             PhD Students: 170




 2009-5-21                            3                        FDU - Xiangyang XUE
School – Research Areas

                        OS: virtualization
                                                    Multimedia
       Software Engineering
                                                            Computer vision
             Database

                                                              Machine Learning
             Compiler


                                                             NLP & IR
              CSCW


                     Theory: Complexity, Cryptography & Algorithms



 2009-5-21                                   4                       FDU - Xiangyang XUE
School – Research Labs

                           Shanghai Key Laboratory for
                     Intelligent Information Processing

      Laboratory of Intelligent Media Computing
      Laboratory of Database Technology


      Laboratory of System Software and Software
       Engineering
      Laboratory of Information Security
      Laboratory of Embedded System

 2009-5-21                      5              FDU - Xiangyang XUE
People in our Laboratory
                                           Dr Xipeng QIU
                                                                                             Lab of
                                                                      Dr Xuanjing
                                                                      HUANG
                                                                                             Intelligent
                                                                                             Media Computing
                                                           Text


             Dr Yuefei GUO               Dr Yaqian ZHOU                                                     Dr Cheng JIN

                                                                                         Image
                 Machine
                                                   Dr Yuejie ZHANG                       Video
                 Learning

Dr Mingmin
CHI
                                                                      Dr Xiangyang XUE


                                                                                            Dr Hong LU

      Dr Wei Zhang
                                    Audio
                                                                            PhD Students:12
                                                                            Master Students:40


 2009-5-21                   Dr Wei LI                            6                                  FDU - Xiangyang XUE
Projects & Publications in our Laboratory

 Projects
     Natural Science Foundation of China
     Ministry of Science and Technology
     Science and Technology Commission of Shanghai
         Municipality
     Industries
 Publications
     Journals: IEEE TMM, TKDE, TCAS-VT, TIP; Pattern
         Recognition, Neural Networks, Information Processing and
         Management etc
     Conferences: ACM MM, ICCV, ICML, IJCAI ,ACL, etc


 2009-5-21                          7                    FDU - Xiangyang XUE
RT1 Natural Language Processing


                                         Current Works
  Word         Syntax     Discourse
                                          Question answering
                                             Open domain
               POS Tag
                          Named Entity
                           Recognition       Trec 2008, Top 2

Chinese word                              Sentiment analysis
               Chunking   Coreference
  segment
                                             Product review
                           Discourse
               Parsing
                           Segment           Trec Blog, Top 5

                                          Text
                                           summarization
   Fundamental researches in NLP
                                          Information Extraction

 2009-5-21                         8                  FDU - Xiangyang XUE
RT2 Multimodal Dialogue System
             Application:Robot


 Knowledge
 Knowledge                Knowledge          Device
  Knowledge                                                          Device API
  Sources
  Sources                  Manager          Manager
   Sources

       Dialogue
                    Dialogue                Activity
       Manager
                    Move Tree                Tree                       Device
                                                                        Devices
                                                                         Device
                                                                           s
                                                                           s
                                 Dialogue
                                  Move
                                  Engine
             Multimodal                          Response
              Fusion                             Generator


         NLU        Gesture                  NLG        Animation


         ASR                                 TTS
 2009-5-21                            9                  FDU - Xiangyang XUE
RT2 Multimodal Dialogue System
              Application:Robot


  Knowledge
  Knowledge                Knowledge          Device
   Knowledge                                                         Device API
   Sources
   Sources                  Manager          Manager
    Sources

    Dialogue
 NLU                Dialogue                Activity
    Manager
                     Move Tree                Tree                      Device
                                                                        Devices
                                                                         Device
     Spoken Language                                                      s
                                                                           s
     Unknown words               Dialogue
     Ontology                     Move
                                   Engine
              Multimodal                          Response
                                              Dialogue Move Engine
               Fusion                            Generator
                                                 Domain adaptation
                                                 Semi-Supervised
          NLU        Gesture                  NLG Methods
                                                        Animation


          ASR                                 TTS
  2009-5-21                            10                FDU - Xiangyang XUE
RT3 Image Classification


                             Wedding

                 Activity

                              Party



                             Coworker
                 People

                             Family



                              Snake
                 Animal

                              Lion



 2009-5-21              11              FDU - Xiangyang XUE
RT4 Cross-Media Search for iTV

           •     Video Shot Boundary Detection
                          ·   镜头1           镜头2




           •
·   镜头1                       镜头2
                 Face Detection and Recognition
                               镜头1          镜头2




    镜头1                       镜头2




           •     Video OCR / ASR

                                                                    Application


           •     Correlation Analysis




                      Movie: Royal Casino   Role: James Bond

          2009-5-21                                            12         FDU - Xiangyang XUE
Shanghai Industry      Intel Developer Forum
                           Fair 2008                 (IDF) 2008



                     Surveillance in Home
                     Interactive TV
                     Education and Gaming for Children
     FUWA Robot
                     Multimodal HCI/Dialog



2009-5-21              13                     FDU - Xiangyang XUE
Assistant Living Technologies in Future Home
2009-5-21                   14                 FDU - Xiangyang XUE
Thank You!


     Q/A?

More Related Content

What's hot

Will RSpec help us to do better science
Will RSpec help us to do better science Will RSpec help us to do better science
Will RSpec help us to do better science
maxott
 
discopen
discopendiscopen
discopen
Jisc
 
CambridgeIP Fact-based Strategy Development: Accelerating your out-licensing
CambridgeIP Fact-based Strategy Development: Accelerating your out-licensingCambridgeIP Fact-based Strategy Development: Accelerating your out-licensing
CambridgeIP Fact-based Strategy Development: Accelerating your out-licensing
CambridgeIP Ltd
 
AI and Machine Learning PG program
AI and Machine Learning PG programAI and Machine Learning PG program
AI and Machine Learning PG program
MamathaSharma4
 
Paper talk: Idcc 11
Paper talk: Idcc 11  Paper talk: Idcc 11
Paper talk: Idcc 11
Paolo Missier
 
Semantic Model-driven Engineering
Semantic Model-driven EngineeringSemantic Model-driven Engineering
Semantic Model-driven Engineering
Steffen Staab
 
Accelrys Announces Experiment Knowledge Base (EKB) for Enterprise Lab Management
Accelrys Announces Experiment Knowledge Base (EKB) for Enterprise Lab ManagementAccelrys Announces Experiment Knowledge Base (EKB) for Enterprise Lab Management
Accelrys Announces Experiment Knowledge Base (EKB) for Enterprise Lab Management
BIOVIA
 
Collaboration and Sharing
Collaboration and SharingCollaboration and Sharing
Collaboration and Sharing
Jisc
 
Scientific data management from the lab to the web
Scientific data management   from the lab to the webScientific data management   from the lab to the web
Scientific data management from the lab to the web
Jose Manuel Gómez-Pérez
 
2013-01-17 Research Object
2013-01-17 Research Object2013-01-17 Research Object
2013-01-17 Research Object
Stian Soiland-Reyes
 

What's hot (11)

Will RSpec help us to do better science
Will RSpec help us to do better science Will RSpec help us to do better science
Will RSpec help us to do better science
 
discopen
discopendiscopen
discopen
 
CambridgeIP Fact-based Strategy Development: Accelerating your out-licensing
CambridgeIP Fact-based Strategy Development: Accelerating your out-licensingCambridgeIP Fact-based Strategy Development: Accelerating your out-licensing
CambridgeIP Fact-based Strategy Development: Accelerating your out-licensing
 
AI and Machine Learning PG program
AI and Machine Learning PG programAI and Machine Learning PG program
AI and Machine Learning PG program
 
VBPR 1st seminar
VBPR 1st seminarVBPR 1st seminar
VBPR 1st seminar
 
Paper talk: Idcc 11
Paper talk: Idcc 11  Paper talk: Idcc 11
Paper talk: Idcc 11
 
Semantic Model-driven Engineering
Semantic Model-driven EngineeringSemantic Model-driven Engineering
Semantic Model-driven Engineering
 
Accelrys Announces Experiment Knowledge Base (EKB) for Enterprise Lab Management
Accelrys Announces Experiment Knowledge Base (EKB) for Enterprise Lab ManagementAccelrys Announces Experiment Knowledge Base (EKB) for Enterprise Lab Management
Accelrys Announces Experiment Knowledge Base (EKB) for Enterprise Lab Management
 
Collaboration and Sharing
Collaboration and SharingCollaboration and Sharing
Collaboration and Sharing
 
Scientific data management from the lab to the web
Scientific data management   from the lab to the webScientific data management   from the lab to the web
Scientific data management from the lab to the web
 
2013-01-17 Research Object
2013-01-17 Research Object2013-01-17 Research Object
2013-01-17 Research Object
 

Similar to Xue Xiangyang - Fudan University

Deroure Repo3
Deroure Repo3Deroure Repo3
Deroure Repo3guru122
 
Book of abstract volume 8 no 9 ijcsis december 2010
Book of abstract volume 8 no 9 ijcsis december 2010Book of abstract volume 8 no 9 ijcsis december 2010
Book of abstract volume 8 no 9 ijcsis december 2010Oladokun Sulaiman
 
EGIforum-Amsterdam-15-Sep2010
EGIforum-Amsterdam-15-Sep2010EGIforum-Amsterdam-15-Sep2010
EGIforum-Amsterdam-15-Sep2010
Alex Hardisty
 
Semantics is not a luxury
Semantics is not a luxurySemantics is not a luxury
Semantics is not a luxuryPaolo Ciccarese
 
Jubatus: Realtime deep analytics for BIgData@Rakuten Technology Conference 2012
Jubatus: Realtime deep analytics for BIgData@Rakuten Technology Conference 2012Jubatus: Realtime deep analytics for BIgData@Rakuten Technology Conference 2012
Jubatus: Realtime deep analytics for BIgData@Rakuten Technology Conference 2012
Preferred Networks
 
Initial steps towards a production platform for DNA sequence analysis on the ...
Initial steps towards a production platform for DNA sequence analysis on the ...Initial steps towards a production platform for DNA sequence analysis on the ...
Initial steps towards a production platform for DNA sequence analysis on the ...
Barbera van Schaik
 
Xu Xing: EasyGenomics – Next Generation Bioinformatics on the Cloud
Xu Xing: EasyGenomics – Next Generation Bioinformatics on the CloudXu Xing: EasyGenomics – Next Generation Bioinformatics on the Cloud
Xu Xing: EasyGenomics – Next Generation Bioinformatics on the Cloud
GigaScience, BGI Hong Kong
 
Open Data: Ready Set Go
Open Data: Ready Set GoOpen Data: Ready Set Go
Open Data: Ready Set Go
Paul Groth
 
International Collaboration
International CollaborationInternational Collaboration
pythonUnit_1forprogrammin launguage.pptx
pythonUnit_1forprogrammin launguage.pptxpythonUnit_1forprogrammin launguage.pptx
pythonUnit_1forprogrammin launguage.pptx
bharathece1
 
IRJET- Design and Development of Tesseract-OCR Based Assistive System to Conv...
IRJET- Design and Development of Tesseract-OCR Based Assistive System to Conv...IRJET- Design and Development of Tesseract-OCR Based Assistive System to Conv...
IRJET- Design and Development of Tesseract-OCR Based Assistive System to Conv...
IRJET Journal
 
The LEGO Maturity & Capability Model Approach
The LEGO Maturity & Capability Model ApproachThe LEGO Maturity & Capability Model Approach
The LEGO Maturity & Capability Model Approach
Luigi Buglione
 
HHS Fusion Form
HHS Fusion FormHHS Fusion Form
HHS Fusion Form
Heather Blanchard
 
NLP on Hadoop: A Distributed Framework for NLP-Based Keyword and Keyphrase Ex...
NLP on Hadoop: A Distributed Framework for NLP-Based Keyword and Keyphrase Ex...NLP on Hadoop: A Distributed Framework for NLP-Based Keyword and Keyphrase Ex...
NLP on Hadoop: A Distributed Framework for NLP-Based Keyword and Keyphrase Ex...
Paolo Nesi
 
Acknowledge 03 Ramit Geert Thienpont
Acknowledge 03 Ramit Geert ThienpontAcknowledge 03 Ramit Geert Thienpont
Acknowledge 03 Ramit Geert Thienpontimec.archive
 
Aalto stanford webinar-on collaborative working ennvironments 2013
Aalto stanford webinar-on collaborative working ennvironments 2013Aalto stanford webinar-on collaborative working ennvironments 2013
Aalto stanford webinar-on collaborative working ennvironments 2013
Matti Vartiainen
 
Open hpi semweb-06-part2
Open hpi semweb-06-part2Open hpi semweb-06-part2
Open hpi semweb-06-part2Nadine Ludwig
 
Semantic Web powering Enterprise and Web Applications
Semantic Web powering Enterprise and Web ApplicationsSemantic Web powering Enterprise and Web Applications
Semantic Web powering Enterprise and Web Applications
Amit Sheth
 

Similar to Xue Xiangyang - Fudan University (20)

Deroure Repo3
Deroure Repo3Deroure Repo3
Deroure Repo3
 
Deroure Repo3
Deroure Repo3Deroure Repo3
Deroure Repo3
 
Book of abstract volume 8 no 9 ijcsis december 2010
Book of abstract volume 8 no 9 ijcsis december 2010Book of abstract volume 8 no 9 ijcsis december 2010
Book of abstract volume 8 no 9 ijcsis december 2010
 
EGIforum-Amsterdam-15-Sep2010
EGIforum-Amsterdam-15-Sep2010EGIforum-Amsterdam-15-Sep2010
EGIforum-Amsterdam-15-Sep2010
 
Semantics is not a luxury
Semantics is not a luxurySemantics is not a luxury
Semantics is not a luxury
 
Jubatus: Realtime deep analytics for BIgData@Rakuten Technology Conference 2012
Jubatus: Realtime deep analytics for BIgData@Rakuten Technology Conference 2012Jubatus: Realtime deep analytics for BIgData@Rakuten Technology Conference 2012
Jubatus: Realtime deep analytics for BIgData@Rakuten Technology Conference 2012
 
Initial steps towards a production platform for DNA sequence analysis on the ...
Initial steps towards a production platform for DNA sequence analysis on the ...Initial steps towards a production platform for DNA sequence analysis on the ...
Initial steps towards a production platform for DNA sequence analysis on the ...
 
Xu Xing: EasyGenomics – Next Generation Bioinformatics on the Cloud
Xu Xing: EasyGenomics – Next Generation Bioinformatics on the CloudXu Xing: EasyGenomics – Next Generation Bioinformatics on the Cloud
Xu Xing: EasyGenomics – Next Generation Bioinformatics on the Cloud
 
Open Data: Ready Set Go
Open Data: Ready Set GoOpen Data: Ready Set Go
Open Data: Ready Set Go
 
International Collaboration
International CollaborationInternational Collaboration
International Collaboration
 
Maya
MayaMaya
Maya
 
pythonUnit_1forprogrammin launguage.pptx
pythonUnit_1forprogrammin launguage.pptxpythonUnit_1forprogrammin launguage.pptx
pythonUnit_1forprogrammin launguage.pptx
 
IRJET- Design and Development of Tesseract-OCR Based Assistive System to Conv...
IRJET- Design and Development of Tesseract-OCR Based Assistive System to Conv...IRJET- Design and Development of Tesseract-OCR Based Assistive System to Conv...
IRJET- Design and Development of Tesseract-OCR Based Assistive System to Conv...
 
The LEGO Maturity & Capability Model Approach
The LEGO Maturity & Capability Model ApproachThe LEGO Maturity & Capability Model Approach
The LEGO Maturity & Capability Model Approach
 
HHS Fusion Form
HHS Fusion FormHHS Fusion Form
HHS Fusion Form
 
NLP on Hadoop: A Distributed Framework for NLP-Based Keyword and Keyphrase Ex...
NLP on Hadoop: A Distributed Framework for NLP-Based Keyword and Keyphrase Ex...NLP on Hadoop: A Distributed Framework for NLP-Based Keyword and Keyphrase Ex...
NLP on Hadoop: A Distributed Framework for NLP-Based Keyword and Keyphrase Ex...
 
Acknowledge 03 Ramit Geert Thienpont
Acknowledge 03 Ramit Geert ThienpontAcknowledge 03 Ramit Geert Thienpont
Acknowledge 03 Ramit Geert Thienpont
 
Aalto stanford webinar-on collaborative working ennvironments 2013
Aalto stanford webinar-on collaborative working ennvironments 2013Aalto stanford webinar-on collaborative working ennvironments 2013
Aalto stanford webinar-on collaborative working ennvironments 2013
 
Open hpi semweb-06-part2
Open hpi semweb-06-part2Open hpi semweb-06-part2
Open hpi semweb-06-part2
 
Semantic Web powering Enterprise and Web Applications
Semantic Web powering Enterprise and Web ApplicationsSemantic Web powering Enterprise and Web Applications
Semantic Web powering Enterprise and Web Applications
 

More from Seismonaut

Hvordan sælger man kreativitet uden for vores egne cirkler?
Hvordan sælger man kreativitet uden for vores egne cirkler?Hvordan sælger man kreativitet uden for vores egne cirkler?
Hvordan sælger man kreativitet uden for vores egne cirkler?
Seismonaut
 
Headstart Morgenseminar: Growth Hacking
Headstart Morgenseminar: Growth HackingHeadstart Morgenseminar: Growth Hacking
Headstart Morgenseminar: Growth Hacking
Seismonaut
 
Headstart Morgenseminar: Growth Hacking
Headstart Morgenseminar: Growth HackingHeadstart Morgenseminar: Growth Hacking
Headstart Morgenseminar: Growth Hacking
Seismonaut
 
Headstart Morgenseminar: Growth Hacking
Headstart Morgenseminar: Growth HackingHeadstart Morgenseminar: Growth Hacking
Headstart Morgenseminar: Growth Hacking
Seismonaut
 
Headstart Morgenseminar: Working as a Network
Headstart Morgenseminar: Working as a NetworkHeadstart Morgenseminar: Working as a Network
Headstart Morgenseminar: Working as a Network
Seismonaut
 
Sælg en oplevelse - om markedsføring af NorthSide på sociale medier
Sælg en oplevelse - om markedsføring af NorthSide på sociale medierSælg en oplevelse - om markedsføring af NorthSide på sociale medier
Sælg en oplevelse - om markedsføring af NorthSide på sociale medier
Seismonaut
 
Headstart Network morgenseminar 13/9 2016: Hvad er tillid?
Headstart Network morgenseminar 13/9 2016: Hvad er tillid?Headstart Network morgenseminar 13/9 2016: Hvad er tillid?
Headstart Network morgenseminar 13/9 2016: Hvad er tillid?
Seismonaut
 
Den digitale Turist - Det ambitiøse værtskab
Den digitale Turist - Det ambitiøse værtskabDen digitale Turist - Det ambitiøse værtskab
Den digitale Turist - Det ambitiøse værtskab
Seismonaut
 
Den digitale turist
Den digitale turistDen digitale turist
Den digitale turist
Seismonaut
 
Det ambitiøse værtsskab - digitale touchpoints
Det ambitiøse værtsskab - digitale touchpointsDet ambitiøse værtsskab - digitale touchpoints
Det ambitiøse værtsskab - digitale touchpoints
Seismonaut
 
Det ambitiøse værtskab - det fysiske møde med gæsten
Det ambitiøse værtskab - det fysiske møde med gæstenDet ambitiøse værtskab - det fysiske møde med gæsten
Det ambitiøse værtskab - det fysiske møde med gæsten
Seismonaut
 
Headstart_Creuna_Slides
Headstart_Creuna_SlidesHeadstart_Creuna_Slides
Headstart_Creuna_Slides
Seismonaut
 
Headstart_Envision_Slides
Headstart_Envision_SlidesHeadstart_Envision_Slides
Headstart_Envision_Slides
Seismonaut
 
Veronika Janeckova & Nelson Sachse, Made by many - Headstart d. 2. juni 2015
Veronika Janeckova & Nelson Sachse, Made by many - Headstart d. 2. juni 2015Veronika Janeckova & Nelson Sachse, Made by many - Headstart d. 2. juni 2015
Veronika Janeckova & Nelson Sachse, Made by many - Headstart d. 2. juni 2015
Seismonaut
 
Kasper Wodstrup Rost, Delta Projects - Headstart d. 2. juni 2015
Kasper Wodstrup Rost, Delta Projects - Headstart d. 2. juni 2015Kasper Wodstrup Rost, Delta Projects - Headstart d. 2. juni 2015
Kasper Wodstrup Rost, Delta Projects - Headstart d. 2. juni 2015
Seismonaut
 
Cerys Hearsey, Post*Shift - Headstart
Cerys Hearsey, Post*Shift - Headstart Cerys Hearsey, Post*Shift - Headstart
Cerys Hearsey, Post*Shift - Headstart
Seismonaut
 
Creative Executive Club - Johanne Bruun Sørensen, Hello Monday
Creative Executive Club - Johanne Bruun Sørensen, Hello MondayCreative Executive Club - Johanne Bruun Sørensen, Hello Monday
Creative Executive Club - Johanne Bruun Sørensen, Hello Monday
Seismonaut
 
Creative Executive Club - Stephen Burrell, Kopenhagen Fur
Creative Executive Club - Stephen Burrell, Kopenhagen FurCreative Executive Club - Stephen Burrell, Kopenhagen Fur
Creative Executive Club - Stephen Burrell, Kopenhagen Fur
Seismonaut
 
Sociale medier i et offentligt perspektiv 2015
Sociale medier i et offentligt perspektiv 2015Sociale medier i et offentligt perspektiv 2015
Sociale medier i et offentligt perspektiv 2015
Seismonaut
 
Digitalisering handler om mennesker
Digitalisering handler om menneskerDigitalisering handler om mennesker
Digitalisering handler om mennesker
Seismonaut
 

More from Seismonaut (20)

Hvordan sælger man kreativitet uden for vores egne cirkler?
Hvordan sælger man kreativitet uden for vores egne cirkler?Hvordan sælger man kreativitet uden for vores egne cirkler?
Hvordan sælger man kreativitet uden for vores egne cirkler?
 
Headstart Morgenseminar: Growth Hacking
Headstart Morgenseminar: Growth HackingHeadstart Morgenseminar: Growth Hacking
Headstart Morgenseminar: Growth Hacking
 
Headstart Morgenseminar: Growth Hacking
Headstart Morgenseminar: Growth HackingHeadstart Morgenseminar: Growth Hacking
Headstart Morgenseminar: Growth Hacking
 
Headstart Morgenseminar: Growth Hacking
Headstart Morgenseminar: Growth HackingHeadstart Morgenseminar: Growth Hacking
Headstart Morgenseminar: Growth Hacking
 
Headstart Morgenseminar: Working as a Network
Headstart Morgenseminar: Working as a NetworkHeadstart Morgenseminar: Working as a Network
Headstart Morgenseminar: Working as a Network
 
Sælg en oplevelse - om markedsføring af NorthSide på sociale medier
Sælg en oplevelse - om markedsføring af NorthSide på sociale medierSælg en oplevelse - om markedsføring af NorthSide på sociale medier
Sælg en oplevelse - om markedsføring af NorthSide på sociale medier
 
Headstart Network morgenseminar 13/9 2016: Hvad er tillid?
Headstart Network morgenseminar 13/9 2016: Hvad er tillid?Headstart Network morgenseminar 13/9 2016: Hvad er tillid?
Headstart Network morgenseminar 13/9 2016: Hvad er tillid?
 
Den digitale Turist - Det ambitiøse værtskab
Den digitale Turist - Det ambitiøse værtskabDen digitale Turist - Det ambitiøse værtskab
Den digitale Turist - Det ambitiøse værtskab
 
Den digitale turist
Den digitale turistDen digitale turist
Den digitale turist
 
Det ambitiøse værtsskab - digitale touchpoints
Det ambitiøse værtsskab - digitale touchpointsDet ambitiøse værtsskab - digitale touchpoints
Det ambitiøse værtsskab - digitale touchpoints
 
Det ambitiøse værtskab - det fysiske møde med gæsten
Det ambitiøse værtskab - det fysiske møde med gæstenDet ambitiøse værtskab - det fysiske møde med gæsten
Det ambitiøse værtskab - det fysiske møde med gæsten
 
Headstart_Creuna_Slides
Headstart_Creuna_SlidesHeadstart_Creuna_Slides
Headstart_Creuna_Slides
 
Headstart_Envision_Slides
Headstart_Envision_SlidesHeadstart_Envision_Slides
Headstart_Envision_Slides
 
Veronika Janeckova & Nelson Sachse, Made by many - Headstart d. 2. juni 2015
Veronika Janeckova & Nelson Sachse, Made by many - Headstart d. 2. juni 2015Veronika Janeckova & Nelson Sachse, Made by many - Headstart d. 2. juni 2015
Veronika Janeckova & Nelson Sachse, Made by many - Headstart d. 2. juni 2015
 
Kasper Wodstrup Rost, Delta Projects - Headstart d. 2. juni 2015
Kasper Wodstrup Rost, Delta Projects - Headstart d. 2. juni 2015Kasper Wodstrup Rost, Delta Projects - Headstart d. 2. juni 2015
Kasper Wodstrup Rost, Delta Projects - Headstart d. 2. juni 2015
 
Cerys Hearsey, Post*Shift - Headstart
Cerys Hearsey, Post*Shift - Headstart Cerys Hearsey, Post*Shift - Headstart
Cerys Hearsey, Post*Shift - Headstart
 
Creative Executive Club - Johanne Bruun Sørensen, Hello Monday
Creative Executive Club - Johanne Bruun Sørensen, Hello MondayCreative Executive Club - Johanne Bruun Sørensen, Hello Monday
Creative Executive Club - Johanne Bruun Sørensen, Hello Monday
 
Creative Executive Club - Stephen Burrell, Kopenhagen Fur
Creative Executive Club - Stephen Burrell, Kopenhagen FurCreative Executive Club - Stephen Burrell, Kopenhagen Fur
Creative Executive Club - Stephen Burrell, Kopenhagen Fur
 
Sociale medier i et offentligt perspektiv 2015
Sociale medier i et offentligt perspektiv 2015Sociale medier i et offentligt perspektiv 2015
Sociale medier i et offentligt perspektiv 2015
 
Digitalisering handler om mennesker
Digitalisering handler om menneskerDigitalisering handler om mennesker
Digitalisering handler om mennesker
 

Recently uploaded

Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
DianaGray10
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
GridMate - End to end testing is a critical piece to ensure quality and avoid...
GridMate - End to end testing is a critical piece to ensure quality and avoid...GridMate - End to end testing is a critical piece to ensure quality and avoid...
GridMate - End to end testing is a critical piece to ensure quality and avoid...
ThomasParaiso2
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Neo4j
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
Pierluigi Pugliese
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
Neo4j
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Nexer Digital
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Aggregage
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 

Recently uploaded (20)

Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
GridMate - End to end testing is a critical piece to ensure quality and avoid...
GridMate - End to end testing is a critical piece to ensure quality and avoid...GridMate - End to end testing is a critical piece to ensure quality and avoid...
GridMate - End to end testing is a critical piece to ensure quality and avoid...
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 

Xue Xiangyang - Fudan University

  • 1. Research of Intelligent Media Computing and its Application Dr. Xiangyang XUE Professor & Vice Dean, School of Computer Science
  • 2. Outline  Introduction of School of Computer Science  Research Topics in our Laboratory  RT1 Natural Language Processing  RT2 Multimodal Dialog  RT3 Image Classification  RT4 Cross-Media Search  Assistant Living Technologies in Future Home  APP1 IPTV ~ video search engine  APP2 Robot ~ multimodal dialog 2009-5-21 2 FDU - Xiangyang XUE
  • 3. School – Staff Members & Students Staff Members  Totally 160 staff members  19 full professors  39 associate professors Students(full time)  Undergraduates: 1100  Master students: 400  PhD Students: 170 2009-5-21 3 FDU - Xiangyang XUE
  • 4. School – Research Areas OS: virtualization Multimedia Software Engineering Computer vision Database Machine Learning Compiler NLP & IR CSCW Theory: Complexity, Cryptography & Algorithms 2009-5-21 4 FDU - Xiangyang XUE
  • 5. School – Research Labs Shanghai Key Laboratory for Intelligent Information Processing  Laboratory of Intelligent Media Computing  Laboratory of Database Technology  Laboratory of System Software and Software Engineering  Laboratory of Information Security  Laboratory of Embedded System 2009-5-21 5 FDU - Xiangyang XUE
  • 6. People in our Laboratory Dr Xipeng QIU Lab of Dr Xuanjing HUANG Intelligent Media Computing Text Dr Yuefei GUO Dr Yaqian ZHOU Dr Cheng JIN Image Machine Dr Yuejie ZHANG Video Learning Dr Mingmin CHI Dr Xiangyang XUE Dr Hong LU Dr Wei Zhang Audio PhD Students:12 Master Students:40 2009-5-21 Dr Wei LI 6 FDU - Xiangyang XUE
  • 7. Projects & Publications in our Laboratory  Projects  Natural Science Foundation of China  Ministry of Science and Technology  Science and Technology Commission of Shanghai Municipality  Industries  Publications  Journals: IEEE TMM, TKDE, TCAS-VT, TIP; Pattern Recognition, Neural Networks, Information Processing and Management etc  Conferences: ACM MM, ICCV, ICML, IJCAI ,ACL, etc 2009-5-21 7 FDU - Xiangyang XUE
  • 8. RT1 Natural Language Processing Current Works Word Syntax Discourse  Question answering  Open domain POS Tag Named Entity Recognition  Trec 2008, Top 2 Chinese word  Sentiment analysis Chunking Coreference segment  Product review Discourse Parsing Segment  Trec Blog, Top 5  Text summarization Fundamental researches in NLP  Information Extraction 2009-5-21 8 FDU - Xiangyang XUE
  • 9. RT2 Multimodal Dialogue System Application:Robot Knowledge Knowledge Knowledge Device Knowledge Device API Sources Sources Manager Manager Sources Dialogue Dialogue Activity Manager Move Tree Tree Device Devices Device s s Dialogue Move Engine Multimodal Response Fusion Generator NLU Gesture NLG Animation ASR TTS 2009-5-21 9 FDU - Xiangyang XUE
  • 10. RT2 Multimodal Dialogue System Application:Robot Knowledge Knowledge Knowledge Device Knowledge Device API Sources Sources Manager Manager Sources Dialogue  NLU Dialogue Activity Manager Move Tree Tree Device Devices Device  Spoken Language s s  Unknown words Dialogue  Ontology Move Engine Multimodal Response  Dialogue Move Engine Fusion Generator  Domain adaptation  Semi-Supervised NLU Gesture NLG Methods Animation ASR TTS 2009-5-21 10 FDU - Xiangyang XUE
  • 11. RT3 Image Classification Wedding Activity Party Coworker People Family Snake Animal Lion 2009-5-21 11 FDU - Xiangyang XUE
  • 12. RT4 Cross-Media Search for iTV • Video Shot Boundary Detection · 镜头1 镜头2 • · 镜头1 镜头2 Face Detection and Recognition 镜头1 镜头2 镜头1 镜头2 • Video OCR / ASR Application • Correlation Analysis Movie: Royal Casino Role: James Bond 2009-5-21 12 FDU - Xiangyang XUE
  • 13. Shanghai Industry Intel Developer Forum Fair 2008 (IDF) 2008  Surveillance in Home  Interactive TV  Education and Gaming for Children FUWA Robot  Multimodal HCI/Dialog 2009-5-21 13 FDU - Xiangyang XUE
  • 14. Assistant Living Technologies in Future Home 2009-5-21 14 FDU - Xiangyang XUE
  • 15. Thank You! Q/A?