Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

2012 12-12 research analytics - idea

814 views

Published on

Just an idea I have about Research Analytics. So the Dutch government would like to see performance indicators by the Higher Education institutions. This information can be drawn from many silo's and just give the indicator. However, when the information from these silo's can be combined, more advanced analytic's can be drawn from this information by data and text mining techniques.

But the first step is to integrate the information in a scalable data infrastructure. Research information is not big data, but it is wise to think about scalability to overcome performance issues in the future.

Multiple sources provide the data with a daily update, such as repositories'metadata, web log files, altmetrics data, citation references, funding and grand information, etc. The information is calculated and implicit relations are made explicit. In he end it is provided as open data invarious formats, including RESTful API's. Services can draw information from these API's to base their services on. Examples are metrics and analytics services, but also resolution and information portals.

Published in: Education
  • Be the first to comment

  • Be the first to like this

2012 12-12 research analytics - idea

  1. 1. Research Intelligence CC-BY: Maurice Vanderfeesten
  2. 2. Research policy making CC-BY: Maurice Vanderfeesten
  3. 3. based onResearch Impact CC-BY: Maurice Vanderfeesten
  4. 4. Research Analytics Infrastructure building an Open Data middleware infrastructure for research information CC-BY: Maurice Vanderfeesten
  5. 5. What should be done with the meaning outcomes? Making policy wisdomWhat do the calculations mean? intelligence Impact interpretationWhat can we calculate? analytics Impact factors Calculations, Correllations & Comparisson metrics HE performance indicatorsWhat can we measure? Accumulations, Citations, Downloads, Mentions, Bookmarks, etc. dataWhat data do we have? Publications, Datasets, Tweets, Projects, People, Grants, etc. sourcesWhat sources are Repositories, Mendeley, CRIS’s, Blogs, NOD, Facebook, SciVerse, Twitter, Web of Science out there? CC-BY: Maurice Vanderfeesten
  6. 6. Problem statementCurrent research policy is made based on a homogeneous-mono-metrics(eenzijdige metrics), from a single source.Yet making impact spans a much wider spectrum. CC-BY: Maurice Vanderfeesten
  7. 7. Current situation: established CC-BY: Maurice Vanderfeesten
  8. 8. What should be done with the meaning outcomes? Making policy wisdomWhat do the calculations mean? intelligence Impact interpretationWhat can we calculate? analytics H-index Impact factors Leiden index Shanghai index metrics HE performance indicatorsWhat can we measure? Citations dataWhat data do we have? A-journal peer reviewed Publications sources Thompson-Reuters ISIWhat sources are Web of Science out there? CC-BY: Maurice Vanderfeesten
  9. 9. Current situation:experimental CC-BY: Maurice Vanderfeesten
  10. 10. What should be done with the meaning outcomes? Making policy wisdomWhat do the calculations mean? intelligence Impact interpretationWhat can we calculate? analytics Impact factors Open Access Popularity index? metrics Not yet, HE performance indicatorsWhat can we measure? Downloads dataWhat data do we have? Open Access Publications sourcesWhat sources are Repositories out there? CC-BY: Maurice Vanderfeesten
  11. 11. What should be done with the meaning outcomes? Making policy wisdomWhat do the calculations mean? intelligence Impact interpretationWhat can we calculate? analytics Impact factors Like-ability index? metrics Not yet, HE performance indicatorsWhat can we measure? Mentions / Altmetrics dataWhat data do we have? Tweets, Bookmarks sources Twitter,What sources are Mendeley out there? CC-BY: Maurice Vanderfeesten
  12. 12. Business case:only based on user drivendemand CC-BY: Maurice Vanderfeesten
  13. 13. Policy makers must answer: Only the HE community wisdom can make a Business case What could be done with the meaning outcomes? intelligence Impact interpretors must answer: What should the calculations mean? analytics Impact factors Calculations, Correllations & Comparisson metrics HE performance indicatorsSURF can orchestratethe ICT infrastructure Accumulations, Citations, Downloads, Mentions, Bookmarks, etc. and licences data Publications, Datasets, Tweets, Projects, People, Grants, etc. sources Repositories, Mendeley, CRIS’s, Blogs, NOD, Facebook, SciVerse, Twitter, Web of Science CC-BY: Maurice Vanderfeesten
  14. 14. Full Spectrum Analyticsposition policy making on a holistic perspective CC-BY: Maurice Vanderfeesten
  15. 15. Imagine…• A single entry where you can find the research information you need• Where you can combine research information to build rich analytics• Get’s updated daily from different sources of information• Scalable and performing fast for tons of services to draw from CC-BY: Maurice Vanderfeesten
  16. 16. Community CloudScalables Research Information storage and restructuring from and by the DutchHigher Education sector CC-BY: Maurice Vanderfeesten
  17. 17. Research Analytics middlewareSources Data types (Information Brokerage and Restructuring) Services Users/Partners distributed scalable database (community cloud) institutions Holding: CWTS licences Research Partners: CBS Technology Partners: Researchers ministry Proven Open Technology: Libraries CC-BY: Maurice Vanderfeesten
  18. 18. Business Case:Performance Indicators forDutch Higher Education HE institutions ministry CC-BY: Maurice Vanderfeesten
  19. 19. Current solutionsspecific use case centric CC-BY: Maurice Vanderfeesten
  20. 20. Sources Data types Data warehouses Services Users metadatarepositories Publications Authors NARCIS [PID] [DAI] [metadata] [PID] Researchers [DAI] Resolution Resolution [PID] [URL] web usage Repositorymetrics [http event] [PID] Libraries [GEO] CC-BY: Maurice Vanderfeesten
  21. 21. Sources Data types Data warehouses Services Users Repository metricsrepositories web statistics Web usage [http event] Libraries [PID] [GEO] publishers Web usage Subscription metrics web statistics [http event] Libraries [PID] [GEO]Twitter altmetrics Alt table Social metrics facebook [social media event] [PID] ResearchersMendeley Citation table institutions [citation reference] Citation metrics citation [PID] Web of CWTS science CC-BY: Maurice Vanderfeesten
  22. 22. Questions• All these sources, why does every service need to build a separate datawarehouse?• What are the posibilities if we could combine all the information needed for different services, and put it in one community cloud? CC-BY: Maurice Vanderfeesten
  23. 23. Metrics AnalyticsFrom Metrics to AnalyticsIntegrating sources of information, making trends across sources visible CC-BY: Maurice Vanderfeesten
  24. 24. Sources Data types Data warehouse Services Users metadata institutionsrepositories web statistics CWTS publishers web statistics Usage table [http event] CBSscopus [PID] Metrics [GEO] Web of citation science Researchers Alt table Citation tableTwitter altmetrics [social media event] [citation reference] [PID] [PID] facebook OCWMendeley Library CC-BY: Maurice Vanderfeesten
  25. 25. Sources Data types Data warehouse Services Users institutionsrepositories web statistics CWTS publishers web statistics Usage table [http event] CBSscopus [PID] Analytics [GEO] Web of citation science Researchers Alt table Citation tableTwitter altmetrics [social media event] [citation reference] [PID] [PID] facebook OCWMendeley Library CC-BY: Maurice Vanderfeesten
  26. 26. Adding sources, addingservicesPotential for a high performing community cloud, as a middelware solution forshared services in the Research Information and Research Analytics domain. CC-BY: Maurice Vanderfeesten
  27. 27. Community Cloudas middleware forResearch InformationServicesResolution NARCIS Analytics Repositorymetrics HBO kennisbank CC-BY: Maurice Vanderfeesten
  28. 28. Research Analytics middleware Sources Data types (Information Brokerage and Restructuring) Services Users distributed scalable database (community cloud) Resolution metadata institutionsrepositories Publications Authors web statistics [PID] [DAI] [metadata] [ISNI/ ORCID] [DAI] [PID] CWTS NARCIS publishers web statistics Usage events Resolution entries [http event] [PID] CBSscopus [PID] [URL] [GEO] Web of citation Analytics science data mesh Researchers Altmetrics Citation referencesTwitter altmetrics [social media event] [citation reference] [PID] [PID] facebook Repositorymetrics OCWMendeley Projects Etc… scalable OCLC ISNI/DAI [ProjectID] […] Library [PID] […] HBO kennisbank CERIF CRIS’ CC-BY: Maurice Vanderfeesten
  29. 29. Use Cases CC-BY: Maurice Vanderfeesten
  30. 30. Research Analytics middleware Sources Data types (Information Brokerage and Restructuring) Services Users distributed scalable cloud database Resolution 5 metadata n! Facultiesrepositories 4 Publications table Authors table web statistics [PID] Use Case: Library wants [DAI] to [metadata] [ISNI/ ORCID] [DAI] see the usage of its [PID] CWTS repository, compared to 3 NARCIS other repositories. publishers web statistics Usage table Resolution table [http event] [PID] CBSscopus [PID] [URL] [GEO] Web of citation Analytics science data mesh Researchers Alt table Citation tableTwitter altmetrics [social media event] [citation reference] [PID] [PID] facebook Repositorymetrics OCW 2Mendeley Projects table Etc… table ISNI/DAI Library OCLC [ProjectID] [PID] […] […] HBO kennisbank 1 CERIF CRIS’ CC-BY: Maurice Vanderfeesten
  31. 31. Research Analytics middleware Sources Data types (Information Brokerage and Restructuring) Services Users distributed scalable cloud database Resolution metadata n! Facultiesrepositories Publications table Authors table web statistics [PID] 3 [DAI] [metadata] [ISNI/ ORCID] [DAI] [PID] CWTS 1 NARCIS publishers web statistics Usage table Resolution table [http event] [PID] CBSscopus [PID] [URL] [GEO] 5 Web of citation Analytics 4 2 science data mesh Researchers Alt table Citation tableTwitter altmetrics [social media event] [citation reference] [PID] [PID] Use Case: CWTS wants OCW Repositorymetrics to facebook make the Leiden index using and combiningMendeley information from a variety Projects table Etc… table OCLC ISNI/DAI [ProjectID] […] of sources. Library 4 [PID] […] HBO kennisbank 5 CERIF CRIS’ CC-BY: Maurice Vanderfeesten
  32. 32. Research Analytics middleware Sources Data types (Information Brokerage and Restructuring) Services Users distributed scalable cloud database Resolution metadata n! Facultiesrepositories Publications table Authors table web statistics [PID] [DAI] [metadata] [ISNI/ ORCID] [DAI] [PID] CWTS 4 3 NARCIS publishers web statistics 2 Usage table Resolution table [http event] [PID] CBSscopus [PID] [URL] [GEO] Web of citation Analytics science data mesh 1 Researchers Alt table Citation tableTwitter altmetrics [social media event] [citation reference] Researcher wants Use Case: [PID] view the download ratio [PID] Repositorymetrics OCW facebook between his Open Acces and toll-gatedMendeley 4 Projects table Etc… table publications, and 5 OCLC ISNI/DAI [ProjectID] comparing this to his co- […] Library [PID] authors’ratio. kennisbank […] HBO CERIF CRIS’ CC-BY: Maurice Vanderfeesten
  33. 33. What does the user see? CC-BY: Maurice Vanderfeesten
  34. 34. Research Analytics Dashboards CC-BY: Maurice Vanderfeesten

×