SlideShare a Scribd company logo
1 of 25
CKAN as an implementation
framework for the open data
          portals

           GFOSS
        George Karamanolis
           ICT Consultant
        Bologna 29/11/2012
Agenda
• CKAN – introduction
• User Groups and Features
• Testing and customization for the
  Decentralized Administration of Crete
  •   Screens from the testing enviroment
• Implementation Toolkit
• Added Value – Possible Synergies
About CKAN
• CKAN is a powerful data management system that makes
  data accessible – by providing tools to streamline
  publishing, sharing, finding and using data.
• Was developed by the non-profit Open Knowledge
  Foundation
• Aimed at data publishers (national and regional
  governments, companies and organizations)
• Used to power both official and community data portals,
  CKAN
• It now powers more than 40 data hubs around the world,
  including portals for local, national and international
  government, such as the UK’s data.gov.uk and the European
  Union’s publicdata.eu (beta version)
Ckan user groups
•Publishers
  • Local/national governments, data providers
•Open Data users
  • Researchers, journalists, programmers, NGOs,
     citizens
Features for publishers
• Publish data through a guided process or import
  via API/harvesting from other catalogs
• Customize: add your own metadata fields,
  themes and branding
• Store data within CKAN or on external (e.g.
  departmental) sites
• Manage: Full access control, version history with
  rollback, INSPIRE/RDF support, user analytics
Features for data users
• Explore: search, add, edit, describe, tag, group
datasets via web front-end or API
•Collaborate: user profiles, dashboard, social
network integration, comments
•Use: metadata and data APIs, data previews and
visualizations
•Extend: full documentation for building extensions
Ckan flows
‘look and feel’ Customization
Integration with existing information
  systems or Content management
              systems
•   extensions for full Drupal and Wordpress
    integration
•   API that makes it straightforward to add
    support for other CMSs and third-party
    catalogs
Community functionality
• Comments extension – users can add comments and
  discussion on a dataset. The extension can be enabled or
  disabled at any time.
• Share – users can quickly and easily promote and discuss a
  dataset using twitter and facebook integration.
• RSS/Atom feeds – create feeds of any changes and revisions
  to datasets and groups.
• Follow extension – ‘follow’ a dataset to be informed of any
  changes, updates or new activity.
• To do extension – flag a dataset with an issue or instructions
  of what is missing or still ‘to do’. This allows for a community
  driven effort for improving and adding to metadata.
Testing for the decentralized
         Administration of Crete
•   Set up at Decentralized Administration of
    Crete for testing and customization
•   Customize layout, look and feel
•   Publish test data sets to explore
    functionality
•   Testing community features
•   Testing Interoperability features, apis etc
Localization (University of Crete)
•English (100%)
                               •
                                   Greek (100%) (80 =>
Spanish (100%)                     100)
•Portuguese (Brazil) (100%)
                               •
                                   Swedish (90%)
•Japanese (100%)
                               •
                                   Serbian (82%)
                               •
                                   Norwegian (100%)
•French (100%)                 •
                                   Slovak (95%)
•Italian (100%)Korean (100%)   •
                                   Russian (56%)
Chech (100%)                   •
                                   German (66%)
•Finnish (100%)                •
                                   Polish (64%)
                               •
                                   Dutch (70%)
                               •
                                   Bulgarian (64%)
                               •
                                   Hungarian (40%)
                               •
                                   Slovenian (15%)
                               •
                                   Latvian (21%)
                               •
                                   Lithuanian (0%)
                               •
                                   Romanian (3%)
ckan version 1.8
Basic information
Organization meta data
Multiple types of resources for
    each data set (eg API)
Relative items.. from Community
Federation
•   the data can be pulled regularly into CKAN from the
    existing repositories.
•   customizable “harvesting” mechanism which can fetch
    and import records from many different repository
    sources, including
         Geospatial Servers
         Existing web catalogues
         Simple HTML index pages
         Other CKAN instances

This functionality is used on data.gov.uk to implement a Discovery Metadata Service used to fulfill
     the UK’s obligations under the EU INSPIRE directive. It is also used on publicdata.eu to pull in
     information from other catalogues to make them all searchable in one place.
Federation
•    The harvesting functionality can be used to pull in
     metadata from other CKAN instances, it can also be
     used to create a federated network of CKAN nodes
     which share data between each other.
CKAN follows the DCAT standard for data catalogue metadata, so data can also be federated from other non-CKAN
    catalogues.
Ιmplementation Toolkit
•   10 pg document
•   Guidelines for opening up data, focusing to to
    existing tools (CKAN)
•   Ckan installation
•   legal issues and licensing
     o
       greek and eu legislation and directives
     o
       Feedback from HOMER PROJECT
•   Cataloging data sets and Publishing data sets
•   Connecting with stakeholders, Building communities
•   Reusable for Homer Partner
Participation to an open source
             project
• A chance to actively participate for an Open
  source project
• GFOSS is willing to coordinate resources for
  further development
  • Eg python developers, web designers
Final Thoughts..
• GFOSS cooperates with OKFN and Informatics
  Directorate-General (DIGIT)
• ADMS, Egov core vocabularies developed by
  ISA Group or EUROVOC
  • .. ADMS can be used for representing reusable
    semantic assets, e.g. schemas, ontologies, models,
    codelists...., hosted in metadata repositories.
    ADMS can act as a common layer among
    repositories that want to exchange data (see als
    http://joinup.ec.europa.eu/asset/adms/descriptio
    n)
Final Thoughts..
• Utilize the whole experience for European level
  projects
• Synergies (eg athens greek hackathons)
• Transparency project in Greece
links

• Ckan.org

More Related Content

Similar to 15 v1 latest version - parousiasi 2

Similar to 15 v1 latest version - parousiasi 2 (20)

The ABES Discovery Study
The ABES Discovery StudyThe ABES Discovery Study
The ABES Discovery Study
 
GeoNetwork workshop introduction mapwindow conference 2012 Velp
GeoNetwork workshop introduction mapwindow conference 2012 VelpGeoNetwork workshop introduction mapwindow conference 2012 Velp
GeoNetwork workshop introduction mapwindow conference 2012 Velp
 
The Hellenic Aggregator - Overview, procedures & the cooperation with Europeana
The Hellenic Aggregator - Overview, procedures & the cooperation with EuropeanaThe Hellenic Aggregator - Overview, procedures & the cooperation with Europeana
The Hellenic Aggregator - Overview, procedures & the cooperation with Europeana
 
ELIXIR Competence Centre in EOSC-hub
ELIXIR Competence Centre in EOSC-hubELIXIR Competence Centre in EOSC-hub
ELIXIR Competence Centre in EOSC-hub
 
Introduction to Galaxy and RNA-Seq
Introduction to Galaxy and RNA-SeqIntroduction to Galaxy and RNA-Seq
Introduction to Galaxy and RNA-Seq
 
All WP Meeting Athens - Europeana Inside - Gordon McKenna
All WP Meeting Athens - Europeana Inside - Gordon McKennaAll WP Meeting Athens - Europeana Inside - Gordon McKenna
All WP Meeting Athens - Europeana Inside - Gordon McKenna
 
TERENA OER portal, metadata extraction analysis, LAK, Leuven @9apr2013
TERENA OER portal, metadata extraction analysis, LAK, Leuven @9apr2013TERENA OER portal, metadata extraction analysis, LAK, Leuven @9apr2013
TERENA OER portal, metadata extraction analysis, LAK, Leuven @9apr2013
 
Scalable Preservation Workflows
Scalable Preservation WorkflowsScalable Preservation Workflows
Scalable Preservation Workflows
 
DLCS
DLCSDLCS
DLCS
 
SCAPE - Scalable Preservation Environments
SCAPE - Scalable Preservation EnvironmentsSCAPE - Scalable Preservation Environments
SCAPE - Scalable Preservation Environments
 
EOSC-Life Workflow Collaboratory
EOSC-Life Workflow CollaboratoryEOSC-Life Workflow Collaboratory
EOSC-Life Workflow Collaboratory
 
Webinar: Fusion 3.1 - What's New
Webinar: Fusion 3.1 - What's NewWebinar: Fusion 3.1 - What's New
Webinar: Fusion 3.1 - What's New
 
COPO - Collaborative Open Plant Omics, by Rob Davey
COPO - Collaborative Open Plant Omics, by Rob DaveyCOPO - Collaborative Open Plant Omics, by Rob Davey
COPO - Collaborative Open Plant Omics, by Rob Davey
 
Validation of services, data and metadata
Validation of services, data and metadataValidation of services, data and metadata
Validation of services, data and metadata
 
ERA CoBioTech Data Management Webinar
ERA CoBioTech Data Management WebinarERA CoBioTech Data Management Webinar
ERA CoBioTech Data Management Webinar
 
Introduction to LoCloud
Introduction to LoCloud Introduction to LoCloud
Introduction to LoCloud
 
Next generation repositories
Next generation repositoriesNext generation repositories
Next generation repositories
 
Current and emerging trends in library services
Current and emerging trends in library servicesCurrent and emerging trends in library services
Current and emerging trends in library services
 
Open source presentation to Cork County Council
Open source presentation to Cork County CouncilOpen source presentation to Cork County Council
Open source presentation to Cork County Council
 
How static analysis supports quality over 50 million lines of C++ code
How static analysis supports quality over 50 million lines of C++ codeHow static analysis supports quality over 50 million lines of C++ code
How static analysis supports quality over 50 million lines of C++ code
 

More from Georgios Karamanolis

public sector innovation - opengov projects
public sector innovation -  opengov projectspublic sector innovation -  opengov projects
public sector innovation - opengov projects
Georgios Karamanolis
 
Social media και δημόσια διοίκηση
Social media και δημόσια διοίκησηSocial media και δημόσια διοίκηση
Social media και δημόσια διοίκηση
Georgios Karamanolis
 
Draft v2-swedish-greek-bilateral-discussion2011-karamanolis-egov
Draft v2-swedish-greek-bilateral-discussion2011-karamanolis-egovDraft v2-swedish-greek-bilateral-discussion2011-karamanolis-egov
Draft v2-swedish-greek-bilateral-discussion2011-karamanolis-egov
Georgios Karamanolis
 

More from Georgios Karamanolis (15)

Karamanolis pitch en
Karamanolis pitch enKaramanolis pitch en
Karamanolis pitch en
 
Api economy crowdsourcing - εκτ event
Api economy   crowdsourcing - εκτ eventApi economy   crowdsourcing - εκτ event
Api economy crowdsourcing - εκτ event
 
Syros 2014 karamanolis need to be refined tmrw
Syros 2014   karamanolis need to be refined tmrwSyros 2014   karamanolis need to be refined tmrw
Syros 2014 karamanolis need to be refined tmrw
 
Presentation psi - καινοτομώντας με ανοικτά δεδομένα
Presentation psi -  καινοτομώντας με ανοικτά δεδομέναPresentation psi -  καινοτομώντας με ανοικτά δεδομένα
Presentation psi - καινοτομώντας με ανοικτά δεδομένα
 
public sector innovation - opengov projects
public sector innovation -  opengov projectspublic sector innovation -  opengov projects
public sector innovation - opengov projects
 
Social media και δημόσια διοίκηση
Social media και δημόσια διοίκησηSocial media και δημόσια διοίκηση
Social media και δημόσια διοίκηση
 
grails framework
grails frameworkgrails framework
grails framework
 
Omeka mscis-last-slideshare
Omeka mscis-last-slideshareOmeka mscis-last-slideshare
Omeka mscis-last-slideshare
 
Omeka
OmekaOmeka
Omeka
 
Public parousiasi-karamanolis-draseis-new
Public parousiasi-karamanolis-draseis-newPublic parousiasi-karamanolis-draseis-new
Public parousiasi-karamanolis-draseis-new
 
Routsis fotis e_health_270711
Routsis fotis e_health_270711Routsis fotis e_health_270711
Routsis fotis e_health_270711
 
Draft v2-swedish-greek-bilateral-discussion2011-karamanolis-egov
Draft v2-swedish-greek-bilateral-discussion2011-karamanolis-egovDraft v2-swedish-greek-bilateral-discussion2011-karamanolis-egov
Draft v2-swedish-greek-bilateral-discussion2011-karamanolis-egov
 
V2 agora-26-10-2011 (1)
V2 agora-26-10-2011 (1)V2 agora-26-10-2011 (1)
V2 agora-26-10-2011 (1)
 
Επιτελική παρουσίαση Egovroadmap v0.3 2
Επιτελική παρουσίαση Egovroadmap v0.3 2Επιτελική παρουσίαση Egovroadmap v0.3 2
Επιτελική παρουσίαση Egovroadmap v0.3 2
 
Web2 Ypodomes Trends Ff2007
Web2 Ypodomes Trends Ff2007Web2 Ypodomes Trends Ff2007
Web2 Ypodomes Trends Ff2007
 

15 v1 latest version - parousiasi 2

  • 1. CKAN as an implementation framework for the open data portals GFOSS George Karamanolis ICT Consultant Bologna 29/11/2012
  • 2. Agenda • CKAN – introduction • User Groups and Features • Testing and customization for the Decentralized Administration of Crete • Screens from the testing enviroment • Implementation Toolkit • Added Value – Possible Synergies
  • 3. About CKAN • CKAN is a powerful data management system that makes data accessible – by providing tools to streamline publishing, sharing, finding and using data. • Was developed by the non-profit Open Knowledge Foundation • Aimed at data publishers (national and regional governments, companies and organizations) • Used to power both official and community data portals, CKAN • It now powers more than 40 data hubs around the world, including portals for local, national and international government, such as the UK’s data.gov.uk and the European Union’s publicdata.eu (beta version)
  • 4. Ckan user groups •Publishers • Local/national governments, data providers •Open Data users • Researchers, journalists, programmers, NGOs, citizens
  • 5. Features for publishers • Publish data through a guided process or import via API/harvesting from other catalogs • Customize: add your own metadata fields, themes and branding • Store data within CKAN or on external (e.g. departmental) sites • Manage: Full access control, version history with rollback, INSPIRE/RDF support, user analytics
  • 6. Features for data users • Explore: search, add, edit, describe, tag, group datasets via web front-end or API •Collaborate: user profiles, dashboard, social network integration, comments •Use: metadata and data APIs, data previews and visualizations •Extend: full documentation for building extensions
  • 8. ‘look and feel’ Customization
  • 9. Integration with existing information systems or Content management systems • extensions for full Drupal and Wordpress integration • API that makes it straightforward to add support for other CMSs and third-party catalogs
  • 10. Community functionality • Comments extension – users can add comments and discussion on a dataset. The extension can be enabled or disabled at any time. • Share – users can quickly and easily promote and discuss a dataset using twitter and facebook integration. • RSS/Atom feeds – create feeds of any changes and revisions to datasets and groups. • Follow extension – ‘follow’ a dataset to be informed of any changes, updates or new activity. • To do extension – flag a dataset with an issue or instructions of what is missing or still ‘to do’. This allows for a community driven effort for improving and adding to metadata.
  • 11. Testing for the decentralized Administration of Crete • Set up at Decentralized Administration of Crete for testing and customization • Customize layout, look and feel • Publish test data sets to explore functionality • Testing community features • Testing Interoperability features, apis etc
  • 12. Localization (University of Crete) •English (100%) • Greek (100%) (80 => Spanish (100%) 100) •Portuguese (Brazil) (100%) • Swedish (90%) •Japanese (100%) • Serbian (82%) • Norwegian (100%) •French (100%) • Slovak (95%) •Italian (100%)Korean (100%) • Russian (56%) Chech (100%) • German (66%) •Finnish (100%) • Polish (64%) • Dutch (70%) • Bulgarian (64%) • Hungarian (40%) • Slovenian (15%) • Latvian (21%) • Lithuanian (0%) • Romanian (3%)
  • 14.
  • 17. Multiple types of resources for each data set (eg API)
  • 19. Federation • the data can be pulled regularly into CKAN from the existing repositories. • customizable “harvesting” mechanism which can fetch and import records from many different repository sources, including  Geospatial Servers  Existing web catalogues  Simple HTML index pages  Other CKAN instances This functionality is used on data.gov.uk to implement a Discovery Metadata Service used to fulfill the UK’s obligations under the EU INSPIRE directive. It is also used on publicdata.eu to pull in information from other catalogues to make them all searchable in one place.
  • 20. Federation • The harvesting functionality can be used to pull in metadata from other CKAN instances, it can also be used to create a federated network of CKAN nodes which share data between each other. CKAN follows the DCAT standard for data catalogue metadata, so data can also be federated from other non-CKAN catalogues.
  • 21. Ιmplementation Toolkit • 10 pg document • Guidelines for opening up data, focusing to to existing tools (CKAN) • Ckan installation • legal issues and licensing o greek and eu legislation and directives o Feedback from HOMER PROJECT • Cataloging data sets and Publishing data sets • Connecting with stakeholders, Building communities • Reusable for Homer Partner
  • 22. Participation to an open source project • A chance to actively participate for an Open source project • GFOSS is willing to coordinate resources for further development • Eg python developers, web designers
  • 23. Final Thoughts.. • GFOSS cooperates with OKFN and Informatics Directorate-General (DIGIT) • ADMS, Egov core vocabularies developed by ISA Group or EUROVOC • .. ADMS can be used for representing reusable semantic assets, e.g. schemas, ontologies, models, codelists...., hosted in metadata repositories. ADMS can act as a common layer among repositories that want to exchange data (see als http://joinup.ec.europa.eu/asset/adms/descriptio n)
  • 24. Final Thoughts.. • Utilize the whole experience for European level projects • Synergies (eg athens greek hackathons) • Transparency project in Greece

Editor's Notes

  1. 1.Turn key solution 2. wanting to make their data open and available.