SlideShare a Scribd company logo
1 of 12
Download to read offline
Content Import in
Drupal 7 Using Feeds
DrupalCamp Berlin, November 2014
About me• Jens Beltofte
• CTO, Denmark & Drupal Architect
• Propeople since 2003 / 2007
• Drupal since 2007
• Acquia Certified Drupal Developer
• Co-founder & Vice Chairman, Drupal Denmark
• d.o: beltofte
• @beltofte
Agenda• What is Feeds?
• Key components / concepts
• 3rd part plugins
• Feeds Tamper
• Client cases
• Demos
• Ressources
• Questions
What is Feeds?• Flexible solution for importing data
• Easy to setup imports in no time
• Multiple simultaneous configurations (importers)
• UI for granular mapping of source and target
• Manually or scheduled import
• Stand-alone or content type for import
What is Feeds?• Formats: RSS, ATOM, CSV, OPML
• Data types: nodes, users, taxonomy terms
• Ctools plugins
• Features support
• Hooks / API
Key components● Fetcher:
○ Download, load or receive feed from a source
○ Standard: HTTP + upload
● Parser
○ Parse fetched source data
○ Standard: RSS/Atom, CSV, OPML, XML Sitemap
● Processor
○ Process the parsed data and store it in the target data type
○ Standard: Node, User, Taxonomy term
3rd part plugins● Fetcher:
○ Directory Fecther
○ Feeds HTTPFetcher Append Headers
○ Feeds HTTPFetcher AA (Advanced Authentication)
○ SOAP/WDSL Fetcher
● Parser
○ Feeds XPath Parser
○ Feeds JSONPath Parser
○ Feeds extensible parsers (replace the two above)
● Processor
○ Commerce Feeds
○ Feeds Comment Processor
Feeds Tamper• Manipulate single fields before it is saved
• Examples:
○ Replace every instance of 'dog' with 'cat'.
○ Make every letter uppercase, lowercase, or capitalize every first letter.
○ Break a comma separated list of words into Taxonomy terms or a multivalued text field.
○ Combine separate 'firstname' and 'lastname' fields into one 'name' field.
○ Convert URL’s from relative to absolute.
• 20+ build in plugins for manipulation
• Custom tamper plugins using ctools
Client cases• Migration of nodes, files and taxonomy terms
• Import of departments and employees from local phone book.
• Import of events from external event system.
• Import of jobs / vacancies from HR system.
• Aggregation of multiple RSS feeds
Now demo time...
Ressources• Feeds: https://www.drupal.org/project/feeds
• Feeds XPath Parser: https://www.drupal.org/project/feeds_xpathparser
• Feeds JSONPath Parser: https://www.drupal.org/project/feeds_jsonpath_parser
• Feeds QueryPath Parser: https://www.drupal.org/project/feeds_querypath_parser
• Feeds Extensible Parsers: https://www.drupal.org/project/feeds_ex
• Feeds Tamper: https://www.drupal.org/project/feeds_tamper
• Documentation: https://www.drupal.org/node/622696
• 3rd part plugins: https://www.drupal.org/node/856644
Questions?

More Related Content

What's hot

JavaScript applicaties voor Enterprise met AngularJS
JavaScript applicaties voor Enterprise met AngularJSJavaScript applicaties voor Enterprise met AngularJS
JavaScript applicaties voor Enterprise met AngularJS
NLJUG
 

What's hot (20)

Future of pandas
Future of pandasFuture of pandas
Future of pandas
 
Deep Dive on ArangoDB
Deep Dive on ArangoDBDeep Dive on ArangoDB
Deep Dive on ArangoDB
 
JavaScript applicaties voor Enterprise met AngularJS
JavaScript applicaties voor Enterprise met AngularJSJavaScript applicaties voor Enterprise met AngularJS
JavaScript applicaties voor Enterprise met AngularJS
 
How Apache Arrow and Parquet boost cross-language interoperability
How Apache Arrow and Parquet boost cross-language interoperabilityHow Apache Arrow and Parquet boost cross-language interoperability
How Apache Arrow and Parquet boost cross-language interoperability
 
Виталий Бондаренко "Fast Data Platform for Real-Time Analytics. Architecture ...
Виталий Бондаренко "Fast Data Platform for Real-Time Analytics. Architecture ...Виталий Бондаренко "Fast Data Platform for Real-Time Analytics. Architecture ...
Виталий Бондаренко "Fast Data Platform for Real-Time Analytics. Architecture ...
 
HDF Cloud: HDF5 at Scale
HDF Cloud: HDF5 at ScaleHDF Cloud: HDF5 at Scale
HDF Cloud: HDF5 at Scale
 
Presto @ Treasure Data - Presto Meetup Boston 2015
Presto @ Treasure Data - Presto Meetup Boston 2015Presto @ Treasure Data - Presto Meetup Boston 2015
Presto @ Treasure Data - Presto Meetup Boston 2015
 
ACM TechTalks : Apache Arrow and the Future of Data Frames
ACM TechTalks : Apache Arrow and the Future of Data FramesACM TechTalks : Apache Arrow and the Future of Data Frames
ACM TechTalks : Apache Arrow and the Future of Data Frames
 
Apache Arrow - An Overview
Apache Arrow - An OverviewApache Arrow - An Overview
Apache Arrow - An Overview
 
Apache Arrow Flight: A New Gold Standard for Data Transport
Apache Arrow Flight: A New Gold Standard for Data TransportApache Arrow Flight: A New Gold Standard for Data Transport
Apache Arrow Flight: A New Gold Standard for Data Transport
 
HDF for the Cloud
HDF for the CloudHDF for the Cloud
HDF for the Cloud
 
Bleeding Edge Databases
Bleeding Edge DatabasesBleeding Edge Databases
Bleeding Edge Databases
 
Building a knowledge graph of the Belgian War Press
Building a knowledge graph of the Belgian War PressBuilding a knowledge graph of the Belgian War Press
Building a knowledge graph of the Belgian War Press
 
Knowledge graph
Knowledge graphKnowledge graph
Knowledge graph
 
Performance comparison: Multi-Model vs. MongoDB and Neo4j
Performance comparison: Multi-Model vs. MongoDB and Neo4jPerformance comparison: Multi-Model vs. MongoDB and Neo4j
Performance comparison: Multi-Model vs. MongoDB and Neo4j
 
Hello, Enterprise! Meet Presto. (Presto Boston Meetup 10062015)
Hello, Enterprise! Meet Presto. (Presto Boston Meetup 10062015)Hello, Enterprise! Meet Presto. (Presto Boston Meetup 10062015)
Hello, Enterprise! Meet Presto. (Presto Boston Meetup 10062015)
 
Practical Use of a NoSQL Database
Practical Use of a NoSQL DatabasePractical Use of a NoSQL Database
Practical Use of a NoSQL Database
 
Big Data Certifications Workshop - 201711 - Introduction and Database Essentials
Big Data Certifications Workshop - 201711 - Introduction and Database EssentialsBig Data Certifications Workshop - 201711 - Introduction and Database Essentials
Big Data Certifications Workshop - 201711 - Introduction and Database Essentials
 
Strata NY 2017 Parquet Arrow roadmap
Strata NY 2017 Parquet Arrow roadmapStrata NY 2017 Parquet Arrow roadmap
Strata NY 2017 Parquet Arrow roadmap
 
SQL To NoSQL - Top 6 Questions Before Making The Move
SQL To NoSQL - Top 6 Questions Before Making The MoveSQL To NoSQL - Top 6 Questions Before Making The Move
SQL To NoSQL - Top 6 Questions Before Making The Move
 

Viewers also liked

Slidshare
SlidshareSlidshare
Slidshare
kluay88
 
Nitrat,nitrit todorhoiloh
Nitrat,nitrit todorhoilohNitrat,nitrit todorhoiloh
Nitrat,nitrit todorhoiloh
Bor Baska
 
Again Life Italia Product Information
Again Life Italia Product InformationAgain Life Italia Product Information
Again Life Italia Product Information
rahm1290
 

Viewers also liked (16)

Shanghai big tradeshow calendar 2014 collection by MARKYE@LIERJIA.CN
Shanghai big tradeshow calendar 2014 collection by MARKYE@LIERJIA.CN Shanghai big tradeshow calendar 2014 collection by MARKYE@LIERJIA.CN
Shanghai big tradeshow calendar 2014 collection by MARKYE@LIERJIA.CN
 
AR
ARAR
AR
 
Clayesmore staff visit Italy
Clayesmore staff visit ItalyClayesmore staff visit Italy
Clayesmore staff visit Italy
 
Think Generic - Add API's To Your Custom Modules
Think Generic - Add API's To Your Custom ModulesThink Generic - Add API's To Your Custom Modules
Think Generic - Add API's To Your Custom Modules
 
Fmc china 2015 stand builder markye@lierjia.cn
Fmc china 2015 stand builder markye@lierjia.cn Fmc china 2015 stand builder markye@lierjia.cn
Fmc china 2015 stand builder markye@lierjia.cn
 
Slidshare
SlidshareSlidshare
Slidshare
 
Nitrat,nitrit todorhoiloh
Nitrat,nitrit todorhoilohNitrat,nitrit todorhoiloh
Nitrat,nitrit todorhoiloh
 
Üniversite Yazılım Mühendisliği programları müfredatının SWEBOK kılavuzu kull...
Üniversite Yazılım Mühendisliği programları müfredatının SWEBOK kılavuzu kull...Üniversite Yazılım Mühendisliği programları müfredatının SWEBOK kılavuzu kull...
Üniversite Yazılım Mühendisliği programları müfredatının SWEBOK kılavuzu kull...
 
Again Life Italia Product Information
Again Life Italia Product InformationAgain Life Italia Product Information
Again Life Italia Product Information
 
Wheat
WheatWheat
Wheat
 
Yimu exhibition services CHINA EXHIBITION CONTRACTOR
Yimu exhibition services   CHINA EXHIBITION CONTRACTORYimu exhibition services   CHINA EXHIBITION CONTRACTOR
Yimu exhibition services CHINA EXHIBITION CONTRACTOR
 
Design brief form from YiMu ExhibitS services
Design brief  form from YiMu ExhibitS servicesDesign brief  form from YiMu ExhibitS services
Design brief form from YiMu ExhibitS services
 
In Turkish: Yazılım Test-Kod Mühendisliği (YTKM): Kaliteli Test-Kodu Geliştir...
In Turkish: Yazılım Test-Kod Mühendisliği (YTKM): Kaliteli Test-Kodu Geliştir...In Turkish: Yazılım Test-Kod Mühendisliği (YTKM): Kaliteli Test-Kodu Geliştir...
In Turkish: Yazılım Test-Kod Mühendisliği (YTKM): Kaliteli Test-Kodu Geliştir...
 
UML-Driven Software Performance Engineering: A systematic mapping and a revie...
UML-Driven Software Performance Engineering: A systematic mapping and a revie...UML-Driven Software Performance Engineering: A systematic mapping and a revie...
UML-Driven Software Performance Engineering: A systematic mapping and a revie...
 
Sugar beet presentation
Sugar beet presentationSugar beet presentation
Sugar beet presentation
 
In English: Latest Trends in Software Engineering ( Yazılım Mühendisliğinde S...
In English: Latest Trends in Software Engineering (Yazılım Mühendisliğinde S...In English: Latest Trends in Software Engineering (Yazılım Mühendisliğinde S...
In English: Latest Trends in Software Engineering ( Yazılım Mühendisliğinde S...
 

Similar to Drupal Camp Berlin 2014 - Content Import in Drupal 7 Using Feeds

Solr Recipes Workshop
Solr Recipes WorkshopSolr Recipes Workshop
Solr Recipes Workshop
Erik Hatcher
 
SQL Server Konferenz 2014 - SSIS & HDInsight
SQL Server Konferenz 2014 - SSIS & HDInsightSQL Server Konferenz 2014 - SSIS & HDInsight
SQL Server Konferenz 2014 - SSIS & HDInsight
Tillmann Eitelberg
 
A Day in the Life of a Druid Implementor and Druid's Roadmap
A Day in the Life of a Druid Implementor and Druid's RoadmapA Day in the Life of a Druid Implementor and Druid's Roadmap
A Day in the Life of a Druid Implementor and Druid's Roadmap
Itai Yaffe
 

Similar to Drupal Camp Berlin 2014 - Content Import in Drupal 7 Using Feeds (20)

How to obtain the Cloudera Data Engineer Certification
How to obtain the Cloudera Data Engineer CertificationHow to obtain the Cloudera Data Engineer Certification
How to obtain the Cloudera Data Engineer Certification
 
Solr Recipes Workshop
Solr Recipes WorkshopSolr Recipes Workshop
Solr Recipes Workshop
 
Building bridges - Plone Conference 2015 Bucharest
Building bridges   - Plone Conference 2015 BucharestBuilding bridges   - Plone Conference 2015 Bucharest
Building bridges - Plone Conference 2015 Bucharest
 
DITA Quick Start Webinar Series: Getting Started with the DITA Open Toolkit
DITA Quick Start Webinar Series: Getting Started with the DITA Open ToolkitDITA Quick Start Webinar Series: Getting Started with the DITA Open Toolkit
DITA Quick Start Webinar Series: Getting Started with the DITA Open Toolkit
 
Performing successful migrations to the microsoft cloud
Performing successful migrations to the microsoft cloudPerforming successful migrations to the microsoft cloud
Performing successful migrations to the microsoft cloud
 
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
 
Tips and tricks for complex migrations to SharePoint Online
Tips and tricks for complex migrations to SharePoint OnlineTips and tricks for complex migrations to SharePoint Online
Tips and tricks for complex migrations to SharePoint Online
 
Tips and tricks for complex migrations to SharePoint Online
Tips and tricks for complex migrations to SharePoint OnlineTips and tricks for complex migrations to SharePoint Online
Tips and tricks for complex migrations to SharePoint Online
 
Apache Flume
Apache FlumeApache Flume
Apache Flume
 
Solving real world data problems with Jerakia
Solving real world data problems with JerakiaSolving real world data problems with Jerakia
Solving real world data problems with Jerakia
 
Web Services PHP Tutorial
Web Services PHP TutorialWeb Services PHP Tutorial
Web Services PHP Tutorial
 
Web Services Tutorial
Web Services TutorialWeb Services Tutorial
Web Services Tutorial
 
Accelerating analytics in the cloud with the Starburst Presto + Alluxio stack
Accelerating analytics in the cloud with the Starburst Presto + Alluxio stackAccelerating analytics in the cloud with the Starburst Presto + Alluxio stack
Accelerating analytics in the cloud with the Starburst Presto + Alluxio stack
 
Solving Data Discovery Challenges at Lyft with Amundsen, an Open-source Metad...
Solving Data Discovery Challenges at Lyft with Amundsen, an Open-source Metad...Solving Data Discovery Challenges at Lyft with Amundsen, an Open-source Metad...
Solving Data Discovery Challenges at Lyft with Amundsen, an Open-source Metad...
 
SQL Server Konferenz 2014 - SSIS & HDInsight
SQL Server Konferenz 2014 - SSIS & HDInsightSQL Server Konferenz 2014 - SSIS & HDInsight
SQL Server Konferenz 2014 - SSIS & HDInsight
 
Drupal 7 and SolR
Drupal 7 and SolRDrupal 7 and SolR
Drupal 7 and SolR
 
Data Onboarding Breakout Session
Data Onboarding Breakout SessionData Onboarding Breakout Session
Data Onboarding Breakout Session
 
QueryPath, Mash-ups, and Web Services
QueryPath, Mash-ups, and Web ServicesQueryPath, Mash-ups, and Web Services
QueryPath, Mash-ups, and Web Services
 
Web services tutorial
Web services tutorialWeb services tutorial
Web services tutorial
 
A Day in the Life of a Druid Implementor and Druid's Roadmap
A Day in the Life of a Druid Implementor and Druid's RoadmapA Day in the Life of a Druid Implementor and Druid's Roadmap
A Day in the Life of a Druid Implementor and Druid's Roadmap
 

Recently uploaded

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Recently uploaded (20)

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 

Drupal Camp Berlin 2014 - Content Import in Drupal 7 Using Feeds

  • 1. Content Import in Drupal 7 Using Feeds DrupalCamp Berlin, November 2014
  • 2. About me• Jens Beltofte • CTO, Denmark & Drupal Architect • Propeople since 2003 / 2007 • Drupal since 2007 • Acquia Certified Drupal Developer • Co-founder & Vice Chairman, Drupal Denmark • d.o: beltofte • @beltofte
  • 3. Agenda• What is Feeds? • Key components / concepts • 3rd part plugins • Feeds Tamper • Client cases • Demos • Ressources • Questions
  • 4. What is Feeds?• Flexible solution for importing data • Easy to setup imports in no time • Multiple simultaneous configurations (importers) • UI for granular mapping of source and target • Manually or scheduled import • Stand-alone or content type for import
  • 5. What is Feeds?• Formats: RSS, ATOM, CSV, OPML • Data types: nodes, users, taxonomy terms • Ctools plugins • Features support • Hooks / API
  • 6. Key components● Fetcher: ○ Download, load or receive feed from a source ○ Standard: HTTP + upload ● Parser ○ Parse fetched source data ○ Standard: RSS/Atom, CSV, OPML, XML Sitemap ● Processor ○ Process the parsed data and store it in the target data type ○ Standard: Node, User, Taxonomy term
  • 7. 3rd part plugins● Fetcher: ○ Directory Fecther ○ Feeds HTTPFetcher Append Headers ○ Feeds HTTPFetcher AA (Advanced Authentication) ○ SOAP/WDSL Fetcher ● Parser ○ Feeds XPath Parser ○ Feeds JSONPath Parser ○ Feeds extensible parsers (replace the two above) ● Processor ○ Commerce Feeds ○ Feeds Comment Processor
  • 8. Feeds Tamper• Manipulate single fields before it is saved • Examples: ○ Replace every instance of 'dog' with 'cat'. ○ Make every letter uppercase, lowercase, or capitalize every first letter. ○ Break a comma separated list of words into Taxonomy terms or a multivalued text field. ○ Combine separate 'firstname' and 'lastname' fields into one 'name' field. ○ Convert URL’s from relative to absolute. • 20+ build in plugins for manipulation • Custom tamper plugins using ctools
  • 9. Client cases• Migration of nodes, files and taxonomy terms • Import of departments and employees from local phone book. • Import of events from external event system. • Import of jobs / vacancies from HR system. • Aggregation of multiple RSS feeds
  • 11. Ressources• Feeds: https://www.drupal.org/project/feeds • Feeds XPath Parser: https://www.drupal.org/project/feeds_xpathparser • Feeds JSONPath Parser: https://www.drupal.org/project/feeds_jsonpath_parser • Feeds QueryPath Parser: https://www.drupal.org/project/feeds_querypath_parser • Feeds Extensible Parsers: https://www.drupal.org/project/feeds_ex • Feeds Tamper: https://www.drupal.org/project/feeds_tamper • Documentation: https://www.drupal.org/node/622696 • 3rd part plugins: https://www.drupal.org/node/856644