How to Use Crawlboard

330 views

Published on

Here is a detailed walk-through on using CrawlBoard to scrape your first website.

Published in: Data & Analytics

How to Use Crawlboard

  1. 1. How to Use CrawlBoard
  2. 2. What is CrawlBoard? CrawlBoard is the requirement gathering dashboard for PromptCloud’s DaaS services where users can add new sites, check for feasibility, manage payments and initiate crawls.
  3. 3. Who is it for? You can use CrawlBoard if you have a data requirement for your business that demands high quality structured data on a recurring basis.
  4. 4. Getting Started All you need to get started with CrawlBoard is your company email address for signing up.
  5. 5. Step 1. Go to the Sign up page:
  6. 6. Step 2. Enter your details like name, company email, role, and accept the terms and conditions (company email is required for signing up). Once done, click on ‘Sign up’.
  7. 7. Step 3. Verify your email by clicking on the verification link sent to your email address. You will be prompted to set a password for your login.
  8. 8. Step 4. Adding a new Sitegroup Now that you are registered and logged in, it’s time to add your first ‘Sitegroup’ (A common container for sites with similar schema). Click on the ‘Sites’ tab on the left sidebar pane of the dashboard.
  9. 9. Step 5. Adding a new Sitegroup Click on the ‘Add sites/Sitegroup’ link on the top right corner and select ‘Sitegroup’.
  10. 10. Step 6. Adding a new Sitegroup Enter details like ‘Sitegroup name’, fields to extract and add a few sample URLs. (All sites within a Sitegroup should have the same schema) Click on the ‘Next’ button.
  11. 11. Step 8. Adding a new Sitegroup Select your preferred data delivery format using the radio button and choose a frequency for crawling.
  12. 12. Step 9. Adding a new Sitegroup Choose the delivery method that’s most suited for you. You have the option to choose one between PromptCloud API, Amazon S3, Dropbox, FTP or box.
  13. 13. Step 10. Adding a new Sitegroup You can also opt for extra services like Image downloads, Expedited delivery, Hosted indexing and File merging on this page. Click on ‘Send for final feasibility check’.
  14. 14. Step 10. Making the payment Once you have submitted the requirements, the feasibility report for your Sitegroup will soon be generated. Follow the link in the feasibility report notification.
  15. 15. Step 11. Making the payment If your requirement is feasible, you will be prompted to make the payment to proceed. Click on the ‘Proceed’ button and accept the Terms and conditions. You will be asked to enter the billing address after this.
  16. 16. Step 12. Crawler setup Once the payment has been made, you are all set. Our team will setup the crawlers and you will be notified via email on the first data upload. You can use the API link in the email to access the data.
  17. 17. Step 12. Using the API Click on the API details tab on the left sidebar to find detailed instructions on using PromptCloud API to access your data.
  18. 18. All done! You can now plug this data into your Database or Analytics system to get going.
  19. 19. Got Questions? Connect with us at: www.promptcloud.com sales@promptcloud.com

×