iRail at hack democracy

•

0 likes•279 views

Pieter Colpaert

Technology

5 minutes
● Scraping
● The law
● Project problems

Really no other option?
DON'T wait
● For big forms to be filled in
● For officials to respond

DON'T talk too much about your ideas

DO

Different explanations for scraping
● Legal: «show data, differently» (~Browser)
● +/-: «already public data»
● Illegal: «steal data»

Public transport: iRail
● Second database law
● Result of activity = no copyright

● Others don't agree?
● iRail vzw/asbl/npo supports you!

Web2.0: If people like it

It's okay!

Just be awesome

So much choice!
● Java servlets
● PHP
● Perl
● Python
● ...

?
● Limit dirtiness?
● How modular?
● Reusability?

Help each other!
● API
● one time job
● Open source
– Everyone helps fixing
● Patch «the» system!

Conclusion
● SCRAPE
● When no other possibility
● WORK
● Together!
● QUICK & DIRTY
● But clean it up

Q&A

@pietercolpaert
Project.iRail.be

Github.com/iRail

What's hot

The One WayDaniel Greenfeld

Besut Kode Challenge 1John Vandenberg

VirtualJUG24 - Testing with Spock: The logical choiceIván López Martín

Besut Kode - Workshop 1John Vandenberg

The what, how and why of scaling git repositoriesJohan Abildskov

Nordic Testing Days - Tallinn 2017 - Test your Java applications with SpockIván López Martín

Code:Nation Tech StackElton Minetto

Towards a Commons RDF Java librarySergio Fernández

Operational MongoDBMitch Pirtle

First Pull Request - Sergio Ocon - ManageIQ Design Summit 2016ManageIQ

London Java Community 2016 - Testing with Spock: The logical choiceIván López Martín

XOHW19 @ NECSTLabNECST Lab @ Politecnico di Milano

HandsOn: git (or version control in general...)Martin Scharm

Ready, set, go! An introduction to the Go programming languageRTigger

MongoDB at LAHacks :)Randall Hunt

ADDO 2019: Looking back at over 10 years of DevopsKris Buytaert

Pravin s glibc-unicode_and_cldrPravin Satpute

What's hot (17)

The One Way

Besut Kode Challenge 1

VirtualJUG24 - Testing with Spock: The logical choice

Besut Kode - Workshop 1

The what, how and why of scaling git repositories

Nordic Testing Days - Tallinn 2017 - Test your Java applications with Spock

Code:Nation Tech Stack

Towards a Commons RDF Java library

Operational MongoDB

First Pull Request - Sergio Ocon - ManageIQ Design Summit 2016

London Java Community 2016 - Testing with Spock: The logical choice

XOHW19 @ NECSTLab

HandsOn: git (or version control in general...)

Ready, set, go! An introduction to the Go programming language

MongoDB at LAHacks :)

ADDO 2019: Looking back at over 10 years of Devops

Pravin s glibc-unicode_and_cldr

Viewers also liked

Happy exit to 2011GreenfieldProject

Umysl sprzedawcyGucio Silva

Akupresura w-praktyceGucio Silva

Кригер Амалия 2ВYanina

Родительский лекторийYanina

Conte abans d'anar a dormir 1silviamecho

Open and close formsPatricia Gutiérrez Marqués

Models by Percent DiscountTrueCar

NBS corporate brochureNorthampton Business School

7TH ST A102 APR.29.16 ZAlfonso Duran, Assoc. AIA

Sertifikat - Recruitment & SelectionRobi Pandunusa

Quantum vacation broucherQuantum vacations

MGT 255-2 Group 1 Amazon's CSR PaperAmanda Page

Viewers also liked (13)

Happy exit to 2011

Umysl sprzedawcy

Akupresura w-praktyce

Кригер Амалия 2В

Родительский лекторий

Conte abans d'anar a dormir 1

Open and close forms

Models by Percent Discount

NBS corporate brochure

7TH ST A102 APR.29.16 Z

Sertifikat - Recruitment & Selection

Quantum vacation broucher

MGT 255-2 Group 1 Amazon's CSR Paper

Similar to iRail at hack democracy

Python in IndustryDharmit Shah

PloneideFranco Pellegrini

Introduce PythonM Asep Indrayana

Apps 4-antwerp-dec-2012-j-carter-parkshark-and-parkshark-api-antwerpJonathan Carter

Python For All | Software Professionals, QA & DevOps professionalsNilesh Sutar

Python for All Pragya Goyal

Introduction to Idem for Microsoft AzureNicholas Hughes

برنامه نویسی بات تلگرام در پایتونShiraz LUG

Build, deploy and scale: Django, GraphQL and SPA (DjangoCon EU 2021)Dhilipsiva DS

Zope is dead - Long live ZopeLennart Regebro

Teaching Open Source In The UniversityDominique Cimafranca

Advantages of Python Learning | Why PythonEvoletTechnologiesCo

Comingle Arse 2014Andrew Quitmeyer

Techhub Riga - tm 27.07Toms Bauģis

Mixing Plone and Django for explosive resultsSimone Deponti

Open source, What | Why | How Nikhil Agrawal

Os hardware meets os softwarePaul Tanner

Open Source Secret Sauce - Lugor Sep 2011Ted Husted

OSDC 2016 | Another 7 tools for your #devops stack by Kris BuytaertNETWAYS

Introduction to Open Data and Data ScienceSuraj Kumar Jana

Similar to iRail at hack democracy (20)

Python in Industry

Ploneide

Introduce Python

Apps 4-antwerp-dec-2012-j-carter-parkshark-and-parkshark-api-antwerp

Python For All | Software Professionals, QA & DevOps professionals

Python for All

Introduction to Idem for Microsoft Azure

برنامه نویسی بات تلگرام در پایتون

Build, deploy and scale: Django, GraphQL and SPA (DjangoCon EU 2021)

Zope is dead - Long live Zope

Teaching Open Source In The University

Advantages of Python Learning | Why Python

Comingle Arse 2014

Techhub Riga - tm 27.07

Mixing Plone and Django for explosive results

Open source, What | Why | How

Os hardware meets os software

Open Source Secret Sauce - Lugor Sep 2011

OSDC 2016 | Another 7 tools for your #devops stack by Kris Buytaert

Introduction to Open Data and Data Science

Recently uploaded

08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls

Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j

Key Features Of Token Development (1).pptxLBM Solutions

08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls

My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar

Pigging Solutions in Pet Food ManufacturingPigging Solutions

GenCyber Cyber Security Day PresentationMichael W. Hawkins

Understanding the Laravel MVC ArchitecturePixlogix Infotech

The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad

Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst

Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix

Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko

Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada

Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies

How to Remove Document Management Hurdles with X-Docs?XfilesPro

Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard

Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited

#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada

IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge

Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent

Recently uploaded (20)

08448380779 Call Girls In Diplomatic Enclave Women Seeking Men

Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...

Key Features Of Token Development (1).pptx

08448380779 Call Girls In Civil Lines Women Seeking Men

My Hashitalk Indonesia April 2024 Presentation

Pigging Solutions in Pet Food Manufacturing

GenCyber Cyber Security Day Presentation

Understanding the Laravel MVC Architecture

The Codex of Business Writing Software for Real-World Solutions 2.pptx

Human Factors of XR: Using Human Factors to Design XR Systems

Swan(sea) Song – personal research during my six years at Swansea ... and bey...

Handwritten Text Recognition for manuscripts and early printed texts

Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024

Benefits Of Flutter Compared To Other Frameworks

How to Remove Document Management Hurdles with X-Docs?

Maximizing Board Effectiveness 2024 Webinar.pptx

Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365

#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024

IAC 2024 - IA Fast Track to Search Focused AI Solutions

Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...

iRail at hack democracy

1. iRail and open data @pietercolpaert Hack democracy

2. 5 minutes ● Scraping ● The law ● Project problems

3. Why?

4. Really no other option? DON'T wait ● For big forms to be filled in ● For officials to respond DON'T talk too much about your ideas DO

5. A Lot Of Laws

6. Different explanations for scraping ● Legal: «show data, differently» (~Browser) ● +/-: «already public data» ● Illegal: «steal data»

7. Public transport: iRail ● Second database law ● Result of activity = no copyright ● Others don't agree? ● iRail vzw/asbl/npo supports you!

8. But! Who cares about laws?

9. Web2.0: If people like it It's okay! Just be awesome

10. Design problems

11. So much choice! ● Java servlets ● PHP ● Perl ● Python ● ...

12.

13. ? ● Limit dirtiness? ● How modular? ● Reusability?

14. Help each other! ● API ● one time job ● Open source – Everyone helps fixing ● Patch «the» system!

15. Conclusion ● SCRAPE ● When no other possibility ● WORK ● Together! ● QUICK & DIRTY ● But clean it up

16. Q&A @pietercolpaert Project.iRail.be Github.com/iRail

iRail at hack democracy

Recommended

Recommended

More Related Content

What's hot

What's hot (17)

Viewers also liked

Viewers also liked (13)

Similar to iRail at hack democracy

Similar to iRail at hack democracy (20)

More from Pieter Colpaert

More from Pieter Colpaert (19)

Recently uploaded

Recently uploaded (20)

iRail at hack democracy