Wiki[mp]edia data sources & the MediaWiki API

•

2 likes•1,818 views

This document summarizes key facts about Wikipedia and related Wikimedia projects. It notes that Wikipedia contains over 13 million articles across 240+ languages, including 3 million in English. It also describes Wikimedia Commons, Wiktionary, DBpedia, and the MediaWiki API. Tools like TemplateTiger and Toolserver provide additional functionality for accessing and analyzing data within the Wikimedia projects.

Wiki[mp]edia
data sources &
the MediaWiki API
Brianna Laugher
for #melhack
November 2009

Wikipedia
13M articles total
3M+ articles in English
240+ languages
Simple English!

${{coord|37|48|49|S|144|57| 47|E|type:city_region:AU-VIC| display=inline,title}} stable.toolserver.org/geohack/ wiki.toolserver.org/view/GeoHack$

${{Infobox Company |name = Lonely Planet |logo = |type = [[United Kingdom|British]] [[Government-owned company|government-owned]] (subsidiary of [[BBC Worldwide]]) |genre = [[Guide book|Travel guides]] |foundation = 1972 |founder = Tony Wheeler Maureen Wheeler |location_city = [[Footscray, Victoria]] |location_country = [[Australia]] |location = |origins = |key_people = Matt Goldberg (Global [[CEO]]) |area_served = Worldwide |industry = [[Multi media]] |products = Travel [[guidebook, digital applications, online travel community]] |services =$

Wikimedia Commons
commons.wikimedia.org
Multilingual
5M+ files
“Self-created”, PD, Flickr

Predominantly photographs,
but also diagrams, maps, flags

Wiktionary
5M+ entries
170+ languages
13 languages > 100K entries

French biggest at 1.5M
(English second at 1.4M)

JavaScript Wiktionary lookup plugin for
third parties:
http://bawolff.blogspot.com/2009/10/introducing-
wiktionary-lookup-now-for.html

http://en.wiktionary.org/wiki/Wiktionary:Parsing

MediaWiki structure
 Users
 Logs

 Pages, subpages, talk pages

 Links, backlinks

 Templates

 Categories

MediaWiki markup

The only thing that completely
understands it is MediaWiki :(

Database dumps
XML

download.wikimedia.org
OR Amazon Public Data Sets

meta.wikimedia.org/wiki/
Data_dumps

DBpedia
Community project extracting
structured data from Wikipedia and
making it available

Can download data sets or query them
online

Ontology++

e.g. dbpedia.org/page/Lonely_Planet

MediaWiki API

mediawiki.org/wiki/API

en.wikipedia.org/w/api.php

Client libraries!

mwclient

Python library for
accessing MediaWiki
APIs

Toolserver
toolserver.org

Server for community-developed plugins,
addons, extensions, stats and hacks –
tools

Tools often explicitly implements implicit
editing community standards
(“community API”)

TemplateTiger
toolserver.org/~kolossos/templatetiger/

For a few dozen Wikipedia languages, &
Wikimedia Commons

Lets you query templates very much
like SQL

Thanks!
identi.ca/pfctdayelise
blaugher@wikimedia.org.au

Logos and screenshots
may be copyright
their respective owners
Slides are otherwise
© Brianna Laugher

AUTHOR: LIAM WYATT “Gratis & Libre” discusses aspects of the idea of freedom in history by analysing the means by which it is curtailed. Specifically these are: the changing nature of copyright; attempts at censorship; knowledge destruction; the monetary cost of knowledge; and the politics of language. It seeks to show how Wikipedia walks a well-trodden path of anti-authority when it comes to the various means by which the ideal of freedom has been curtailed.

Velocity 2015 building self healing systems (slide share version)

SOASTA

mediawiki and mantis

bill1630

Working with Mediawiki

James Howard

Power to the Users (and Librarians)

Guus van den Brekel

The development of better library information systems will always remain the core business of any serious library organization, but a shift took place towards (freely) available web-based tools for creating and managing the information workflow. End-users are not only using these heavily, but are also creating their own preferred tools. Today's students are incorporating Web 2.0 skills in daily life, in their social and learning environments. Tomorrow's academic staff will expect to be able to use their preferred tools and resources within their work environment. Today's ánd tomorrow's libraries should support students and staff in the learning and research process by integrating their services and resources into our patrons' environments. This practical workshop will demonstrate the use of Web 2.0 technology to empower users and librarians. During a hands-on session, participants will work with these tools. They will develop tailor-made services via personal start page software like Netvibes, making use of RSS-feeds, Widgets and Browser extensions. We will explore the use of Netvibes and Web 2.0 tools in library staff and/or library user education/instruction. We will focus on library services which can be created almost on-the-fly with low costs and high impact. The growing use of social networks justifies the development of a library presence within these networks to reach out to our users. Paper, slides and recommended reading : http://www.tilburguniversity.nl/services/lis/ticer/08carte/recommendedreading.html#brekel

Semantic Wiki: Social Semantic Web in Use

Jesse Wang

The “right to fork”, a consequence of the “hack on copyright” that is copyleft licensing, helps keep open source and open content project leaders honest. Forking is a political act as much as a version control command, and it used to be that both were a big deal. But now that distributed version control systems (DVCS) have made forking trivial, are there implications for the political act as well? How does political forking work within collaborative prose text projects (i.e. wikis)? English Wikipedia is so large as to be practically unforkable - it essentially has an unassailable monopoly, and unchecked power, in the English language encyclopedia market. One of the core Wikipedia rules is “one topic, one article”, which would seem to prohibit forking, but could we adhere to this principle and still take advantage of DVCS? Can a community be forked while keeping the shared project goals intact? Audience members will benefit from a grasp of version control, distributed version control and the workings of wikis and Wikipedia. Presented at the 'Freedom in the Cloud' miniconf, Monday January 24 2011 at linux.conf.au.

New Free Web 2.0 Developments 97

Vince123

So You're A Software Developer, Now What? Exploring Career Growth

Brianna Laugher

Talk presented at PyConline Australia 2021. So you’re a software developer, now what? Is it satisfying? How do you level up? How can you influence your career direction? How can you even figure out what you want? If your manager asked where you want your career to go, do you know what you would say? Do you feel like being a developer is a bit “meh”, but you are not really sure what else is out there? If career questions make you feel a bit lost, you’re not alone. It’s common for software developers to feel that their career is something that happens to them while they scramble for job stability, rather than something that they have any influence or control over. This talk will challenge you to look sideways when it comes to moving on up. Software is so much more than just programming, even if you still program every day. Come to get some new ideas on what your current or next job might look like, and how to figure out what you might like. Leave with some confident directions to guide your next 1:1 discussion or job search. Software is a generous and expansive field - why not aim to find fulfilling work while we’re here, hey?

CFFSW - Crowdfunded free software

Brianna Laugher

Similar to Wiki[mp]edia data sources & the MediaWiki API

Web2 0rbwalker15

Web20 Intro Naj Shaik

Karen Vignare

Hacking Mediawiki

Jani Patokallio

Aswc2009 Smw Tutorial Part 1 Intro And Examples

Jesse Wang

Web2.0 Tools

Satyendra Arora

Reflections On Personal Experiences In Using Wikis

lisbk

Web 2.0 Resources for Teaching

Alexis Alexander

The Social Semantic Web

John Breslin

Web 2.0: Implications For The Cultural Heritage Sector

lisbk

Water Wiki, a global platform for water communityXWiki

Web 2.0 lib_2.0_1smtcd

Semantic Wikis - Social Semantic Web in Action

Jesse Wang

wikisGhadah Khojah

Wikis[1]experts

wikisGhadah Khojah

wikisguest4f0f6bb

Course WikisJason Rhode

Alternative eLearning Tools

Yum Studio

Distributed wikis

Brianna Laugher

New Free Web 2.0 Developments 97

Vince123

Similar to Wiki[mp]edia data sources & the MediaWiki API (20)

Web2 0

Web20 Intro Naj Shaik

Hacking Mediawiki

Aswc2009 Smw Tutorial Part 1 Intro And Examples

Web2.0 Tools

Reflections On Personal Experiences In Using Wikis

Web 2.0 Resources for Teaching

The Social Semantic Web

Web 2.0: Implications For The Cultural Heritage Sector

Water Wiki, a global platform for water community

Web 2.0 lib_2.0_1

Semantic Wikis - Social Semantic Web in Action

wikis

Wikis[1]

wikis

Course Wikis

Alternative eLearning Tools

Distributed wikis

New Free Web 2.0 Developments 97

More from Brianna Laugher

So You're A Software Developer, Now What? Exploring Career Growth

Brianna Laugher

CFFSW - Crowdfunded free software

Brianna Laugher

Dynamic viz in the IPython Notebook

Brianna Laugher

Slides for a talk at PyCon AU 2013. Integrating PyDAP + WMS + OpenLayers + IPython Notebook. Video: http://www.youtube.com/watch?v=YJqBGi48RAM The IPython Notebook is a powerful web app for exploring ideas and data sets with Python. It has excellent integration with Matplotlib, giving the user highly customisable static plots with ease. But for larger data sets, a static plot may not be ideal - the ability to pan, zoom, choose dynamic layers and sample the data at particular points would be nice. This talk will demonstrate just how easy it is to integrate a Web Map Service/client such as Pydap/Leaflet.js into the IPython Notebook.

Funcargs & other fun with pytest

Brianna Laugher

Video - http://www.youtube.com/watch?v=DTNejE9EraI Code - https://gist.github.com/3386951 Pytest is a mature and comprehensive testing suite for Python projects, but it can be a little intimidating for newcomers. Where do these mysterious funcargs come from, how do parametrised tests work, and where are my xUnit-style setUp and tearDown methods? Pytest lives by "convention over configuration" - which is great once you know what the conventions are. This talk will look at real examples of pytest in use, emphasising the features that differentiate it from nose.

Zookeepr: Home-grown conference management software

Brianna Laugher

A talk presented at PyCon AU 2011. Zookeepr ( http://zookeepr.org/ ) is a comprehensive web-based conference management system, written in Python and built on Pylons. It has an unusual development history: custom created for the annual Linux.conf.au conference, there are yearly spikes in event-focused feature development, but relatively little of the ongoing development typically seen in open source projects. This presentation is an introduction to the project, aimed at developers interested in contributing to a non-trivial open source project where meeting your fellow developers is quite possible, even likely, and your work is almost guaranteed to be seen and used each year by hundreds of Australia's most diehard geeks.

BarCamp Geelong - Why gender should be a text field

Brianna Laugher

Neurosexism

Brianna Laugher

Clash of the encyclopedias - is competition good for sharing?

Brianna Laugher

Talk given at the Get It Louder 'SHARISM' conference in Shanghai, 22 October 2010. http://www.getitlouder.com/enChair.aspx?ID=94 One of the benefits of the open web is that good ideas can flourish easily. In the Chinese speaking web, the idea of an online encyclopedia has been especially fruitful. With the Chinese Wikipedia enjoying its eighth birthday last month, it’s worth examining whether the fragmentation of efforts ultimately leads to a better product and bigger communities, or if the “us vs them” mentality is harmful to sharing.

Language Sleuthing HOWTO with NLTK

Brianna Laugher

Visualising geo-data

Brianna Laugher

GLAM-WIKI - Wikimedia tech infrastructure

Brianna Laugher

The right level of detail (MediaWiki, APIs)

Brianna Laugher

Free as in Market: Liberty and Property - Rusty Russell

Brianna Laugher

Public history in the digital age - Claudine Chionh

Brianna Laugher

AUTHOR: CLAUDINE CHIONH Public history is a field that seeks to return the study and interpretation of history to the wider community. While 'professional' historians with academic training may be involved, public history is largely focused on and driven by 'amateurs' – genealogists, local history societies and others who collect and collate sources and interpret and present them for a general audience. The increased use of the internet in recent years has created new opportunities for opening up sources and archives to the world, and for collaboration and public presentation of historical research. In this presentation I will describe two projects that aim to collect and publish historical sources on the web and to work with local and family historians to maintain these as dynamic historical resources.

It's all fun and games until someone wants to sue you: Reporting in the age o...

Brianna Laugher

OpenAustralia - Everyday democracy for everybody in Australia - Matthew Landauer

Brianna Laugher

Freedom Fighting: How do we convince the powers that be to relax their grip? ...

Brianna Laugher

AUTHOR: JESSICA COATES Over the last few years the free culture movement has moved out of the bedrooms and into the boardrooms. Open copyright models are increasingly of interest not just to enthusiasts, but to big name creators, government bodies and even corporate entities. It finally feels like we're just a hair's breadth away from widespread acceptance and take up, both in Australia and internationally. But there is still that tiny gap. How do we get people to cross the final divide from interested party to adopter? Drawing on her experience as Project Manager of Creative Commons Australia, Jessica Coates will lead a group discussion on tactics for promoting greater adoption of open copyright in Australia. What tools are most useful for spreading the word? What projects have been successful in the past? How do we convince people to give more thought to their copyright decisions?

Free and open geodata: From shadows to reality - Simon Greener

Brianna Laugher

AUTHOR: SIMON GREENER This talk will attempt a review of the geospatial data space within Australia. The talk will outline who the main players are, what spatial data is available, and the licensing options that cover their use. An assessment of the licenses will be made. In particular the talk will outline the data that is available for free and, and after establishing the various uses of that data, assess how important that data is to various sectors and individuals within society and how it might benefit society as a whole.

Future directions for copyright law - Laura Simes

Brianna Laugher

AUTHOR: LAURA SIMES Australia's copyright laws are the chief means by which we as a society regulate the creation and distribution of knowledge. With the digital age well and truly upon us, individuals, corporations and Governments are grappling with how copyright law now 'fits' in with this, with diverse opinions on how copyright law could or should adapt to meet these changes. This talk will look at a few current issues of interest in the world of copyright, and consider where we seem to be heading. Some developments, such as the Anti-Counterfeiting Trade Agreement (ACTA) suggest a preoccuopation with stronger copyright laws and penalties. On the other hand, the recent Review of the National Innovation System (aka the Cutler Report) presents a number of recommendations for more 'flexible' copyright law, along with a suggestion that we need to look at copyright law in a different way than we have in the past.

Beyond Open Source - Arthur Sale

Brianna Laugher

AUTHOR:ARTHUR SALE The Open Source movement, of which Linux is a shining example, is a showcase of how accessibility makes for excellence. A parallel thrust is currently being conducted in the research institutions and the publishing industries of the world to create Open Access to the world’s publicly funded research. Arthur Sale will trace the origin of the movement, its economics and the forces holding it back, and where we are now, particularly in Australia. Open Access, or OA, has very many more active participants than Open Source, and many more nay-sayers, cautious Scrooges, and ignorant people. The struggle is titanic – the benefits equally large! http://freeasinfreedom.modernthings.org/d/doku.php?id=arthur_sale

More from Brianna Laugher (20)

So You're A Software Developer, Now What? Exploring Career Growth

CFFSW - Crowdfunded free software

Dynamic viz in the IPython Notebook

Funcargs & other fun with pytest

Zookeepr: Home-grown conference management software

BarCamp Geelong - Why gender should be a text field

Neurosexism

Clash of the encyclopedias - is competition good for sharing?

Language Sleuthing HOWTO with NLTK

Visualising geo-data

GLAM-WIKI - Wikimedia tech infrastructure

The right level of detail (MediaWiki, APIs)

Free as in Market: Liberty and Property - Rusty Russell

Public history in the digital age - Claudine Chionh

It's all fun and games until someone wants to sue you: Reporting in the age o...

OpenAustralia - Everyday democracy for everybody in Australia - Matthew Landauer

Freedom Fighting: How do we convince the powers that be to relax their grip? ...

Free and open geodata: From shadows to reality - Simon Greener

Future directions for copyright law - Laura Simes

Beyond Open Source - Arthur Sale

Recently uploaded

LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...

DanBrown980551

Do you want to learn how to model and simulate an electrical network from scratch in under an hour? Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)! During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook. PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides: - A fully editable and extendable library for grid component modelling; - Visualization tools to display your network; - Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses; The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well. What you will learn during the webinar: - For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills; - For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.

To Graph or Not to Graph Knowledge Graph Architectures and LLMs

Paul Groth

From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...

Product School

Designing Great Products: The Power of Design and Leadership by Chief Designe...

Product School

Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...

Jeffrey Haguewood

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams. Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...

Product School

Assuring Contact Center Experiences for Your Customers With ThousandEyes

ThousandEyes

FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf

FIDO Alliance

Mission to Decommission: Importance of Decommissioning Products to Increase E...

Product School

Securing your Kubernetes cluster_ a step-by-step guide to success !

KatiaHIMEUR1

Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster. However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks. In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

Tobias Schneck

As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other? Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.

UiPath Test Automation using UiPath Test Suite series, part 3

DianaGray10

Transcript: Selling digital books in 2024: Insights from industry leaders - T...

BookNet Canada

The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more. Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/ Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.

JMeter webinar - integration with InfluxDB and Grafana

RTTS

Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application. In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics. Length: 30 minutes Session Overview ------------------------------------------- During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana: - What out-of-the-box solutions are available for real-time monitoring JMeter tests? - What are the benefits of integrating InfluxDB and Grafana into the load testing stack? - Which features are provided by Grafana? - Demonstration of InfluxDB and Grafana using a practice web application To view the webinar recording, go to: https://www.rttsweb.com/jmeter-integration-webinar

State of ICS and IoT Cyber Threat Landscape Report 2024 preview

Prayukth K V

The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development. The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers: State of global ICS asset and network exposure Sectoral targets and attacks as well as the cost of ransom Global APT activity, AI usage, actor and tactic profiles, and implications Rise in volumes of AI-powered cyberattacks Major cyber events in 2024 Malware and malicious payload trends Cyberattack types and targets Vulnerability exploit attempts on CVEs Attacks on counties – USA Expansion of bot farms – how, where, and why In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East Why are attacks on smart factories rising? Cyber risk predictions Axis of attacks – Europe Systemic attacks in the Middle East Download the full report from here: https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/

Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...

Product School

Essentials of Automations: Optimizing FME Workflows with Parameters

Safe Software

Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place. Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects. Here’s what you’ll gain: - Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows. - Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy. - Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency. - Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity. We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic. Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.

The Future of Platform Engineering

Jemma Hussein Allen

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

Product School

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

James Anderson

Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management. The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM). Speakers: Bob Boule Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle. Gopinath Rebala Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.

Recently uploaded (20)

LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...

To Graph or Not to Graph Knowledge Graph Architectures and LLMs

From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...

Designing Great Products: The Power of Design and Leadership by Chief Designe...

Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...

From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...

Assuring Contact Center Experiences for Your Customers With ThousandEyes

FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf

Mission to Decommission: Importance of Decommissioning Products to Increase E...

Securing your Kubernetes cluster_ a step-by-step guide to success !

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

UiPath Test Automation using UiPath Test Suite series, part 3

Transcript: Selling digital books in 2024: Insights from industry leaders - T...

JMeter webinar - integration with InfluxDB and Grafana

State of ICS and IoT Cyber Threat Landscape Report 2024 preview

Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...

Essentials of Automations: Optimizing FME Workflows with Parameters

The Future of Platform Engineering

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

Wiki[mp]edia data sources & the MediaWiki API

1. Wiki[mp]edia data sources & the MediaWiki API Brianna Laugher for #melhack November 2009

2. ...

3. Wikipedia 13M articles total 3M+ articles in English 240+ languages Simple English!

4. {{coord|37|48|49|S|144|57| 47|E|type:city_region:AU-VIC| display=inline,title}} stable.toolserver.org/geohack/ wiki.toolserver.org/view/GeoHack

5. {{Infobox Company |name = Lonely Planet |logo = |type = [[United Kingdom|British]] [[Government-owned company|government-owned]] (subsidiary of [[BBC Worldwide]]) |genre = [[Guide book|Travel guides]] |foundation = 1972 |founder = Tony Wheeler Maureen Wheeler |location_city = [[Footscray, Victoria]] |location_country = [[Australia]] |location = |origins = |key_people = Matt Goldberg (Global [[CEO]]) |area_served = Worldwide |industry = [[Multi media]] |products = Travel [[guidebook, digital applications, online travel community]] |services =

6. Wikimedia Commons commons.wikimedia.org Multilingual 5M+ files “Self-created”, PD, Flickr Predominantly photographs, but also diagrams, maps, flags

8. Wiktionary 5M+ entries 170+ languages 13 languages > 100K entries French biggest at 1.5M (English second at 1.4M)

9. JavaScript Wiktionary lookup plugin for third parties: http://bawolff.blogspot.com/2009/10/introducing- wiktionary-lookup-now-for.html http://en.wiktionary.org/wiki/Wiktionary:Parsing

10. MediaWiki structure  Users  Logs  Pages, subpages, talk pages  Links, backlinks  Templates  Categories

11. MediaWiki markup The only thing that completely understands it is MediaWiki :(

12. Database dumps XML download.wikimedia.org OR Amazon Public Data Sets meta.wikimedia.org/wiki/ Data_dumps

13. DBpedia Community project extracting structured data from Wikipedia and making it available Can download data sets or query them online Ontology++ e.g. dbpedia.org/page/Lonely_Planet

14. MediaWiki API mediawiki.org/wiki/API en.wikipedia.org/w/api.php Client libraries!

15. mwclient Python library for accessing MediaWiki APIs

16.

17. Toolserver toolserver.org Server for community-developed plugins, addons, extensions, stats and hacks – tools Tools often explicitly implements implicit editing community standards (“community API”)

18. TemplateTiger toolserver.org/~kolossos/templatetiger/ For a few dozen Wikipedia languages, & Wikimedia Commons Lets you query templates very much like SQL

19. Thanks! identi.ca/pfctdayelise blaugher@wikimedia.org.au Logos and screenshots may be copyright their respective owners Slides are otherwise © Brianna Laugher

Wiki[mp]edia data sources & the MediaWiki API

Recommended

Recommended

More Related Content

Similar to Wiki[mp]edia data sources & the MediaWiki API

Similar to Wiki[mp]edia data sources & the MediaWiki API (20)

More from Brianna Laugher

More from Brianna Laugher (20)

Recently uploaded

Recently uploaded (20)

Wiki[mp]edia data sources & the MediaWiki API