Techniques in using open data, as well as using open data standards for unstructured data for government transparency and anti-corruption

1. Using & Making Public Data for
Anti-corruption Locally and Internationally
Supported by
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
IDEAS: Supporting the MACC in the fight against
corruption Public Forum
26 Jan 2017, Kuala Lumpur
Khairil Yusof <khairil.yusof@sinarproject.org>
sinarproject.org

2. Open Government Data

3. Budgets
Agencies
Decision Makers
(Elected, Senior
Public Officials)
Contracts
Legislature
CSOs
Issue
Reporting
FOI
Request
Communities
Request for contracts
Request for
expenditures
orgs
contract
data
budget
data
open31
1
Companies
people &
orgs
legislative data
company
info
demographic data
social audit data
expenditures
Service
s
Works
(Infrastructure)
impact data
people & posts & orgs
Supply
open31
1Auditor
General

4. Open Data Barometer By Sector (Score of 100)
15
Health
40
Crime
15
Government
Budget
15
Company Register
15
Maps
15
Primary & Secondary
Education
65
Environment
65
International Trade
15
Elections
15
Demographics
15
Transportation
15
Public Contracts
5
Expenditure
5
Ownership
15
Legislative

5. Detect Anomalies

6. Government / Public Contracts
● Beneficial Ownership
● Lopsided agreements
● Contract variations in procurement (delays, extensions)

7. Algorithms to detect contract anomalies

8. Slush funds in budgets

9. Can analyse key budget cuts

10. No public detailed
contracts &
expenditures
published is a huge
red flag

11. Opaque Governments
“Government doesn’t provide open data, therefore we cannot do all of this open
data things for transparency or anti-corruption”
Not true.

12. Tracking Politically Exposed Persons
(PEPS) with Public Open Data Database

13. Popolo Standards
● Person
○ identifiers (eg. IC)
○ names, honorifics
○ addresses, photos etc.
● Organizations
○ identifiers (eg ssm)
● Posts/Memberships (of orgs,
committees, BoD)
○ title
○ start/end
● Motions
○ BoD/Cabinet Decisions
● Relations
○ Close Relative etc.
Relations Membership
Post
Organization
Motion
PEP

14. Relation Membership
Post
Organization
Motion
PEP
Relation Membership
Post
Organization
Motion
PEP
Relation Membership
Post
Organization
Motion
PEP
Relation: Father - Son
Org: Parent-Subsidiary
Membership: Same organization, board,
committee
Power / Conflicts of Interest

15. Keep adding bits of
information over time

16. Unstructured Data in Legislative Documents

17. Company No, Posts held/dates from company
documents

18. Government websites

19. Organization Structure and Posts

20. AG Report -> Company -> Directors

21. PEPs
4444

22. 251
Organizations, Committees and Boards

23. 968
Posts

24. Mapping out MARA

25. Relations Membership
Post
Organization
Motion
PEP
Contracts
Properties
Luxury Vehicles
Companies
Joined Up Data for Beneficial Ownership
Identifiers
Civil/Criminal
Cases
Shell
Companies
PEP (eg.
step-son)

26. Transparency: Match Representatives to
Contracts/Interests

27. International joint effort for open data on beneficial
ownership

28. Panama Leaks, Australian News + Sinar PEPs DB

29. Joined up data from legal cases

30. ● Explore public assets, interests
& governance issues for PEPs
○ Politicians, Electoral Candidates
○ Judges & Prosecutors
○ Government Officials
● Visualizations
○ Graph Current Known Assets vs
Post
Now we can
build the apps
and do the
research

31. data.sinarproject.org
http://sinar.github.io/popit_visualizer
api.popit.sinarproject.org (PEPs database)
@sinarproject (twitter)
Slack (community chat/workspace)
team@sinarproject.org for invite
Tools & Data