@tobyberesford #affiliatehuddle #algorithms
Algorithmic 

Accountability 

is coming
Toby Beresford
Head of Client Engagement
Magic Freebies
@tobyberesford #affiliatehuddle #algorithms
Magic Freebies
• MagicFreebies is a daily
publisher serving 2M members.
• For clients, Magic Freebies
offers a curated introduction
bringing them affordable
consumer leads at scale.
@tobyberesford #affiliatehuddle #algorithms
Today we’ll cover…
• Algorithmic Aversion and Appreciation

• When Algorithms Go Wrong

• Algorithmic Accountability & Principles

• What MagicFreebies are doing

• What Google and Facebook are doing
@tobyberesford #affiliatehuddle #algorithms
Algorithmic Aversion
@tobyberesford #affiliatehuddle #algorithms
@tobyberesford #affiliatehuddle #algorithms
Photo: David Sugden
@tobyberesford #affiliatehuddle #algorithms
@tobyberesford #affiliatehuddle #algorithms
Algorithmic Appreciation
@tobyberesford #affiliatehuddle #algorithms
@tobyberesford #affiliatehuddle #algorithms
@tobyberesford #affiliatehuddle #algorithms
@tobyberesford #affiliatehuddle #algorithms
When Algorithms Go Wrong
@tobyberesford #affiliatehuddle #algorithms
@tobyberesford #affiliatehuddle #algorithms
@tobyberesford #affiliatehuddle #algorithms
@tobyberesford #affiliatehuddle #algorithms
@tobyberesford #affiliatehuddle #algorithms
Algorithmic Accountability
@tobyberesford #affiliatehuddle #algorithms
@tobyberesford #affiliatehuddle #algorithms
Getting Ready
@tobyberesford #affiliatehuddle #algorithms
Algorithmic Accountability Principles
• Awareness
• Access and redress
• Accountability
• Explanation
• Data provenance
• Audit-ability
• Validation and testing
@tobyberesford #affiliatehuddle #algorithms
Awareness
Users know where automated decisions have
been made, and owners are aware of the
potential harm automated decision making can
do.
@tobyberesford #affiliatehuddle #algorithms
Access and redress
Users have access to a way to correct wrong
decisions.
@tobyberesford #affiliatehuddle #algorithms
Accountability
If you deploy an algorithm you are responsible for
its decisions.
@tobyberesford #affiliatehuddle #algorithms
Explanation
You should be able to explain the algorithm in
human terms.
@tobyberesford #affiliatehuddle #algorithms
Data Provenance
You should be able to say where did the data
come from (and also where did training set data
come from).
@tobyberesford #affiliatehuddle #algorithms
Auditability
You need to keep records of decisions made.
@tobyberesford #affiliatehuddle #algorithms
Validation and Testing
Keep checking the algorithm is behaving as it
should.
@tobyberesford #affiliatehuddle #algorithms
What we’re doing at
MagicFreebies
@tobyberesford #affiliatehuddle #algorithms
@tobyberesford #affiliatehuddle #algorithms
What are Google &
Facebook doing?
@tobyberesford #affiliatehuddle #algorithms
@tobyberesford #affiliatehuddle #algorithms
@tobyberesford #affiliatehuddle #algorithms
@tobyberesford #affiliatehuddle #algorithms
Time for a Magic
Freebie!
Pick up an Algorithmic
Accountability Principles info
sheet and take it back to your
team

Algorithmic accountability is coming