Introduction to the law of robots and AIs - lecture 5

Introduction to the Law of Robots and Artificial IntelligencesIntroduction to the Law of Robots and Artificial IntelligencesIntroduction to the Law of Robots and Artificial IntelligencesIntroduction to the Law of Robots and Artificial Intelligences
Prof. Nicolas Petit ©Prof. Nicolas Petit ©Prof. Nicolas Petit ©Prof. Nicolas Petit ©
University of Liege, 2015University of Liege, 2015University of Liege, 2015University of Liege, 2015----2016201620162016

Lecture V: Liability Issues (Civil)

www.lcii.euwww.lcii.euwww.lcii.euwww.lcii.eu
Goals of the lecture
Who should pay for robot generated harm?
How is the issue dealt with under basic legal
structure?
Should regulation be adopted?

FriendsFriendsFriendsFriends paypaypaypay youyouyouyou aaaa visitvisitvisitvisit
RobotRobotRobotRobot killskillskillskills aaaa friend’sfriend’sfriend’sfriend’s catcatcatcat,,,, whichwhichwhichwhich
itititit confusesconfusesconfusesconfuses withwithwithwith anananan insectinsectinsectinsect
Hypothetical scenario
YouYouYouYou have ahave ahave ahave a gardengardengardengarden
BuyBuyBuyBuy aaaa robotrobotrobotrobot gardenergardenergardenergardener
UnmannedUnmannedUnmannedUnmanned systemsystemsystemsystem withwithwithwith veryveryveryvery
highhighhighhigh autonomyautonomyautonomyautonomy
CanCanCanCan flyflyflyfly andandandand taketaketaketake photographsphotographsphotographsphotographs
ofofofof youryouryouryour treestreestreestrees totototo assessassessassessassess
maturation ofmaturation ofmaturation ofmaturation of fruitsfruitsfruitsfruits
Robot has «Robot has «Robot has «Robot has « actuatorsactuatorsactuatorsactuators »»»»
Turn irrigating devices « on »
Prun the grass
Kill mosquitos
Carry and spill water,
pesticides and other
liquid/aerial products

Social goals of liability law
Solution toSolution toSolution toSolution to bebebebe foundfoundfoundfound sosososo as toas toas toas to fulfillfulfillfulfillfulfill goals ofgoals ofgoals ofgoals of liabilityliabilityliabilityliability lawlawlawlaw
Disputed
G. Williams, « The Aims of the Law of Tort », 4 Current Legal
Problems, 1951
Corrective/protective
Return those injured to the situation before injury
Deterrence
No gain from harmful conduct
Encourage precaution

S. Lehman Wilzig, « Frankestein Unbound », 1981
ProductProductProductProduct liabilityliabilityliabilityliability
Robot is piece of hardware
Liability on producer, plus possible limited liability on importers,
wholesalers and retailers
« Inherent risk »
DangerousDangerousDangerousDangerous animalsanimalsanimalsanimals
Liability on owner, unless « usually harmless species »
SlaverySlaverySlaverySlavery
Several regimes: master is liable v slave is liable
Roman law: master only liable for civil claims, not criminal acts; and only if
accomplice
What punishment against the bot?
DiminishedDiminishedDiminishedDiminished capacitycapacitycapacitycapacity:::: independentindependentindependentindependent personspersonspersonspersons, but not, but not, but not, but not entirelyentirelyentirelyentirely intelligentintelligentintelligentintelligent
ChildrenChildrenChildrenChildren:::: fullyfullyfullyfully intelligent, butintelligent, butintelligent, butintelligent, but withwithwithwith lowlowlowlow moralmoralmoralmoral responsibilityresponsibilityresponsibilityresponsibility
AgentAgentAgentAgent
PersonPersonPersonPerson

Landscaping of basic legal structure
DefaultDefaultDefaultDefault rulesrulesrulesrules (not exclusive)(not exclusive)(not exclusive)(not exclusive)
Default liability regimes: articles 1382 to 1386 Civil Code
Litigation in court
AdditionalAdditionalAdditionalAdditional rulesrulesrulesrules (not exclusive)(not exclusive)(not exclusive)(not exclusive)
Defective products liability
Directive 85/374/EEC on liability for defective products was adopted in
1985;
Loi du 25 février 1991, relative à la responsabilité du fait des produits
défectueux
Consumer rights
Directive 2011/83/EC on Consumer Rights
BE: Book VI CDE
Latent defects
Only for sales
Duty of guidance
Only for contracts

LiabilityLiabilityLiabilityLiability ofofofof
ownerownerownerowner////holderholderholderholder????
LiabilityLiabilityLiabilityLiability ofofofof perpetratorperpetratorperpetratorperpetrator????
manufacturer?manufacturer?manufacturer?manufacturer?
Framing the options
WhoWhoWhoWho shouldshouldshouldshould paypaypaypay for robotfor robotfor robotfor robot
generatedgeneratedgeneratedgenerated harmharmharmharm????
ClassicClassicClassicClassic imputabilityimputabilityimputabilityimputability issueissueissueissue
«««« Imputer c’estImputer c’estImputer c’estImputer c’est
reprocherreprocherreprocherreprocher »,»,»,», FlourFlourFlourFlour etetetet
Aubert, 7Aubert, 7Aubert, 7Aubert, 7èmeèmeèmeème edededed....

Basic Legal Structure, Discrete Externalities

Default rules: liability law (BE)
ownerownerownerowner////keeperkeeperkeeperkeeper/user (1)/user (1)/user (1)/user (1)
Due toDue toDue toDue to actactactact of robotof robotof robotof robot consideredconsideredconsideredconsidered
as (i) a «as (i) a «as (i) a «as (i) a « thingthingthingthing »»»» underunderunderunder one’sone’sone’sone’s
keepingkeepingkeepingkeeping; (ii) or as an «; (ii) or as an «; (ii) or as an «; (ii) or as an « agentagentagentagent »»»»
Article 1384 (and 1385 andArticle 1384 (and 1385 andArticle 1384 (and 1385 andArticle 1384 (and 1385 and
1386) of the Civil Code1386) of the Civil Code1386) of the Civil Code1386) of the Civil Code
LiabilityLiabilityLiabilityLiability ofofofof perpetratorperpetratorperpetratorperpetrator (2)(2)(2)(2)
LiabilityLiabilityLiabilityLiability of robotof robotof robotof robot itselfitselfitselfitself
Article 1382 and 1383 of theArticle 1382 and 1383 of theArticle 1382 and 1383 of theArticle 1382 and 1383 of the
Civil CodeCivil CodeCivil CodeCivil Code

WillingnessWillingnessWillingnessWillingness totototo ensureensureensureensure effectiveeffectiveeffectiveeffective
protectionprotectionprotectionprotection ofofofof victimsvictimsvictimsvictims, by, by, by, by providingprovidingprovidingproviding
solventsolventsolventsolvent targettargettargettarget
DamageDamageDamageDamage causedcausedcausedcaused bybybyby «««« thingsthingsthingsthings » or» or» or» or
«««« thirdthirdthirdthird partiespartiespartiesparties »»»»
LiabilityLiabilityLiabilityLiability incurredincurredincurredincurred,,,, regardlessregardlessregardlessregardless ofofofof anyanyanyany
faultfaultfaultfault of «of «of «of « guardianguardianguardianguardian » or «» or «» or «» or « principalprincipalprincipalprincipal »»»»
Ratio: controlRatio: controlRatio: controlRatio: control over «over «over «over « thingsthingsthingsthings » or» or» or» or
«««« agentsagentsagentsagents » supposes power to» supposes power to» supposes power to» supposes power to avoidavoidavoidavoid
harmharmharmharm
NeedNeedNeedNeed illicitillicitillicitillicit conductconductconductconduct ofofofof thirdthirdthirdthird
party/viceparty/viceparty/viceparty/vice of theof theof theof the thingthingthingthing underunderunderunder
custodycustodycustodycustody
Strict orStrict orStrict orStrict or veryveryveryvery strictstrictstrictstrict liabilityliabilityliabilityliability systemsystemsystemsystem
AdditiveAdditiveAdditiveAdditive liabilityliabilityliabilityliability:::: victimvictimvictimvictim cancancancan actactactact
againstagainstagainstagainst thirdthirdthirdthird party andparty andparty andparty and principalprincipalprincipalprincipal
ExhaustiveExhaustiveExhaustiveExhaustive listlistlistlist forforforfor thirdthirdthirdthird partiespartiespartiesparties
liabilityliabilityliabilityliability
Liability of owner/keeper/user (1)
Article 1384 Civil Code: «Article 1384 Civil Code: «Article 1384 Civil Code: «Article 1384 Civil Code: « On estOn estOn estOn est
responsable non seulement du dommageresponsable non seulement du dommageresponsable non seulement du dommageresponsable non seulement du dommage
que l'on cause par son propre fait, maisque l'on cause par son propre fait, maisque l'on cause par son propre fait, maisque l'on cause par son propre fait, mais
encore de celui qui est causé par le fait desencore de celui qui est causé par le fait desencore de celui qui est causé par le fait desencore de celui qui est causé par le fait des
personnes dont on doit répondre, ou despersonnes dont on doit répondre, ou despersonnes dont on doit répondre, ou despersonnes dont on doit répondre, ou des
choses que l'on a sous sa garde.choses que l'on a sous sa garde.choses que l'on a sous sa garde.choses que l'on a sous sa garde.
[Le père et la mère sont responsables du[Le père et la mère sont responsables du[Le père et la mère sont responsables du[Le père et la mère sont responsables du
dommage causé par leurs enfants mineurs.]dommage causé par leurs enfants mineurs.]dommage causé par leurs enfants mineurs.]dommage causé par leurs enfants mineurs.]
<L 06<L 06<L 06<L 06----07070707----1977, art. 1>1977, art. 1>1977, art. 1>1977, art. 1>
Les maîtres et les commettants, duLes maîtres et les commettants, duLes maîtres et les commettants, duLes maîtres et les commettants, du
dommage causé par leurs domestiques etdommage causé par leurs domestiques etdommage causé par leurs domestiques etdommage causé par leurs domestiques et
préposés dans les fonctions auxquelles ilspréposés dans les fonctions auxquelles ilspréposés dans les fonctions auxquelles ilspréposés dans les fonctions auxquelles ils
les ont employés.les ont employés.les ont employés.les ont employés.
Les instituteurs et les artisans, duLes instituteurs et les artisans, duLes instituteurs et les artisans, duLes instituteurs et les artisans, du
dommage cause par leurs élèves etdommage cause par leurs élèves etdommage cause par leurs élèves etdommage cause par leurs élèves et
apprentis pendant le temps qu'ils sont sousapprentis pendant le temps qu'ils sont sousapprentis pendant le temps qu'ils sont sousapprentis pendant le temps qu'ils sont sous
leur surveillance.leur surveillance.leur surveillance.leur surveillance.
La responsabilité ciLa responsabilité ciLa responsabilité ciLa responsabilité ci----dessus a lieu, à moinsdessus a lieu, à moinsdessus a lieu, à moinsdessus a lieu, à moins
que les père et mère, instituteurs et artisans,que les père et mère, instituteurs et artisans,que les père et mère, instituteurs et artisans,que les père et mère, instituteurs et artisans,
ne prouvent qu'ils n'ont pu empêcher le faitne prouvent qu'ils n'ont pu empêcher le faitne prouvent qu'ils n'ont pu empêcher le faitne prouvent qu'ils n'ont pu empêcher le fait
qui donne lieu à cette responsabilitéqui donne lieu à cette responsabilitéqui donne lieu à cette responsabilitéqui donne lieu à cette responsabilité »»»»

SubordinationSubordinationSubordinationSubordination
HYPO: robot gardener instructed
to optimally protect flowers and
trees; autonomous understanding
that mosquito killing includes
killing the neighbour’s cat who
eats the grass
Bostrom’s smile dystopia
OnOnOnOn the occasion ofthe occasion ofthe occasion ofthe occasion of itsitsitsits functionsfunctionsfunctionsfunctions
HYPO: robot gardener
instructed to keep the grass
green; decides to prevent
visitors from walking on the
grass; throws toxic product at
them
Beyond or within its gardening
functions?
Bostrom’s paperclip hypothesis
Master and principal (article 1384 § 3)
3333 conditionsconditionsconditionsconditions
Subordination;
Fault;
On the occasion of its functions
(+ causality and harm)
CannotCannotCannotCannot bebebebe rebuttedrebuttedrebuttedrebutted
VeryVeryVeryVery strictstrictstrictstrict liabilityliabilityliabilityliability systemsystemsystemsystem

Point of robotsPoint of robotsPoint of robotsPoint of robots isisisis totototo avoidavoidavoidavoid totototo
monitor and tomonitor and tomonitor and tomonitor and to educateeducateeducateeducate
Father and mother (article 1384 § 2)
3 conditions3 conditions3 conditions3 conditions
Father and mother
Harm by minor
Objectively illicit act
(+ causality and harm)
PresumptionPresumptionPresumptionPresumption ofofofof faultfaultfaultfault inininin educationeducationeducationeducation
and surveillanceand surveillanceand surveillanceand surveillance
CanCanCanCan bebebebe rebuttedrebuttedrebuttedrebutted
Proof of both proper surveillance
and education
StrictStrictStrictStrict liabilityliabilityliabilityliability systemsystemsystemsystem
IncentiveIncentiveIncentiveIncentive forforforfor properproperproperproper educationeducationeducationeducation
and surveillance + protection ofand surveillance + protection ofand surveillance + protection ofand surveillance + protection of
victimsvictimsvictimsvictims by provision ofby provision ofby provision ofby provision of solventsolventsolventsolvent
targettargettargettarget

HYPO: robotHYPO: robotHYPO: robotHYPO: robot gardenergardenergardenergardener isisisis not anot anot anot a
deepdeepdeepdeep learninglearninglearninglearning machine, but onemachine, but onemachine, but onemachine, but one
thatthatthatthat needsneedsneedsneeds input andinput andinput andinput and labelinglabelinglabelinglabeling
Teacher and craftsmen (article 1384 § 4)
3 conditions3 conditions3 conditions3 conditions
Student or apprentice
Objectively illicit act
During surveillance time
PresumptionPresumptionPresumptionPresumption ofofofof faultfaultfaultfault inininin
surveillancesurveillancesurveillancesurveillance
CanCanCanCan bebebebe rebuttedrebuttedrebuttedrebutted
StrictStrictStrictStrict liabilityliabilityliabilityliability systemsystemsystemsystem

SocialSocialSocialSocial purposepurposepurposepurpose unclearunclearunclearunclear
ProtectProtectProtectProtect victimsvictimsvictimsvictims bybybyby providingprovidingprovidingproviding
aaaa solventsolventsolventsolvent targettargettargettarget
Liability for « things » under one’s control
GeneralGeneralGeneralGeneral rulerulerulerule ofofofof liabilityliabilityliabilityliability
Things under one’s
control (article 1384 § 1
Civil Code)
Owner or keeper of
animal (article 1385 Civil
Code)
Owner of a building
(article 1386 Civil Code)

LiabililityLiabililityLiabililityLiabilility of the «of the «of the «of the « holderholderholderholder »»»»
TheTheTheThe holderholderholderholder
has power of surveillance,
direction or control; and
uses it for its own benefit
NotNotNotNot necessarilynecessarilynecessarilynecessarily thethethethe ownerownerownerowner
HYPOHYPOHYPOHYPO
You lend the drone to a
neighbor for his own garden?
You lease it on a sharing
economy website?
You carry a robotic prosthesis
which dysfunctions?
« Things »
MovableMovableMovableMovable////unmovableunmovableunmovableunmovable;;;; MannedMannedMannedManned////unmannedunmannedunmannedunmanned
Cars,Cars,Cars,Cars, treestreestreestrees, planes, statues, lifts, planes, statues, lifts, planes, statues, lifts, planes, statues, lifts
NeedNeedNeedNeed totototo proveproveproveprove anananan intrinsicintrinsicintrinsicintrinsic defectdefectdefectdefect (vice(vice(vice(vice):):):):
«««« abnormalabnormalabnormalabnormal featurefeaturefeaturefeature thatthatthatthat makesmakesmakesmakes itititit likelylikelylikelylikely totototo
causecausecausecause injuryinjuryinjuryinjury in certainin certainin certainin certain circumstancescircumstancescircumstancescircumstances »»»»
HYPOHYPOHYPOHYPO
Drone overheats whilst transporting
straws in its basket, which catch fire
=> // with Ccass, 5 June 1998, Pas
1998, I, p.692 v Pas 1971, I, p.391
BurdenBurdenBurdenBurden of proof onof proof onof proof onof proof on claimantclaimantclaimantclaimant
NoNoNoNo defensedefensedefensedefense basedbasedbasedbased onononon factfactfactfact thatthatthatthat vicevicevicevice causedcausedcausedcaused
thirdthirdthirdthird partypartypartyparty misconductmisconductmisconductmisconduct, force majeure or, force majeure or, force majeure or, force majeure or
ignorance ofignorance ofignorance ofignorance of defectdefectdefectdefect
Engineering defect does not exonerate
holder liability
ButButButBut defensedefensedefensedefense if damageif damageif damageif damage exclusivelyexclusivelyexclusivelyexclusively causedcausedcausedcaused
bybybyby thirdthirdthirdthird party/party/party/party/victimvictimvictimvictim misconductmisconductmisconductmisconduct or forceor forceor forceor force
majeuremajeuremajeuremajeure
Third party spilled gas on straws;

Animals
Article 1385 Civil CodeArticle 1385 Civil CodeArticle 1385 Civil CodeArticle 1385 Civil Code
«««« LeLeLeLe propriétaire d'un animal, ou celui qui s'en sert, pendant qu'il est à sonpropriétaire d'un animal, ou celui qui s'en sert, pendant qu'il est à sonpropriétaire d'un animal, ou celui qui s'en sert, pendant qu'il est à sonpropriétaire d'un animal, ou celui qui s'en sert, pendant qu'il est à son
usage, est responsable du dommage que l'animal a causé, soit que l'animalusage, est responsable du dommage que l'animal a causé, soit que l'animalusage, est responsable du dommage que l'animal a causé, soit que l'animalusage, est responsable du dommage que l'animal a causé, soit que l'animal
fût sous sa garde, soit qu'il fût égaré oufût sous sa garde, soit qu'il fût égaré oufût sous sa garde, soit qu'il fût égaré oufût sous sa garde, soit qu'il fût égaré ou échappééchappééchappééchappé ».».».».
OwnerOwnerOwnerOwner orororor keeperkeeperkeeperkeeper
AnimalAnimalAnimalAnimal subjectsubjectsubjectsubject to appropriation,to appropriation,to appropriation,to appropriation, bebebebe itititit aaaa domesticateddomesticateddomesticateddomesticated animal or notanimal or notanimal or notanimal or not
No viceNo viceNo viceNo vice neededneededneededneeded
NonNonNonNon rebuttablerebuttablerebuttablerebuttable presumptionpresumptionpresumptionpresumption
ButButButBut possibilitypossibilitypossibilitypossibility to breakto breakto breakto break causalitycausalitycausalitycausality linklinklinklink, if damage, if damage, if damage, if damage exclusivelyexclusivelyexclusivelyexclusively causedcausedcausedcaused bybybyby
externalexternalexternalexternal eventeventeventevent:::: thirdthirdthirdthird party orparty orparty orparty or victimvictimvictimvictim misconductmisconductmisconductmisconduct
HYPO: visitors trash used cans on grass; drone « senses » visitors as
pollution agents like mosquitos; drone spill toxic pesticides on visitors

Liability of perpetrator (2)
ArticlesArticlesArticlesArticles 1382 and1382 and1382 and1382 and 1383 Civil Code1383 Civil Code1383 Civil Code1383 Civil Code
FaultFaultFaultFault
ButButButBut cancancancan youyouyouyou impute aimpute aimpute aimpute a faultfaultfaultfault to a robot?to a robot?to a robot?to a robot?
MorallyMorallyMorallyMorally????
LegallyLegallyLegallyLegally????
Precedent with corporations
Precedent with impaired persons
L. Solum, « Legal Personhood for Artificial Intelligences », North Carolina
Law Review Vol. 70, 1992, p. 1231-1287: some inanimate object could be
subject of rights and duties: temples, ships (in rem)
Shall trees have standing?

Fault-based liability (aka + or – negligence)
PrinciplesPrinciplesPrinciplesPrinciples
Violation of aViolation of aViolation of aViolation of a legallegallegallegal dutydutydutyduty or of aor of aor of aor of a
rulerulerulerule of goodof goodof goodof good conductconductconductconduct (to(to(to(to bebebebe
expectedexpectedexpectedexpected fromfromfromfrom aaaa reasonablereasonablereasonablereasonable
personpersonpersonperson
ActoriActoriActoriActori incumbitincumbitincumbitincumbit probatioprobatioprobatioprobatio (+(+(+(+
Article 1315Article 1315Article 1315Article 1315 civil code + 870civil code + 870civil code + 870civil code + 870
judicialjudicialjudicialjudicial codecodecodecode))))
The concept ofThe concept ofThe concept ofThe concept of faultfaultfaultfault isisisis assessedassessedassessedassessed inininin
abstracto: «abstracto: «abstracto: «abstracto: « bonus pater familiasbonus pater familiasbonus pater familiasbonus pater familias »»»»
«««« ExonerationExonerationExonerationExoneration causescausescausescauses » (» (» (» (faultfaultfaultfault
prongprongprongprong) or «) or «) or «) or « externalexternalexternalexternal causescausescausescauses »»»»
((((causalitycausalitycausalitycausality prongprongprongprong))))
Fault of the victim
The cat trespassed; the tourist
stepped into an area marked as
dangerous
PracticePracticePracticePractice
MoreMoreMoreMore demandingdemandingdemandingdemanding forforforfor victimsvictimsvictimsvictims
thanthanthanthan liabilityliabilityliabilityliability onononon
ownerownerownerowner////keeperkeeperkeeperkeeper/user/user/user/user

Conclusion
OwnerOwnerOwnerOwner////keeperkeeperkeeperkeeper/user/user/user/user
imputabilityimputabilityimputabilityimputability
VeryVeryVeryVery protective ofprotective ofprotective ofprotective of victimvictimvictimvictim
NotNotNotNot necessarilynecessarilynecessarilynecessarily aptaptaptapt totototo achieveachieveachieveachieve
deterrencedeterrencedeterrencedeterrence purposepurposepurposepurpose ofofofof liabilityliabilityliabilityliability lawlawlawlaw
LittleLittleLittleLittle basedbasedbasedbased on control of robot oron control of robot oron control of robot oron control of robot or
AIAIAIAI
LimitedLimitedLimitedLimited exonerationexonerationexonerationexoneration ((((causalitycausalitycausalitycausality
prongprongprongprong mostlymostlymostlymostly))))
PerversePerversePerversePerverse effectseffectseffectseffects on innovationon innovationon innovationon innovation
incentivesincentivesincentivesincentives? =>? =>? =>? => killskillskillskills marketmarketmarketmarket for thefor thefor thefor the
purchasepurchasepurchasepurchase of robotsof robotsof robotsof robots
Mitigated with insuranceMitigated with insuranceMitigated with insuranceMitigated with insurance
requirements?requirements?requirements?requirements?
Policy of NeoTech Assurances
OptionalOptionalOptionalOptional orororor compulsorycompulsorycompulsorycompulsory
MarketMarketMarketMarket sizesizesizesize----relatedrelatedrelatedrelated????
Robolaw: driverless cars
(optional?); robotic prostheses
(mandatory?)
RobotRobotRobotRobot imputabilityimputabilityimputabilityimputability
FaultFaultFaultFault----basedbasedbasedbased liabilityliabilityliabilityliability
CouldCouldCouldCould achieveachieveachieveachieve deterrencedeterrencedeterrencedeterrence, for, for, for, for
robots androbots androbots androbots and AIsAIsAIsAIs cancancancan
Make cost-benefit analyzis
Be taught some legal and
moral principles: bonus pater
familias
But notBut notBut notBut not practicalpracticalpracticalpractical????
Robots need registration and
to have property (capital
endowment)
Swedish car insurance system

Additional rules: Product Liability Law
Directive 85/374/EECDirective 85/374/EECDirective 85/374/EECDirective 85/374/EEC onononon liabilityliabilityliabilityliability forforforfor defectivedefectivedefectivedefective
productsproductsproductsproducts;;;;
Loi du 25 février 1991, relative à la responsabilité duLoi du 25 février 1991, relative à la responsabilité duLoi du 25 février 1991, relative à la responsabilité duLoi du 25 février 1991, relative à la responsabilité du
fait des produits défectueuxfait des produits défectueuxfait des produits défectueuxfait des produits défectueux

Recitals of PLL Directive
“liability without fault on the part of the producer is the sole means of
adequately solving the problem, peculiar to our age of increasing technicality, of
a fair apportionment of the risks inherent in modern technological production”
“All producers involved in the production process” including “importers”
If products “lack of the safety which the public at large is entitled to expect”,
“excluding any misuse of the product not reasonable under the circumstances”
Rebuttable if “exonerating circumstances” but no third party excuse except
victim’s “contributory negligence”
“consumer requires compensation for death and personal injury as well as
compensation for damage to property”
“an injured party may have a claim for damages based on grounds of contractual
liability or on grounds of non-contractual liability other than that provided for
in this Directive”
Defense based on “the state of scientific and technical knowledge” can be
prohibited by national law, but standstill for new legislation
No ceiling on producer financial liability

Provisions of PLL Directive (1)
Article 1: TheArticle 1: TheArticle 1: TheArticle 1: The producerproducerproducerproducer shallshallshallshall bebebebe liable (Article 1 BEL)liable (Article 1 BEL)liable (Article 1 BEL)liable (Article 1 BEL)
Article 2: allArticle 2: allArticle 2: allArticle 2: all movablesmovablesmovablesmovables
Article 4: proof of damage,Article 4: proof of damage,Article 4: proof of damage,Article 4: proof of damage, defectdefectdefectdefect and causaland causaland causaland causal connectionconnectionconnectionconnection onononon injuredinjuredinjuredinjured personpersonpersonperson
(Article 7 BEL)(Article 7 BEL)(Article 7 BEL)(Article 7 BEL)
Article 6:Article 6:Article 6:Article 6: defectdefectdefectdefect meansmeansmeansmeans thatthatthatthat productproductproductproduct ““““doesdoesdoesdoes notnotnotnot provideprovideprovideprovide thethethethe safety which asafety which asafety which asafety which a
person is entitled toperson is entitled toperson is entitled toperson is entitled to expectexpectexpectexpect” => amongst other things, “” => amongst other things, “” => amongst other things, “” => amongst other things, “useuseuseuse to which it couldto which it couldto which it couldto which it could
reasonably bereasonably bereasonably bereasonably be expected thatexpected thatexpected thatexpected that the product would bethe product would bethe product would bethe product would be putputputput” (Article 5 BEL)” (Article 5 BEL)” (Article 5 BEL)” (Article 5 BEL)
HYPO revisedHYPO revisedHYPO revisedHYPO revised
User usesUser usesUser usesUser uses the drone to take group pictures ofthe drone to take group pictures ofthe drone to take group pictures ofthe drone to take group pictures of friends;friends;friends;friends;
Drone explodesDrone explodesDrone explodesDrone explodes
InjuryInjuryInjuryInjury
NotNotNotNot the initial purpose of thethe initial purpose of thethe initial purpose of thethe initial purpose of the drone?drone?drone?drone?
Very limited exoneration: did not put the product into circulation, mandatoryVery limited exoneration: did not put the product into circulation, mandatoryVery limited exoneration: did not put the product into circulation, mandatoryVery limited exoneration: did not put the product into circulation, mandatory
compliance with rule of law, scientific or technical state of the artcompliance with rule of law, scientific or technical state of the artcompliance with rule of law, scientific or technical state of the artcompliance with rule of law, scientific or technical state of the art
Article 8(2): Producer liability can only be reduced if defect + fault of injuredArticle 8(2): Producer liability can only be reduced if defect + fault of injuredArticle 8(2): Producer liability can only be reduced if defect + fault of injuredArticle 8(2): Producer liability can only be reduced if defect + fault of injured
victim or person for whom he is responsible (Article 10victim or person for whom he is responsible (Article 10victim or person for whom he is responsible (Article 10victim or person for whom he is responsible (Article 10§§§§2 BEL)2 BEL)2 BEL)2 BEL)

Provisions of PLL Directive (2)
Article 9:Article 9:Article 9:Article 9: ““““damagedamagedamagedamage caused by death or by personalcaused by death or by personalcaused by death or by personalcaused by death or by personal injuriesinjuriesinjuriesinjuries” or “” or “” or “” or “to propertyto propertyto propertyto property””””
HYPO revised: drone takes photographs of neighbor producer beating itsHYPO revised: drone takes photographs of neighbor producer beating itsHYPO revised: drone takes photographs of neighbor producer beating itsHYPO revised: drone takes photographs of neighbor producer beating its
dog, and posts it on socialdog, and posts it on socialdog, and posts it on socialdog, and posts it on social networksnetworksnetworksnetworks
But Article 11But Article 11But Article 11But Article 11§§§§1 BEL: “1 BEL: “1 BEL: “1 BEL: “dommagesdommagesdommagesdommages"""" causés aux personnes,causés aux personnes,causés aux personnes,causés aux personnes, ““““yyyy compris lescompris lescompris lescompris les
dommagesdommagesdommagesdommages morauxmorauxmorauxmoraux””””
Article 13:Article 13:Article 13:Article 13: ““““ThisThisThisThis Directive shall not affect any rights whichDirective shall not affect any rights whichDirective shall not affect any rights whichDirective shall not affect any rights which an injuredan injuredan injuredan injured personpersonpersonperson
may have according to the rules ofmay have according to the rules ofmay have according to the rules ofmay have according to the rules of the lawthe lawthe lawthe law of contractual or nonof contractual or nonof contractual or nonof contractual or non----contractualcontractualcontractualcontractual
liability orliability orliability orliability or aaaa specialspecialspecialspecial liabilityliabilityliabilityliability systemsystemsystemsystem””””
Article 16: possible ceiling for damages for death or personal injury, up toArticle 16: possible ceiling for damages for death or personal injury, up toArticle 16: possible ceiling for damages for death or personal injury, up toArticle 16: possible ceiling for damages for death or personal injury, up to
€€€€70 millions70 millions70 millions70 millions
Article 27: no possibility to exclude liability by contractArticle 27: no possibility to exclude liability by contractArticle 27: no possibility to exclude liability by contractArticle 27: no possibility to exclude liability by contract

HYPO revised
Not aNot aNot aNot a privateprivateprivateprivate gardengardengardengarden, but a, but a, but a, but a vineyardvineyardvineyardvineyard
PLLPLLPLLPLL onlyonlyonlyonly forforforfor consumersconsumersconsumersconsumers
Drone spreadsDrone spreadsDrone spreadsDrone spreads toxictoxictoxictoxic pesticide onpesticide onpesticide onpesticide on visitorsvisitorsvisitorsvisitors takingtakingtakingtaking a tour in thea tour in thea tour in thea tour in the
vineyardvineyardvineyardvineyard
Back in Article 1384 Civil Code area
DroneDroneDroneDrone usedusedusedused totototo spyspyspyspy onononon neighbour’sneighbour’sneighbour’sneighbour’s techniquestechniquestechniquestechniques
Other regimes, including unfair trading practices

Assessment into context
ManufacturerManufacturerManufacturerManufacturer liabilityliabilityliabilityliability
LiabilityLiabilityLiabilityLiability withoutwithoutwithoutwithout faultfaultfaultfault
VeryVeryVeryVery strictstrictstrictstrict liabilityliabilityliabilityliability
PrimaryPrimaryPrimaryPrimary goalgoalgoalgoal isisisis correctivecorrectivecorrectivecorrective
ComplementedComplementedComplementedComplemented by the General Productby the General Productby the General Productby the General Product SafetySafetySafetySafety Directive,Directive,Directive,Directive, whichwhichwhichwhich isisisis
moremoremoremore preventivepreventivepreventivepreventive andandandand seeksseeksseeksseeks totototo avoidavoidavoidavoid orororor mitigatemitigatemitigatemitigate harmharmharmharm causedcausedcausedcaused bybybyby
manufacturersmanufacturersmanufacturersmanufacturers inininin theirtheirtheirtheir productsproductsproductsproducts
General duty of information on normal or foreseeable risks
General duty of warning
ConcernConcernConcernConcern ofofofof chillingchillingchillingchilling effecteffecteffecteffect on innovation if PLLon innovation if PLLon innovation if PLLon innovation if PLL isisisis extendedextendedextendedextended
accrossaccrossaccrossaccross manymanymanymany sectorssectorssectorssectors, as automation, as automation, as automation, as automation unravelsunravelsunravelsunravels

What the basic legal structure achieves
MultiplicityMultiplicityMultiplicityMultiplicity ofofofof potentialpotentialpotentialpotential regimesregimesregimesregimes are applicableare applicableare applicableare applicable
NoNoNoNo legallegallegallegal desertdesertdesertdesert!!!!
MostMostMostMost likelylikelylikelylikely totototo taketaketaketake placeplaceplaceplace underunderunderunder Article 1384 Civil Code inArticle 1384 Civil Code inArticle 1384 Civil Code inArticle 1384 Civil Code in
relation torelation torelation torelation to thingsthingsthingsthings andandandand underunderunderunder PLLPLLPLLPLL
LessLessLessLess likelylikelylikelylikely totototo occuroccuroccuroccur underunderunderunder Article 1382 and 1383 Civil CodeArticle 1382 and 1383 Civil CodeArticle 1382 and 1383 Civil CodeArticle 1382 and 1383 Civil Code
BothBothBothBoth regimesregimesregimesregimes setsetsetset veryveryveryvery strictstrictstrictstrict liabilityliabilityliabilityliability systemssystemssystemssystems
For consumer goods, imputability on manufacturer
For non consumer goods, imputability on owner/user
LiabilityLiabilityLiabilityLiability bothbothbothboth onononon supplysupplysupplysupply andandandand demanddemanddemanddemand sidesidesideside

Regulation? Systemic Externalities

The issue
DoesDoesDoesDoes the basicthe basicthe basicthe basic legallegallegallegal structurestructurestructurestructure –––– existingexistingexistingexisting liabilityliabilityliabilityliability lawlawlawlaw –––– limitslimitslimitslimits thethethethe
production ofproduction ofproduction ofproduction of sociallysociallysociallysocially beneficialbeneficialbeneficialbeneficial technologytechnologytechnologytechnology? =>? =>? =>? => chillingchillingchillingchilling effecteffecteffecteffect
on innovation (1)on innovation (1)on innovation (1)on innovation (1)
DoesDoesDoesDoes the basicthe basicthe basicthe basic legallegallegallegal structurestructurestructurestructure –––– existingexistingexistingexisting liabilityliabilityliabilityliability lawlawlawlaw –––– promotespromotespromotespromotes
the production ofthe production ofthe production ofthe production of unsafeunsafeunsafeunsafe technologytechnologytechnologytechnology? =>? =>? =>? => safetysafetysafetysafety measuresmeasuresmeasuresmeasures (2)(2)(2)(2)

1. Chilling effect on innovation
Appeals to limit liability, as a way both to boost innovation in the robotic
industry, by reducing the fears of liability-related costs (Calo, 2011)
Calls for robots electronic personhood (Leroux et al, 2012)
Would be registered and hold an asset in order to compensate for
damages
Would ensure the “bundling of all the legal responsibilities of the various
parties (users, sellers, producers, etc…)”.
“Sum of money would be raised from producers and users alike, and
would be collected before the machine would be put into use”
Strict liability of owner, with cap: owner benefits from introduction of
technology, and victim faces tough causality problem (Decker, 2014)

Ryan Calo, « Open Robotics », 2011
Distinction btw closed and open robots
Closed robots are designed to perform a set task: // dishwasher
Open robots invite third party contribution: multifunction, open to all
software, hardware modularity
According to Calo, « open robots » are more « generative » in terms of
innovation
But, “open robotics may expose robotics platform manufacturers and
distributors to legal liability for accidents in a far wider set of scenarios than
closed robotics”
Roomba example: vacuums up and kills an animal
Manufacturer liability if Roomba causes injury in its normal use
If product misuse – attempt to use Roomba as pet locomotion device – no
manufacturer liability
With open robots: no product misuse defense for the robot is not designed
to perform predetermined tasks

The problem
Disincentive to investments in (open) robotics
markets
“Early adopters of robotics are likely to be populations
such as the elderly or disabled that need in-home
assistance. Other early applications have involved
helping autistic children. These populations would
make understandably sympathetic plaintiffs in the
event of litigation”
(http://cyberlaw.stanford.edu/blog/2009/11/robotic
s-law-liability-personal-robots)

Selective immunity
Immunizing manufacturers of open robotic platforms from
damages lawsuits arising out of users’ implementation of
robots, at least temporarily;
Precedent in aviation industry, crippled by litigation under PLL
=> General Aviation Revitalization Act (“GARA”) of 1994
// immunity enjoyed by firearms manufacturers and website
operators
Websites not liable for users’ postings (re. defamation, for
instance)
Selective immunity: “presumption against suit unless the
plaintiff can show the problem was clearly related to the
platform’s design”

Insurance question
OftenOftenOftenOften referredreferredreferredreferred to asto asto asto as liabilityliabilityliabilityliability ex anteex anteex anteex ante
InsuranceInsuranceInsuranceInsurance isisisis likelylikelylikelylikely totototo emergeemergeemergeemerge on largeon largeon largeon large marketsmarketsmarketsmarkets::::
driverlessdriverlessdriverlessdriverless carscarscarscars
Volvo and Google accept liability
http://www.roboticstrends.com/article/volvo_well_
accept_liability_in_self_driving_car_accidents
InsuranceInsuranceInsuranceInsurance lesslesslessless likelylikelylikelylikely totototo emergeemergeemergeemerge onononon thinthinthinthin marketsmarketsmarketsmarkets::::
roboticroboticroboticrobotic prosthesesprosthesesprosthesesprostheses? => must? => must? => must? => must bebebebe mademademademade mandatorymandatorymandatorymandatory????

2. Safety measures
PrivatePrivatePrivatePrivate orderingorderingorderingordering mechanismsmechanismsmechanismsmechanisms
International Standardization organs (ISO, IEC)
ISO/TS 15066:2016(en), Robots and robotic devices —
Collaborative robots
EU organizations (CEN, CENELEC)
ManyManyManyMany EUEUEUEU rulesrulesrulesrules onononon machinerymachinerymachinerymachinery andandandand productproductproductproduct safetysafetysafetysafety
Example: Directive 2006/42/EC of the European
Parliament and the Council of 17 May 2006 on
machinery

Coase Theorem
HYPOHYPOHYPOHYPO
A uses robot gardener at night, when water and
electricity cost less
Neighbour B moves in, creates a boutique hotel
With noise at night, B’s clients flee in droves
Who should be liable for injury?
Standard legal solution: A liable to compensate
externality
But at the same time, it is B that creates harm if A is
forbidden to use its robot gardener simply bc the former
moved
Coase argues that who is liable is to some extent
irrelevant: as long as no transaction costs and property
rights well defined, parties will bargain the efficient
solution

ThisThisThisThis isisisis onlyonlyonlyonly possible absent transactionpossible absent transactionpossible absent transactionpossible absent transaction
costscostscostscosts,,,, ieieieie whenwhenwhenwhen itititit isisisis easyeasyeasyeasy totototo negotiatenegotiatenegotiatenegotiate
OftenOftenOftenOften not the case in the real worldnot the case in the real worldnot the case in the real worldnot the case in the real world
AAAA isisisis aaaa cooperativecooperativecooperativecooperative of multipleof multipleof multipleof multiple ownersownersownersowners,,,,
whowhowhowho areareareare nevernevernevernever presentpresentpresentpresent, for, for, for, for theirtheirtheirtheir
agricultural exploitationagricultural exploitationagricultural exploitationagricultural exploitation isisisis fullyfullyfullyfully
automatedautomatedautomatedautomated:::: searchsearchsearchsearch costscostscostscosts andandandand negotiationnegotiationnegotiationnegotiation
costscostscostscosts
BBBB wouldwouldwouldwould contemplatecontemplatecontemplatecontemplate installinginstallinginstallinginstalling doubledoubledoubledouble
glazingglazingglazingglazing:::: €€€€10,00010,00010,00010,000 losslosslossloss
Not theNot theNot theNot the cheapestcheapestcheapestcheapest costcostcostcost solutionsolutionsolutionsolution
WhenWhenWhenWhen theretheretherethere are transactionare transactionare transactionare transaction costscostscostscosts,,,, lawlawlawlaw
shouldshouldshouldshould assignassignassignassign liabilityliabilityliabilityliability sosososo as toas toas toas to achieveachieveachieveachieve
thethethethe cheapestcheapestcheapestcheapest costcostcostcost solutionsolutionsolutionsolution thatthatthatthat wouldwouldwouldwould
have beenhave beenhave beenhave been foundfoundfoundfound inininin negotiationnegotiationnegotiationnegotiation
AAAA isisisis liableliableliableliable
NegativeNegativeNegativeNegative externalityexternalityexternalityexternality inflictedinflictedinflictedinflicted bybybyby
regulatoryregulatoryregulatoryregulatory systemsystemsystemsystem shouldshouldshouldshould bebebebe asasasas littlelittlelittlelittle
efficiencyefficiencyefficiencyefficiency harmfulharmfulharmfulharmful asasasas possiblepossiblepossiblepossible
Cheapest cost solution principle
OptionsOptionsOptionsOptions
A sends robot for mechanical
update so it makes less noise:
5,000€
B installs double glazing: extra
€15,000.00
SolutionSolutionSolutionSolution
Efficient social solution is that
robot gardener is retooled
This happens regardless of
liability assignement
If town hall assigns B right to
control noise, A will pay 5,000€
to retool bot
If town hall assigns A right to
noise, B will pay to A 5,000€ to
retool bot
In both cases, the efficient
solution is followed, regardless
of who is liable

Application to robotics
Invites toInvites toInvites toInvites to researchresearchresearchresearch whatwhatwhatwhat isisisis thethethethe cheapestcheapestcheapestcheapest costcostcostcost solutionsolutionsolutionsolution
Not oneNot oneNot oneNot one obviousobviousobviousobvious culpritculpritculpritculprit,,,, avoidavoidavoidavoid moralmoralmoralmoral biasbiasbiasbias
A, B orA, B orA, B orA, B or someonesomeonesomeonesomeone elseelseelseelse????

Liability on the creator/programmer?
Robot manufacturer to encodeRobot manufacturer to encodeRobot manufacturer to encodeRobot manufacturer to encode ex anteex anteex anteex ante robot prohibition torobot prohibition torobot prohibition torobot prohibition to
operateoperateoperateoperate at night?at night?at night?at night?
One line of code: 1One line of code: 1One line of code: 1One line of code: 1€€€€????
If all the Bs ofIf all the Bs ofIf all the Bs ofIf all the Bs of thisthisthisthis worldworldworldworld couldcouldcouldcould negotiatenegotiatenegotiatenegotiate freelyfreelyfreelyfreely,,,, theytheytheythey wouldwouldwouldwould
contact all robotcontact all robotcontact all robotcontact all robot gardenergardenergardenergardener producersproducersproducersproducers andandandand askaskaskask themthemthemthem to encodeto encodeto encodeto encode
thisthisthisthis prohibitionprohibitionprohibitionprohibition
Not possibleNot possibleNot possibleNot possible
LegalLegalLegalLegal system tosystem tosystem tosystem to holdholdholdhold robotrobotrobotrobot producersproducersproducersproducers liable if noiseliable if noiseliable if noiseliable if noise harmharmharmharm atatatat
nightnightnightnight
But botsBut botsBut botsBut bots wouldwouldwouldwould bebebebe lesslesslessless valuablevaluablevaluablevaluable forforforfor buyersbuyersbuyersbuyers, and, and, and, and pricepricepriceprice systemsystemsystemsystem
wouldwouldwouldwould correctcorrectcorrectcorrect thisthisthisthis????

References
R.R.R.R. CoaseCoaseCoaseCoase,,,, ““““TheTheTheThe ProblemProblemProblemProblem of Socialof Socialof Socialof Social CostCostCostCost””””, 3, 3, 3, 3 JJJJ. Law &. Law &. Law &. Law & Econ.Econ.Econ.Econ. [1960][1960][1960][1960]
R. Coase, “TheR. Coase, “TheR. Coase, “TheR. Coase, “The Federal CommunicationsFederal CommunicationsFederal CommunicationsFederal Communications Commission”,Commission”,Commission”,Commission”, 2222 J. Law &J. Law &J. Law &J. Law &
Econ.Econ.Econ.Econ. [[[[1959195919591959]]]]

LiegeLiegeLiegeLiege CompetitionCompetitionCompetitionCompetition and Innovation Institute (LCII)and Innovation Institute (LCII)and Innovation Institute (LCII)and Innovation Institute (LCII)
University of Liege (ULg)
Quartier Agora | Place des Orateurs, 1, Bât. B 33, 4000 Liege, BELGIUM

Introduction to the law of robots and AIs - lecture 5

Recommended

Recommended

More Related Content

What's hot

What's hot (9)

Similar to Introduction to the law of robots and AIs - lecture 5

Similar to Introduction to the law of robots and AIs - lecture 5 (20)

More from Nicolas Petit

More from Nicolas Petit (12)

Recently uploaded

Recently uploaded (20)

Introduction to the law of robots and AIs - lecture 5