SlideShare a Scribd company logo
1 of 19
Download to read offline
From	
  Seman*c	
  Parsing	
  to	
  Reasoning	
  
	
  	
  	
  	
  Lenhart	
  Schubert	
  	
  
University	
  of	
  Rochester	
  
Overall	
  objec*ve:	
  
	
  	
  	
  	
  	
  	
  Broad,	
  genuine	
  language	
  understanding,	
  allowing	
  reasoning	
  
	
  	
  	
  	
  	
  	
  (beyond	
  answer	
  extrac6on	
  or	
  classifica6on);	
  
My	
  view	
  of	
  intelligent	
  ac*vity:	
  
• 	
  	
  Pa6ern	
  matching/recogni:on	
  
• 	
  	
  Pa6ern	
  transduc:on	
  (template-­‐to-­‐template,	
  or	
  tree-­‐to-­‐tree)	
  
• 	
  	
  Learning	
  (and	
  associa:ve	
  storage/retrieval)	
  of	
  pa6erns	
  and	
  transduc:ons	
  
But	
  animals	
  do	
  this	
  	
  -­‐-­‐	
  how	
  are	
  we	
  special?	
  
	
  	
  	
  	
  	
  	
  	
  	
  We	
  have	
  the	
  ability	
  to	
  learn,	
  store,	
  manipulate,	
  &	
  communicate	
  
	
  	
  	
  	
  	
  	
  	
  	
  meaningful	
  symbolic	
  pa6erns	
  –	
  seman:c/knowledge	
  representa:ons	
  
Issues:	
  
• 	
  	
  	
  What	
  sorts	
  of	
  seman:c	
  representa:ons	
  do	
  we	
  need	
  for	
  broad	
  NLU?	
  
• 	
  	
  	
  How	
  can	
  we	
  derive	
  reliable	
  ini:al	
  logical	
  forms	
  (LFs)?	
  
• 	
  	
  	
  What	
  sorts	
  of	
  background	
  knowledge	
  do	
  we	
  require?	
  
• 	
  	
  	
  What	
  sorts	
  of	
  inference	
  methods	
  are	
  required	
  to	
  enable	
  human-­‐like	
  
	
  	
  	
  	
  	
  understanding	
  and	
  reasoning?	
  
• 	
  	
  	
  How	
  we	
  can	
  acquire	
  the	
  necessary	
  knowledge?	
  
 	
  	
  	
  	
  	
  	
  An	
  Example	
  of	
  genuine	
  understanding	
  and	
  reasoning	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Alicia	
  drove	
  home	
  from	
  her	
  holiday	
  visit	
  to	
  the	
  US.	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  What	
  border(s)	
  did	
  she	
  cross	
  in	
  her	
  drive?	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Visi%ng	
  a	
  place	
  generally	
  entails	
  having	
  one's	
  current	
  place	
  of	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  residence	
  away	
  from	
  that	
  place,	
  going	
  to	
  it,	
  staying	
  there	
  in	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  the	
  expecta%on	
  of	
  some	
  immediate	
  rewards,	
  and	
  then	
  leaving	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  it,	
  typically	
  going	
  back	
  to	
  one's	
  place	
  of	
  residence.	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  “Home”	
  is	
  a	
  person's	
  permanent	
  place	
  of	
  residence.	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  The	
  US	
  is	
  a	
  country,	
  and	
  leaving	
  a	
  country	
  entails	
  crossing	
  its	
  border.	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Driving	
  takes	
  place	
  on	
  land.	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  The	
  only	
  land	
  borders	
  of	
  the	
  US	
  are	
  with	
  Canada	
  and	
  Mexico.	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  Along	
  with	
  lexical	
  and	
  paraphrase	
  knowledge	
  #
Alicia	
  crossed	
  the	
  border	
  with	
  Canada	
  OR	
  Mexico	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (and	
  perhaps	
  others,	
  e.g.,	
  from	
  Mexico	
  into	
  Guatemala).	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  Also,	
  it's	
  quite	
  possible	
  that	
  Alicia	
  is	
  a	
  resident	
  of	
  Canada	
  or	
  Mexico,	
  	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  and	
  that	
  she	
  is	
  a	
  ci:zen	
  of	
  one	
  of	
  those	
  countries.	
  
A	
  (s6ll)	
  more	
  demanding	
  example	
  
	
  When	
  Randy	
  learned	
  that	
  his	
  metasta:c	
  cancer	
  was	
  terminal,	
  he	
  decided	
  to	
  stop	
  receiving	
  
	
  chemotherapy	
  and	
  enrol	
  in	
  a	
  hospice	
  program	
  designed	
  to	
  provide	
  pallia:ve	
  care.	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  Why	
  did	
  Randy	
  decide	
  this?	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
   When	
  you	
  learn	
  something,	
  you	
  then	
  know	
  it;	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (so	
  Randy	
  knew	
  he	
  had	
  terminal	
  metasta%c	
  cancer);	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  When	
  someone	
  learns	
  (or	
  knows)	
  that	
  something	
  is	
  the	
  case,	
  it	
  is	
  indeed	
  the	
  case;	
  	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (so	
  Randy	
  had	
  terminal	
  metasta%c	
  cancer).	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Terminal	
  metasta*c	
  cancer	
  is	
  usually	
  fatal	
  within	
  a	
  few	
  months;	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (thus	
  Randy	
  was	
  des%ned	
  to	
  die	
  within	
  a	
  few	
  months);	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Chemotherapy	
  is	
  intended	
  to	
  combat	
  cancer	
  and	
  prolong	
  life,	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  but	
  results	
  in	
  suffering	
  and	
  weakness;	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  No	
  medical	
  treatment	
  will	
  significantly	
  prolong	
  a	
  terminal	
  cancer	
  pa*ent's	
  life;	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  chemotherapy	
  is	
  a	
  medical	
  treatment;	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Stopping	
  something	
  entails	
  it	
  was	
  going	
  on;	
  	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (so	
  Randy	
  had	
  been	
  receiving	
  chemotherapy,	
  and	
  therefore	
  had	
  endured	
  suffering);	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Receiving	
  pallia*ve	
  care	
  reduces	
  pain	
  and	
  discomfort;	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Enrolling	
  in	
  a	
  program	
  to	
  provide	
  certain	
  services	
  will	
  lead	
  to	
  receiving	
  those	
  services;	
  	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (so	
  Randy	
  would	
  receive	
  pallia%ve	
  care);	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  If	
  Randy	
  con%nued	
  receiving	
  chemotherapy,	
  he	
  would	
  endure	
  further	
  suffering	
  	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  without	
  significant	
  life	
  extension,	
  while	
  pallia%ve	
  care	
  would	
  make	
  him	
  feel	
  bePer;	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  People	
  act	
  to	
  op*mize	
  expected	
  rewards	
  and	
  minimize	
  suffering;	
  
	
  	
  	
  so	
  if	
  Randy	
  knew	
  all	
  of	
  the	
  above,	
  his	
  choice	
  of	
  pallia:ve	
  care	
  instead	
  of	
  chemotherapy	
  is	
  explained.	
  
 Example	
  con6nued	
  
How	
  did	
  Randy	
  know	
  all	
  this?	
  	
  
	
  	
  Commonsense	
  inferences	
  that	
  "jump	
  out”	
  at	
  me	
  also	
  "jump	
  out"	
  at	
  others	
  	
  
	
  	
  	
  	
  (who	
  possess	
  the	
  same	
  premise	
  knowledge)	
  –	
  “simula:ve	
  inference”	
  
	
  	
  All	
  the	
  items	
  above	
  are	
  common	
  knowledge	
  (especially	
  to	
  cancer	
  pa%ents),	
  
	
  	
  	
  	
  so	
  the	
  indicated	
  inferences	
  were	
  just	
  as	
  obvious	
  to	
  Randy	
  as	
  they	
  are	
  to	
  me;	
  	
  
	
  	
  So	
  the	
  presump%on	
  previously	
  underscored	
  (Randy	
  knew/inferred	
  all	
  those	
  facts)	
  
	
  	
  	
  	
  surely	
  holds,	
  and	
  Randy's	
  choice	
  is	
  explained.	
  
(Again,	
  we're	
  also	
  presupposing	
  a	
  lot	
  of	
  lexical	
  &	
  paraphrase	
  knowledge:	
  
“terminal”	
  illness,	
  “fatal”	
  condi%on,	
  “medical	
  treatment”,	
  “pallia%ve	
  care”,	
  
“op%mize”,	
  “life	
  extension”,	
  “suffering”,	
  etc.)	
  
 Expressive	
  devices	
  encountered	
  in	
  the	
  two	
  examples:	
  
	
  	
  	
  	
  	
  Predica:on,	
  of	
  course	
  (Alicia	
  visited	
  the	
  US,	
  the	
  US	
  is	
  a	
  country,	
  
	
  	
  	
  	
  	
  	
  	
  and	
  so	
  on)	
  
	
  	
  	
  	
  	
  Temporally	
  related	
  events	
  (driving	
  somewhere,	
  staying,	
  returning)	
  
	
  	
  	
  	
  	
  	
  	
  and	
  their	
  implicit	
  consequences	
  (crossing	
  borders,	
  enjoyment)	
  
	
  	
  	
  	
  	
  Causal	
  rela:ons	
  	
  (chemotherapy	
  causes	
  suffering,	
  possible	
  life	
  prolonga%on)	
  
	
  	
  	
  	
  	
  Geographic	
  rela:onships	
  (perhaps	
  dependent	
  on	
  "mental	
  maps")	
  
	
  	
  	
  	
  	
  Conjunc:on	
  and	
  disjunc:on	
  (the	
  US	
  borders	
  on	
  Canada	
  and	
  Mexico;	
  
	
  	
  	
  	
  	
  	
  	
  Alicia	
  drove	
  into	
  Canada	
  or	
  Mexico)	
  
	
  	
  	
  	
  	
  Nega:on	
  (if	
  you	
  leave	
  a	
  place,	
  you	
  are	
  then	
  not	
  in	
  that	
  place;	
  
	
  	
  	
  	
  	
  	
  	
  not	
  receiving	
  significant	
  benefits	
  from	
  chemotherapy)	
  
	
  	
  	
  	
  	
  Quan:fica:on	
  (almost	
  everyone	
  knows	
  that	
  chemotherapy	
  is	
  used	
  
	
  	
  	
  	
  	
  	
  	
  to	
  treat	
  cancer;	
  no	
  medical	
  treatment	
  will	
  significantly	
  prolong	
  
	
  	
  	
  	
  	
  	
  	
  a	
  terminal	
  cancer	
  pa%ent's	
  life;	
  
And	
  that’s	
  not	
  all	
  …	
  
Further	
  demands	
  on	
  expressivity	
  	
  	
  	
  
	
  	
  	
  	
  	
  	
  Genericity	
  -­‐-­‐	
  almost	
  all	
  the	
  general	
  knowledge	
  listed	
  has	
  the	
  character	
  of	
  applying	
  	
  
	
  	
  	
  	
  	
  	
  	
  	
  in	
  “typical”	
  cases,	
  	
  but	
  allowing	
  for	
  excep:ons;	
  
	
  	
  	
  	
  	
  	
  Pa6erns	
  of	
  behavior	
  (holiday	
  trips;	
  	
  the	
  usual	
  course	
  of	
  events	
  if	
  you	
  get	
  cancer);	
  	
  
	
  	
  	
  	
  	
  	
  	
  	
  this	
  is	
  of	
  course	
  generic	
  	
  knowledge;	
  
	
  	
  	
  	
  	
  	
  Modal/mental	
  no:ons	
  	
  (learning,	
  knowing,	
  expec:ng,	
  deciding,	
  inferring,	
  intending,	
  …)	
  
	
  	
  	
  	
  	
  	
  Counterfactuals	
  (deciding	
  against	
  something	
  because	
  of	
  the	
  adverse	
  consequences	
  
	
  	
  	
  	
  	
  	
  	
  	
  it	
  would	
  have);	
  
	
  	
  	
  	
  	
  	
  Uncertainty	
  	
  (Alicia's	
  probable	
  home	
  country,	
  Randy's	
  life	
  expectancy)	
  
	
  	
  	
  	
  	
  	
  Predicate	
  modifica:on	
  	
  (terminal	
  metasta:c	
  cancer,	
  pallia:ve	
  care,	
  con:nuing/stopping	
  	
  
	
  	
  	
  	
  	
  	
  	
  	
  receiving	
  	
  chemotherapy,	
  	
  feel	
  bePer)	
  
	
  	
  	
  	
  	
  	
  Sentence	
  modifica:on	
  (probably,	
  Alicia	
  lives	
  in	
  Canada	
  or	
  in	
  Mexico;	
  possibly	
  she	
  lives	
  in	
  	
  	
  
	
  	
  	
  	
  	
  	
  	
  	
  Guatemala)	
  
	
  	
  	
  	
  	
  	
  Predicate	
  reifica:on	
  (driving	
  takes	
  place	
  on	
  land;	
  pallia:ve	
  care	
  reduces	
  suffering)	
  
	
  	
  	
  	
  	
  	
  Sentence	
  reifica:on	
  (Randy	
  learned	
  that	
  his	
  metasta:c	
  cancer	
  was	
  terminal)	
  
Are	
  any	
  of	
  these	
  devices	
  peculiar	
  to	
  English?	
  
These	
  devices	
  are	
  available	
  in	
  all	
  languages!	
  	
  
(A	
  cultural	
  accident,	
  or	
  a	
  reflec%on	
  of	
  our	
  “mentalese”	
  seman%c	
  types?)	
  
	
  My	
  working	
  hypothesis:	
  	
  
	
  We	
  need	
  
	
  	
  	
  	
  	
  sufficiently	
  expressive	
  representa%ons	
  of	
  linguis%c	
  content;	
  
	
  	
  	
  	
  	
  ways	
  of	
  deriving	
  reliable	
  ini%al	
  logical	
  forms	
  (LFs);	
  
	
  	
  	
  	
  	
  sufficient	
  lexical	
  and	
  world	
  knowledge	
  (including	
  paPern/schema-­‐like	
  	
  
	
  	
  	
  	
  	
  	
  	
  knowledge)	
  to	
  elaborate	
  ini%al	
  LFs	
  into	
  the	
  intended	
  content,	
  	
  
	
  	
  	
  	
  	
  	
  	
  and	
  understand	
  and	
  reason	
  with	
  that	
  content;	
  
 Candidates	
  for	
  seman6c	
  representa6on	
  and	
  knowledge	
  representa6on	
  
	
  	
  	
  (discussed	
  &	
  cri%qued	
  in	
  Schubert,	
  AAAI	
  '15;	
  cri%cisms	
  here	
  are	
  “caricatures”)	
  
	
  	
  	
  	
  	
  FOL,	
  DRT	
  (e.g.,	
  Allen,	
  Jurafsky	
  &	
  Mar%n,	
  Kamp,	
  Heim,	
  J.	
  Bos,	
  ...)	
  [expressively	
  inadequate]	
  
	
  	
  	
  	
  	
  Seman6c	
  nets	
  (wide	
  spectrum:	
  Shapiro,	
  Sowa,	
  Schubert,	
  ConceptNet,	
  ...);	
  [any	
  nota%on	
  can	
  be	
  cast	
  as	
  SN]	
  
	
  	
  	
  	
  	
  Descrip6on	
  logics	
  (CLASSIC,	
  LOOM,	
  OWL-­‐DL,	
  KAON,	
  SROIQ,	
  ...)	
  	
  	
  	
  [expressively	
  inadequate]	
  
	
  	
  	
  	
  	
  Conceptual	
  meaning	
  representa6ons	
  (Schank's	
  CD,	
  Jackendoff,	
  FrameNet,	
  ...)	
  [expr./infer.	
  inadequate]	
  
	
  	
  	
  	
  	
  Thema6c	
  role	
  representa6ons	
  (e.g.,	
  Palmer,	
  Gildea,	
  &	
  Xue	
  ’10)	
  [expr./infer.	
  inadequate]	
  
	
  	
  	
  	
  	
  Abstract	
  meaning	
  representa6on	
  (AMR)	
  (Banarescu	
  et	
  al.	
  '13)	
  [inferen%ally	
  inadequate]	
  
	
  	
  	
  	
  	
  Hobbs'	
  "flat"	
  representa6on	
  (Hobbs	
  '06)	
  	
  [conflates	
  dis%nct	
  types]	
  
	
  	
  	
  	
  	
  Structured	
  English	
  (e.g.,	
  MacCartney	
  &	
  Manning	
  '09,	
  Dagan	
  et	
  al.	
  '08,	
  …);	
  [ambiguous,	
  inferen%ally	
  inadequate]	
  
	
  	
  	
  	
  	
  Montague	
  Grammar	
  (English	
  as	
  logic)	
  (e.g.,	
  Dowty	
  '79,	
  Chierchia	
  &	
  McConnell-­‐Ginet	
  '00);	
  
	
  	
  	
  	
  	
  	
  	
  [unnecessarily	
  complex,	
  higher-­‐order]	
  
	
  	
  	
  	
  	
  Extensional	
  Montague	
  fragments	
  (e.g.,	
  McAllester	
  &	
  Divan	
  '92,	
  Artzi	
  &	
  ZePlemoyer	
  '13);	
  	
  
	
  	
  	
  	
  	
  	
  	
  [expressively	
  inadequate]	
  
	
  	
  	
  	
  	
  DCS	
  trees	
  (Liang	
  et	
  al.	
  '11);	
  [expressively	
  inadequate]	
  
	
  	
  	
  	
  	
  Situa6on	
  seman6cs	
  (Reichenbach	
  '47,	
  Barwise	
  &	
  Perry	
  '83)	
  [abstruse,	
  inferen%ally	
  inadequate]	
  
	
  	
  	
  	
  	
  Episodic	
  Logic	
  (EL)	
  	
  [remedies	
  many	
  of	
  these	
  flaws;	
  s%ll	
  briPle,	
  lacks	
  adequate	
  KB]	
  
Episodic	
  Logic	
  (EL)	
  –	
  Montague-­‐inspired,	
  first-­‐order,	
  situa*onal,	
  intensional	
  
	
  A	
  language-­‐like,	
  first-­‐order	
  SR/KR	
  with	
  a	
  small	
  number	
  of	
  types	
  (but	
  abstract	
  individuals);	
  
	
  LFs	
  are	
  obtained	
  composi:onally	
  from	
  phrase	
  structure	
  trees;	
  
	
  	
  Handles	
  most	
  seman%c	
  phenomena	
  shared	
  by	
  NLs;	
  all	
  types	
  of	
  referents;	
  	
  
	
  	
  allows	
  complex	
  situa%ons/events,	
  with	
  temporal/causal	
  rela%ons	
  
	
  	
  John	
  donated	
  blood	
  to	
  the	
  Red	
  Cross.	
  
	
  	
  	
  	
  [John1	
  <past	
  donate.v>	
  (K	
  blood.n)	
  Red_Cross]	
  	
  {ini%al	
  representa%on}	
  
	
  	
  	
  	
  (some	
  e:	
  [e	
  before	
  Now3]	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Skolemize,	
  split	
  	
  	
  	
  [E1.sk	
  before	
  Now3],	
  [Blood1.sk	
  blood.n],	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (some	
  x:	
  [x	
  blood.n]	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  [[John1	
  donate.v	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  [[John1	
  donate.v	
  	
  x	
  Red_Cross1]	
  **	
  e]	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Blood1.sk	
  Red_Cross1]	
  **	
  E1.sk	
  ]	
  
	
  	
  Very	
  few	
  people	
  s:ll	
  debate	
  the	
  fact	
  that	
  the	
  earth	
  is	
  hea:ng	
  up	
  {final	
  representa%on}:	
  
	
  	
  	
  	
  	
  	
  	
  [Fact4.sk	
  fact.n],	
  	
  	
  
	
  	
  	
  	
  	
  	
  	
  [Fact4.sk	
  =	
  (that	
  (some	
  e0:	
  [e0	
  at-­‐about	
  Now0]	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  [(The	
  z	
  [z	
  earth.n]	
  [z	
  heat_up.v])	
  **	
  e0]))],	
  
	
  	
  	
  	
  	
  	
  	
  ((fquan	
  (very.adv	
  few.a))	
  x:	
  [x	
  (plur	
  person.n)]	
  (s%ll.adv	
  (l	
  v	
  [v	
  debate.v	
  Fact4.sk])))	
  	
  	
  
	
  	
  	
  Unfortunately,	
  faulty/underspecified	
  syntac:c	
  analyses	
  lead	
  to	
  faulty	
  LFs.	
  
	
  	
  	
  We	
  don’t	
  have	
  enough	
  (reliable)	
  seman:c	
  pa6ern	
  knowledge.	
  
The	
  EPILOG	
  system	
  for	
  Episodic	
  Logic	
  	
  	
  
	
  (L.	
  Schubert,	
  C.-­‐H.	
  Hwang,	
  S.	
  Schaeffer,	
  F.	
  Morbini,	
  	
  Purtee,	
  ...)	
  
episode	
  
set	
  
hier2	
  
color	
   meta	
   number	
  
string	
  
%me	
  
type	
  
equality	
   parts	
  
other	
  
LOGICAL	
  INPUT	
  
LOGICAL	
  OUTPUT	
  
	
  	
  EPILOG	
  
	
  	
  	
  	
  core	
  
reasoner	
  
	
  Specialist	
  
	
  Interface	
  
	
  	
  	
  “A	
  car	
  crashed	
  into	
  a	
  tree.	
  …”	
  
(some e: [e before Now34]
(some x: [x car] (some y: [y tree]
[[x crash-into y] ** e])))
	
  	
  	
  “The	
  driver	
  of	
  x	
  may	
  	
  
	
  	
  	
  	
  	
  	
  be	
  hurt	
  or	
  killed”	
  
KNOWLEDGE
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Expressive	
  richness	
  does	
  not	
  impede	
  inference:	
  	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  EPILOG	
  2	
  holds	
  its	
  own	
  on	
  large	
  FOL	
  problems	
  (Morbini	
  &	
  Schubert	
  ’09);	
  
	
  but	
  inference	
  remains	
  briPle;	
  	
  uncertainty	
  handling	
  is	
  heuris%c;	
  KB	
  remains	
  inadequate	
  
Example	
  using	
  “most”	
  (from	
  J.F.	
  Allen’s	
  ‘Monroe	
  emergency’	
  domain):	
  
	
  Most	
  front	
  loaders	
  are	
  currently	
  in	
  use;	
  
	
  Whatever	
  equipment	
  is	
  in	
  use	
  in	
  unavailable;	
  
	
  Front	
  loaders	
  are	
  equipment	
  	
  	
  
	
  	
  	
  	
  	
  Therefore,	
  most	
  front	
  loaders	
  are	
  currently	
  unavailable.	
  
	
  	
  (most	
  x:	
  	
  [x	
  front-­‐loader]	
  [[x	
  in-­‐use]	
  @	
  Now3]);	
  
	
  	
  (all	
  x:	
  [x	
  equipment]	
  (all	
  e	
  [[[x	
  in-­‐use]	
  @	
  e]	
  =>	
  [(not	
  [x	
  available])	
  @	
  e]]));	
  
	
  	
  (all	
  x:	
  [x	
  front-­‐loader]	
  [x	
  equipment])	
  	
  	
  
	
  	
  	
  	
  	
  	
  	
  (most	
  x:	
  [x	
  front-­‐loader]	
  [(not	
  [x	
  available])	
  @	
  Now3])	
  
Example	
  involving	
  a^tudes	
  (English	
  glosses	
  of	
  EL	
  formulas)	
  
	
  Alice	
  found	
  out	
  that	
  Mark	
  Twain	
  is	
  the	
  same	
  as	
  Samuel	
  Clemens.	
  	
  
	
  When	
  someone	
  finds	
  out	
  something,	
  s/he	
  doesn’t	
  know	
  it	
  to	
  be	
  true	
  at	
  
	
  the	
  beginning	
  (of	
  the	
  finding-­‐out	
  event)	
  but	
  knows	
  it	
  to	
  be	
  true	
  at	
  the	
  end.	
  	
  
	
  Therefore:	
  
	
  -­‐	
  	
  Alice	
  didn’t	
  know	
  (before	
  finding	
  out)	
  that	
  Mark	
  Twain	
  is	
  the	
  same	
  
	
  	
  	
  	
  as	
  Samual	
  Clemens;	
  
	
  -­‐	
  	
  Alice	
  knew	
  a€erwards	
  that	
  Mark	
  Twain	
  is	
  the	
  same	
  as	
  Samuel	
  Clemens;	
  
	
  -­‐	
  	
  Mark	
  Twain	
  is	
  the	
  same	
  as	
  Samuel	
  Clemens	
  (from	
  knowing-­‐axioms).	
  
EPILOG	
  inference	
  resembles	
  Natural	
  Logic	
  (Nlog)	
  but	
  is	
  more	
  general.	
  
An	
  example	
  beyond	
  the	
  scope	
  of	
  Nlog	
  	
  (again	
  from	
  Allen's	
  Monroe	
  domain):
Every available crane can be used to hoist rubble onto a truck.
The small crane, which is on Clinton Ave, is not in use.
Therefore: the	
  small	
  crane	
  can	
  be	
  used	
  to	
  hoist	
  rubble	
  from	
  
	
  	
  	
  	
  	
  	
  	
  the	
  collapsed	
  building	
  on	
  Penfield	
  Rd	
  onto	
  a	
  truck.	
  
	
  	
  	
  Every	
  available	
  crane	
  can	
  be	
  used	
  to	
  hoist	
  rubble	
  onto	
  a	
  truck	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (s	
  '(all	
  x	
  (x	
  ((aPr	
  available)	
  crane))	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (all	
  r	
  (r	
  rubble)	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  ((that	
  (some	
  y	
  (y	
  person)	
  	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (some	
  z	
  (z	
  truck)	
  (y	
  (adv-­‐a	
  (for-­‐purpose	
  (Ka	
  (adv-­‐a	
  (onto	
  z)	
  (hoist	
  r))))	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (use	
  x))))))	
  possible))))	
  
	
  	
  	
  The	
  small	
  crane,	
  on	
  Clinton	
  Ave.,	
  is	
  not	
  in	
  use.	
  	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (s	
  '(the	
  x	
  (x	
  ((aPr	
  small)	
  crane))	
  ((x	
  on	
  Clinton-­‐Ave)	
  and	
  (not	
  (x	
  in-­‐use)))))	
  
	
  	
  	
  Every	
  crane	
  is	
  a	
  device	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (s	
  '(all	
  x	
  (x	
  crane)	
  (x	
  device)))	
  
	
  	
  	
  Every	
  device	
  that	
  is	
  not	
  in	
  use	
  is	
  available	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (s	
  ‘(all	
  x	
  ((x	
  device)	
  and	
  (not	
  (x	
  in-­‐use)))	
  (x	
  available)))	
  
Can	
  the	
  small	
  crane	
  be	
  used	
  to	
  hoist	
  rubble	
  from	
  the	
  collapsed	
  building	
  
on	
  Penfield	
  Rd	
  onto	
  a	
  truck?	
  (Answered	
  	
  affirma:vely	
  by	
  EPILOG	
  in	
  .127	
  sec)	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (q	
  	
  (p	
  ‘(the	
  x	
  (x	
  ((aPr	
  small)	
  crane))	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (some	
  r	
  ((r	
  rubble)	
  and	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (the	
  s	
  ((s	
  (aPr	
  collapsed	
  building))	
  and	
  (s	
  on	
  Penfield-­‐Rd))	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (r	
  from	
  s)))	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  ((that	
  (some	
  y	
  (y	
  person)	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (some	
  z	
  (z	
  truck)	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (y	
  (adv-­‐a	
  (for-­‐purpose	
  (Ka	
  (adv-­‐a	
  (onto	
  z)	
  (hoist	
  r))))	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (use	
  x))))))	
  possible)))))	
  
 	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Types	
  of	
  knowledge	
  required	
  
Pa^erns	
  of	
  predica6on,	
  modifica6on	
  (tens	
  of	
  millions!):	
  for	
  parser	
  guidance	
  
	
  	
  e.g.,	
  person	
  see	
  bird;	
  see	
  with	
  viewing	
  instruments;	
  bird	
  with	
  feathers;	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  tail	
  feathers;	
  colored	
  feathers	
  	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Disambiguate	
  “He	
  saw	
  a	
  bird	
  with	
  {binoculars	
  |	
  yellow	
  tail	
  feathers}	
  
Pa^erns	
  of	
  ac6ons/events	
  and	
  rela6onships:	
  for	
  expanding	
  /connec%ng	
  sentences	
  
	
  	
  e.g.,	
  Dyn-­‐schema	
  [Person	
  x	
  visits	
  foreign-­‐country	
  y]	
  	
  (episode	
  e):	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Init-­‐conds:	
  	
  	
  [x	
  loc-­‐at	
  u:<some	
  (place	
  in	
  (home-­‐country-­‐of	
  y))>]	
  (episode	
  e1),	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Co-­‐conds:	
  	
  	
  	
  [x	
  have	
  v:<some	
  (travel	
  paraphernalia	
  for	
  y	
  e)>]	
  (episode	
  e2)	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Steps:	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  [x	
  travel	
  from	
  u	
  to	
  w:<some	
  (place	
  in	
  y)>]	
  (episode	
  e3),	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  [x	
  do	
  some	
  ac%vi%es	
  in	
  y]	
  (episode	
  e4),	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  [x	
  travel	
  from	
  z:<some	
  (place	
  in	
  y)>	
  to	
  u]	
  (episode	
  e5)	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Effects:	
  	
  	
  	
  	
  	
  	
  	
  	
  [x	
  obtain	
  g:<some	
  (gra%fica%on-­‐from	
  e4)>]	
  (episode	
  e6)	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Constr:	
  	
  	
  	
  	
  	
  	
  	
  	
  [e	
  =	
  (join-­‐of	
  e3	
  e4	
  e5	
  e6)],	
  [e1	
  starts	
  e],	
  [e2	
  same-­‐%me	
  e],	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  [e3	
  consec	
  e4	
  e5],	
  [e6	
  during	
  e4]	
  
	
  	
  Similarly,	
  possible	
  paPerns	
  of	
  events	
  for	
  cancer	
  pa%ent	
  diagnosis,	
  surgery,	
  chemo,	
  …)	
  
	
  	
  Similarly,	
  “object	
  u%lity”	
  paPerns	
  (what	
  can	
  you	
  do	
  with	
  an	
  apple?	
  a	
  pen?	
  a	
  car?	
  …)	
  	
  
	
  	
  Similarly,	
  “disposi%onal”	
  paPerns	
  (dogs	
  bark;	
  fragile	
  object	
  tend	
  to	
  break	
  on	
  impact)	
  
Lexical	
  and	
  paraphrase	
  knowledge	
  (dogs	
  are	
  land	
  mammals;	
  pens	
  are	
  wri%ng	
  instruments;	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  trees	
  are	
  plants	
  with	
  a	
  	
  tall	
  wooden	
  trunk	
  and	
  a	
  branched	
  canopy	
  bearing	
  leaves;	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  to	
  kill	
  is	
  to	
  render	
  dead;	
  to	
  walk	
  is	
  to	
  advance	
  on	
  foot;	
  managing	
  to	
  do	
  x	
  entails	
  doing	
  x;	
  etc.)	
  
Condi6onal/generic	
  world	
  knowledge	
  (if	
  you	
  drop	
  an	
  object,	
  it	
  will	
  hit	
  the	
  ground;	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  most	
  dogs	
  are	
  someone’s	
  pet;	
  dogs	
  are	
  generally	
  friendly;	
  chemotherapy	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  tends	
  to	
  cause	
  nausea	
  and	
  hair	
  loss;	
  …)	
  
Specialist	
  knowledge:	
  taxonomies,	
  partonomies,	
  temporal	
  rela%ons,	
  arithme%c	
  &	
  scales,	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  geometric/imagis%c	
  representa%ons,	
  sets,	
  symbolic	
  expressions	
  (incl.	
  language),	
  …	
  
Some	
  a`empts	
  to	
  address	
  the	
  “Knowledge	
  Acquisi*on	
  Bo`leneck”	
  
We	
  have	
  plenty	
  of	
  textual	
  “knowledge”,	
  but	
  liPle	
  
	
  	
  	
  	
  	
  	
  -­‐	
  	
  schema%c	
  paPern	
  knowledge	
  for	
  understanding	
  (and	
  behavior);	
  
	
  	
  	
  	
  	
  	
  -­‐	
  “if-­‐then”	
  lexical	
  and	
  world	
  knowledge	
  for	
  reasoning!	
  
Past	
  and	
  ongoing	
  efforts	
  in	
  my	
  Rochester	
  group:	
  
	
  	
  KNEXT	
  –	
  knowledge	
  extrac%on	
  from	
  text,	
  	
  
	
  	
  	
  	
  	
  aimed	
  at	
  general	
  factoids	
  (typically,	
  paPerns	
  of	
  predica%on)	
  
	
  “Sharpening”	
  and	
  abstrac%ng	
  of	
  KNEXT	
  factoids	
  into	
  quan%fied	
  generaliza%ons	
  
	
  	
  	
  	
  	
  (Lore,	
  successor	
  to	
  KNEXT)	
  
	
  	
  Lexical	
  knowledge	
  engineering	
  (par%ally	
  automated),	
  esp.	
  for	
  frequent	
  and	
  
	
  	
  	
  	
  “primi%ve”	
  verbs,	
  several	
  VerbNet	
  classes,	
  implica%ves,	
  a„tudinal	
  verbs	
  
	
  	
  Automa%c	
  WordNet	
  gloss	
  interpreta%on	
  (in	
  progress)	
  
	
  	
  Computer-­‐graphics-­‐based	
  object/scene	
  representa%on	
  &	
  inference	
  
	
  	
  Experimental	
  schema	
  engineering,	
  to	
  assess	
  syntac%c/seman%c	
  requirements	
  
	
  	
  Schema	
  learning	
  (future	
  work)	
  	
  
“Sharpening”	
  KNEXT	
  factoids	
  	
  
	
  (using	
  transduc%on	
  paPerns,	
  
	
  seman%c	
  info	
  from	
  WordNet,	
  
	
  VerbNet,	
  etc.)	
  
E.g.,	
  A	
  person	
  may	
  have	
  hair	
  
	
  	
  	
  	
  All	
  or	
  most	
  persons	
  	
  
	
  	
  	
  	
  	
  	
  	
  	
  permanently	
  have	
  some	
  
	
  	
  	
  	
  	
  	
  	
  	
  hair	
  as	
  part	
  	
  
	
  	
  	
  (all-­‐or-­‐most	
  x:	
  	
  [x	
  person]	
  
	
  	
  	
  	
  	
  	
  	
  	
  (some	
  e:	
  [(x	
  .	
  e)	
  permanent]	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  (some	
  y:	
  [y	
  hair]	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  [[x	
  have-­‐as-­‐part	
  y]	
  **	
  e])))	
  
Sample	
  inferences:	
  
Dana	
  is	
  a	
  person	
  	
  	
  
Probably,	
  Dana	
  permanently	
  
has	
  some	
  hair	
  as	
  part.	
  
	
  (probably	
  	
  
	
  	
  	
  	
  (some	
  e:	
  [(Dana	
  .	
  e)	
  permanent]	
  	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  (some	
  y:	
  [y	
  hair]	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  [[Dana	
  has-­‐as-­‐part	
  y]	
  **	
  e])))	
  
ACME	
  is	
  a	
  company	
  	
  	
  
Probably,	
  ACME	
  occasionally	
  
announces	
  a	
  product.	
  
	
  (probably	
  
	
  	
  	
  	
  (occasional	
  e	
  	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  (some	
  y:	
  [y	
  product]	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  [[ACME	
  announce	
  y]	
  **	
  e])))	
  
~150	
  “primi*ve”	
  verbal	
  concepts,	
  with	
  axioms	
  
	
  	
  	
  (MOVE,	
  GRASP,	
  SEE,	
  LEARN,	
  MAKE,	
  ASK-­‐OF,	
  CONVEY-­‐INFO-­‐TO,	
  WANT-­‐TBT,	
  …)	
  
	
  	
  Several	
  hundred	
  axioms	
  for	
  VerbNet	
  classes	
  
	
  	
  	
  (e.g.,	
  state-­‐change	
  concepts	
  like	
  BREAK,	
  REPAIR,	
  MELT,	
  etc.)	
  in	
  terms	
  of	
  “primi%ves”	
  	
  	
  	
  	
  
	
  	
  	
  and	
  “predicate	
  parameters”,	
  inserted	
  into	
  2-­‐4	
  axiom	
  schemas	
  per	
  class)	
  
	
  	
  WordNet:	
  77,000	
  formal	
  axioms	
  derived	
  from	
  WN	
  nominal	
  hierarchy	
  
	
  	
  	
  (used	
  mass/count	
  dis%nc%on	
  and	
  various	
  other	
  features	
  to	
  dis%nguish	
  
	
  	
  	
  the	
  rela%on	
  between	
  pairs	
  like	
  <seawater,	
  water>	
  	
  all	
  seawater	
  is	
  water,	
  
	
  	
  	
  and	
  like	
  <gold,	
  noble_metal>	
  	
  gold	
  (the	
  kind	
  of	
  stuff)	
  is	
  a	
  	
  noble_metal	
  )	
  
	
  	
  Gloss	
  interpreta*on	
  (in	
  progress):	
  E.g.,	
  x	
  slam2.v	
  y	
  in	
  event	
  e	
  	
  
	
  	
  	
  x	
  violently	
  strike1.v	
  y,	
  and	
  x	
  is	
  probably	
  a	
  person	
  and	
  y	
  is	
  probably	
  
	
  	
  	
  a	
  thing12.n	
  (physical	
  en:ty).	
  Problems:	
  Many	
  glosses	
  are	
  quasi-­‐circular	
  
	
  	
  	
  (admire	
  	
  feel	
  admira:on	
  for),	
  don’t	
  apply	
  to	
  al	
  synset	
  members,	
  and	
  
	
  	
  	
  don’t	
  provide	
  major	
  entailments	
  (like,	
  dying	
  results	
  in	
  being	
  dead!)	
  
	
  	
  Graphics-­‐based	
  scene	
  modeling	
  in	
  first-­‐reader	
  stories:	
  
	
  	
  	
  	
  Rosy	
  and	
  Frank	
  see	
  the	
  nest	
  in	
  the	
  apple	
  tree.	
  
	
  	
  	
  	
  Why	
  can’t	
  they	
  tell	
  whether	
  there	
  are	
  eggs	
  in	
  the	
  nest?	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Visual	
  occlusion	
  by	
  the	
  nest	
  itself!	
  
Current	
  preliminary	
  schema	
  work:	
  experimen%ng	
  with	
  schema	
  syntax	
  (like	
  	
  
	
  	
  	
  	
  the	
  “visi%ng	
  a	
  foreign	
  country”	
  example),	
  to	
  be	
  used	
  as	
  target	
  formalism	
  for	
  
	
  	
  	
  	
  learning	
  schemas	
  from	
  text.	
  
 Concluding	
  comments	
  
	
  	
  	
  	
  	
  	
  Reliable	
  seman%c	
  parsing	
  requires	
  reliable	
  syntac%c	
  parsing;	
  
	
  	
  	
  	
  	
  	
  	
  	
  need	
  guidance	
  by	
  paPerns	
  of	
  predica%on,	
  modifica%on,	
  etc.	
  (KNEXT-­‐like)	
  
	
  	
  	
  	
  	
  	
  EL	
  provides	
  an	
  expressively	
  adequate	
  representa%on	
  close	
  to	
  language	
  
	
  	
  	
  	
  	
  	
  Inference	
  methods	
  beyond	
  those	
  of	
  FOL	
  are	
  implemented	
  
	
  	
  	
  	
  	
  	
  Probabilis%c	
  inference	
  remains	
  ad	
  hoc	
  
	
  	
  	
  	
  	
  	
  KA	
  boPleneck	
  is	
  under	
  aPack,	
  but	
  far	
  from	
  vanquished;	
  
	
  	
  	
  	
  	
  	
  	
  	
  schemas	
  (containing	
  EL	
  formulas)	
  seem	
  to	
  be	
  the	
  kind	
  of	
  “so€”	
  
	
  	
  	
  	
  	
  	
  	
  	
  representa%on	
  that	
  will	
  support	
  genuine	
  understanding,	
  reasoning	
  
•  L.K.	
  Schubert,	
  "Seman%c	
  representa%on",	
  29th	
  AAAI	
  Conference	
  (AAAI15),	
  Jan.	
  25-­‐30,	
  2015,	
  Aus%n,	
  TX.	
  Slides	
  of	
  the	
  talk.	
  	
  
•  E.	
  Bigelow,	
  D.	
  Scarafoni,	
  L.	
  Schubert,	
  and	
  A.	
  Wilson,	
  "On	
  the	
  need	
  for	
  imagis%c	
  modeling	
  in	
  story	
  understanding",	
  Biologically	
  Inspired	
  
Cogni:ve	
  Architectures	
  11,	
  Jan.	
  2015,	
  22-­‐-­‐28.	
  (Presented	
  at	
  Ann.	
  Int.	
  Conf.	
  on	
  Biologically	
  Inspired	
  Compu%ng	
  Architectures	
  (BICA	
  2014),	
  
Nov.	
  7-­‐9,	
  MIT,	
  Cambridge,	
  MA,	
  2014.)	
  	
  
•  L.K.	
  Schubert,	
  Computa%onal	
  linguis%cs",	
  in	
  Edward	
  N.	
  Zalta	
  (Principal	
  Editor),	
  Stanford	
  Encyclopedia	
  of	
  Philosophy,	
  CSLI,	
  Stanford,	
  CA.
(100pp),	
  2014.	
  L.K.	
  Schubert,	
  "From	
  Treebank	
  parses	
  to	
  Episodic	
  Logic	
  and	
  commonsense	
  inference",	
  Proc.	
  of	
  the	
  ACL	
  2014	
  Workshop	
  on	
  
Seman%c	
  Parsing,	
  Bal%more,	
  MD,	
  June	
  26,	
  ACL,	
  55-­‐60.	
  
•  	
  L.K.	
  Schubert,	
  "NLog-­‐like	
  inference	
  and	
  commonsense	
  reasoning",	
  in	
  A.	
  Zaenen,	
  V.	
  de	
  Paiva,	
  &	
  C.	
  Condoravdi	
  (eds.),	
  Seman:cs	
  for	
  Textual	
  
Inference,	
  special	
  issue	
  of	
  Linguis%c	
  Issues	
  in	
  Language	
  Technology	
  (LiLT)	
  9(9),	
  2013.	
  (The	
  pdf	
  file	
  is	
  a	
  preliminary	
  version,	
  Dept.	
  of	
  Computer	
  
Science,	
  University	
  of	
  Rochester,	
  Oct.	
  2012.)	
  
•  	
  J.	
  Gordon	
  and	
  L.K.	
  Schubert,	
  WordNet	
  hierarchy	
  axioma%za%on	
  and	
  the	
  mass-­‐count	
  dis%nc%on",	
  7th	
  IEEE	
  Int.	
  Conf.	
  on	
  Seman%c	
  Compu%ng	
  
(ICSC	
  2013),	
  September	
  16-­‐18,	
  Irvine,	
  CA,	
  2013.	
  
•  	
  A.	
  Purtee	
  and	
  L.K.	
  Schubert,	
  "TTT:	
  A	
  tree	
  transduc%on	
  language	
  for	
  syntac%c	
  and	
  seman%c	
  processing",	
  EACL	
  2012	
  Workshop	
  on	
  
Applica%ons	
  of	
  Tree	
  Automata	
  Techniques	
  in	
  Natural	
  Language	
  Processing	
  (ATANLP	
  2012),	
  Avignon,	
  France,	
  Apr.	
  24,	
  2012.	
  
•  K.	
  Stratos,	
  L.K.	
  Schubert,	
  &	
  J.	
  Gordon,	
  "Episodic	
  Logic:	
  Natural	
  Logic	
  +	
  reasoning",	
  Int.	
  Conf.	
  on	
  Knowledge	
  Engineering	
  and	
  Ontology	
  
Development,	
  (KEOD'11),	
  Oct	
  26-­‐29,	
  Paris,	
  2011.	
  	
  
•  Jonathan	
  Gordon	
  and	
  Lenhart	
  Schubert,	
  "Quan%fica%onal	
  sharpening	
  of	
  commonsense	
  knowledge",	
  Proc.	
  of	
  the	
  AAAI	
  Fall	
  Symposium	
  on	
  
Commonsense	
  Knowledge,	
  Arlington,	
  VA,	
  Nov.	
  11-­‐13,	
  2010.	
  L.K.	
  Schubert,	
  "From	
  generic	
  sentences	
  to	
  scripts",	
  IJCAI'09	
  Workshop	
  W22,	
  
Logic	
  and	
  the	
  Simula%on	
  of	
  Interac%on	
  and	
  Reasoning	
  (LSIR	
  2),	
  Pasadena,	
  CA,	
  July	
  12,	
  2009.	
  	
  
•  F.	
  Morbini	
  and	
  L.K.	
  Schubert,	
  "Evalua%on	
  of	
  Epilog:	
  A	
  reasoner	
  for	
  Episodic	
  Logic",	
  Commonsense'09,	
  June	
  1-­‐3,	
  2009,	
  Toronto,	
  Canada.	
  Also	
  
available	
  at	
  hPp://commonsensereasoning.org/2009/papers.html	
  	
  
•  Benjamin	
  Van	
  Durme	
  and	
  Lenhart	
  K.	
  Schubert,	
  "Open	
  knowledge	
  extrac%on	
  using	
  composi%onal	
  language	
  processing",	
  
Symposium	
  on	
  Seman%cs	
  in	
  Systems	
  for	
  Text	
  Processing	
  (STEP	
  2008),	
  September	
  22-­‐24,	
  2008	
  -­‐	
  Venice,	
  Italy.	
  	
  
•  A.N.	
  Kaplan	
  and	
  L.K.	
  Schubert,	
  "A	
  computa%onal	
  model	
  of	
  belief",	
  Ar:ficial	
  Intelligence	
  120(1),	
  June	
  2000,	
  119-­‐160.	
  
•  L.K.	
  Schubert	
  and	
  C.H.	
  Hwang,	
  
"Episodic	
  Logic	
  meets	
  LiPle	
  Red	
  Riding	
  Hood:	
  A	
  comprehensive,	
  natural	
  representa%on	
  for	
  language	
  understanding",	
  in	
  L.	
  
Iwanska	
  and	
  S.C.	
  Shapiro	
  (eds.),	
  Natural	
  Language	
  Processing	
  and	
  Knowledge	
  Representa:on:	
  Language	
  for	
  Knowledge	
  and	
  
Knowledge	
  for	
  Language,	
  MIT/AAAI	
  Press,	
  Menlo	
  Park,	
  CA,	
  and	
  Cambridge,	
  MA,	
  2000,	
  111-­‐174.	
  	
  	

Publications (from my web page, http://www.cs.rochester.edu/u/schubert/)

More Related Content

Similar to From Semantic Parsing to Reasoning

Errors and biases in medical decision making
Errors and biases in medical decision makingErrors and biases in medical decision making
Errors and biases in medical decision makingAymery Constant
 
"This is how i want to die" DPT Study Day 16th September 2011
"This is how i want to die" DPT Study Day 16th September 2011"This is how i want to die" DPT Study Day 16th September 2011
"This is how i want to die" DPT Study Day 16th September 2011Hospiscare
 
Goals of Care When Cancer is Chronic - FightCRC Feb 2018 CRCwebinar
Goals of Care When Cancer is Chronic - FightCRC Feb 2018 CRCwebinarGoals of Care When Cancer is Chronic - FightCRC Feb 2018 CRCwebinar
Goals of Care When Cancer is Chronic - FightCRC Feb 2018 CRCwebinarFight Colorectal Cancer
 
Dealing With Requests For Hastened Death (Handout)
Dealing With Requests For Hastened Death (Handout)Dealing With Requests For Hastened Death (Handout)
Dealing With Requests For Hastened Death (Handout)Christian Sinclair
 
World without cancer - the story of vitamin b17
World without cancer - the story of vitamin b17    World without cancer - the story of vitamin b17
World without cancer - the story of vitamin b17 Om Verma
 
How To Write An Analysis Essay. Online assignment writing service.
How To Write An Analysis Essay. Online assignment writing service.How To Write An Analysis Essay. Online assignment writing service.
How To Write An Analysis Essay. Online assignment writing service.Jennifer Wood
 
Q&A Global Swine Flu Call
Q&A Global Swine Flu CallQ&A Global Swine Flu Call
Q&A Global Swine Flu CallEdelmanPR
 
DISCUSSION 1Describe the origins and nature of hospice care..docx
DISCUSSION 1Describe the origins and nature of hospice care..docxDISCUSSION 1Describe the origins and nature of hospice care..docx
DISCUSSION 1Describe the origins and nature of hospice care..docxSusanaFurman449
 
You Decide - Choices and ConsequencesAssignmentThe You Decid.docx
You Decide - Choices and ConsequencesAssignmentThe You Decid.docxYou Decide - Choices and ConsequencesAssignmentThe You Decid.docx
You Decide - Choices and ConsequencesAssignmentThe You Decid.docxmaxinesmith73660
 
Corporate Presentation
Corporate PresentationCorporate Presentation
Corporate PresentationDavid Ocana
 
Advanced care planning Hospiscare
Advanced care planning   HospiscareAdvanced care planning   Hospiscare
Advanced care planning HospiscareHospiscare
 
Informed refusal: You are doing it wrong
Informed refusal: You are doing it wrongInformed refusal: You are doing it wrong
Informed refusal: You are doing it wrongRobert Cole
 
Your dilemma is that you have to make a painful medical decision and.docx
Your dilemma is that you have to make a painful medical decision and.docxYour dilemma is that you have to make a painful medical decision and.docx
Your dilemma is that you have to make a painful medical decision and.docxwoodruffeloisa
 
Advance care planning 21 sept 11
Advance care planning 21 sept 11Advance care planning 21 sept 11
Advance care planning 21 sept 11Hospiscare
 
Most of the servicessupport provided for human trafficking (HT) v.docx
Most of the servicessupport provided for human trafficking (HT) v.docxMost of the servicessupport provided for human trafficking (HT) v.docx
Most of the servicessupport provided for human trafficking (HT) v.docxpauline234567
 
Removing the Blinders - stereotypes of foreign-born physicians
Removing the Blinders - stereotypes of foreign-born physiciansRemoving the Blinders - stereotypes of foreign-born physicians
Removing the Blinders - stereotypes of foreign-born physiciansEmerson R. Moses, MBA, FASPR
 

Similar to From Semantic Parsing to Reasoning (20)

Errors and biases in medical decision making
Errors and biases in medical decision makingErrors and biases in medical decision making
Errors and biases in medical decision making
 
Advanced cancer care_planning
Advanced cancer care_planningAdvanced cancer care_planning
Advanced cancer care_planning
 
"This is how i want to die" DPT Study Day 16th September 2011
"This is how i want to die" DPT Study Day 16th September 2011"This is how i want to die" DPT Study Day 16th September 2011
"This is how i want to die" DPT Study Day 16th September 2011
 
Goals of Care When Cancer is Chronic - FightCRC Feb 2018 CRCwebinar
Goals of Care When Cancer is Chronic - FightCRC Feb 2018 CRCwebinarGoals of Care When Cancer is Chronic - FightCRC Feb 2018 CRCwebinar
Goals of Care When Cancer is Chronic - FightCRC Feb 2018 CRCwebinar
 
Dealing With Requests For Hastened Death (Handout)
Dealing With Requests For Hastened Death (Handout)Dealing With Requests For Hastened Death (Handout)
Dealing With Requests For Hastened Death (Handout)
 
World without cancer - the story of vitamin b17
World without cancer - the story of vitamin b17    World without cancer - the story of vitamin b17
World without cancer - the story of vitamin b17
 
How To Write An Analysis Essay. Online assignment writing service.
How To Write An Analysis Essay. Online assignment writing service.How To Write An Analysis Essay. Online assignment writing service.
How To Write An Analysis Essay. Online assignment writing service.
 
Stigma Skills Workshop
Stigma Skills WorkshopStigma Skills Workshop
Stigma Skills Workshop
 
Q&A Global Swine Flu Call
Q&A Global Swine Flu CallQ&A Global Swine Flu Call
Q&A Global Swine Flu Call
 
DISCUSSION 1Describe the origins and nature of hospice care..docx
DISCUSSION 1Describe the origins and nature of hospice care..docxDISCUSSION 1Describe the origins and nature of hospice care..docx
DISCUSSION 1Describe the origins and nature of hospice care..docx
 
You Decide - Choices and ConsequencesAssignmentThe You Decid.docx
You Decide - Choices and ConsequencesAssignmentThe You Decid.docxYou Decide - Choices and ConsequencesAssignmentThe You Decid.docx
You Decide - Choices and ConsequencesAssignmentThe You Decid.docx
 
Corporate Presentation
Corporate PresentationCorporate Presentation
Corporate Presentation
 
Advanced care planning Hospiscare
Advanced care planning   HospiscareAdvanced care planning   Hospiscare
Advanced care planning Hospiscare
 
Informed refusal: You are doing it wrong
Informed refusal: You are doing it wrongInformed refusal: You are doing it wrong
Informed refusal: You are doing it wrong
 
Your dilemma is that you have to make a painful medical decision and.docx
Your dilemma is that you have to make a painful medical decision and.docxYour dilemma is that you have to make a painful medical decision and.docx
Your dilemma is that you have to make a painful medical decision and.docx
 
Advance care planning 21 sept 11
Advance care planning 21 sept 11Advance care planning 21 sept 11
Advance care planning 21 sept 11
 
Challenges To Our Professional Attitudes Jk09
Challenges To Our Professional Attitudes Jk09Challenges To Our Professional Attitudes Jk09
Challenges To Our Professional Attitudes Jk09
 
Most of the servicessupport provided for human trafficking (HT) v.docx
Most of the servicessupport provided for human trafficking (HT) v.docxMost of the servicessupport provided for human trafficking (HT) v.docx
Most of the servicessupport provided for human trafficking (HT) v.docx
 
Removing the Blinders - stereotypes of foreign-born physicians
Removing the Blinders - stereotypes of foreign-born physiciansRemoving the Blinders - stereotypes of foreign-born physicians
Removing the Blinders - stereotypes of foreign-born physicians
 
Surgical Grand Rounds: Palliative Care
Surgical Grand Rounds: Palliative CareSurgical Grand Rounds: Palliative Care
Surgical Grand Rounds: Palliative Care
 

More from diannepatricia

Teaching cognitive computing with ibm watson
Teaching cognitive computing with ibm watsonTeaching cognitive computing with ibm watson
Teaching cognitive computing with ibm watsondiannepatricia
 
Cognitive systems institute talk 8 june 2017 - v.1.0
Cognitive systems institute talk   8 june 2017 - v.1.0Cognitive systems institute talk   8 june 2017 - v.1.0
Cognitive systems institute talk 8 june 2017 - v.1.0diannepatricia
 
Building Compassionate Conversational Systems
Building Compassionate Conversational SystemsBuilding Compassionate Conversational Systems
Building Compassionate Conversational Systemsdiannepatricia
 
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”“Artificial Intelligence, Cognitive Computing and Innovating in Practice”
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”diannepatricia
 
Cognitive Insights drive self-driving Accessibility
Cognitive Insights drive self-driving AccessibilityCognitive Insights drive self-driving Accessibility
Cognitive Insights drive self-driving Accessibilitydiannepatricia
 
Artificial Intellingence in the Car
Artificial Intellingence in the CarArtificial Intellingence in the Car
Artificial Intellingence in the Cardiannepatricia
 
“Semantic PDF Processing & Document Representation”
“Semantic PDF Processing & Document Representation”“Semantic PDF Processing & Document Representation”
“Semantic PDF Processing & Document Representation”diannepatricia
 
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...diannepatricia
 
170330 cognitive systems institute speaker series mark sherman - watson pr...
170330 cognitive systems institute speaker series    mark sherman - watson pr...170330 cognitive systems institute speaker series    mark sherman - watson pr...
170330 cognitive systems institute speaker series mark sherman - watson pr...diannepatricia
 
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”diannepatricia
 
Cognitive Assistance for the Aging
Cognitive Assistance for the AgingCognitive Assistance for the Aging
Cognitive Assistance for the Agingdiannepatricia
 
From complex Systems to Networks: Discovering and Modeling the Correct Network"
From complex Systems to Networks: Discovering and Modeling the Correct Network"From complex Systems to Networks: Discovering and Modeling the Correct Network"
From complex Systems to Networks: Discovering and Modeling the Correct Network"diannepatricia
 
The Role of Dialog in Augmented Intelligence
The Role of Dialog in Augmented IntelligenceThe Role of Dialog in Augmented Intelligence
The Role of Dialog in Augmented Intelligencediannepatricia
 
Developing Cognitive Systems to Support Team Cognition
Developing Cognitive Systems to Support Team CognitionDeveloping Cognitive Systems to Support Team Cognition
Developing Cognitive Systems to Support Team Cognitiondiannepatricia
 
Cyber-Social Learning Systems
Cyber-Social Learning SystemsCyber-Social Learning Systems
Cyber-Social Learning Systemsdiannepatricia
 
“IT Technology Trends in 2017… and Beyond”
“IT Technology Trends in 2017… and Beyond”“IT Technology Trends in 2017… and Beyond”
“IT Technology Trends in 2017… and Beyond”diannepatricia
 
"Curious Learning: using a mobile platform for early literacy education as a ...
"Curious Learning: using a mobile platform for early literacy education as a ..."Curious Learning: using a mobile platform for early literacy education as a ...
"Curious Learning: using a mobile platform for early literacy education as a ...diannepatricia
 
Embodied Cognition - Booch HICSS50
Embodied Cognition - Booch HICSS50Embodied Cognition - Booch HICSS50
Embodied Cognition - Booch HICSS50diannepatricia
 
KATE - a Platform for Machine Learning
KATE - a Platform for Machine LearningKATE - a Platform for Machine Learning
KATE - a Platform for Machine Learningdiannepatricia
 
Cognitive Computing for Aging Society
Cognitive Computing for Aging SocietyCognitive Computing for Aging Society
Cognitive Computing for Aging Societydiannepatricia
 

More from diannepatricia (20)

Teaching cognitive computing with ibm watson
Teaching cognitive computing with ibm watsonTeaching cognitive computing with ibm watson
Teaching cognitive computing with ibm watson
 
Cognitive systems institute talk 8 june 2017 - v.1.0
Cognitive systems institute talk   8 june 2017 - v.1.0Cognitive systems institute talk   8 june 2017 - v.1.0
Cognitive systems institute talk 8 june 2017 - v.1.0
 
Building Compassionate Conversational Systems
Building Compassionate Conversational SystemsBuilding Compassionate Conversational Systems
Building Compassionate Conversational Systems
 
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”“Artificial Intelligence, Cognitive Computing and Innovating in Practice”
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”
 
Cognitive Insights drive self-driving Accessibility
Cognitive Insights drive self-driving AccessibilityCognitive Insights drive self-driving Accessibility
Cognitive Insights drive self-driving Accessibility
 
Artificial Intellingence in the Car
Artificial Intellingence in the CarArtificial Intellingence in the Car
Artificial Intellingence in the Car
 
“Semantic PDF Processing & Document Representation”
“Semantic PDF Processing & Document Representation”“Semantic PDF Processing & Document Representation”
“Semantic PDF Processing & Document Representation”
 
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...
 
170330 cognitive systems institute speaker series mark sherman - watson pr...
170330 cognitive systems institute speaker series    mark sherman - watson pr...170330 cognitive systems institute speaker series    mark sherman - watson pr...
170330 cognitive systems institute speaker series mark sherman - watson pr...
 
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”
 
Cognitive Assistance for the Aging
Cognitive Assistance for the AgingCognitive Assistance for the Aging
Cognitive Assistance for the Aging
 
From complex Systems to Networks: Discovering and Modeling the Correct Network"
From complex Systems to Networks: Discovering and Modeling the Correct Network"From complex Systems to Networks: Discovering and Modeling the Correct Network"
From complex Systems to Networks: Discovering and Modeling the Correct Network"
 
The Role of Dialog in Augmented Intelligence
The Role of Dialog in Augmented IntelligenceThe Role of Dialog in Augmented Intelligence
The Role of Dialog in Augmented Intelligence
 
Developing Cognitive Systems to Support Team Cognition
Developing Cognitive Systems to Support Team CognitionDeveloping Cognitive Systems to Support Team Cognition
Developing Cognitive Systems to Support Team Cognition
 
Cyber-Social Learning Systems
Cyber-Social Learning SystemsCyber-Social Learning Systems
Cyber-Social Learning Systems
 
“IT Technology Trends in 2017… and Beyond”
“IT Technology Trends in 2017… and Beyond”“IT Technology Trends in 2017… and Beyond”
“IT Technology Trends in 2017… and Beyond”
 
"Curious Learning: using a mobile platform for early literacy education as a ...
"Curious Learning: using a mobile platform for early literacy education as a ..."Curious Learning: using a mobile platform for early literacy education as a ...
"Curious Learning: using a mobile platform for early literacy education as a ...
 
Embodied Cognition - Booch HICSS50
Embodied Cognition - Booch HICSS50Embodied Cognition - Booch HICSS50
Embodied Cognition - Booch HICSS50
 
KATE - a Platform for Machine Learning
KATE - a Platform for Machine LearningKATE - a Platform for Machine Learning
KATE - a Platform for Machine Learning
 
Cognitive Computing for Aging Society
Cognitive Computing for Aging SocietyCognitive Computing for Aging Society
Cognitive Computing for Aging Society
 

Recently uploaded

Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 

Recently uploaded (20)

Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 

From Semantic Parsing to Reasoning

  • 1. From  Seman*c  Parsing  to  Reasoning          Lenhart  Schubert     University  of  Rochester  
  • 2. Overall  objec*ve:              Broad,  genuine  language  understanding,  allowing  reasoning              (beyond  answer  extrac6on  or  classifica6on);   My  view  of  intelligent  ac*vity:   •     Pa6ern  matching/recogni:on   •     Pa6ern  transduc:on  (template-­‐to-­‐template,  or  tree-­‐to-­‐tree)   •     Learning  (and  associa:ve  storage/retrieval)  of  pa6erns  and  transduc:ons   But  animals  do  this    -­‐-­‐  how  are  we  special?                  We  have  the  ability  to  learn,  store,  manipulate,  &  communicate                  meaningful  symbolic  pa6erns  –  seman:c/knowledge  representa:ons   Issues:   •       What  sorts  of  seman:c  representa:ons  do  we  need  for  broad  NLU?   •       How  can  we  derive  reliable  ini:al  logical  forms  (LFs)?   •       What  sorts  of  background  knowledge  do  we  require?   •       What  sorts  of  inference  methods  are  required  to  enable  human-­‐like            understanding  and  reasoning?   •       How  we  can  acquire  the  necessary  knowledge?  
  • 3.              An  Example  of  genuine  understanding  and  reasoning                              Alicia  drove  home  from  her  holiday  visit  to  the  US.                              What  border(s)  did  she  cross  in  her  drive?                        Visi%ng  a  place  generally  entails  having  one's  current  place  of                            residence  away  from  that  place,  going  to  it,  staying  there  in                            the  expecta%on  of  some  immediate  rewards,  and  then  leaving                            it,  typically  going  back  to  one's  place  of  residence.                      “Home”  is  a  person's  permanent  place  of  residence.                        The  US  is  a  country,  and  leaving  a  country  entails  crossing  its  border.                        Driving  takes  place  on  land.                      The  only  land  borders  of  the  US  are  with  Canada  and  Mexico.                    Along  with  lexical  and  paraphrase  knowledge  # Alicia  crossed  the  border  with  Canada  OR  Mexico                                              (and  perhaps  others,  e.g.,  from  Mexico  into  Guatemala).                    Also,  it's  quite  possible  that  Alicia  is  a  resident  of  Canada  or  Mexico,                      and  that  she  is  a  ci:zen  of  one  of  those  countries.  
  • 4. A  (s6ll)  more  demanding  example    When  Randy  learned  that  his  metasta:c  cancer  was  terminal,  he  decided  to  stop  receiving    chemotherapy  and  enrol  in  a  hospice  program  designed  to  provide  pallia:ve  care.                    Why  did  Randy  decide  this?                     When  you  learn  something,  you  then  know  it;                              (so  Randy  knew  he  had  terminal  metasta%c  cancer);                          When  someone  learns  (or  knows)  that  something  is  the  case,  it  is  indeed  the  case;                                (so  Randy  had  terminal  metasta%c  cancer).                          Terminal  metasta*c  cancer  is  usually  fatal  within  a  few  months;                              (thus  Randy  was  des%ned  to  die  within  a  few  months);                          Chemotherapy  is  intended  to  combat  cancer  and  prolong  life,                              but  results  in  suffering  and  weakness;                          No  medical  treatment  will  significantly  prolong  a  terminal  cancer  pa*ent's  life;                              chemotherapy  is  a  medical  treatment;                          Stopping  something  entails  it  was  going  on;                                (so  Randy  had  been  receiving  chemotherapy,  and  therefore  had  endured  suffering);                          Receiving  pallia*ve  care  reduces  pain  and  discomfort;                          Enrolling  in  a  program  to  provide  certain  services  will  lead  to  receiving  those  services;                                (so  Randy  would  receive  pallia%ve  care);                          If  Randy  con%nued  receiving  chemotherapy,  he  would  endure  further  suffering                                without  significant  life  extension,  while  pallia%ve  care  would  make  him  feel  bePer;                          People  act  to  op*mize  expected  rewards  and  minimize  suffering;        so  if  Randy  knew  all  of  the  above,  his  choice  of  pallia:ve  care  instead  of  chemotherapy  is  explained.  
  • 5.  Example  con6nued   How  did  Randy  know  all  this?         Commonsense  inferences  that  "jump  out”  at  me  also  "jump  out"  at  others            (who  possess  the  same  premise  knowledge)  –  “simula:ve  inference”       All  the  items  above  are  common  knowledge  (especially  to  cancer  pa%ents),          so  the  indicated  inferences  were  just  as  obvious  to  Randy  as  they  are  to  me;         So  the  presump%on  previously  underscored  (Randy  knew/inferred  all  those  facts)          surely  holds,  and  Randy's  choice  is  explained.   (Again,  we're  also  presupposing  a  lot  of  lexical  &  paraphrase  knowledge:   “terminal”  illness,  “fatal”  condi%on,  “medical  treatment”,  “pallia%ve  care”,   “op%mize”,  “life  extension”,  “suffering”,  etc.)  
  • 6.  Expressive  devices  encountered  in  the  two  examples:            Predica:on,  of  course  (Alicia  visited  the  US,  the  US  is  a  country,                and  so  on)            Temporally  related  events  (driving  somewhere,  staying,  returning)                and  their  implicit  consequences  (crossing  borders,  enjoyment)            Causal  rela:ons    (chemotherapy  causes  suffering,  possible  life  prolonga%on)            Geographic  rela:onships  (perhaps  dependent  on  "mental  maps")            Conjunc:on  and  disjunc:on  (the  US  borders  on  Canada  and  Mexico;                Alicia  drove  into  Canada  or  Mexico)            Nega:on  (if  you  leave  a  place,  you  are  then  not  in  that  place;                not  receiving  significant  benefits  from  chemotherapy)            Quan:fica:on  (almost  everyone  knows  that  chemotherapy  is  used                to  treat  cancer;  no  medical  treatment  will  significantly  prolong                a  terminal  cancer  pa%ent's  life;   And  that’s  not  all  …  
  • 7. Further  demands  on  expressivity                    Genericity  -­‐-­‐  almost  all  the  general  knowledge  listed  has  the  character  of  applying                    in  “typical”  cases,    but  allowing  for  excep:ons;              Pa6erns  of  behavior  (holiday  trips;    the  usual  course  of  events  if  you  get  cancer);                    this  is  of  course  generic    knowledge;              Modal/mental  no:ons    (learning,  knowing,  expec:ng,  deciding,  inferring,  intending,  …)              Counterfactuals  (deciding  against  something  because  of  the  adverse  consequences                  it  would  have);              Uncertainty    (Alicia's  probable  home  country,  Randy's  life  expectancy)              Predicate  modifica:on    (terminal  metasta:c  cancer,  pallia:ve  care,  con:nuing/stopping                    receiving    chemotherapy,    feel  bePer)              Sentence  modifica:on  (probably,  Alicia  lives  in  Canada  or  in  Mexico;  possibly  she  lives  in                      Guatemala)              Predicate  reifica:on  (driving  takes  place  on  land;  pallia:ve  care  reduces  suffering)              Sentence  reifica:on  (Randy  learned  that  his  metasta:c  cancer  was  terminal)   Are  any  of  these  devices  peculiar  to  English?  
  • 8. These  devices  are  available  in  all  languages!     (A  cultural  accident,  or  a  reflec%on  of  our  “mentalese”  seman%c  types?)    My  working  hypothesis:      We  need            sufficiently  expressive  representa%ons  of  linguis%c  content;            ways  of  deriving  reliable  ini%al  logical  forms  (LFs);            sufficient  lexical  and  world  knowledge  (including  paPern/schema-­‐like                  knowledge)  to  elaborate  ini%al  LFs  into  the  intended  content,                  and  understand  and  reason  with  that  content;  
  • 9.  Candidates  for  seman6c  representa6on  and  knowledge  representa6on        (discussed  &  cri%qued  in  Schubert,  AAAI  '15;  cri%cisms  here  are  “caricatures”)            FOL,  DRT  (e.g.,  Allen,  Jurafsky  &  Mar%n,  Kamp,  Heim,  J.  Bos,  ...)  [expressively  inadequate]            Seman6c  nets  (wide  spectrum:  Shapiro,  Sowa,  Schubert,  ConceptNet,  ...);  [any  nota%on  can  be  cast  as  SN]            Descrip6on  logics  (CLASSIC,  LOOM,  OWL-­‐DL,  KAON,  SROIQ,  ...)        [expressively  inadequate]            Conceptual  meaning  representa6ons  (Schank's  CD,  Jackendoff,  FrameNet,  ...)  [expr./infer.  inadequate]            Thema6c  role  representa6ons  (e.g.,  Palmer,  Gildea,  &  Xue  ’10)  [expr./infer.  inadequate]            Abstract  meaning  representa6on  (AMR)  (Banarescu  et  al.  '13)  [inferen%ally  inadequate]            Hobbs'  "flat"  representa6on  (Hobbs  '06)    [conflates  dis%nct  types]            Structured  English  (e.g.,  MacCartney  &  Manning  '09,  Dagan  et  al.  '08,  …);  [ambiguous,  inferen%ally  inadequate]            Montague  Grammar  (English  as  logic)  (e.g.,  Dowty  '79,  Chierchia  &  McConnell-­‐Ginet  '00);                [unnecessarily  complex,  higher-­‐order]            Extensional  Montague  fragments  (e.g.,  McAllester  &  Divan  '92,  Artzi  &  ZePlemoyer  '13);                  [expressively  inadequate]            DCS  trees  (Liang  et  al.  '11);  [expressively  inadequate]            Situa6on  seman6cs  (Reichenbach  '47,  Barwise  &  Perry  '83)  [abstruse,  inferen%ally  inadequate]            Episodic  Logic  (EL)    [remedies  many  of  these  flaws;  s%ll  briPle,  lacks  adequate  KB]  
  • 10. Episodic  Logic  (EL)  –  Montague-­‐inspired,  first-­‐order,  situa*onal,  intensional    A  language-­‐like,  first-­‐order  SR/KR  with  a  small  number  of  types  (but  abstract  individuals);    LFs  are  obtained  composi:onally  from  phrase  structure  trees;      Handles  most  seman%c  phenomena  shared  by  NLs;  all  types  of  referents;        allows  complex  situa%ons/events,  with  temporal/causal  rela%ons      John  donated  blood  to  the  Red  Cross.          [John1  <past  donate.v>  (K  blood.n)  Red_Cross]    {ini%al  representa%on}          (some  e:  [e  before  Now3]                                Skolemize,  split        [E1.sk  before  Now3],  [Blood1.sk  blood.n],                      (some  x:  [x  blood.n]                                                                                                      [[John1  donate.v                                  [[John1  donate.v    x  Red_Cross1]  **  e]                                              Blood1.sk  Red_Cross1]  **  E1.sk  ]      Very  few  people  s:ll  debate  the  fact  that  the  earth  is  hea:ng  up  {final  representa%on}:                [Fact4.sk  fact.n],                    [Fact4.sk  =  (that  (some  e0:  [e0  at-­‐about  Now0]                                                                                                                  [(The  z  [z  earth.n]  [z  heat_up.v])  **  e0]))],                ((fquan  (very.adv  few.a))  x:  [x  (plur  person.n)]  (s%ll.adv  (l  v  [v  debate.v  Fact4.sk])))            Unfortunately,  faulty/underspecified  syntac:c  analyses  lead  to  faulty  LFs.        We  don’t  have  enough  (reliable)  seman:c  pa6ern  knowledge.  
  • 11. The  EPILOG  system  for  Episodic  Logic        (L.  Schubert,  C.-­‐H.  Hwang,  S.  Schaeffer,  F.  Morbini,    Purtee,  ...)   episode   set   hier2   color   meta   number   string   %me   type   equality   parts   other   LOGICAL  INPUT   LOGICAL  OUTPUT      EPILOG          core   reasoner    Specialist    Interface        “A  car  crashed  into  a  tree.  …”   (some e: [e before Now34] (some x: [x car] (some y: [y tree] [[x crash-into y] ** e])))      “The  driver  of  x  may                be  hurt  or  killed”   KNOWLEDGE                                                    Expressive  richness  does  not  impede  inference:                        EPILOG  2  holds  its  own  on  large  FOL  problems  (Morbini  &  Schubert  ’09);    but  inference  remains  briPle;    uncertainty  handling  is  heuris%c;  KB  remains  inadequate  
  • 12. Example  using  “most”  (from  J.F.  Allen’s  ‘Monroe  emergency’  domain):    Most  front  loaders  are  currently  in  use;    Whatever  equipment  is  in  use  in  unavailable;    Front  loaders  are  equipment                Therefore,  most  front  loaders  are  currently  unavailable.      (most  x:    [x  front-­‐loader]  [[x  in-­‐use]  @  Now3]);      (all  x:  [x  equipment]  (all  e  [[[x  in-­‐use]  @  e]  =>  [(not  [x  available])  @  e]]));      (all  x:  [x  front-­‐loader]  [x  equipment])                    (most  x:  [x  front-­‐loader]  [(not  [x  available])  @  Now3])   Example  involving  a^tudes  (English  glosses  of  EL  formulas)    Alice  found  out  that  Mark  Twain  is  the  same  as  Samuel  Clemens.      When  someone  finds  out  something,  s/he  doesn’t  know  it  to  be  true  at    the  beginning  (of  the  finding-­‐out  event)  but  knows  it  to  be  true  at  the  end.      Therefore:    -­‐    Alice  didn’t  know  (before  finding  out)  that  Mark  Twain  is  the  same          as  Samual  Clemens;    -­‐    Alice  knew  a€erwards  that  Mark  Twain  is  the  same  as  Samuel  Clemens;    -­‐    Mark  Twain  is  the  same  as  Samuel  Clemens  (from  knowing-­‐axioms).  
  • 13. EPILOG  inference  resembles  Natural  Logic  (Nlog)  but  is  more  general.   An  example  beyond  the  scope  of  Nlog    (again  from  Allen's  Monroe  domain): Every available crane can be used to hoist rubble onto a truck. The small crane, which is on Clinton Ave, is not in use. Therefore: the  small  crane  can  be  used  to  hoist  rubble  from                the  collapsed  building  on  Penfield  Rd  onto  a  truck.         Every  available  crane  can  be  used  to  hoist  rubble  onto  a  truck                              (s  '(all  x  (x  ((aPr  available)  crane))                                            (all  r  (r  rubble)                                                  ((that  (some  y  (y  person)                                                                            (some  z  (z  truck)  (y  (adv-­‐a  (for-­‐purpose  (Ka  (adv-­‐a  (onto  z)  (hoist  r))))                                                                                                                                        (use  x))))))  possible))))         The  small  crane,  on  Clinton  Ave.,  is  not  in  use.                            (s  '(the  x  (x  ((aPr  small)  crane))  ((x  on  Clinton-­‐Ave)  and  (not  (x  in-­‐use)))))         Every  crane  is  a  device                          (s  '(all  x  (x  crane)  (x  device)))         Every  device  that  is  not  in  use  is  available                            (s  ‘(all  x  ((x  device)  and  (not  (x  in-­‐use)))  (x  available)))   Can  the  small  crane  be  used  to  hoist  rubble  from  the  collapsed  building   on  Penfield  Rd  onto  a  truck?  (Answered    affirma:vely  by  EPILOG  in  .127  sec)                              (q    (p  ‘(the  x  (x  ((aPr  small)  crane))                                                        (some  r  ((r  rubble)  and                                                                                    (the  s  ((s  (aPr  collapsed  building))  and  (s  on  Penfield-­‐Rd))                                                                                                        (r  from  s)))                                                                                  ((that  (some  y  (y  person)                                                                                                            (some  z  (z  truck)                                                                                                                  (y  (adv-­‐a  (for-­‐purpose  (Ka  (adv-­‐a  (onto  z)  (hoist  r))))                                                                                                                                                (use  x))))))  possible)))))  
  • 14.                                                                        Types  of  knowledge  required   Pa^erns  of  predica6on,  modifica6on  (tens  of  millions!):  for  parser  guidance      e.g.,  person  see  bird;  see  with  viewing  instruments;  bird  with  feathers;                        tail  feathers;  colored  feathers                          Disambiguate  “He  saw  a  bird  with  {binoculars  |  yellow  tail  feathers}   Pa^erns  of  ac6ons/events  and  rela6onships:  for  expanding  /connec%ng  sentences      e.g.,  Dyn-­‐schema  [Person  x  visits  foreign-­‐country  y]    (episode  e):                          Init-­‐conds:      [x  loc-­‐at  u:<some  (place  in  (home-­‐country-­‐of  y))>]  (episode  e1),                          Co-­‐conds:        [x  have  v:<some  (travel  paraphernalia  for  y  e)>]  (episode  e2)                          Steps:                      [x  travel  from  u  to  w:<some  (place  in  y)>]  (episode  e3),                                                                      [x  do  some  ac%vi%es  in  y]  (episode  e4),                                                                      [x  travel  from  z:<some  (place  in  y)>  to  u]  (episode  e5)                          Effects:                  [x  obtain  g:<some  (gra%fica%on-­‐from  e4)>]  (episode  e6)                          Constr:                  [e  =  (join-­‐of  e3  e4  e5  e6)],  [e1  starts  e],  [e2  same-­‐%me  e],                                                                      [e3  consec  e4  e5],  [e6  during  e4]      Similarly,  possible  paPerns  of  events  for  cancer  pa%ent  diagnosis,  surgery,  chemo,  …)      Similarly,  “object  u%lity”  paPerns  (what  can  you  do  with  an  apple?  a  pen?  a  car?  …)        Similarly,  “disposi%onal”  paPerns  (dogs  bark;  fragile  object  tend  to  break  on  impact)   Lexical  and  paraphrase  knowledge  (dogs  are  land  mammals;  pens  are  wri%ng  instruments;                        trees  are  plants  with  a    tall  wooden  trunk  and  a  branched  canopy  bearing  leaves;                        to  kill  is  to  render  dead;  to  walk  is  to  advance  on  foot;  managing  to  do  x  entails  doing  x;  etc.)   Condi6onal/generic  world  knowledge  (if  you  drop  an  object,  it  will  hit  the  ground;                          most  dogs  are  someone’s  pet;  dogs  are  generally  friendly;  chemotherapy                          tends  to  cause  nausea  and  hair  loss;  …)   Specialist  knowledge:  taxonomies,  partonomies,  temporal  rela%ons,  arithme%c  &  scales,                          geometric/imagis%c  representa%ons,  sets,  symbolic  expressions  (incl.  language),  …  
  • 15. Some  a`empts  to  address  the  “Knowledge  Acquisi*on  Bo`leneck”   We  have  plenty  of  textual  “knowledge”,  but  liPle              -­‐    schema%c  paPern  knowledge  for  understanding  (and  behavior);              -­‐  “if-­‐then”  lexical  and  world  knowledge  for  reasoning!   Past  and  ongoing  efforts  in  my  Rochester  group:       KNEXT  –  knowledge  extrac%on  from  text,              aimed  at  general  factoids  (typically,  paPerns  of  predica%on)     “Sharpening”  and  abstrac%ng  of  KNEXT  factoids  into  quan%fied  generaliza%ons            (Lore,  successor  to  KNEXT)       Lexical  knowledge  engineering  (par%ally  automated),  esp.  for  frequent  and          “primi%ve”  verbs,  several  VerbNet  classes,  implica%ves,  a„tudinal  verbs       Automa%c  WordNet  gloss  interpreta%on  (in  progress)       Computer-­‐graphics-­‐based  object/scene  representa%on  &  inference       Experimental  schema  engineering,  to  assess  syntac%c/seman%c  requirements       Schema  learning  (future  work)    
  • 16. “Sharpening”  KNEXT  factoids      (using  transduc%on  paPerns,    seman%c  info  from  WordNet,    VerbNet,  etc.)   E.g.,  A  person  may  have  hair          All  or  most  persons                    permanently  have  some                  hair  as  part          (all-­‐or-­‐most  x:    [x  person]                  (some  e:  [(x  .  e)  permanent]                          (some  y:  [y  hair]                                  [[x  have-­‐as-­‐part  y]  **  e])))   Sample  inferences:   Dana  is  a  person       Probably,  Dana  permanently   has  some  hair  as  part.    (probably            (some  e:  [(Dana  .  e)  permanent]                      (some  y:  [y  hair]                              [[Dana  has-­‐as-­‐part  y]  **  e])))   ACME  is  a  company       Probably,  ACME  occasionally   announces  a  product.    (probably          (occasional  e                      (some  y:  [y  product]                                [[ACME  announce  y]  **  e])))  
  • 17. ~150  “primi*ve”  verbal  concepts,  with  axioms        (MOVE,  GRASP,  SEE,  LEARN,  MAKE,  ASK-­‐OF,  CONVEY-­‐INFO-­‐TO,  WANT-­‐TBT,  …)      Several  hundred  axioms  for  VerbNet  classes        (e.g.,  state-­‐change  concepts  like  BREAK,  REPAIR,  MELT,  etc.)  in  terms  of  “primi%ves”                and  “predicate  parameters”,  inserted  into  2-­‐4  axiom  schemas  per  class)      WordNet:  77,000  formal  axioms  derived  from  WN  nominal  hierarchy        (used  mass/count  dis%nc%on  and  various  other  features  to  dis%nguish        the  rela%on  between  pairs  like  <seawater,  water>    all  seawater  is  water,        and  like  <gold,  noble_metal>    gold  (the  kind  of  stuff)  is  a    noble_metal  )      Gloss  interpreta*on  (in  progress):  E.g.,  x  slam2.v  y  in  event  e          x  violently  strike1.v  y,  and  x  is  probably  a  person  and  y  is  probably        a  thing12.n  (physical  en:ty).  Problems:  Many  glosses  are  quasi-­‐circular        (admire    feel  admira:on  for),  don’t  apply  to  al  synset  members,  and        don’t  provide  major  entailments  (like,  dying  results  in  being  dead!)      Graphics-­‐based  scene  modeling  in  first-­‐reader  stories:          Rosy  and  Frank  see  the  nest  in  the  apple  tree.          Why  can’t  they  tell  whether  there  are  eggs  in  the  nest?                                                                                                Visual  occlusion  by  the  nest  itself!   Current  preliminary  schema  work:  experimen%ng  with  schema  syntax  (like            the  “visi%ng  a  foreign  country”  example),  to  be  used  as  target  formalism  for          learning  schemas  from  text.  
  • 18.  Concluding  comments              Reliable  seman%c  parsing  requires  reliable  syntac%c  parsing;                  need  guidance  by  paPerns  of  predica%on,  modifica%on,  etc.  (KNEXT-­‐like)              EL  provides  an  expressively  adequate  representa%on  close  to  language              Inference  methods  beyond  those  of  FOL  are  implemented              Probabilis%c  inference  remains  ad  hoc              KA  boPleneck  is  under  aPack,  but  far  from  vanquished;                  schemas  (containing  EL  formulas)  seem  to  be  the  kind  of  “so€”                  representa%on  that  will  support  genuine  understanding,  reasoning  
  • 19. •  L.K.  Schubert,  "Seman%c  representa%on",  29th  AAAI  Conference  (AAAI15),  Jan.  25-­‐30,  2015,  Aus%n,  TX.  Slides  of  the  talk.     •  E.  Bigelow,  D.  Scarafoni,  L.  Schubert,  and  A.  Wilson,  "On  the  need  for  imagis%c  modeling  in  story  understanding",  Biologically  Inspired   Cogni:ve  Architectures  11,  Jan.  2015,  22-­‐-­‐28.  (Presented  at  Ann.  Int.  Conf.  on  Biologically  Inspired  Compu%ng  Architectures  (BICA  2014),   Nov.  7-­‐9,  MIT,  Cambridge,  MA,  2014.)     •  L.K.  Schubert,  Computa%onal  linguis%cs",  in  Edward  N.  Zalta  (Principal  Editor),  Stanford  Encyclopedia  of  Philosophy,  CSLI,  Stanford,  CA. (100pp),  2014.  L.K.  Schubert,  "From  Treebank  parses  to  Episodic  Logic  and  commonsense  inference",  Proc.  of  the  ACL  2014  Workshop  on   Seman%c  Parsing,  Bal%more,  MD,  June  26,  ACL,  55-­‐60.   •   L.K.  Schubert,  "NLog-­‐like  inference  and  commonsense  reasoning",  in  A.  Zaenen,  V.  de  Paiva,  &  C.  Condoravdi  (eds.),  Seman:cs  for  Textual   Inference,  special  issue  of  Linguis%c  Issues  in  Language  Technology  (LiLT)  9(9),  2013.  (The  pdf  file  is  a  preliminary  version,  Dept.  of  Computer   Science,  University  of  Rochester,  Oct.  2012.)   •   J.  Gordon  and  L.K.  Schubert,  WordNet  hierarchy  axioma%za%on  and  the  mass-­‐count  dis%nc%on",  7th  IEEE  Int.  Conf.  on  Seman%c  Compu%ng   (ICSC  2013),  September  16-­‐18,  Irvine,  CA,  2013.   •   A.  Purtee  and  L.K.  Schubert,  "TTT:  A  tree  transduc%on  language  for  syntac%c  and  seman%c  processing",  EACL  2012  Workshop  on   Applica%ons  of  Tree  Automata  Techniques  in  Natural  Language  Processing  (ATANLP  2012),  Avignon,  France,  Apr.  24,  2012.   •  K.  Stratos,  L.K.  Schubert,  &  J.  Gordon,  "Episodic  Logic:  Natural  Logic  +  reasoning",  Int.  Conf.  on  Knowledge  Engineering  and  Ontology   Development,  (KEOD'11),  Oct  26-­‐29,  Paris,  2011.     •  Jonathan  Gordon  and  Lenhart  Schubert,  "Quan%fica%onal  sharpening  of  commonsense  knowledge",  Proc.  of  the  AAAI  Fall  Symposium  on   Commonsense  Knowledge,  Arlington,  VA,  Nov.  11-­‐13,  2010.  L.K.  Schubert,  "From  generic  sentences  to  scripts",  IJCAI'09  Workshop  W22,   Logic  and  the  Simula%on  of  Interac%on  and  Reasoning  (LSIR  2),  Pasadena,  CA,  July  12,  2009.     •  F.  Morbini  and  L.K.  Schubert,  "Evalua%on  of  Epilog:  A  reasoner  for  Episodic  Logic",  Commonsense'09,  June  1-­‐3,  2009,  Toronto,  Canada.  Also   available  at  hPp://commonsensereasoning.org/2009/papers.html     •  Benjamin  Van  Durme  and  Lenhart  K.  Schubert,  "Open  knowledge  extrac%on  using  composi%onal  language  processing",   Symposium  on  Seman%cs  in  Systems  for  Text  Processing  (STEP  2008),  September  22-­‐24,  2008  -­‐  Venice,  Italy.     •  A.N.  Kaplan  and  L.K.  Schubert,  "A  computa%onal  model  of  belief",  Ar:ficial  Intelligence  120(1),  June  2000,  119-­‐160.   •  L.K.  Schubert  and  C.H.  Hwang,   "Episodic  Logic  meets  LiPle  Red  Riding  Hood:  A  comprehensive,  natural  representa%on  for  language  understanding",  in  L.   Iwanska  and  S.C.  Shapiro  (eds.),  Natural  Language  Processing  and  Knowledge  Representa:on:  Language  for  Knowledge  and   Knowledge  for  Language,  MIT/AAAI  Press,  Menlo  Park,  CA,  and  Cambridge,  MA,  2000,  111-­‐174.     Publications (from my web page, http://www.cs.rochester.edu/u/schubert/)