SlideShare a Scribd company logo
1 of 5
Download to read offline
Research Prototyping in Games
  General: C t th b t possible
   G       l Create the best       ibl
  design, guided by design goals.
 Here: Create a prototype that can yield
  the most knowledge or insight to a
  particular question or area of inquiry.

 Build it to understand it (Stern & Mateas
  2005))
 Wicked Problems (Churchman 1967)
Challenges
 To do game design, but not only aiming
  to do a good design, but also gain
  answers to certain questions.
 Design for the (always limited) play
  tests: to balance how big or small the
  vertical slice should be
                        be.
Introductions
   Organizers: Mirjam P Eladhari (Malta University, Gotland
    University), Elina M.I. Ollila (Independent), Anne Sullivan
    (Univ Of California, Santa Cruz)
    (Univ.    California
   Program Committee: Stephane Bura (Namaste Ent.), Dan
    Cook (Spry Fox) Joris Dormans (Univ Of Amsterdam)
                                        (Univ.  Amsterdam),
    Jussi Holopainen (Nokia), Ian Horswill (Northwestern
    University), Mark Nelson (IT University of Copenhagen),
    Brian Schwab (Blizzard Entertainment)
   Speakers: Mark Nelson, Emmet Tomai, Rosendo Salazar,
    Dave Salinas, Jon Manker
   Participants
Program
9:00a - 9:30a Welcome
9:30a - 10:30a Morning Session 1
     9:30a - 10:00a - Prototyping Kant-inspired Reflexive Game Mechanics - Mark Nelson
     10:00a - 10:30a - An MMORPG Prototype for Investigating Adaptive Quest Narratives and Player
     Behavior - Emmet Tomai, Rosendo Salazar and Dave Salinas

10:30a - 11:00a Break

11:00a - noon Morning Session 2
     11:00a - 11:30a - Testing the Designscape – Prototyping a Game Prototyping Tool - Jon Manker
     11:30a - noon - The Research Prototyping Toolbox - Elina MI Ollila

noon - 1:30p Lunch

1:30p 2:00p Presentation of workshop
1 30 - 2 00 P        t ti  f   k h
2:00p - 3:00p - Group work

3:00p - 3:30p Break

3:30p - 4:15p - Group work
4:15p - 5:00p - Discussion and wrap-up

More Related Content

More from Mirjam Eladhari

Four ways game research field approach narrative
Four ways game research field approach narrativeFour ways game research field approach narrative
Four ways game research field approach narrativeMirjam Eladhari
 
TOG: An Innovation Centric Approach to teaching Computational Expression and ...
TOG: An Innovation Centric Approach to teaching Computational Expression and ...TOG: An Innovation Centric Approach to teaching Computational Expression and ...
TOG: An Innovation Centric Approach to teaching Computational Expression and ...Mirjam Eladhari
 
Constructive Alignment in
 Teaching Game Research 
 in Game Development 
 Bac...
Constructive Alignment in
 Teaching Game Research 
 in Game Development 
 Bac...Constructive Alignment in
 Teaching Game Research 
 in Game Development 
 Bac...
Constructive Alignment in
 Teaching Game Research 
 in Game Development 
 Bac...Mirjam Eladhari
 
Research Overview Mirjam P Eladhari August 2019
Research Overview Mirjam P Eladhari August 2019Research Overview Mirjam P Eladhari August 2019
Research Overview Mirjam P Eladhari August 2019Mirjam Eladhari
 
Ludocriticism -
 Steps Towards a Critical Framework for Games
Ludocriticism -
 Steps Towards a Critical Framework for Games Ludocriticism -
 Steps Towards a Critical Framework for Games
Ludocriticism -
 Steps Towards a Critical Framework for Games Mirjam Eladhari
 
Workshop on Teaching Games: Pedagogical Approaches at DIGRA2019
Workshop on Teaching Games:  Pedagogical Approaches at DIGRA2019Workshop on Teaching Games:  Pedagogical Approaches at DIGRA2019
Workshop on Teaching Games: Pedagogical Approaches at DIGRA2019Mirjam Eladhari
 
Re-Tellings: The Fourth Layer of Narrative as an Instrument for Critique
Re-Tellings: The Fourth Layer of Narrative as an Instrument for CritiqueRe-Tellings: The Fourth Layer of Narrative as an Instrument for Critique
Re-Tellings: The Fourth Layer of Narrative as an Instrument for CritiqueMirjam Eladhari
 
Re-Tellings: The Fourth Layer of Narrative as an Instrument for Critique (wit...
Re-Tellings: The Fourth Layer of Narrative as an Instrument for Critique (wit...Re-Tellings: The Fourth Layer of Narrative as an Instrument for Critique (wit...
Re-Tellings: The Fourth Layer of Narrative as an Instrument for Critique (wit...Mirjam Eladhari
 
SGC18 Talk at Sweden Game Conference 2018
SGC18 Talk at Sweden Game Conference 2018SGC18 Talk at Sweden Game Conference 2018
SGC18 Talk at Sweden Game Conference 2018Mirjam Eladhari
 
Bleed in, Bleed Out – A Design Case in Board Game Therapy
Bleed in, Bleed Out – A Design Case in Board Game TherapyBleed in, Bleed Out – A Design Case in Board Game Therapy
Bleed in, Bleed Out – A Design Case in Board Game TherapyMirjam Eladhari
 
Methods, History, and Impact - Directions in Game Design Research
Methods, History, and Impact - Directions in Game Design ResearchMethods, History, and Impact - Directions in Game Design Research
Methods, History, and Impact - Directions in Game Design ResearchMirjam Eladhari
 
Computational narrative and narrative systems
Computational narrative and narrative systemsComputational narrative and narrative systems
Computational narrative and narrative systemsMirjam Eladhari
 
Beyond believable agents - employing AI for improving game like simulations f...
Beyond believable agents - employing AI for improving game like simulations f...Beyond believable agents - employing AI for improving game like simulations f...
Beyond believable agents - employing AI for improving game like simulations f...Mirjam Eladhari
 
Designing for Creativity and Kindness in Games
Designing for Creativity and Kindness in GamesDesigning for Creativity and Kindness in Games
Designing for Creativity and Kindness in GamesMirjam Eladhari
 
AI Based Game Design - Teaching how to expand designers' artistic palette wit...
AI Based Game Design - Teaching how to expand designers' artistic palette wit...AI Based Game Design - Teaching how to expand designers' artistic palette wit...
AI Based Game Design - Teaching how to expand designers' artistic palette wit...Mirjam Eladhari
 
Social Simulation in Games
Social Simulation in GamesSocial Simulation in Games
Social Simulation in GamesMirjam Eladhari
 
Players Imbuing Meaning: Co-creation of Challenges in a prototype MMO
Players Imbuing Meaning: Co-creation of Challenges in a prototype MMOPlayers Imbuing Meaning: Co-creation of Challenges in a prototype MMO
Players Imbuing Meaning: Co-creation of Challenges in a prototype MMOMirjam Eladhari
 
The role of ai in social games eladhari2011 uppsalauni
The role of ai in social games eladhari2011 uppsalauniThe role of ai in social games eladhari2011 uppsalauni
The role of ai in social games eladhari2011 uppsalauniMirjam Eladhari
 
Avatars bridging the semantic gap eladhari 2007
Avatars bridging the semantic gap eladhari 2007Avatars bridging the semantic gap eladhari 2007
Avatars bridging the semantic gap eladhari 2007Mirjam Eladhari
 
Experimental Game Prototyping and Play Testing using Iterative Design
Experimental Game Prototyping and Play Testing using Iterative DesignExperimental Game Prototyping and Play Testing using Iterative Design
Experimental Game Prototyping and Play Testing using Iterative DesignMirjam Eladhari
 

More from Mirjam Eladhari (20)

Four ways game research field approach narrative
Four ways game research field approach narrativeFour ways game research field approach narrative
Four ways game research field approach narrative
 
TOG: An Innovation Centric Approach to teaching Computational Expression and ...
TOG: An Innovation Centric Approach to teaching Computational Expression and ...TOG: An Innovation Centric Approach to teaching Computational Expression and ...
TOG: An Innovation Centric Approach to teaching Computational Expression and ...
 
Constructive Alignment in
 Teaching Game Research 
 in Game Development 
 Bac...
Constructive Alignment in
 Teaching Game Research 
 in Game Development 
 Bac...Constructive Alignment in
 Teaching Game Research 
 in Game Development 
 Bac...
Constructive Alignment in
 Teaching Game Research 
 in Game Development 
 Bac...
 
Research Overview Mirjam P Eladhari August 2019
Research Overview Mirjam P Eladhari August 2019Research Overview Mirjam P Eladhari August 2019
Research Overview Mirjam P Eladhari August 2019
 
Ludocriticism -
 Steps Towards a Critical Framework for Games
Ludocriticism -
 Steps Towards a Critical Framework for Games Ludocriticism -
 Steps Towards a Critical Framework for Games
Ludocriticism -
 Steps Towards a Critical Framework for Games
 
Workshop on Teaching Games: Pedagogical Approaches at DIGRA2019
Workshop on Teaching Games:  Pedagogical Approaches at DIGRA2019Workshop on Teaching Games:  Pedagogical Approaches at DIGRA2019
Workshop on Teaching Games: Pedagogical Approaches at DIGRA2019
 
Re-Tellings: The Fourth Layer of Narrative as an Instrument for Critique
Re-Tellings: The Fourth Layer of Narrative as an Instrument for CritiqueRe-Tellings: The Fourth Layer of Narrative as an Instrument for Critique
Re-Tellings: The Fourth Layer of Narrative as an Instrument for Critique
 
Re-Tellings: The Fourth Layer of Narrative as an Instrument for Critique (wit...
Re-Tellings: The Fourth Layer of Narrative as an Instrument for Critique (wit...Re-Tellings: The Fourth Layer of Narrative as an Instrument for Critique (wit...
Re-Tellings: The Fourth Layer of Narrative as an Instrument for Critique (wit...
 
SGC18 Talk at Sweden Game Conference 2018
SGC18 Talk at Sweden Game Conference 2018SGC18 Talk at Sweden Game Conference 2018
SGC18 Talk at Sweden Game Conference 2018
 
Bleed in, Bleed Out – A Design Case in Board Game Therapy
Bleed in, Bleed Out – A Design Case in Board Game TherapyBleed in, Bleed Out – A Design Case in Board Game Therapy
Bleed in, Bleed Out – A Design Case in Board Game Therapy
 
Methods, History, and Impact - Directions in Game Design Research
Methods, History, and Impact - Directions in Game Design ResearchMethods, History, and Impact - Directions in Game Design Research
Methods, History, and Impact - Directions in Game Design Research
 
Computational narrative and narrative systems
Computational narrative and narrative systemsComputational narrative and narrative systems
Computational narrative and narrative systems
 
Beyond believable agents - employing AI for improving game like simulations f...
Beyond believable agents - employing AI for improving game like simulations f...Beyond believable agents - employing AI for improving game like simulations f...
Beyond believable agents - employing AI for improving game like simulations f...
 
Designing for Creativity and Kindness in Games
Designing for Creativity and Kindness in GamesDesigning for Creativity and Kindness in Games
Designing for Creativity and Kindness in Games
 
AI Based Game Design - Teaching how to expand designers' artistic palette wit...
AI Based Game Design - Teaching how to expand designers' artistic palette wit...AI Based Game Design - Teaching how to expand designers' artistic palette wit...
AI Based Game Design - Teaching how to expand designers' artistic palette wit...
 
Social Simulation in Games
Social Simulation in GamesSocial Simulation in Games
Social Simulation in Games
 
Players Imbuing Meaning: Co-creation of Challenges in a prototype MMO
Players Imbuing Meaning: Co-creation of Challenges in a prototype MMOPlayers Imbuing Meaning: Co-creation of Challenges in a prototype MMO
Players Imbuing Meaning: Co-creation of Challenges in a prototype MMO
 
The role of ai in social games eladhari2011 uppsalauni
The role of ai in social games eladhari2011 uppsalauniThe role of ai in social games eladhari2011 uppsalauni
The role of ai in social games eladhari2011 uppsalauni
 
Avatars bridging the semantic gap eladhari 2007
Avatars bridging the semantic gap eladhari 2007Avatars bridging the semantic gap eladhari 2007
Avatars bridging the semantic gap eladhari 2007
 
Experimental Game Prototyping and Play Testing using Iterative Design
Experimental Game Prototyping and Play Testing using Iterative DesignExperimental Game Prototyping and Play Testing using Iterative Design
Experimental Game Prototyping and Play Testing using Iterative Design
 

Recently uploaded

Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 

Recently uploaded (20)

Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 

Welcome to the Workshop on Research Prototyping in Games (WRPG 2012)

  • 1.
  • 2. Research Prototyping in Games  General: C t th b t possible G l Create the best ibl design, guided by design goals.  Here: Create a prototype that can yield the most knowledge or insight to a particular question or area of inquiry.  Build it to understand it (Stern & Mateas 2005))  Wicked Problems (Churchman 1967)
  • 3. Challenges  To do game design, but not only aiming to do a good design, but also gain answers to certain questions.  Design for the (always limited) play tests: to balance how big or small the vertical slice should be be.
  • 4. Introductions  Organizers: Mirjam P Eladhari (Malta University, Gotland University), Elina M.I. Ollila (Independent), Anne Sullivan (Univ Of California, Santa Cruz) (Univ. California  Program Committee: Stephane Bura (Namaste Ent.), Dan Cook (Spry Fox) Joris Dormans (Univ Of Amsterdam) (Univ. Amsterdam), Jussi Holopainen (Nokia), Ian Horswill (Northwestern University), Mark Nelson (IT University of Copenhagen), Brian Schwab (Blizzard Entertainment)  Speakers: Mark Nelson, Emmet Tomai, Rosendo Salazar, Dave Salinas, Jon Manker  Participants
  • 5. Program 9:00a - 9:30a Welcome 9:30a - 10:30a Morning Session 1 9:30a - 10:00a - Prototyping Kant-inspired Reflexive Game Mechanics - Mark Nelson 10:00a - 10:30a - An MMORPG Prototype for Investigating Adaptive Quest Narratives and Player Behavior - Emmet Tomai, Rosendo Salazar and Dave Salinas 10:30a - 11:00a Break 11:00a - noon Morning Session 2 11:00a - 11:30a - Testing the Designscape – Prototyping a Game Prototyping Tool - Jon Manker 11:30a - noon - The Research Prototyping Toolbox - Elina MI Ollila noon - 1:30p Lunch 1:30p 2:00p Presentation of workshop 1 30 - 2 00 P t ti f k h 2:00p - 3:00p - Group work 3:00p - 3:30p Break 3:30p - 4:15p - Group work 4:15p - 5:00p - Discussion and wrap-up

Editor's Notes

  1. Full game design that may net make sense to implement. But need larger context to understand the part. Resources.
  2. history. Realizing that thereZ is little on games research proto. Most I knew, I learned from Elina. Euproj.We wrote a paper on it. Anne using similar methodology. Many do! Build it to Understand it (2005), Wicked Problems.Now this workProgram committee composition: researchers in the wicked design space. Industry people who design in the space, and articulate thoughts in books etc. (not so much division re acadea-industry in this, more alike each other re work-driving forces than many in the home-org)Ask forName affiliation and what they want to get out from workshop