Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Partial  Models:  TowardsModeling and Reasoning    with Uncertainty M.Famelis,  R.Salay,       Partial Models: Towards Mod...
Partial  Models:  TowardsModeling and                 Intuition: Sudoku Reasoning    with Uncertainty M.Famelis,  R.Salay,...
Partial  Models:  TowardsModeling and                 Intuition: Sudoku Reasoning    with Uncertainty M.Famelis,  R.Salay,...
Partial  Models:  TowardsModeling and                 Intuition: Sudoku Reasoning    with Uncertainty M.Famelis,  R.Salay,...
Partial  Models:  TowardsModeling and                 Intuition: Sudoku Reasoning    with Uncertainty M.Famelis,  R.Salay,...
Partial  Models:  TowardsModeling and                 Intuition: Sudoku Reasoning    with Uncertainty M.Famelis,  R.Salay,...
Partial  Models:  TowardsModeling and                 Intuition: Sudoku Reasoning    with Uncertainty M.Famelis,  R.Salay,...
Partial  Models:  TowardsModeling and                 Intuition: Sudoku Reasoning    with Uncertainty M.Famelis,  R.Salay,...
Partial  Models:  TowardsModeling and                 Intuition: Sudoku Reasoning    with Uncertainty M.Famelis,  R.Salay,...
Partial  Models:  TowardsModeling and                 Intuition: Sudoku Reasoning    with Uncertainty M.Famelis,  R.Salay,...
Partial  Models:  TowardsModeling and                 Enough About Sudoku Reasoning    with Uncertainty M.Famelis,  R.Sala...
Partial  Models:  TowardsModeling and                       Goal: Uncertainty in Software Reasoning    with Uncertainty M....
Partial  Models:  TowardsModeling and                                  Designing a P2P Application Reasoning    with      ...
Partial  Models:  TowardsModeling and                                  Designing a P2P Application Reasoning    with      ...
Partial  Models:  TowardsModeling and                                  Designing a P2P Application Reasoning    with      ...
Partial  Models:  TowardsModeling and                                  Designing a P2P Application Reasoning    with      ...
Partial  Models:  TowardsModeling and                                                          Contribution Reasoning    w...
Partial  Models:  TowardsModeling and                                         In Paper / Not In Talk Reasoning    with Unc...
Partial  Models:  TowardsModeling and                                                          Contribution Reasoning    w...
Partial  Models:  TowardsModeling and                 Partial Models Reasoning    with Uncertainty M.Famelis,  R.Salay, M....
Partial  Models:  TowardsModeling and                 Partial Models Reasoning    with Uncertainty M.Famelis,  R.Salay, M....
Partial  Models:  TowardsModeling and                 Partial Models Reasoning    with Uncertainty M.Famelis,  R.Salay, M....
Partial  Models:  TowardsModeling and                 Partial Models Reasoning    with Uncertainty M.Famelis,  R.Salay, M....
Partial  Models:  TowardsModeling and                 Partial Models Reasoning    with Uncertainty M.Famelis,  R.Salay, M....
Partial  Models:  TowardsModeling and                 Partial Models Reasoning    with Uncertainty M.Famelis,  R.Salay, M....
Partial  Models:  TowardsModeling and                 Semantics of Partial Models Reasoning    with Uncertainty M.Famelis,...
Partial  Models:  TowardsModeling and                 Semantics of Partial Models Reasoning    with Uncertainty M.Famelis,...
Partial  Models:  TowardsModeling and                 Semantics of Partial Models Reasoning    with Uncertainty M.Famelis,...
Partial  Models:  TowardsModeling and                                                     Related Ideas Reasoning    with ...
Partial  Models:  TowardsModeling and                                                          Contribution Reasoning    w...
Partial  Models:  TowardsModeling and                                             1) Property Checking Reasoning    with U...
Partial  Models:  TowardsModeling and                 Property Checking: Example Reasoning    with Uncertainty M.Famelis, ...
Partial  Models:  TowardsModeling and                 Property Checking: Example Reasoning    with Uncertainty M.Famelis, ...
Partial  Models:  TowardsModeling and                 Property Checking: Example Reasoning    with Uncertainty M.Famelis, ...
Partial  Models:  TowardsModeling and                 Property Checking: Example Reasoning    with Uncertainty M.Famelis, ...
Partial  Models:  TowardsModeling and                 Property Checking: Example Reasoning    with Uncertainty M.Famelis, ...
Partial  Models:  TowardsModeling and                 Property Checking: Example Reasoning    with Uncertainty M.Famelis, ...
Partial  Models:  TowardsModeling and                 Property Checking: Example Reasoning    with Uncertainty M.Famelis, ...
Partial  Models:  TowardsModeling and                 Property Checking: Example Reasoning    with Uncertainty M.Famelis, ...
Partial  Models:  TowardsModeling and                 Property Checking: Example Reasoning    with Uncertainty M.Famelis, ...
Partial  Models:  TowardsModeling and                 Property Checking: Example Reasoning    with Uncertainty M.Famelis, ...
Partial  Models:  TowardsModeling and                 Property Checking: Example Reasoning    with Uncertainty M.Famelis, ...
Partial  Models:  TowardsModeling and                 Property Checking: Example Reasoning    with Uncertainty M.Famelis, ...
Partial  Models:  TowardsModeling and                 Property Checking: Example Reasoning    with Uncertainty M.Famelis, ...
Partial  Models:  TowardsModeling and                 Property Checking: Example Reasoning    with Uncertainty M.Famelis, ...
Partial  Models:  TowardsModeling and                 Property Checking: Example Reasoning    with Uncertainty M.Famelis, ...
Partial  Models:  TowardsModeling and                                                       2) Diagnosis Reasoning    with...
Partial  Models:  TowardsModeling and                 Diagnosis: Example Reasoning    with Uncertainty M.Famelis,  R.Salay...
Partial  Models:  TowardsModeling and                 Diagnosis: Example Reasoning    with Uncertainty M.Famelis,  R.Salay...
Partial  Models:  TowardsModeling and                                                          Contribution Reasoning    w...
Partial  Models:  TowardsModeling and                                                         Questions Reasoning    with ...
Partial  Models:  TowardsModeling and                                                         Questions Reasoning    with ...
Partial  Models:  TowardsModeling and                 Experiments Reasoning    with Uncertainty M.Famelis,  R.Salay, M.Che...
Partial  Models:  TowardsModeling and                 Experiments Reasoning    with Uncertainty M.Famelis,  R.Salay, M.Che...
Partial  Models:  TowardsModeling and                 Experiments Reasoning    with Uncertainty M.Famelis,  R.Salay, M.Che...
Partial  Models:  TowardsModeling and                 Experiments Reasoning    with Uncertainty M.Famelis,  R.Salay, M.Che...
Partial  Models:  TowardsModeling and                 Experiments Reasoning    with Uncertainty M.Famelis,  R.Salay, M.Che...
Partial  Models:  TowardsModeling and                 Experiments Reasoning    with Uncertainty M.Famelis,  R.Salay, M.Che...
Partial  Models:  TowardsModeling and                 Experiments Reasoning    with Uncertainty M.Famelis,  R.Salay, M.Che...
Partial  Models:  TowardsModeling and                 Experiments Reasoning    with Uncertainty M.Famelis,  R.Salay, M.Che...
Partial  Models:  TowardsModeling and                 Experiments Reasoning    with Uncertainty M.Famelis,  R.Salay, M.Che...
Partial  Models:  TowardsModeling and                                                         Case Study Reasoning    with...
Partial  Models:  TowardsModeling and                 Case Study Reasoning    with Uncertainty M.Famelis,  R.Salay, M.Chec...
Partial  Models:  TowardsModeling and                                            Results of Evaluation Reasoning    with U...
Partial  Models:  TowardsModeling and                                                               Summary Reasoning    w...
Partial  Models:  TowardsModeling and                 The Big Picture Reasoning    with Uncertainty M.Famelis,  R.Salay, M...
Partial  Models:  TowardsModeling and                 Next Steps Reasoning    with Uncertainty M.Famelis,  R.Salay, M.Chec...
Questions?
Partial  Models:  TowardsModeling and                                       Language Independent! Reasoning    with Uncert...
Partial  Models:  TowardsModeling and                                                        Bibliography I Reasoning    w...
Partial  Models:  TowardsModeling and                                                      Bibliography II Reasoning    wi...
Upcoming SlideShare
Loading in …5
×

Partial Models: Towards Modeling and Reasoning with Uncertainty

960 views

Published on

Published in: Business, Technology
  • Thanks, really helpful , solved some of my questions !
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Partial Models: Towards Modeling and Reasoning with Uncertainty

  1. 1. Partial Models: TowardsModeling and Reasoning with Uncertainty M.Famelis, R.Salay, Partial Models: Towards Modeling and M.Chechik, Reasoning with UncertaintyIntroductionIntuitionMotivatingExampleModeling Michalis Famelis, Rick Salay, and Marsha ChechikUncertaintyPartial ModelsSemantics University of TorontoReasoningWithUncertainty June 7, 2012PropertyChecking ICSE’12, Zurich, SwitzerlandDiagnosisEvaluationExperimentsCase StudyConclusion 1 / 29
  2. 2. Partial Models: TowardsModeling and Intuition: Sudoku Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion Created with GNOME Sudoku 2.32.0. 2 / 29
  3. 3. Partial Models: TowardsModeling and Intuition: Sudoku Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion Created with GNOME Sudoku 2.32.0. 2 / 29
  4. 4. Partial Models: TowardsModeling and Intuition: Sudoku Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion Created with GNOME Sudoku 2.32.0. 2 / 29
  5. 5. Partial Models: TowardsModeling and Intuition: Sudoku Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion Created with GNOME Sudoku 2.32.0. 2 / 29
  6. 6. Partial Models: TowardsModeling and Intuition: Sudoku Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion Created with GNOME Sudoku 2.32.0. 2 / 29
  7. 7. Partial Models: TowardsModeling and Intuition: Sudoku Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion Created with GNOME Sudoku 2.32.0. 2 / 29
  8. 8. Partial Models: TowardsModeling and Intuition: Sudoku Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion Created with GNOME Sudoku 2.32.0. 2 / 29
  9. 9. Partial Models: TowardsModeling and Intuition: Sudoku Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion Created with GNOME Sudoku 2.32.0. 2 / 29
  10. 10. Partial Models: TowardsModeling and Intuition: Sudoku Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion Created with GNOME Sudoku 2.32.0. 2 / 29
  11. 11. Partial Models: TowardsModeling and Enough About Sudoku Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion Source: Wikimedia, 3 / 29
  12. 12. Partial Models: TowardsModeling and Goal: Uncertainty in Software Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik, Modeling Explicate points of uncertaintyIntroductionIntuition Correlate points of uncertaintyMotivatingExampleModelingUncertaintyPartial Models ReasoningSemanticsReasoning Check propertiesWith Give feedback to facilitate diagnosisUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 4 / 29
  13. 13. Partial Models: TowardsModeling and Designing a P2P Application Reasoning with Trying to design a P2P client application. Uncertainty M.Famelis, R.Salay, What do I know? M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 5 / 29
  14. 14. Partial Models: TowardsModeling and Designing a P2P Application Reasoning with Trying to design a P2P client application. Uncertainty M.Famelis, R.Salay, What do I not know? M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 5 / 29
  15. 15. Partial Models: TowardsModeling and Designing a P2P Application Reasoning with Trying to design a P2P client application. Uncertainty M.Famelis, R.Salay, What do I not know? M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 5 / 29
  16. 16. Partial Models: TowardsModeling and Designing a P2P Application Reasoning with Trying to design a P2P client application. Uncertainty M.Famelis, R.Salay, How can I explicate my uncertainty and reason in its presence? M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 5 / 29
  17. 17. Partial Models: TowardsModeling and Contribution Reasoning with Uncertainty Modeling Uncertainty M.Famelis, R.Salay, M.Chechik, • Encode uncertainty in Partial Models.Introduction • Semantics: sets of conventional models.IntuitionMotivatingExampleModeling Reasoning in the Presence of UncertaintyUncertaintyPartial Models • Check properties.SemanticsReasoning • Give feedback to facilitate diagnosis.WithUncertaintyPropertyCheckingDiagnosis Evaluation of ReasoningEvaluationExperiments • Reasoning with Partial models vs. reasoning with a set ofCase Study conventional modelsConclusion 6 / 29
  18. 18. Partial Models: TowardsModeling and In Paper / Not In Talk Reasoning with Uncertainty M.Famelis, Presentation of these would take too much time: R.Salay, M.Chechik, • Encoding conventional models in logic and backIntroduction • Construction algorithm of Partial ModelsIntuitionMotivating • Propositional Normal Form (PNF)ExampleModeling • Graphical Normal Form (GNF)UncertaintyPartial Models • Diagnostic coresSemanticsReasoning • “Property-driven” refinement.WithUncertainty • Translation from PNF to GNF and vice versaPropertyCheckingDiagnosis • Evaluation of diagnostic cores and property-drivenEvaluation refinementExperimentsCase Study • Random generation of experimental inputsConclusion 7 / 29
  19. 19. Partial Models: TowardsModeling and Contribution Reasoning with Uncertainty Modeling Uncertainty M.Famelis, R.Salay, M.Chechik, • Encode uncertainty in Partial Models.Introduction • Semantics: sets of conventional models.IntuitionMotivatingExampleModeling Reasoning in the Presence of UncertaintyUncertaintyPartial Models • Check properties.SemanticsReasoning • Give feedback to facilitate diagnosis.WithUncertaintyPropertyCheckingDiagnosis Evaluation of ReasoningEvaluationExperiments • Reasoning with Partial models vs. reasoning with a set ofCase Study conventional modelsConclusion 8 / 29
  20. 20. Partial Models: TowardsModeling and Partial Models Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 9 / 29
  21. 21. Partial Models: TowardsModeling and Partial Models Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 9 / 29
  22. 22. Partial Models: TowardsModeling and Partial Models Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 9 / 29
  23. 23. Partial Models: TowardsModeling and Partial Models Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 9 / 29
  24. 24. Partial Models: TowardsModeling and Partial Models Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 9 / 29
  25. 25. Partial Models: TowardsModeling and Partial Models Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 9 / 29
  26. 26. Partial Models: TowardsModeling and Semantics of Partial Models Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 10 / 29
  27. 27. Partial Models: TowardsModeling and Semantics of Partial Models Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 10 / 29
  28. 28. Partial Models: TowardsModeling and Semantics of Partial Models Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 10 / 29
  29. 29. Partial Models: TowardsModeling and Related Ideas Reasoning with Behavioral modeling: Uncertainty • Modal Transition Systems (MTSs) [Larsen’88]. M.Famelis, R.Salay, • Disjunctive MTSs [Larsen’91]. M.Chechik,Introduction Software Product Lines:IntuitionMotivatingExample • Variability in the metamodel [Morin’09].Modeling • Featured Transition Systems [Classen’10].UncertaintyPartial ModelsSemanticsReasoning Partial Models:WithUncertainty • Language-independentPropertyChecking not just behavioral models!Diagnosis • May formula: exact encodingEvaluationExperiments thorough reasoningCase Study • Focus on systematic management of uncertaintyConclusion uncertainty-reducing refinement [VOLT’12] transformations [MiSE’12] 11 / 29
  30. 30. Partial Models: TowardsModeling and Contribution Reasoning with Uncertainty Modeling Uncertainty M.Famelis, R.Salay, M.Chechik, • Encode uncertainty in Partial Models.Introduction • Semantics: sets of conventional models.IntuitionMotivatingExampleModeling Reasoning in the Presence of UncertaintyUncertaintyPartial Models • Check properties.SemanticsReasoning • Give feedback to facilitate diagnosis.WithUncertaintyPropertyCheckingDiagnosis Evaluation of ReasoningEvaluationExperiments • Reasoning with Partial models vs. reasoning with a set ofCase Study conventional modelsConclusion 12 / 29
  31. 31. Partial Models: TowardsModeling and 1) Property Checking Reasoning with Uncertainty Property can be: M.Famelis, • True: holds for all concretizations R.Salay, M.Chechik, • False: holds for noneIntroduction • Maybe: true for some, false for othersIntuitionMotivatingExampleModelingUncertaintyPartial Models To check a property:Semantics - Encode model and property in propositional logic.ReasoningWithUncertainty - Use SAT solver.PropertyCheckingDiagnosis ΦM ∧ Φp ΦM ∧ ¬Φp Property p SAT SAT MaybeEvaluationExperiments SAT UNSAT TrueCase Study UNSAT SAT FalseConclusion UNSAT UNSAT (model inconsistent) 13 / 29
  32. 32. Partial Models: TowardsModeling and Property Checking: Example Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 14 / 29
  33. 33. Partial Models: TowardsModeling and Property Checking: Example Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 14 / 29
  34. 34. Partial Models: TowardsModeling and Property Checking: Example Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 14 / 29
  35. 35. Partial Models: TowardsModeling and Property Checking: Example Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 14 / 29
  36. 36. Partial Models: TowardsModeling and Property Checking: Example Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 14 / 29
  37. 37. Partial Models: TowardsModeling and Property Checking: Example Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 14 / 29
  38. 38. Partial Models: TowardsModeling and Property Checking: Example Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 14 / 29
  39. 39. Partial Models: TowardsModeling and Property Checking: Example Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 14 / 29
  40. 40. Partial Models: TowardsModeling and Property Checking: Example Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 14 / 29
  41. 41. Partial Models: TowardsModeling and Property Checking: Example Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 14 / 29
  42. 42. Partial Models: TowardsModeling and Property Checking: Example Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 14 / 29
  43. 43. Partial Models: TowardsModeling and Property Checking: Example Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 14 / 29
  44. 44. Partial Models: TowardsModeling and Property Checking: Example Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 14 / 29
  45. 45. Partial Models: TowardsModeling and Property Checking: Example Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 14 / 29
  46. 46. Partial Models: TowardsModeling and Property Checking: Example Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 14 / 29
  47. 47. Partial Models: TowardsModeling and 2) Diagnosis Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik, Feedback: A concretization of the Partial Model for which theIntroductionIntuition property does not hold.MotivatingExampleModelingUncertainty Reuse the results of property checking:Partial ModelsSemantics ΦM ∧ Φp ΦM ∧ ¬Φp Property pReasoningWith SAT SAT MaybeUncertainty SAT UNSAT TrueProperty UNSAT SAT FalseCheckingDiagnosis UNSAT UNSAT (model inconsistent)EvaluationExperimentsCase StudyConclusion 15 / 29
  48. 48. Partial Models: TowardsModeling and Diagnosis: Example Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 16 / 29
  49. 49. Partial Models: TowardsModeling and Diagnosis: Example Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 16 / 29
  50. 50. Partial Models: TowardsModeling and Contribution Reasoning with Uncertainty Modeling Uncertainty M.Famelis, R.Salay, M.Chechik, • Encode uncertainty in Partial Models.Introduction • Semantics: sets of conventional models.IntuitionMotivatingExampleModeling Reasoning in the Presence of UncertaintyUncertaintyPartial Models • Check properties.SemanticsReasoning • Give feedback to facilitate diagnosis.WithUncertaintyPropertyCheckingDiagnosis Evaluation of ReasoningEvaluationExperiments • Reasoning with Partial models vs. reasoning with a set ofCase Study conventional modelsConclusion 17 / 29
  51. 51. Partial Models: TowardsModeling and Questions Reasoning with Uncertainty Reasoning with Partial models M.Famelis, R.Salay, vs M.Chechik, Reasoning with a set of conventional modelsIntroductionIntuitionMotivatingExampleModeling Is there a speedup?UncertaintyPartial ModelsSemantics How is speedup affected by changing:ReasoningWith • model sizeUncertaintyPropertyChecking • levels of uncertainty?DiagnosisEvaluationExperimentsCase StudyConclusion 18 / 29
  52. 52. Partial Models: TowardsModeling and Questions Reasoning with Uncertainty Reasoning with Partial models M.Famelis, R.Salay, vs M.Chechik, Reasoning with a set of conventional modelsIntroductionIntuitionMotivatingExampleModeling Is there a speedup?UncertaintyPartial ModelsSemantics How is speedup affected by changing:ReasoningWith • model sizeUncertaintyPropertyChecking • levels of uncertainty?DiagnosisEvaluationExperimentsCase Study To get answers:Conclusion 1) Experiments with random inputs. 2) Real-world case study. 18 / 29
  53. 53. Partial Models: TowardsModeling and Experiments Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 19 / 29
  54. 54. Partial Models: TowardsModeling and Experiments Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 19 / 29
  55. 55. Partial Models: TowardsModeling and Experiments Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 19 / 29
  56. 56. Partial Models: TowardsModeling and Experiments Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 19 / 29
  57. 57. Partial Models: TowardsModeling and Experiments Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 19 / 29
  58. 58. Partial Models: TowardsModeling and Experiments Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 19 / 29
  59. 59. Partial Models: TowardsModeling and Experiments Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 19 / 29
  60. 60. Partial Models: TowardsModeling and Experiments Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 19 / 29
  61. 61. Partial Models: TowardsModeling and Experiments Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 19 / 29
  62. 62. Partial Models: TowardsModeling and Case Study Reasoning with Uncertainty M.Famelis, Why Case Study? R.Salay, M.Chechik, Triangulate experimental results (randomly inputs)Introduction with observations from a real-world scenario.IntuitionMotivatingExampleModeling Case Study details:UncertaintyPartial Models • Real-world software project: UMLet.SemanticsReasoning • Real-world bug from UMLet bugzilla.WithUncertainty • Realistic bug fixes.PropertyCheckingDiagnosis • Two properties from literature [V.D.Straeten’03].Evaluation • 27,261 elements (XL model size)ExperimentsCase Study • 220 concretizations (XL uncertainty size)Conclusion 20 / 29
  63. 63. Partial Models: TowardsModeling and Case Study Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 21 / 29
  64. 64. Partial Models: TowardsModeling and Results of Evaluation Reasoning with Uncertainty M.Famelis, R.Salay, Reasoning with Partial models M.Chechik, vsIntroduction Reasoning with a set of conventional modelsIntuitionMotivatingExample Is there a speedup?ModelingUncertaintyPartial Models – Yes, it is consistently faster than reasoning with the set.SemanticsReasoningWith How is speedup affected by changing model size and levels ofUncertaintyProperty uncertainty?CheckingDiagnosis – Speedup decreases with model size.EvaluationExperimentsCase Study – Speedup increases with uncertainty.Conclusion – No slowdowns! 22 / 29
  65. 65. Partial Models: TowardsModeling and Summary Reasoning with Uncertainty Modeling Uncertainty M.Famelis, R.Salay, M.Chechik, • Encode uncertainty in Partial Models.Introduction • Semantics: sets of conventional models.IntuitionMotivatingExampleModeling Reasoning in the Presence of UncertaintyUncertaintyPartial Models • Check properties.SemanticsReasoning • Give feedback to facilitate diagnosis.WithUncertaintyPropertyCheckingDiagnosis Evaluation of ReasoningEvaluationExperiments • Reasoning with Partial models vs. reasoning with a set ofCase Study conventional modelsConclusion 23 / 29
  66. 66. Partial Models: TowardsModeling and The Big Picture Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 24 / 29
  67. 67. Partial Models: TowardsModeling and Next Steps Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase StudyConclusion 25 / 29
  68. 68. Questions?
  69. 69. Partial Models: TowardsModeling and Language Independent! Reasoning with Uncertainty M.Famelis, R.Salay, M.Chechik,IntroductionIntuitionMotivatingExampleModelingUncertaintyPartial ModelsSemanticsReasoningWithUncertaintyPropertyCheckingDiagnosisEvaluationExperimentsCase Study Class Diagram example from [MiSE’12].Conclusion 27 / 29
  70. 70. Partial Models: TowardsModeling and Bibliography I Reasoning with Uncertainty P. Classen, A.and Heymans, P.Y. Schobbens, A. Legay, and J.F. Raskin. “Model Checking Lots of Systems: Efficient Verification of Temporal M.Famelis, Properties in Software Product Lines”. R.Salay, M.Chechik, In Proc. of ICSE’10, pages 335–344, 2010. M. Famelis, Shoham Ben-David, Marsha Chechik, and Rick Salay.Introduction “Partial Models: A Position Paper”.IntuitionMotivating In Proc. of MoDeVVa’11, pages 1–6, 2011.ExampleModeling M. Famelis, R. Salay, and M. Chechik.Uncertainty “The Semantics of Partial Model Transformations”.Partial Models In Proc. of MiSE’12, 2012.SemanticsReasoning K. G. Larsen and B. Thomsen.With “A Modal Process Logic”.Uncertainty In Proc. of LICS’88, pages 203–210, 1988.PropertyCheckingDiagnosis P. Larsen.Evaluation “The Expressive Power of Implicit Specifications”.Experiments In Proc. of ICALP’91, volume 510 of LNCS, pages 204–216, 1991.Case StudyConclusion M.Famelis, R.Salay, and M. Chechik. “The Semantics of Partial Model Transformations”. In Proc. of MiSE’12, pages 546–560, 2012. 28 / 29
  71. 71. Partial Models: TowardsModeling and Bibliography II Reasoning with Uncertainty M.Famelis, B. Morin, G. Perrouin, P. Lahire, O. Barais, G. Vanwormhoudt, and J. M. R.Salay, J´z´quel. e e M.Chechik, “Weaving Variability into Domain Metamodels”. J. Model Driven Engineering Languages and Systems, pages 690–705, 2009.IntroductionIntuition R.Salay, M. Chechik, and J.Horkoff.MotivatingExample “Managing Requirements Uncertainty with Partial Models”. In Proc. of RE’12, pages 546–560, 2012.ModelingUncertainty R. Salay, M. Chechik, and J. Gorzny.Partial ModelsSemantics “Towards a Methodology for Verifying Partial Model Refinements”.Reasoning In Proc. of VOLT’12, 2012.WithUncertainty R. Salay, M. Famelis, and M. Chechik.Property “Language Independent Refinement using Partial Modeling”.CheckingDiagnosis In Proc. of FASE’12, 2012.Evaluation R. V. D. Straeten, T. Mens, J. Simmonds, and V. Jonckers.Experiments “Using Description Logic to Maintain Consistency between UML Models”.Case Study In Proc. of UML’03, pages 326–340, 2003.Conclusion 29 / 29

×