SlideShare a Scribd company logo
DEPENDENCE TRACING TECHNIQUES FOR
SPREADSHEETS: AN INVESTIGATION
SOHON ROY
FELIENNE HERMANS
The earth as we see in plain sight
How it really is if we consider flight paths
Interconnected!
Spreadsheet in plain sight
How the cells are interconnected
Why bother about dependence?
“the most important information needs of professional
spreadsheet users concern the structure of the formula
dependencies” – Hermans et al. in 2011
20% problemsInformal Survey
Necessity is the mother of inventions
But getting your paper
accepted and published is
the father?!
The gap
Not really the best way
Definitely not the best way
The gap
Hypothesis
Better dependence tracing
techniques or tools developed
under scientific research is
not adequately making it
across to the industry to
benefit real-life spreadsheet
users.
Why the bottleneck between
research and industry?
A metrics framework to measure
user friendliness and effectiveness?
Any opportunity of improvement in
the dependence tracing context?
Review of existing research papers
•Relevance to the topic
•Citations and references in
related papers
•Distinct and unique
approach
•Theory demonstrated
through tool/prototype
Limited scope
for this paper
S
E
L
E
C
T
The papers
Fluid Visualization
Igarashi et al. 1998
3D Interactive Visualization
Shiozawa et al. 1999
Visual Checking with VBA
Chen et al. 2000
Spreadsheet Visualisation with Java
Ballinger et al. 2003
Leveled Dataflow Diagrams
Hermans et al. 2011
Findings
5 of 5
Innovative Ideas & Tool/Prototypes
Findings
2-Defunct
1-Subject to Compatibility Issue
2-Current (Java, C#)
Technology
Defunct Subject to Compatibility Current
Performance Testing
Tested Unrealistic Test Not Tested
Findings
2-Tested
1-Unrealistic Test (400 cells)
2-Not Tested
User Testing
User Study No User Study
Findings
1 of 5
Exposure to the Industry
Available to the Industry Never exposed to the Industry
Findings
1 of 5
Why the bottleneck between
research and industry?
Lack of motivation?
Why the bottleneck between
research and industry?
Difficult to scale up
performance?
Difficult to test?
Performance Testing
Tested Unrealistic Test Not Tested
Findings
2-Tested
1-Unrealistic Test (400 cells)
2-Not Tested
Why the bottleneck between
research and industry?
Difficult to scale up
performance?
Difficult to test?
A metrics framework to measure
user friendliness and effectiveness?
Apparently none.
User Testing
User Study No User Study
Findings
1 of 5
A metrics framework to measure
user friendliness and effectiveness?
To define and measure
useability of spreadhsheet
tools.
Any opportunity of improvement in
the dependence tracing context?
@sohonroy
S.Roy-1@tudelft.nl
http://spreadsheetlab.org/
http://sohonroy.wordpress.com/
Paper Published In Technique Prototype Prototype Comments Industrial Relevance
1.1998 Igarashi
Fluid Visualization &
Animation
Pad++ (now defunct)
and Python for UNIX
Performance
drastically worsens
after 400 cells.No user
study.
No implementation
plan given. Some
ideological influence
can be observed in
MS Excel 2007
onwards.
2.1999 Shiozawa
3D Interactive lift-up
operation
OpenGL APIs and
SLSC for UNIX
None available. None.
3. 2000 Chen
Visual indications
superimposed on
Excel sheets like
arrows, highlights,
shading.
VBA plug-in for Excel. None available.
No standardized
definite influence.
However similar
techniques are used
in ad hoc basis by
expert spreadsheet
users on individually
or internally to
organizations.
4.2003 Ballinger
Different types of
graphs and trees
depicting spreadsheet
dependency structure.
Java tool for Excel
workbooks.
Successfully tested on
a corpus of 259 Excel
workbooks of
undisclosed source.No
user acceptance or
comprehension study.
Authors apparently did
not carry forward their
work on this project.
5.2011 Hermans
Leveled dataflow
diagrams
C# toolkit that accepts
Excel workbooks for
input.
Extensive user testing
with 27 industrial
spreadsheet users in a
financial asset
management
Is currently a part of
service offered by the
company Infotron.nl

More Related Content

What's hot

Data Quality Doesn’t Just Happen: And Here’s What Some of the Industry’s Most...
Data Quality Doesn’t Just Happen: And Here’s What Some of the Industry’s Most...Data Quality Doesn’t Just Happen: And Here’s What Some of the Industry’s Most...
Data Quality Doesn’t Just Happen: And Here’s What Some of the Industry’s Most...
InsightInnovation
 
Clinical Anatomy 9566
Clinical Anatomy 9566Clinical Anatomy 9566
Clinical Anatomy 9566
Robin Featherstone
 
Working with Quertle
Working with QuertleWorking with Quertle
Working with Quertle
Janet Delicata
 
Riscoss convention ossmetera.bagnato
Riscoss convention ossmetera.bagnatoRiscoss convention ossmetera.bagnato
Riscoss convention ossmetera.bagnato
Alessandra Bagnato
 
mHealth Israel_Human Factors Engineering BOOTCAMP_Tressa J. Daniels_AAMI
mHealth Israel_Human Factors Engineering BOOTCAMP_Tressa J. Daniels_AAMImHealth Israel_Human Factors Engineering BOOTCAMP_Tressa J. Daniels_AAMI
mHealth Israel_Human Factors Engineering BOOTCAMP_Tressa J. Daniels_AAMI
Levi Shapiro
 
Statistical Review of Basic Science Manuscripts at Osteoarthritis and Cartila...
Statistical Review of Basic Science Manuscripts at Osteoarthritis and Cartila...Statistical Review of Basic Science Manuscripts at Osteoarthritis and Cartila...
Statistical Review of Basic Science Manuscripts at Osteoarthritis and Cartila...
OARSI
 
Total Survey Error & Institutional Research: A case study of the University E...
Total Survey Error & Institutional Research: A case study of the University E...Total Survey Error & Institutional Research: A case study of the University E...
Total Survey Error & Institutional Research: A case study of the University E...
Sonia Whiteley
 
CIS375 Interaction Designs Chapter13
CIS375 Interaction Designs Chapter13CIS375 Interaction Designs Chapter13
CIS375 Interaction Designs Chapter13
Dr. Ahmed Al Zaidy
 
Empirical Software Engineering
Empirical Software EngineeringEmpirical Software Engineering
Empirical Software Engineering
RahimLotfi
 
Software Development as an Experiment System: A Qualitative Survey on the St...
Software Development as an Experiment System:  A Qualitative Survey on the St...Software Development as an Experiment System:  A Qualitative Survey on the St...
Software Development as an Experiment System: A Qualitative Survey on the St...
Jürgen Münch
 
Building Blocks for Continuous Experimentation
Building Blocks for Continuous ExperimentationBuilding Blocks for Continuous Experimentation
Building Blocks for Continuous Experimentation
Jürgen Münch
 
RDA Scholarly Infrastructure 2015
RDA Scholarly Infrastructure 2015RDA Scholarly Infrastructure 2015
RDA Scholarly Infrastructure 2015
William Gunn
 
Lec 06
Lec 06Lec 06
Learning to share: understanding perceptions of repurposing OERs in social sc...
Learning to share: understanding perceptions of repurposing OERs in social sc...Learning to share: understanding perceptions of repurposing OERs in social sc...
Learning to share: understanding perceptions of repurposing OERs in social sc...
The Higher Education Academy
 
Nicolas Brown - AppliedResearch_10-11-15
Nicolas Brown - AppliedResearch_10-11-15Nicolas Brown - AppliedResearch_10-11-15
Nicolas Brown - AppliedResearch_10-11-15
Nicolas Brown
 
Systematic Literature Reviews and Systematic Mapping Studies
Systematic Literature Reviews and Systematic Mapping StudiesSystematic Literature Reviews and Systematic Mapping Studies
Systematic Literature Reviews and Systematic Mapping Studies
alessio_ferrari
 
Is our two way communication a one way street? Informal Surveys & Polls in Li...
Is our two way communication a one way street? Informal Surveys & Polls in Li...Is our two way communication a one way street? Informal Surveys & Polls in Li...
Is our two way communication a one way street? Informal Surveys & Polls in Li...
Gillian Byrne
 

What's hot (17)

Data Quality Doesn’t Just Happen: And Here’s What Some of the Industry’s Most...
Data Quality Doesn’t Just Happen: And Here’s What Some of the Industry’s Most...Data Quality Doesn’t Just Happen: And Here’s What Some of the Industry’s Most...
Data Quality Doesn’t Just Happen: And Here’s What Some of the Industry’s Most...
 
Clinical Anatomy 9566
Clinical Anatomy 9566Clinical Anatomy 9566
Clinical Anatomy 9566
 
Working with Quertle
Working with QuertleWorking with Quertle
Working with Quertle
 
Riscoss convention ossmetera.bagnato
Riscoss convention ossmetera.bagnatoRiscoss convention ossmetera.bagnato
Riscoss convention ossmetera.bagnato
 
mHealth Israel_Human Factors Engineering BOOTCAMP_Tressa J. Daniels_AAMI
mHealth Israel_Human Factors Engineering BOOTCAMP_Tressa J. Daniels_AAMImHealth Israel_Human Factors Engineering BOOTCAMP_Tressa J. Daniels_AAMI
mHealth Israel_Human Factors Engineering BOOTCAMP_Tressa J. Daniels_AAMI
 
Statistical Review of Basic Science Manuscripts at Osteoarthritis and Cartila...
Statistical Review of Basic Science Manuscripts at Osteoarthritis and Cartila...Statistical Review of Basic Science Manuscripts at Osteoarthritis and Cartila...
Statistical Review of Basic Science Manuscripts at Osteoarthritis and Cartila...
 
Total Survey Error & Institutional Research: A case study of the University E...
Total Survey Error & Institutional Research: A case study of the University E...Total Survey Error & Institutional Research: A case study of the University E...
Total Survey Error & Institutional Research: A case study of the University E...
 
CIS375 Interaction Designs Chapter13
CIS375 Interaction Designs Chapter13CIS375 Interaction Designs Chapter13
CIS375 Interaction Designs Chapter13
 
Empirical Software Engineering
Empirical Software EngineeringEmpirical Software Engineering
Empirical Software Engineering
 
Software Development as an Experiment System: A Qualitative Survey on the St...
Software Development as an Experiment System:  A Qualitative Survey on the St...Software Development as an Experiment System:  A Qualitative Survey on the St...
Software Development as an Experiment System: A Qualitative Survey on the St...
 
Building Blocks for Continuous Experimentation
Building Blocks for Continuous ExperimentationBuilding Blocks for Continuous Experimentation
Building Blocks for Continuous Experimentation
 
RDA Scholarly Infrastructure 2015
RDA Scholarly Infrastructure 2015RDA Scholarly Infrastructure 2015
RDA Scholarly Infrastructure 2015
 
Lec 06
Lec 06Lec 06
Lec 06
 
Learning to share: understanding perceptions of repurposing OERs in social sc...
Learning to share: understanding perceptions of repurposing OERs in social sc...Learning to share: understanding perceptions of repurposing OERs in social sc...
Learning to share: understanding perceptions of repurposing OERs in social sc...
 
Nicolas Brown - AppliedResearch_10-11-15
Nicolas Brown - AppliedResearch_10-11-15Nicolas Brown - AppliedResearch_10-11-15
Nicolas Brown - AppliedResearch_10-11-15
 
Systematic Literature Reviews and Systematic Mapping Studies
Systematic Literature Reviews and Systematic Mapping StudiesSystematic Literature Reviews and Systematic Mapping Studies
Systematic Literature Reviews and Systematic Mapping Studies
 
Is our two way communication a one way street? Informal Surveys & Polls in Li...
Is our two way communication a one way street? Informal Surveys & Polls in Li...Is our two way communication a one way street? Informal Surveys & Polls in Li...
Is our two way communication a one way street? Informal Surveys & Polls in Li...
 

Similar to Dependence tracing techniques for spreadsheets - Sohon Roy at Sems 2014

Lionel Briand ICSM 2011 Keynote
Lionel Briand ICSM 2011 KeynoteLionel Briand ICSM 2011 Keynote
Lionel Briand ICSM 2011 Keynote
ICSM 2011
 
Laboratory Integration John Trigg
Laboratory Integration  John TriggLaboratory Integration  John Trigg
Laboratory Integration John Trigg
John Trigg
 
IEEE augmented reality learning experience model (ARLEM)
IEEE augmented reality learning experience model (ARLEM)IEEE augmented reality learning experience model (ARLEM)
IEEE augmented reality learning experience model (ARLEM)
fridolin.wild
 
Session 0.0 poster minutes madness
Session 0.0   poster minutes madnessSession 0.0   poster minutes madness
Session 0.0 poster minutes madness
semanticsconference
 
Software Engineering Research: Leading a Double-Agent Life.
Software Engineering Research: Leading a Double-Agent Life.Software Engineering Research: Leading a Double-Agent Life.
Software Engineering Research: Leading a Double-Agent Life.
Lionel Briand
 
Open Assessment In Metal Risks
Open Assessment In Metal RisksOpen Assessment In Metal Risks
Open Assessment In Metal Risks
guest4d312e0
 
Open Assessment In Metal Risks
Open Assessment In Metal RisksOpen Assessment In Metal Risks
Open Assessment In Metal Risks
guest4d312e0
 
Product, Pricing, and Channels Paper Grading GuideMKT421 Vers.docx
Product, Pricing, and Channels Paper Grading GuideMKT421 Vers.docxProduct, Pricing, and Channels Paper Grading GuideMKT421 Vers.docx
Product, Pricing, and Channels Paper Grading GuideMKT421 Vers.docx
wkyra78
 
Intranet User Feedback
Intranet User FeedbackIntranet User Feedback
Intranet User Feedback
Gary Schroeder
 
Missing pieces in_the_global_metadata_landscap
Missing pieces in_the_global_metadata_landscapMissing pieces in_the_global_metadata_landscap
Missing pieces in_the_global_metadata_landscap
Stuart Weibel
 
Exploring 'Impact': new approaches for alternative scholarly metrics in Africa
Exploring 'Impact': new approaches for alternative scholarly metrics in AfricaExploring 'Impact': new approaches for alternative scholarly metrics in Africa
Exploring 'Impact': new approaches for alternative scholarly metrics in Africa
Thomas King
 
Sci Know Mine 2013: What can we learn from topic modeling on 350M academic do...
Sci Know Mine 2013: What can we learn from topic modeling on 350M academic do...Sci Know Mine 2013: What can we learn from topic modeling on 350M academic do...
Sci Know Mine 2013: What can we learn from topic modeling on 350M academic do...
William Gunn
 
UCL’s research IT management systems architecture review aligned with Open Sc...
UCL’s research IT management systems architecture review aligned with Open Sc...UCL’s research IT management systems architecture review aligned with Open Sc...
UCL’s research IT management systems architecture review aligned with Open Sc...
Jisc
 
Data-driven UX: What it really takes and how to get there
Data-driven UX: What it really takes and how to get thereData-driven UX: What it really takes and how to get there
Data-driven UX: What it really takes and how to get there
Emmanuelle Boloix, Ph.D.
 
Investigating Crowdsourcing as an Evaluation Method for (TEL) Recommender Sy...
Investigating Crowdsourcing as an Evaluation Method for (TEL) Recommender Sy...Investigating Crowdsourcing as an Evaluation Method for (TEL) Recommender Sy...
Investigating Crowdsourcing as an Evaluation Method for (TEL) Recommender Sy...
Christoph Rensing
 
Analysis and Design of Information Systems
Analysis and Design of Information SystemsAnalysis and Design of Information Systems
Writing a research paper for publication structure and recommendations (compu...
Writing a research paper for publication structure and recommendations (compu...Writing a research paper for publication structure and recommendations (compu...
Writing a research paper for publication structure and recommendations (compu...
Tawfeeq Alsanoosy
 
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Carol Smith
 
ISEC'18 Tutorial: Research Methodology on Pursuing Impact-Driven Research
ISEC'18 Tutorial: Research Methodology on Pursuing Impact-Driven ResearchISEC'18 Tutorial: Research Methodology on Pursuing Impact-Driven Research
ISEC'18 Tutorial: Research Methodology on Pursuing Impact-Driven Research
Tao Xie
 
Opponents' questions from doctoral defense of Yue Dai
Opponents' questions from doctoral defense of Yue DaiOpponents' questions from doctoral defense of Yue Dai
Opponents' questions from doctoral defense of Yue Dai
University of Eastern Finland, IMPDET-LE
 

Similar to Dependence tracing techniques for spreadsheets - Sohon Roy at Sems 2014 (20)

Lionel Briand ICSM 2011 Keynote
Lionel Briand ICSM 2011 KeynoteLionel Briand ICSM 2011 Keynote
Lionel Briand ICSM 2011 Keynote
 
Laboratory Integration John Trigg
Laboratory Integration  John TriggLaboratory Integration  John Trigg
Laboratory Integration John Trigg
 
IEEE augmented reality learning experience model (ARLEM)
IEEE augmented reality learning experience model (ARLEM)IEEE augmented reality learning experience model (ARLEM)
IEEE augmented reality learning experience model (ARLEM)
 
Session 0.0 poster minutes madness
Session 0.0   poster minutes madnessSession 0.0   poster minutes madness
Session 0.0 poster minutes madness
 
Software Engineering Research: Leading a Double-Agent Life.
Software Engineering Research: Leading a Double-Agent Life.Software Engineering Research: Leading a Double-Agent Life.
Software Engineering Research: Leading a Double-Agent Life.
 
Open Assessment In Metal Risks
Open Assessment In Metal RisksOpen Assessment In Metal Risks
Open Assessment In Metal Risks
 
Open Assessment In Metal Risks
Open Assessment In Metal RisksOpen Assessment In Metal Risks
Open Assessment In Metal Risks
 
Product, Pricing, and Channels Paper Grading GuideMKT421 Vers.docx
Product, Pricing, and Channels Paper Grading GuideMKT421 Vers.docxProduct, Pricing, and Channels Paper Grading GuideMKT421 Vers.docx
Product, Pricing, and Channels Paper Grading GuideMKT421 Vers.docx
 
Intranet User Feedback
Intranet User FeedbackIntranet User Feedback
Intranet User Feedback
 
Missing pieces in_the_global_metadata_landscap
Missing pieces in_the_global_metadata_landscapMissing pieces in_the_global_metadata_landscap
Missing pieces in_the_global_metadata_landscap
 
Exploring 'Impact': new approaches for alternative scholarly metrics in Africa
Exploring 'Impact': new approaches for alternative scholarly metrics in AfricaExploring 'Impact': new approaches for alternative scholarly metrics in Africa
Exploring 'Impact': new approaches for alternative scholarly metrics in Africa
 
Sci Know Mine 2013: What can we learn from topic modeling on 350M academic do...
Sci Know Mine 2013: What can we learn from topic modeling on 350M academic do...Sci Know Mine 2013: What can we learn from topic modeling on 350M academic do...
Sci Know Mine 2013: What can we learn from topic modeling on 350M academic do...
 
UCL’s research IT management systems architecture review aligned with Open Sc...
UCL’s research IT management systems architecture review aligned with Open Sc...UCL’s research IT management systems architecture review aligned with Open Sc...
UCL’s research IT management systems architecture review aligned with Open Sc...
 
Data-driven UX: What it really takes and how to get there
Data-driven UX: What it really takes and how to get thereData-driven UX: What it really takes and how to get there
Data-driven UX: What it really takes and how to get there
 
Investigating Crowdsourcing as an Evaluation Method for (TEL) Recommender Sy...
Investigating Crowdsourcing as an Evaluation Method for (TEL) Recommender Sy...Investigating Crowdsourcing as an Evaluation Method for (TEL) Recommender Sy...
Investigating Crowdsourcing as an Evaluation Method for (TEL) Recommender Sy...
 
Analysis and Design of Information Systems
Analysis and Design of Information SystemsAnalysis and Design of Information Systems
Analysis and Design of Information Systems
 
Writing a research paper for publication structure and recommendations (compu...
Writing a research paper for publication structure and recommendations (compu...Writing a research paper for publication structure and recommendations (compu...
Writing a research paper for publication structure and recommendations (compu...
 
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
 
ISEC'18 Tutorial: Research Methodology on Pursuing Impact-Driven Research
ISEC'18 Tutorial: Research Methodology on Pursuing Impact-Driven ResearchISEC'18 Tutorial: Research Methodology on Pursuing Impact-Driven Research
ISEC'18 Tutorial: Research Methodology on Pursuing Impact-Driven Research
 
Opponents' questions from doctoral defense of Yue Dai
Opponents' questions from doctoral defense of Yue DaiOpponents' questions from doctoral defense of Yue Dai
Opponents' questions from doctoral defense of Yue Dai
 

More from semsworkshop

Spreadsheets are models too - Richard Paige at Sems 2014
Spreadsheets are models too - Richard Paige at Sems 2014Spreadsheets are models too - Richard Paige at Sems 2014
Spreadsheets are models too - Richard Paige at Sems 2014
semsworkshop
 
MDSheet - Model driven spreadsheets - Jacome Cunha at Sems 2014
MDSheet - Model driven spreadsheets - Jacome Cunha at Sems 2014MDSheet - Model driven spreadsheets - Jacome Cunha at Sems 2014
MDSheet - Model driven spreadsheets - Jacome Cunha at Sems 2014
semsworkshop
 
A spreadsheet cell-meaning model for testing - Daniel Kulesz at Sems 2014
A spreadsheet cell-meaning model for testing - Daniel Kulesz at Sems 2014A spreadsheet cell-meaning model for testing - Daniel Kulesz at Sems 2014
A spreadsheet cell-meaning model for testing - Daniel Kulesz at Sems 2014
semsworkshop
 
Using a visual language to create better spreadsheets - Bas Jansen at Sems 2014
Using a visual language to create better spreadsheets - Bas Jansen at Sems 2014Using a visual language to create better spreadsheets - Bas Jansen at Sems 2014
Using a visual language to create better spreadsheets - Bas Jansen at Sems 2014
semsworkshop
 
Tool-Supported 2014 07 sems_limitations_evaluation_practice
Tool-Supported 2014 07 sems_limitations_evaluation_practiceTool-Supported 2014 07 sems_limitations_evaluation_practice
Tool-Supported 2014 07 sems_limitations_evaluation_practice
semsworkshop
 
2014 07 sems_debugging_models
2014 07 sems_debugging_models2014 07 sems_debugging_models
2014 07 sems_debugging_models
semsworkshop
 
High-performance sheet-defined functions in Excel - Peter Sestoft at Sems 2014
High-performance sheet-defined functions in Excel - Peter Sestoft at Sems 2014High-performance sheet-defined functions in Excel - Peter Sestoft at Sems 2014
High-performance sheet-defined functions in Excel - Peter Sestoft at Sems 2014
semsworkshop
 

More from semsworkshop (7)

Spreadsheets are models too - Richard Paige at Sems 2014
Spreadsheets are models too - Richard Paige at Sems 2014Spreadsheets are models too - Richard Paige at Sems 2014
Spreadsheets are models too - Richard Paige at Sems 2014
 
MDSheet - Model driven spreadsheets - Jacome Cunha at Sems 2014
MDSheet - Model driven spreadsheets - Jacome Cunha at Sems 2014MDSheet - Model driven spreadsheets - Jacome Cunha at Sems 2014
MDSheet - Model driven spreadsheets - Jacome Cunha at Sems 2014
 
A spreadsheet cell-meaning model for testing - Daniel Kulesz at Sems 2014
A spreadsheet cell-meaning model for testing - Daniel Kulesz at Sems 2014A spreadsheet cell-meaning model for testing - Daniel Kulesz at Sems 2014
A spreadsheet cell-meaning model for testing - Daniel Kulesz at Sems 2014
 
Using a visual language to create better spreadsheets - Bas Jansen at Sems 2014
Using a visual language to create better spreadsheets - Bas Jansen at Sems 2014Using a visual language to create better spreadsheets - Bas Jansen at Sems 2014
Using a visual language to create better spreadsheets - Bas Jansen at Sems 2014
 
Tool-Supported 2014 07 sems_limitations_evaluation_practice
Tool-Supported 2014 07 sems_limitations_evaluation_practiceTool-Supported 2014 07 sems_limitations_evaluation_practice
Tool-Supported 2014 07 sems_limitations_evaluation_practice
 
2014 07 sems_debugging_models
2014 07 sems_debugging_models2014 07 sems_debugging_models
2014 07 sems_debugging_models
 
High-performance sheet-defined functions in Excel - Peter Sestoft at Sems 2014
High-performance sheet-defined functions in Excel - Peter Sestoft at Sems 2014High-performance sheet-defined functions in Excel - Peter Sestoft at Sems 2014
High-performance sheet-defined functions in Excel - Peter Sestoft at Sems 2014
 

Recently uploaded

Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Tatiana Kojar
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Deep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStr
Deep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStrDeep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStr
Deep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStr
saastr
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Pixlogix Infotech
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
kumardaparthi1024
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Zilliz
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
tolgahangng
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Tomaz Bratanic
 
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
alexjohnson7307
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
dbms calicut university B. sc Cs 4th sem.pdf
dbms  calicut university B. sc Cs 4th sem.pdfdbms  calicut university B. sc Cs 4th sem.pdf
dbms calicut university B. sc Cs 4th sem.pdf
Shinana2
 
Letter and Document Automation for Bonterra Impact Management (fka Social Sol...
Letter and Document Automation for Bonterra Impact Management (fka Social Sol...Letter and Document Automation for Bonterra Impact Management (fka Social Sol...
Letter and Document Automation for Bonterra Impact Management (fka Social Sol...
Jeffrey Haguewood
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
saastr
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
Postman
 

Recently uploaded (20)

Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Deep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStr
Deep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStrDeep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStr
Deep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStr
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
 
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
dbms calicut university B. sc Cs 4th sem.pdf
dbms  calicut university B. sc Cs 4th sem.pdfdbms  calicut university B. sc Cs 4th sem.pdf
dbms calicut university B. sc Cs 4th sem.pdf
 
Letter and Document Automation for Bonterra Impact Management (fka Social Sol...
Letter and Document Automation for Bonterra Impact Management (fka Social Sol...Letter and Document Automation for Bonterra Impact Management (fka Social Sol...
Letter and Document Automation for Bonterra Impact Management (fka Social Sol...
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
 

Dependence tracing techniques for spreadsheets - Sohon Roy at Sems 2014

  • 1. DEPENDENCE TRACING TECHNIQUES FOR SPREADSHEETS: AN INVESTIGATION SOHON ROY FELIENNE HERMANS
  • 2. The earth as we see in plain sight
  • 3. How it really is if we consider flight paths Interconnected!
  • 5. How the cells are interconnected
  • 6. Why bother about dependence? “the most important information needs of professional spreadsheet users concern the structure of the formula dependencies” – Hermans et al. in 2011 20% problemsInformal Survey
  • 7. Necessity is the mother of inventions But getting your paper accepted and published is the father?!
  • 9. Not really the best way
  • 10. Definitely not the best way
  • 12. Hypothesis Better dependence tracing techniques or tools developed under scientific research is not adequately making it across to the industry to benefit real-life spreadsheet users.
  • 13. Why the bottleneck between research and industry?
  • 14. A metrics framework to measure user friendliness and effectiveness?
  • 15. Any opportunity of improvement in the dependence tracing context?
  • 16. Review of existing research papers •Relevance to the topic •Citations and references in related papers •Distinct and unique approach •Theory demonstrated through tool/prototype Limited scope for this paper S E L E C T
  • 17. The papers Fluid Visualization Igarashi et al. 1998 3D Interactive Visualization Shiozawa et al. 1999 Visual Checking with VBA Chen et al. 2000 Spreadsheet Visualisation with Java Ballinger et al. 2003 Leveled Dataflow Diagrams Hermans et al. 2011
  • 18. Findings 5 of 5 Innovative Ideas & Tool/Prototypes
  • 19. Findings 2-Defunct 1-Subject to Compatibility Issue 2-Current (Java, C#) Technology Defunct Subject to Compatibility Current
  • 20. Performance Testing Tested Unrealistic Test Not Tested Findings 2-Tested 1-Unrealistic Test (400 cells) 2-Not Tested
  • 21. User Testing User Study No User Study Findings 1 of 5
  • 22. Exposure to the Industry Available to the Industry Never exposed to the Industry Findings 1 of 5
  • 23. Why the bottleneck between research and industry? Lack of motivation?
  • 24. Why the bottleneck between research and industry? Difficult to scale up performance? Difficult to test?
  • 25. Performance Testing Tested Unrealistic Test Not Tested Findings 2-Tested 1-Unrealistic Test (400 cells) 2-Not Tested
  • 26. Why the bottleneck between research and industry? Difficult to scale up performance? Difficult to test?
  • 27. A metrics framework to measure user friendliness and effectiveness? Apparently none.
  • 28. User Testing User Study No User Study Findings 1 of 5
  • 29. A metrics framework to measure user friendliness and effectiveness? To define and measure useability of spreadhsheet tools.
  • 30. Any opportunity of improvement in the dependence tracing context?
  • 32. Paper Published In Technique Prototype Prototype Comments Industrial Relevance 1.1998 Igarashi Fluid Visualization & Animation Pad++ (now defunct) and Python for UNIX Performance drastically worsens after 400 cells.No user study. No implementation plan given. Some ideological influence can be observed in MS Excel 2007 onwards. 2.1999 Shiozawa 3D Interactive lift-up operation OpenGL APIs and SLSC for UNIX None available. None. 3. 2000 Chen Visual indications superimposed on Excel sheets like arrows, highlights, shading. VBA plug-in for Excel. None available. No standardized definite influence. However similar techniques are used in ad hoc basis by expert spreadsheet users on individually or internally to organizations. 4.2003 Ballinger Different types of graphs and trees depicting spreadsheet dependency structure. Java tool for Excel workbooks. Successfully tested on a corpus of 259 Excel workbooks of undisclosed source.No user acceptance or comprehension study. Authors apparently did not carry forward their work on this project. 5.2011 Hermans Leveled dataflow diagrams C# toolkit that accepts Excel workbooks for input. Extensive user testing with 27 industrial spreadsheet users in a financial asset management Is currently a part of service offered by the company Infotron.nl

Editor's Notes

  1. This is somewhat decieving. Why? Because it does not illustrate how various parts of the earth is connected. What do I mean? For example the America is separated from Africa and Europe. But does that really mean that whatever happens in America has no effect on Europe or Africa?
  2. This picture however gives us a better insight! This is how the earth looks when the map is genrated out of flight paths of air lines! And here we can clearly see how the different parts of the earth is interconnected. Some are more connected than others! It gives a totally different outlook.
  3. As you see in this arch made of rocks, if you pull out one of the rocks, chances are the arch will collapse. Most spreadsheet models are very similar and vulnerable if you are not careful when you are changing the contents of your cells. As expected it is indeed one of the biggest challenges spreadsheet users face. The response is from spreadsheet users of a Dutch Financial company as described in Felienne Herman’s work in 2011. I also went to the offices of F1F9, the financial modelling company. I did an informal survey. Received a set of complaints of which 20% were related to this dependecne related... No other single unique are received as much percentage of complaints. This is why of course dependence tracing needs a lot of attention.
  4. So what do we do? We start making new tools and aids? No! We can’t ‘cause before that we have to check what is already existing!
  5. So what we found? We found that yes there is quite a considrable lot of research that has been done on this topic. But what we find in the industry? Lets take a look.... Excel... Excel... More Excel... EXCEL!! And what Excel offers?
  6. Excel’s only formula auditing feature. Blue arrows... But as you can see.. Not very intuitive and help ful... Also lot many clicks required... Then when they lie on the same row they all superimpose on each other and then it becomes really difficult to make out which is pointing where.
  7. And when it becoms like this? Oh boy! 
  8. So what’s going on really here? It seems that as if some invisible monster is gobbling up the research before they can make their way to the industry! So we have to understand this monster and vanquish it!
  9. So we have our hypothesis.
  10. So what to do? Of course a careful review of exisitng litarature! But our scope is limited for presenting the study in one paper. So selected 5! And how did we select? We used these indicators.
  11. Now the time for the findings! So what did we find?
  12. Acceptance of newer ideas are more than follow up of previously published works? Pressure for innovation but no drive for implementation?
  13. Spreadsheet sizes have a very broad spectrum ranging from small to very very large.
  14. Spreadsheet sizes have a very broad spectrum ranging from small to very very large.
  15. Then it can be used to compare various tools with each other and can be established which is more effective for users.
  16. Then it can be used to compare various tools with each other and can be established which is more effective for users. And also useful when it is out of scope or not possible to do a full extensive user study. KPI (key performance indicators) can be useful to judge the worth of a tool particularly for the context of spreadsheets and effectiveness for users.
  17. Especially from the perspective of actually helping the real life spreadsheet users and not just in order to get your work published as a paper and then move on to other porjects. Or at least to ensure that the work you did can be helpful to users and is realistic enough so that it can be implemented even if by someone else.
  18. Make a summary of what we did and sign off confidently inviting for questions. So what we did? We percieved the importance of dependence tracing in spreadsheets; we wanted to do something about it so we dug up the existing research; then we saw that research was not going across to the industry; so we tried to answer some questions about that... And to answer we selected and did a comparative study of 5 papers... We found some interesting results and from that we drew some conclusive and some open answers to our questions. And now I would try to answer any questions you have!! :D