SlideShare a Scribd company logo
1 of 19
Download to read offline
data / visual analysis
& digital humanities




                     zoe borovsky
                   zoe@ats.ucla.edu
drucker (& nowviskie), 2004, speculative computing




• embodiment should be a dynamic and
  subjective process
• our tools should engage us in a
  “dynamic, generative, iterative” process
• model as an interpretive expression of a
  particular dataset
data/ visual analysis


    MONK: metadata offers new knowledge




• traditional text-
  analysis tools
  feature prominent
  visualization tools


                        http://www.monkproject.org/
data/ visual analysis




TAPoR: text analysis
 portal for research


• runs in web-browser

• interactive displays

• upload your own
  texts


                   http://portal.tapor.ca/
data/ visual analysis




incorporating
results directly
      into
 publications
visualization applications become text-friendly



                                      • “Many Eyes is a bet on the
                                        power of human visual
                                        intelligence to find patterns.”


                                      • “Our goal is to ‘democratize’
                                        visualization and to enable a
                                        new social kind of data
                                        analysis.”




             http://services.alphaworks.ibm.com/manyeyes/home
• runs in web-browser

• interactive displays

• users have access to the
  underlying data

• visualizations can be
  embedded or linked
data/ visual analysis




• visualization tools are more accessible to the “lone
  scholar”

• more data is available in machine-readable format

• are these useful tools for humanities research? can they
  engage us in a “dynamic, generative, iterative” analysis?
data/ visual analysis


     an approach (works in progress)



• model your data/metadata

• interpret

• re-present

• the modeling process may be more important
  than any one model
data/ visual analysis


macfadyen: meter & rhyme, repetition




                  a quick, overall view
data/ visual analysis


almila: overview of a discipline, citation network




         spreadsheets are your new best-friend
data/ visual analysis
data/ visual analysis




• other examples
 • Gedankenraum: semaspace
 •
data/ visual analysis



        authors who cite articles published in Leonardo
                      mostly art journals
                                                 Record
                                                                                     mostly Leonardo
Subject Area                                              % of 1689
                                                 Count
                                                                                                                  Record
ART                                              770      45.5891%    Source Title                                                % of 1689
                                                                                                                  Count

                                                                      LEONARDO                                     659            39.0172%
PSYCHOLOGY, EXPERIMENTAL                         154      9.1178%

                                                                      PERCEPTION                                  39             2.3091%
PSYCHOLOGY                                       103      6.0983%
                                                                      PERCEPTION                      &           23             1.3618%
                                                                      PSYCHOPHYSICS
HUMANITIES, MULTIDISCIPLINARY                    77       4.5589%
                                                                      DIGITAL CREATIVITY                          18             1.0657%

MUSIC                                            68       4.0261%
                                                                      LEONARDO               MUSIC                18             1.0657%
                                                                      JOURNAL
PSYCHOLOGY, MULTIDISCIPLINARY                    58       3.4340%     COMPUTER               MUSIC                13             0.7697%
                                                                      JOURNAL
COMPUTER SCIENCE,                SOFTWARE
                                                 52       3.0787%     BRITISH JOURNAL                OF
ENGINEERING                                                                                                       11             0.6513%
                                                                      AESTHETICS
COMPUTER            SCIENCE,   THEORY        &                        JOURNAL OF AESTHETICS
                                                 47       2.7827%                                                 11             0.6513%
METHODS                                                               AND ART CRITICISM

COMPUTER             SCIENCE,                                         INTERFACE-JOURNAL OF
                                                 42       2.4867%                                                 10             0.5921%
INTERDISCIPLINARY APPLICATIONS                                        NEW MUSIC RESEARCH

PHILOSOPHY                                       35       2.0722%     BELFAGOR                                     9              0.5329%

        (140 Subject Area value(s) outside
                                                                      (529 Source Title value(s) outside display options.)
display options.)
examples:   data/ visual analysis




• Cave Art:
  “Lascaux” (2005)
  the order of
  superimposed
  images: horse,
  aurochs-stag
examples:   data/ visual analysis




               • manuscripts
applications to watch


• Simile: http://simile.mit.edu
• Swivel: http://www.swivel.com
• Google visualization and spreadsheets:
  e.g. Motion Chart
will digital humanities provide new knowledge?


       • or just “better”/different artifacts,
         communication & arguments?

       • weigh the benefits and risks of an opportunity

       • greater benefits if:

          • viewed as a process (rather than product)

          • integrated into research as well as
            instruction

          • as much processing in the hands of
            researchers as practical

          • scholars and developers work together

More Related Content

Similar to Visual Analysis and Digital Humanities

Hybrid Publishing Consortium
Hybrid Publishing ConsortiumHybrid Publishing Consortium
Hybrid Publishing ConsortiumSimon Worthington
 
Semantic Web powering Enterprise and Web Applications
Semantic Web powering Enterprise and Web ApplicationsSemantic Web powering Enterprise and Web Applications
Semantic Web powering Enterprise and Web ApplicationsAmit Sheth
 
Company Presentation
Company PresentationCompany Presentation
Company Presentationsleitgeb
 
Model-Based Visual Software Specification
Model-Based Visual Software SpecificationModel-Based Visual Software Specification
Model-Based Visual Software SpecificationThomas Memmel
 
Deroure Repo3
Deroure Repo3Deroure Repo3
Deroure Repo3guru122
 
Fiat 20080921 results PISA
Fiat 20080921 results PISAFiat 20080921 results PISA
Fiat 20080921 results PISAvrt-medialab
 
PISA - Proof of Concept
PISA - Proof of ConceptPISA - Proof of Concept
PISA - Proof of Conceptvrt-medialab
 
Mria 2012 riding the change wave architecting market research for the future
Mria 2012 riding the change wave   architecting market research for the futureMria 2012 riding the change wave   architecting market research for the future
Mria 2012 riding the change wave architecting market research for the futureLeonard Murphy
 
Women's Engineering Society, UK; 11 September 2009
Women's Engineering Society, UK; 11 September 2009Women's Engineering Society, UK; 11 September 2009
Women's Engineering Society, UK; 11 September 2009Wendy Schultz
 
Tim Malthus_Towards standards for the exchange of field spectral datasets
Tim Malthus_Towards standards for the exchange of field spectral datasetsTim Malthus_Towards standards for the exchange of field spectral datasets
Tim Malthus_Towards standards for the exchange of field spectral datasetsTERN Australia
 
Open Data Platforms: Characteristics and Challenges
Open Data Platforms: Characteristics and ChallengesOpen Data Platforms: Characteristics and Challenges
Open Data Platforms: Characteristics and ChallengesYannis Charalabidis
 
Design for People, Effective Innovation and Sustainability
Design for People, Effective Innovation and SustainabilityDesign for People, Effective Innovation and Sustainability
Design for People, Effective Innovation and SustainabilityMusstanser Tinauli
 
Girardin lift france10_notes
Girardin lift france10_notesGirardin lift france10_notes
Girardin lift france10_notesFing
 
Workshop on Visualization of Large Scientific Data
 Workshop on Visualization of Large Scientific Data Workshop on Visualization of Large Scientific Data
Workshop on Visualization of Large Scientific DataCineca
 

Similar to Visual Analysis and Digital Humanities (20)

Hybrid Publishing Consortium
Hybrid Publishing ConsortiumHybrid Publishing Consortium
Hybrid Publishing Consortium
 
Action matrix short.b
Action matrix short.bAction matrix short.b
Action matrix short.b
 
Semantic Web powering Enterprise and Web Applications
Semantic Web powering Enterprise and Web ApplicationsSemantic Web powering Enterprise and Web Applications
Semantic Web powering Enterprise and Web Applications
 
Visual Tools
Visual ToolsVisual Tools
Visual Tools
 
Company Presentation
Company PresentationCompany Presentation
Company Presentation
 
Model-Based Visual Software Specification
Model-Based Visual Software SpecificationModel-Based Visual Software Specification
Model-Based Visual Software Specification
 
Deroure Repo3
Deroure Repo3Deroure Repo3
Deroure Repo3
 
Deroure Repo3
Deroure Repo3Deroure Repo3
Deroure Repo3
 
Data-Intensive Research
Data-Intensive ResearchData-Intensive Research
Data-Intensive Research
 
Fiat 20080921 results PISA
Fiat 20080921 results PISAFiat 20080921 results PISA
Fiat 20080921 results PISA
 
PISA - Proof of Concept
PISA - Proof of ConceptPISA - Proof of Concept
PISA - Proof of Concept
 
Mria 2012 riding the change wave architecting market research for the future
Mria 2012 riding the change wave   architecting market research for the futureMria 2012 riding the change wave   architecting market research for the future
Mria 2012 riding the change wave architecting market research for the future
 
Women's Engineering Society, UK; 11 September 2009
Women's Engineering Society, UK; 11 September 2009Women's Engineering Society, UK; 11 September 2009
Women's Engineering Society, UK; 11 September 2009
 
Photonics bretagne members
Photonics bretagne membersPhotonics bretagne members
Photonics bretagne members
 
The Semantic Web: RPI ITWS Capstone (Fall 2012)
The Semantic Web: RPI ITWS Capstone (Fall 2012)The Semantic Web: RPI ITWS Capstone (Fall 2012)
The Semantic Web: RPI ITWS Capstone (Fall 2012)
 
Tim Malthus_Towards standards for the exchange of field spectral datasets
Tim Malthus_Towards standards for the exchange of field spectral datasetsTim Malthus_Towards standards for the exchange of field spectral datasets
Tim Malthus_Towards standards for the exchange of field spectral datasets
 
Open Data Platforms: Characteristics and Challenges
Open Data Platforms: Characteristics and ChallengesOpen Data Platforms: Characteristics and Challenges
Open Data Platforms: Characteristics and Challenges
 
Design for People, Effective Innovation and Sustainability
Design for People, Effective Innovation and SustainabilityDesign for People, Effective Innovation and Sustainability
Design for People, Effective Innovation and Sustainability
 
Girardin lift france10_notes
Girardin lift france10_notesGirardin lift france10_notes
Girardin lift france10_notes
 
Workshop on Visualization of Large Scientific Data
 Workshop on Visualization of Large Scientific Data Workshop on Visualization of Large Scientific Data
Workshop on Visualization of Large Scientific Data
 

Recently uploaded

How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfOrbitshub
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdfSandro Moreira
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...apidays
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Angeliki Cooney
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024The Digital Insurer
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Victor Rentea
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistandanishmna97
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Jeffrey Haguewood
 

Recently uploaded (20)

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 

Visual Analysis and Digital Humanities

  • 1. data / visual analysis & digital humanities zoe borovsky zoe@ats.ucla.edu
  • 2. drucker (& nowviskie), 2004, speculative computing • embodiment should be a dynamic and subjective process • our tools should engage us in a “dynamic, generative, iterative” process • model as an interpretive expression of a particular dataset
  • 3. data/ visual analysis MONK: metadata offers new knowledge • traditional text- analysis tools feature prominent visualization tools http://www.monkproject.org/
  • 4. data/ visual analysis TAPoR: text analysis portal for research • runs in web-browser • interactive displays • upload your own texts http://portal.tapor.ca/
  • 5. data/ visual analysis incorporating results directly into publications
  • 6. visualization applications become text-friendly • “Many Eyes is a bet on the power of human visual intelligence to find patterns.” • “Our goal is to ‘democratize’ visualization and to enable a new social kind of data analysis.” http://services.alphaworks.ibm.com/manyeyes/home
  • 7. • runs in web-browser • interactive displays • users have access to the underlying data • visualizations can be embedded or linked
  • 8. data/ visual analysis • visualization tools are more accessible to the “lone scholar” • more data is available in machine-readable format • are these useful tools for humanities research? can they engage us in a “dynamic, generative, iterative” analysis?
  • 9. data/ visual analysis an approach (works in progress) • model your data/metadata • interpret • re-present • the modeling process may be more important than any one model
  • 10. data/ visual analysis macfadyen: meter & rhyme, repetition a quick, overall view
  • 11. data/ visual analysis almila: overview of a discipline, citation network spreadsheets are your new best-friend
  • 13.
  • 14. data/ visual analysis • other examples • Gedankenraum: semaspace •
  • 15. data/ visual analysis authors who cite articles published in Leonardo mostly art journals Record mostly Leonardo Subject Area % of 1689 Count Record ART 770 45.5891% Source Title % of 1689 Count LEONARDO 659 39.0172% PSYCHOLOGY, EXPERIMENTAL 154 9.1178% PERCEPTION 39 2.3091% PSYCHOLOGY 103 6.0983% PERCEPTION & 23 1.3618% PSYCHOPHYSICS HUMANITIES, MULTIDISCIPLINARY 77 4.5589% DIGITAL CREATIVITY 18 1.0657% MUSIC 68 4.0261% LEONARDO MUSIC 18 1.0657% JOURNAL PSYCHOLOGY, MULTIDISCIPLINARY 58 3.4340% COMPUTER MUSIC 13 0.7697% JOURNAL COMPUTER SCIENCE, SOFTWARE 52 3.0787% BRITISH JOURNAL OF ENGINEERING 11 0.6513% AESTHETICS COMPUTER SCIENCE, THEORY & JOURNAL OF AESTHETICS 47 2.7827% 11 0.6513% METHODS AND ART CRITICISM COMPUTER SCIENCE, INTERFACE-JOURNAL OF 42 2.4867% 10 0.5921% INTERDISCIPLINARY APPLICATIONS NEW MUSIC RESEARCH PHILOSOPHY 35 2.0722% BELFAGOR 9 0.5329% (140 Subject Area value(s) outside (529 Source Title value(s) outside display options.) display options.)
  • 16. examples: data/ visual analysis • Cave Art: “Lascaux” (2005) the order of superimposed images: horse, aurochs-stag
  • 17. examples: data/ visual analysis • manuscripts
  • 18. applications to watch • Simile: http://simile.mit.edu • Swivel: http://www.swivel.com • Google visualization and spreadsheets: e.g. Motion Chart
  • 19. will digital humanities provide new knowledge? • or just “better”/different artifacts, communication & arguments? • weigh the benefits and risks of an opportunity • greater benefits if: • viewed as a process (rather than product) • integrated into research as well as instruction • as much processing in the hands of researchers as practical • scholars and developers work together