The need for change is nationally recognized. The USA Race to the Top initiatives and reports (http://www2.ed.gov/programs/racetothetop/performance.html) provide national recognition of a educational desire to change. In addition, university programs preparing technology leaders are encouraged to train change leaders. The International Society for Technology in Education (ISTE) program review, supplies standards that point to a need for visionary leaders and change agents (ISTE-NETS, 2011). The national movement towards understanding change provides a ripe time for the AECT division. Creating an accessible repository of material may bridge a divide between practitioners and academics/researchers for understanding systemic change.
17 item survey
Without asking the users directly – and having them identify the usability – and not take a test.
Add Item numbers to survey
Most were Tech SupportBook SellerSpecial services clerk2 ProfessorsLibrary85% Did business on the computer 86% Felt Technology made you more efficient90% Inspiring and new professional ideas
Likert Scale for 1 Disagree to 7 AgreeStatements … I can find what I am looking for…Content was high quality..Fourteen items of ratingLittle Efforts.75%-61% - was positive 71% agree, “It has high quality content.”66% agree, “I find what I’m looking for without many errors or false starts,” while 71% believe “I find what I’m looking for quickly with little wasted effort” and 75% responded positively to “I am able to use it with little mental effort or energy” thus implying that perhaps errors and false starts are not major deterrents to use. 72% responded that they are highly satisfied with the website81% liked the graphic design of the website67% liked the graphic design of the videos
Positive Feedback:Easy to navigateI have only sampled the website and will use it in the futureSelf-explanatory, I could navigate easilyThe design made it easy to read and understand infoVery clean and simple website….Very clear labelsWebsite is nicely laid outNavigation is efficient…The website has clear navigation links…The website is very organized. The tabs make it easy for users to find what they are looking forIt was quite intuitive…. Negative Feedback:Many of the links did not workSome of the videos are a bit “too much” – “too much” on the same web page…Not overly in-depth information thoughIt is not exciting to the eye, and I have to sift through the info on the page rather than being able to pinpoint specific information via bullet points or subjects in bold letteringI cannot verify if I would use it, or if it is reliable because I do not know who the creator of the website ishttp://farm5.staticflickr.com/4125/4832959065_056cab873b_b.jpg
Likert Scale for 1 Disagree to 7 AgreeStatements … Website is effective in representing systemic changeEfficient in learning about systemic changeVideos were effective in representing systemic changeVideos were efficient in learning about systemic change87% responded that the content is high quality90% responded that the content is useful93% believe that this site is effective in representing systemic change, while only 86% believe that the videos are effective in representing systemic change.90% responded that the site is efficient in learning about systemic change, while 87% responded that the videos are an efficient way of representing systemic change.
I like the “systematic change is-is not” section. The organization flows in a sensible mannerI was very impressed with the introductory videoUseful information; very plain designVideos helpfulThe videos were interesting, but I did have a bit of a sound issue at one point…I like the overall clean look of the site and the multiple navigational linksThere is a lot of wording on the site, which is great for explaining exactly what systemic change is. I felt that the site facilitated learning at both a surface or deep level. I loved how the video names were meaningful and spoke to the section heading.I found the video on the home page very engaging and informative about the importance of this topic
Banathy, B. H. (1996). Conversation as a medium for change in education. Educational Technology, 36(1), 39-41.Braverman, B. (2010). Video shooter: Storytelling with HD camera (2 ed.). Boston: Focal Press.Coburn, C. (2003). Rethinking scale: Moving beyond numbers to deep lasting change. Educational Researcher, 32(6), 3-12.Duffy, F. M. (2003). Courage, passion, and vision: A guide to leading systemic school improvement. Lanham, Md.: Scarecrow Press.Duffy, F., & Reigeluth, C. M. (2008). Strategic Communication during Times of Great Change. School Administrator, 65(4), 22-25.Fullan, M. G. (2010). All systems go. Thousand Oaks, CA: Corwin Press.Goodman, J. (1995). Change without Difference. Harvard Educational Review, 65(1), 1-32.Gotto, K., & Colter, M. (2004). Web redesign 2.0: Workflow that works (2 ed.). San Jose, CA: Peachpit.Hargreaves, A. (2006). The sustainability of innovative schools as learning organizations and professional leaning communities during standardized reform. Educational Administration Quarterly, 42(1), 124-156.Hurbis-Cherrier, M. (2012). Voice and vision: A creative approach to narrative film & DV production (2 ed.). Boston: Elsevier.Jenlink, P. M., Reigeluth, C. M., Carr, A. A., & Nelson, L. (1996). An expedition for change: Facilitating the systemic change process in school districts. Tech Trends, 21-30.Joseph, R., & Reigeluth, C. M. (2010). The Systemic Change Process in Education: A Conceptual Framework. Contemporary Educational Technology, 1(2), 97-117.Osgood, R. J., & Hinshaw, M. J. (2009). Video storytelling: Videography and post production in the digital age. Boston: Wadworth.Peck, K. L., & Carr, A. A. (1997). Restoring public confidence in school through systems thinking. International Journal of Educational Reform, 6(3), 316-323.Reigeluth, C. M., Banathy, B. H., & Olson, J. R. (1993). Comprehensive systems design: A new educational technology (Vol. 95). Berlin Heidelberg, Germany: Springer-Verlag.Reigeluth, C. M. (1995). A Conversation on Guidelines for the Process of Facilitating Systemic Change in Education.Unpublished manuscript.Reigeluth, C. M., & Duffy, F. M. (2008). The AECT Future Minds Initiative: Transforming America's School Systems. Educational Technology, 48(3), 45-49.Richter, K., & Reigeluth, C. M. (2006). A systemic change experience in Decatur Township. Tech Trends, 50 (2), 35-36.Rogers, E. (1995). Diffusions of innovations (4 ed.). NY: Free Press.Senge, P. (1990). The fifth discipline: The art & practice of the learning organization. NY: Bantam Double Day Dell Publishing.Squire, K.D., & Reigeluth, C.M. (2000). The many faces of systemic change. Educational Horizons, 78 (3), 143-152.Stringer, E. (2007). Action research Thousand Oaks, CA: Sage Publications.Watson, W. R., Watson, S. L., & Reigeluth, C. M. (2012). A Systemic Integration of Technology for New-Paradigm Education. Educational Technology, 52(5), 25-29.
Impacting Perceptions of Practitioners for a Refined Understanding of Educational Systemic Change through a Practitioner Focused On-line Presence
Beth Rajan Sockman, Ph.D.
East Stroudsburg University
Anthony Chow, Ph.D.
University of North Carolina at Greensboro
Sinem Aslan, Ph. D.
Principal Investigator, Intel Corporation
Kurt Richter, Ph.D.
Ashley Scott M.Ed.
Impacting Perceptions of Practitioners for a Refined
Understanding of Educational Systemic Change through
a Practitioner Focused On-line Presence
Innovate Integrate Communicate AECT International
Conference 2013Anaheim, CA
November 2, 2013
What would it be like if practitioners and community
members had an understanding of educational systemic
View of educational systemic change
Value of Usability Study
Evaluate the research of a study
Identify what practitioners say about a Systemic
It is all about being fair…
Picture from http://weknowmemes.com/tag/please-climb-that-tree/
experiences is a key to be fair!
Picture from http://personalizedlearningsd8.yolasite.com/view.php
Technology as enabler for
new paradigm of education
The USA Race to the Top initiatives and reports
School Official Certifications
The International Society for Technology in
Backlash to No Child Left Behind
Voices of Vision
What can we do about it?
The national movement towards understanding
change provides a ripe time for the AECT division.
Creating an accessible repository of material
may bridge a divide between practitioners and
academics/researchers for understanding
Usability Study - Context
7 Point Scale
17-item usability survey
11 graduate students
Background to Project
Bridge gap between practitioners and researchers of
educational systemic change
Begin a conversation
Increase profile on the web and become a
Viable Resource Center for
Division of Systemic Change Strategic Plan
Strategic Goal 2.5. This goal is about extending
the reach of our division and expanding the
promise of systemic change into leadership
Providing concrete examples of how
systemic change works in public
Videos were effective – More?
Access to what you are looking for fast and
Efficiency, Effectiveness, and Satisfaction (ISO9241)
UX or User Experience is becoming more
important in our “information overload” world.
25-35 seconds to convince a user to stay (Nielsen
& Loranger, 2006).
Usability provides precise way of measuring and
improving websites in a systematic fashion.
1.) How do practitioners perceive the overall usability of the website?
2.) Does the practitioner find the website’s content useful for
understanding systemic change in K-12 schools?
3.) After time spent on the website, do practitioners perceive that they
would like to learn more about systemic change for the benefit of
leading change efforts?
4.) What suggestions do practitioners give for the improvement of the
on-line delivery and conversation systems to connect practitioners with
researchers of educational systemic change?
Social Networks, Emails, 1
Survey- 23 Item study
Question 1 How do practitioners perceive the
Design - Clean
Mechanics- Some links
Architecture - Efficient
Navigation - Easy
Content - Not in-depth
Reliability – Can verify who
Does the practitioner find the website’s content
systemic change in K-12 schools?
Perceptions in representing systemic
Open Comments - Positive
CONTENT: 3 Positive Comments on video learning
and organization - Home page and Individual
“I felt that the site facilitated learning at both a
surface or deep level. I loved how the video
names were meaningful and spoke to the
After time spent on the website, do practitioners
perceive that they would like to learn more about
systemic change for the benefit of leading change
Corresponds with Survey Question: Why are you
interested in Systemic Change?
Answered Characterized by the following:
Dissatisfaction – 9
Schools need it &
how is important
No child left
I feel like it's constantly the same old song
playing on the record player...children aren't
getting the education the need or deserve.
It's frustrating. But it's great to know people
are still out there trying to help fight this
system of standardization
Informed – 14 Comments
I am an
I’m a librarian any
change to education
will change what the
library should offer it's
I'm an educator. I want to prepare my
students for their futures as best I can.
Leadership– 2 Comments
know how to lead it
The organization I work for, Curriculum
Leadership Institute prides itself on help
school districts achieve positive systemic
What suggestions do practitioners give for the
improvement of the on-line delivery and
conversation systems to connect practitioners
with researchers of educational systemic
2 Mechanics– Links
4 Design of
1 Architecture – Videos tab
3 Content – Specific
Strategies, Tools, Examples
of working, more
personal, Success stories
3 Reliability of information
Usability Study – CONTENT
7 Point Scale
23-item usability survey
Overall Participants felt…
59% Use website in
82% Recommend to
14 Supplied Email
Interest with Practitioners
Why interested? Dissatisfaction
& want to be informed
Usability study – short survey
& not an in-depth understanding
Does generate interest? Maybe
Question: Is it worth it?
Changes to website to consider:
Aslan, S., & Reigeluth, C. M. (2012). A Trip to the past and future of
educational computing: Understanding its evolution. Contemporary
Educational Technology, 2(1), 1-17. Banathy, B. H. (1996). Conversation
as a medium for change in education. Educational
Technology, 36(1), 39-41.
Duffy, F. M. (2010). Dream! Create! Sustain! Mastering the Art and
Science of Tranforming School Systems. Lanham, MD: Rowman &
Fullan, M. G. (2010). All systems go. Thousand Oaks, CA: Corwin Press.
Reigeluth, C. M., & Duffy, F. M. (2008). The AECT FutureMinds Initiative:
Transforming America's School Systems. Educational
Technology, 48(3), 45-49.
Reigeluth, C. M., & Karnopp, J. R. (2013). Reinventing Schools: It's Time
to Break the Mold. Lanham, MD: Rowman & Littlefield Education.
Beth Sockman: email@example.com
Anthony Chow: firstname.lastname@example.org.