by Sarah Baughman, John Dorner, Karen Jeanette The eXtension Military Families Initiative Network Literacy Community of Practice (CoP) was created to build a community around learning in online networked environments. The CoP helps Extension professionals and military service helping professionals use social networks and learning networks to work more effectively and efficiently across boundaries. The emerging nature of the CoP’s work requires an evaluation method that captures the fluidity and constant change inherent in working in a complex system. Using reflective practice in a developmental evaluation framework, the Network Literacy CoP is able to monitor and adapt quickly to the environment. This session will focus on the work of the Network Literacy CoP as it incorporates a developmental evaluation approach. Presenters will discuss the CoP and its work implementing the reflective practice and lessons learned.

1. Beyond Logic Models:
Evaluating Complex
Emerging Programs
Sarah Baughman
John Dorner
Karen Jeannette
eXtension

2. http://www.extension.org/militaryfamilies
http://blogs.extension.org/militaryfamilies

3. NetLit Steering Committee
• Anne Adrian
• Connie Hancock
• Sarah Baughman, Evaluation Specialist
• Amy Hays
• Bob Bertsch
• Karen Jeannette
• Peg Boyles
• Stephen Judd, Chair
• Kyleen Burgess
• Jim Langcuster
• Chris Canjar
• Kristen Mastel
• Thomas G. Coon, Administrative advisor
• Rich Phelps
• John Dorner, Vice-Chair
• Jerry Thomas
• Brent Elrod, National Program Leader
• Kevin Gamble • Terrence Wolfork
• Diana Hagan • Barbara Woods
Image Credit: http://www.flickr.com/photos/info_grrl/6862478946/in/set-72157629286123040/

4. How do we plan to measure outcomes when we aren't
sure where we are going?
Image credit: http://www.flickr.com/photos/kelvin255/3518359517/

6. Developmental Evaluation adapts to
the realities of complex nonlinear
dynamics rather than trying to impose
order and certainty on a disorderly and
uncertain world.
– Michael Quinn Patton

7. Evaluation Progress
Steps along the way
internal evaluator with eval committee
establishing the framework
developing initial evaluation questions
surveying steering committee for
sensitizing concepts
reflective practice

8. Reflections to
move us forward
Participating in online
networks is an essential
skill for our increasingly
inter-connected world.
Network Literacy is the
ability to leverage
technology to create
connections with other
people and/or
organizations in a virtual
space.
http://www.flickr.com/photos/foxypar4/

9. • Networks are powerful
• Participating in networks has opened opportunities for
creating stronger relationships resulting in
professional collaborations
• Learning, co-learning, and active learning all happen
with participation in networks
• Comfort level increases through active participation in
networks
• Need for recognizing barriers to participating in
networks
Image credit: http://www.flickr.com/photos/mag3737/

10. What role can we play?
• Role model good online teaching
• Leveraging individual CoP member networks to
create impact within the system
• Leader in defining, creating best practices for online
learning and extension education
• Serve as “technology stewards” for CES by showing
how tools and approaches can address challenges.
• Strategic efforts to leverage our networks around
specific events

11. Roles we can play
• Hold national level online conversations
about cooperative extension that are
open to the public to raise awareness
of cooperative extension programs.
• Support the efforts of others within
Extension working to build network
literacy.

12. Next Steps
• Discussion results of reflective practice
with the steering committee
• Engage entire CoP in more specific
plans to more forward
• Continue to document our work

13. What we’ve learned
• Time consuming, challenging approach
• Stakeholder involvement has been
difficult to get
• We are making progress in individual
learning networks
• Increasing engagement and interaction
outside of CoP membership

14. What we’ve learned
• Time consuming, challenging approach
• Stakeholder involvement has been
difficult to get
• We are making progress in individual
learning networks
• Increasing engagement and interaction
outside of CoP membership

15. Harold Jarche: www.jarche.com

16. Listening Session
• Offer a chance to invest
• Opportunity to identify themes
(sensitizing concepts to work from)
• Create opportunity to request specific
contributors/contributions
• Provide tighter direction for future
educational offerings (webinars, blog
posts, etc)

17. Themes can help identify contributors
and “community indicators”
• Can we provide programming that
responds to themes and increase:
– #new contributors
– # contributors from state systems
– # contributors from external learning
networks
– Repeat visitors, contributors

18. Contact Information
SarahBaughman
@programeval
sarahbaughman@extension.org
John Dorner
@jdorner
jdorner@extension.org
Karen Jeannette
@kjeannette
Karen.jeannette@extension.org