Loading…

Flash Player 9 (or above) is needed to view presentations.
We have detected that you do not have it on your computer. To install it, go here.

Like this presentation? Why not share!

Sea Grant Annual Reporting

on

  • 1,378 views

Sami Grimes and Heather Treizenberg of the National Sea Grant Office discuss national reporting guidelines and response to network feedback. Sea Grant Week 2010

Sami Grimes and Heather Treizenberg of the National Sea Grant Office discuss national reporting guidelines and response to network feedback. Sea Grant Week 2010

Statistics

Views

Total Views
1,378
Views on SlideShare
1,378
Embed Views
0

Actions

Likes
0
Downloads
0
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

CC Attribution-NonCommercial-ShareAlike LicenseCC Attribution-NonCommercial-ShareAlike LicenseCC Attribution-NonCommercial-ShareAlike License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • - What exactly IS an annual report - How annual report information is used Network concerns- How Annual Reports fit into the planning, implementation and evaluation system Results from the Feedback Questionnaire that took place in Sept. - What to expect for next year- Then we will have plenty of time for discussion and Q&As
  • Four main components to the annual report:Program & Project Impacts,Program Metrics, Performance Measures, and Project updatesThe 1st 3 components are what are produced as a program’s annual report for Site Visits.Dates of the annual report follow the grant year (2/1 – 1/31)The annual report is intended to highlight annual components of the programSame information is collected from each program in order to aggregate impacts, performance measures and metrics up at the national level to help highlight components of the entire national sea grant college program and help tell part of the national sea grant story
  • Because we collect similar information from the program, we are able to help tell a better national story. Last year alone…the sea grant network “created or retained...” read bullets in slideInformation from bullet 2, 3, and 4 has already been used and requested by NOAA to report to DOC and OMBThese types of bullets help us tell part of the national story; the other part is the impact statements
  • Mandatory Reporting: Reporting – quarterly, data calls/taskers – weekly, hot topicsFiredrills – give us 2-24 hoursBudget Request Narratives Template to follow consists of half of the allowed 1page to consist of metrics, milestones and PMThose that are making budget decisions focus on the budget amount requested and then look at the table that includes the metrics, pm and milestones without ever reading the narrative – looking at the quantitative data, and little opportunity for the qualitative impact storiesProviding information is essential to survival – some of the exercises aren’t about budget increases, but maintaining our current budgetAnd then, of course, telling the national story or state program story, depending on the tasker
  • Other ways annual reports are used - As part of the new evaluation system, annual reports are to serve the purpose of a self-evaluation; programs can annually review their progress towards their program plan and make any necessary adjustments in order to meet their planned outcomesPrograms can use the information in the annual report to create their performance progress reportNearly 80% of the feedback questionnaire respondents said they used the annual report content for other reporting or communication purposes (more about the questionnaire results to come soon)
  • As stated in the previous slide, annual reports track and report progress against program plans over a one-year period (program self-evaluation)The most recent annual report goes to members of the Site Review Teams – give them an idea of the activities the program is involved inAnnual reports serve as a basis for discussion of the program for the NSGO Review (information sharing)Beginning in 2015, a collection of annual reports (2010-2014) will serve as the basis for the Performance Review Panel review
  • Rumblings in the network over Annual Report Process – developed feedback questionnaire to unearth and understand what the issues and concerns were
  • Majority of respondents felt they provided input, but not enough time was given and timing was poor.
  • Comments:Execution of annual reporting process has been poor, the idea is important.It is a lot of work to put this together; not sure if the equivalent benefit has been realized.Programs need an explanation of the annual reporting and how this information has been used.In university setting, programs are aware 1 year out of the reporting requirements not post-year.Not clear how annual reporting information will be used in PIE.A database can’t replace the human thought needed to synthesize, aggregate, and analyze the impact information.
  • Comments:Once guidance was finalized, it was great, but along the way staff lost significant time awaiting its announcement.The earlier the better, ideally when the reporting year starts (Feb 1). At least 8 weeks are needed to provide information. “We need final guidance by the end of the year for annual reports due next year.”“Defensible activity” only counts relative to the definitions provided. Website is not easy to find information.Deepwater horizon incident in April changed timelines.University reporting is due before NSGO annual reporting, so programs already go started on the tracking/reporting even before final NSGO guidance was issued.Problem of multiple changing deadlines – lots of scrambling and wasted time.
  • Comments:Agreement that national performance measures do not capture national or program stories.
  • Comments:
  • Comments:All online resources MUST be Mac-compatible!!!!!
  • Comments:We use info to report to university, Board of Governors, UPR, College Extension reporting system, advisory bodies, reporting progress reports to NOAA, SGA, website, constituents via magazines.We do not yet trust NIMS, but staff generate other reports.Program re-purposed impact statements for university reports.“The annual report is a secondary use for data collected for state-level reporting.”
  • Comments:To university and extension administrators, as well as board of governors.Faculty members report to individual departments.Other funding sources require periodic reports.Director’s performance reviews.
  • Comments:“Yes, but the NSGO reporting requirements are increasingly diverging from what we report to our Board and adding to our reporting load.”“There are different formats, expectations, "years" and timing. University reports are due in May/June, but we utilize the material we are pulling together for NSGO and other grant reports to put those reports together.”
  • Guidance will be sent out by Feb. 2011Information for annual reports will be the same as last year, but include progress towards your program planMechanism to collect the information is currently unknownNIMS – programs have an opportunity to help shape the system – become a beta-tester!KOLA – WHERE ARE WE WITH UPDATING NIMS???

Sea Grant Annual Reporting Presentation Transcript

  • 1. Annual Reporting
    Sami Grimes and Heather Triezenberg Sea Grant Week – New Orleans
    October 16, 2010
  • 2. Outline
    Components of an annual report
    How annual report information is used
    How do annual reports fit into the planning, implementation and evaluation (PIE) system
    Network concerns
    Feedback Results
    What to expect for next year’s annual reporting process
    Discussion/Questions and Answers
  • 3. What are the components of an annual report?
    Program and Project Impacts
    Performance Measures
    Program Metrics
    Project Updates
    Dates – follow grant year (2/1 – 1/31)
    Dates follow grant year (2/1 – 1/31)
    (2) Program
    Metrics
    (1) Program & Project Impacts
    (4) Project Updates
    (3) Perf. Measures
  • 4. Sea Grant Milestones from 2009-2010 Annual Report
    4
    • 3,500 jobs and 650 businesses created or retained
    • 5. SG assisted 160 coastal communitiesadopt or implement hazard resiliency practices
    • 6. 1,700 undergraduate and graduate students supported
    • 7. 128 peer-reviewed journal articles published
    • 8. Leveraged over $86M
    • 9. 186 coastal communities restored degraded ecosystems (nearly 32,000 acres)
    Programs now have access to the national information from the National website.
  • 10. How is annual report information used?
    Nationally -
    Mandatory reporting to NOAA, Dept. of Commerce and Office of Management & Budget
    Budget request narratives
    Tell the national and state
    program stories
    Create Hill briefing materials
  • 11. How is annual report information used? (con’t)
    Assess progress towards program plan (annual self-evaluation)
    Create Performance Progress Reports for NOAA grants online requirement
    Other sea grant program reporting or communication purposes
  • 12. How do annual reports fit into the PIE system?
    Track and report progress against plans over a one-year period (program self-evaluation)
    The current program annual report goes to members of the Site Review Teams
    Basis for discussion of the program for the NSGO Review (information sharing)
    Beginning in 2015, a collection of annual reports (2010-2014) will serve as the basis for the Performance Review Panel review
  • 13. Annual Report - Network Concerns
    To better serve the network: we listened, we implemented:
    Weekly annual report conference calls
    Impact Guidance
    Definitions for Metrics and Perf. Measures
    Invited feedback
  • 14. Methods
    SGA &Advisory Board
    Census of programs (via directors)
    Online feedback form (surveymonkey.com)
    September 17 – October 1.
    1 invitation, 1 reminder/thank-you
    No non-response check
    18/32 programs completed form (56%)
  • 15. Results
  • 16. Results
  • 17. Results
  • 18. Results
    Comments on performance measures:
    ”Easy to count attendees of workshops; but more difficult to determine who modified practices. Difficult to determine who implemented practices and how much SG was a factor.”
    “The definitions, and deciding exactly how to count what things, remains a challenge. For example, it is quite subjective and variable to define (a) a coastal community, (b) a sustainable practice, and (c) whether a practice has been adopted or implemented specifically as a result of our program, thus making it difficult to accurately measure that particular performance measure.”
  • 19. Q10
  • 20. Results
  • 21. Results
  • 22. Results
  • 23. Results
  • 24. Q25
  • 25. Results
    • Please describe ideas for how the National Sea Grant College Program can improve planning and reporting processes that best capture the excellence of Sea Grant Programs. (Please type below.)
    • 26. Align impacts and performance measures reporting with grants reporting.
    • 27. Appears to be little relationship between omnibus and PIE.
    • 28. Administrative burdens have become an enormous drain.
    • 29. We worry about too much reliance on data output without analysis or thoughtful synthesis.
    • 30. Increase capacity of National Office.
    • 31. We need to get beyond the numbers to the qualitative impacts on people/communities wherever possible.
  • Results
    • General comments:
    • 32. Provide feedback to programs on how data were used.
    • 33. We appreciate the efforts that the NSGO staff are putting in trying to shift the network into this new system. It's been as difficult for the National Office as it has for the programs. We also recognize that NOAA, OMB and Congress can always add new expectations. We're heading in the right direction, and if we can keep to the path we are currently following for the foreseeable future with few changes, it will benefit the entire network. Thanks!
  • What to expect for next year’s annual reporting process
    Guidance will be sent out by Feb. 2011
    Content of annual report will be similar to last year, but will also include progress towards your program plan
    Mechanism to collect the information is currently unknown
    NIMS – programs have an opportunity to help shape the system – become a beta-tester!
  • 34. Discussion/Question and Answers