Embrapa´s Success Measurement Methodology


Published on

Presentation of José Dilcio Rocha for the "Workshop Virtual Sugarcane Biorefinery"

Apresentação de José Dilcio Rocha realizada no "Workshop Virtual Sugarcane Biorefinery "

Date / Data : Aug 13 - 14th 2009/
13 e 14 de agosto de 2009
Place / Local: ABTLus, Campinas, Brazil
Event Website / Website do evento: http://www.bioetanol.org.br/workshop4

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Embrapa´s Success Measurement Methodology

  1. 1. Embrapa’s success measurement methodology José Dilcio RochaEmbrapa-Agroenergy - CNPAE August 2009
  2. 2. Mission Statement“To seek and implement sustainabledevelopment solutions for the rural space,focusing on Brazilian agribusiness, through thegeneration, adaptation and transfer ofknowledge and technology, in order to benefitthe entire Brazilian society”
  3. 3. EMBRAPA: Brazilian Agricultural Research Corporation• Established in 1973• Linked to the Ministry of Agriculture, Livestock and Food Supply• Headquarters: Brasilia, FD• ANNUAL BUDGET US$ ~ 500 millions• FUNDING Federal Government - 88% Own Funding - 12%
  4. 4. • HUMAN RESOURCES (1) Total: 8,375 2,198 Researchers 68% PhD (12% Post-Doc) 30% MS 2% BS 1,270 Support Analysts 5% PhD 21% MS 8% BS Specialist 66% BS 4,907 Others Categories
  5. 5. Embrapa Network• 40 Research Centers - 11 National Thematic Centers - 15 National Commodity Centers - 14 Ecorregional /Agroforestry Centers• 4 Special Services• 2 VIRTUAL LABORATORIES OVERSEAS Labex: USA – USDA/ARS Europe: France, The Netherlands• Embrapa Africa – Accra, Ghana and Venezuela
  6. 6. Embrapa’s RD&I NetworkNorth (06) Embrapa Acre   Embrapa Amapa Embrapa Western Amazonia  Embrapa Eastern Amazonia    Embrapa Rondonia  Southeast (10) Embrapa RoraimaNortheast (07)   Embrapa Agrobiology    Embrapa Mid-North   Embrapa Food Technology Embrapa Tropical Semi-Arid  Embrapa Dairy Cattle   Embrapa Coastal Tablelands     Embrapa Agriculture Informatics Embrapa Goats   Embrapa Agricultural Instrumentation  Embrapa Cassava & Tropical Fruits   Embrapa Environment Embrapa Cotton   Embrapa Maize & Sorghum  Embrapa Tropical Agroindustry    Embrapa Satellite Monitoring   Center-west (10)  Embrapa Cattle-Southeast   Embrapa Western Region Agriculture  Embrapa Soils  Embrapa Rice & Beans South (07)  Embrapa Coffee  Embrapa Temperate Agriculture   Embrapa Cerrados  Embrapa Forestry   Embrapa Beef Cattle  Embrapa South Animal Husbandry & Sheep Embrapa Vegetables  Embrapa Soybean  Embrapa Pantanal  Embrapa Swine & Poultry  Embrapa Agroenergy  Embrapa Wheat  Embrapa Genetic Resources & Biotechnology  Embrapa Grape & Wine  Embrapa Tecnological Information Embrapa Africa Labex USA Labex Europe
  7. 7. The Embrapa’s Management System - SEG Strategic Manager Committee - CGE EDP General & specific objectives, Strategic Strategic Guidelines Institutional Agenda Operational guidelines R&D Technology Transfer Communication Institutional Development Manager Committee of the Program – CGP Tactic MP 2 MP 3 MP 4 MP 5 MP 6MP 1 Operational Sectorial Incremental Tech Transfer Institutional FamiliarBig challenges Comp.& Sust. Tech. Dev. Communication Development Agriculture ECs & Partners ECDPs (PDUs)
  9. 9. EMBRAPA´S RD&I PROGRAM: Platforms
  10. 10. http://www.cnpae.embrapa.br Brasília, DF, Brazil +55 61 3447 4022Embrapa-Agroenergy– National Agroenergy Research CenterMay 24th, 2006, startup Jan, 2007• Central point of coordination of several Embrapa’s Research Centers;• Research in strategic themes and products: – Not carried out by other Brazilian research institutions, – With specificity, – Complementary approaches;• New expertise not yet worked;• Embrapa’s reference in R,D&I nets and consortium in the country and abroad;• Support to Consortium and Agroenergy Funds.
  11. 11. Embrapa’s research impact evaluation Objectives:  Communicate the company’s R&D results to the society;  Provide information for actions to minimize social imbalances, environmental and economic risks;  Consolidate indicators to help in getting grants targeting the development of research at Embrapa.Embrapa-Agroenergy - CNPAE August 2009
  12. 12. Embrapa’s research impact evaluation Methodology: 1) – Economic impacts Economic surplus 2) – Social impacts Employment/ New jobs Ambitec Social 3) – Environmental impacts Ambitec Agro (Agriculture) Ambitec Agroindústria (Agro-industry) Ambitec Produção animal (Animal production) 4)- Knowledge, training, and politic-institutional impacts ESAC (developed by GEOPI/Unicamp)Embrapa-Agroenergy - CNPAE August 2009
  13. 13. Embrapa’s research impact evaluation Economic Impact EvaluationEmbrapa-Agroenergy - CNPAE August 2009
  14. 14. Embrapa’s research impact evaluationEconomic impact evaluation – Economic Surplus Method Measurement of the social benefits aggregated to a research project.
  15. 15. Embrapa’s research impact evaluation Method (continuing) – important information:  Variation in the production due innovation;  Increasing in productivity;  Drop in production costs;  Price of the target product;  Adoption rates;  Adoption costs;  Magnitude of the supply curve displacement resulting from the adoption of technological innovations.Embrapa-Agroenergy - CNPAE August 2009
  16. 16. Embrapa’s research impact evaluation Method (continuing) - Types of Impacts Increment in the productivity - Ex: new cultivars. Obs. Attention to the additional production costs; Cost reduction - Ex: pest integrated management and biologic control; Production expansion in new areas - Ex: use of new technologies that allow the production in inappropriate areas before its use; Value aggregation - Ex: processing technologies.Embrapa-Agroenergy - CNPAE August 2009
  17. 17. Embrapa’s research impact evaluation Economic Impact – Considerations: As the impact evaluation is ex post, it is strongly suggested to evaluate the technology after some years of adoption; Evaluated technology should be compared to the best available option to producers; Yields, costs, and income in the tables are considering variables due variation in labor, inputs such as fertilizers, agrochemicals, etc., and climate variation and other factors; The unit price can also change in different years.Embrapa-Agroenergy - CNPAE August 2009
  18. 18. Embrapa’s research impact evaluation Observations: “Embrapa’s Participation” is estimated in the benefit after the following considerations: * The technology pedigree; * The partner involvement to develop the technology; * The technology transfer costs. Embrapa’s participation is not higher than 70%.Embrapa-Agroenergy - CNPAE August 2009
  19. 19. Embrapa’s research impact evaluation Technology Costs Personnel Costs Research Costs Capital Depreciation Administration Costs Technology Transfer CostsEmbrapa-Agroenergy - CNPAE August 2009
  20. 20. Embrapa’s research impact evaluation OBS: The capital depreciation is calculated annually to each research center in the context of the Center Evaluation System (SAU) and the Awards and Evaluation System for Results (SAPRE). Costs must be considered from the beginning of the project conception and not from its startup or adoption. All costs have annual variation. After calculating all benefits and all research costs it is possible to calculate the Net Present Value (NPV), the Internal Rate of Return (IRR) or the benefit/cost ratio (B/C) of the technologies. This calculus can be done by the end of each Center Directive Plan PDU (each four year).Embrapa-Agroenergy - CNPAE August 2009
  21. 21. Embrapa’s research impact evaluationEnvironment Impact Evaluation
  22. 22. Embrapa’s research impact evaluation Methodology: Environment Impact Evaluation of Agricultural and Livestock Innovation Technologies in the R&D context – AMBITEC-AGRO Ecologic Dimension – consider indicators related to rural entrepreneur:  Upstream - natural resources and inputs uses;  Downstream – residues production, environment changes, and ecosystem and habitat changes and recovering
  23. 23. Embrapa’s research impact evaluation The AMBITEC system is based on a set of indicators to R&D project impact assessment.
  24. 24. Embrapa’s research impact evaluationAgricultural Technologies - AMBITEC-Agro;Agro-industrial Technologies - AMBITEC-AgroindústriaLivestock Technologies - AMBITEC-Produção Animal
  25. 25. Embrapa’s research impact evaluationAmbitec-Agro aspects:Technology scope;Technology efficiency;Environment conservation andEnvironment recovering.
  26. 26. Embrapa’s research impact evaluationAmbitec-Agroindústria aspects:Technology scope;Technology efficiency; Environment conservation; Product quality and Social capital.
  27. 27. Embrapa’s research impact evaluationAmbitec-Produção Animal aspects: Technology scope; Technology efficiency; Environment conservation; Environment recovering; Product quality and Animal comfort and health.
  28. 28. Embrapa’s research impact evaluationSocial Impact Evaluation
  29. 29. Embrapa’s research impact evaluation Methodology: - AMBITEC-Social The AMBITEC-Social assesses agriculture innovation technology social impacts. It analyses the aspects of the basic needs satisfaction and the quality of life changes due the new technology adoption.
  30. 30. Embrapa’s research impact evaluationO Ambitec Social aspects:Employment;Income;Health; andManagement and Administration
  31. 31. Embrapa’s research impact evaluation Employment Income Health Management & Administration 8.Personnel and 1. Training 5. Income Environment generation of Health 11. Manager the property profile and 2. New qualified dedication local jobs 9. Occupational 6. Diversity of 12. Commercialization security and health income sources conditions3. Job availability and worker conditions 7. Property 13. Residue 10. Food security value recycling 14. Institutional 4. Job quality relationship
  32. 32. Embrapa’s research impact evaluationSocial Impact Evaluation - New job Assessment
  33. 33. Embrapa’s research social impact evaluationAll productive chain is considering for job generation.
  34. 34. Embrapa’s research impact evaluationImpact Evaluation inKnowledge, Training, and Politic- Institutional
  35. 35. Embrapa’s research knowledge, training, and politic- institutional impact evaluationObjectives: Impact evaluation in knowledge (basic research), Impact evaluation in training and e learning, Impact evaluation in politic-institutional.
  36. 36. Embrapa’s research knowledge, training, and politic- institutional impact evaluation Evaluation mainly to evaluate the thematic centers like Agroenergy; The methodology was adapted from ESAC (developed by Geopi/Unicamp). It is similar to Ambitec and Ambitec-Social; It analyses 21 indicators and their quality aspects in a -3 to +3 scale.
  37. 37. Embrapa’s research impact evaluation Integrated Analysis
  38. 38. Embrapa’s research impact evaluation The integrated analysis has three steps: 1. Select 3 technologies for each Center with appropriated description, 2. Analysis of each technology following the procedure above and compared each other considering the results for the analyzed year and the previous ones, 3. Finaly, a short report with all conclusions concerning the impact analysis must be presented by each Center.Embrapa-Agroenergy - CNPAE August 2009
  39. 39. Embrapa’s research impact evaluationIntegrated analysis
  40. 40. Embrapa’s success measurement methodology THANK YOU Embrapa Agroenergia www.cnpae.embrapa.br Jose.rocha@embrapa.br