This document provides information on setting up a Hydrological Information System (HIS) for India. It includes details on:
1. Defining key concepts of a HIS, including that it is a system to collect, process, and disseminate hydrological data to provide useful information to users.
2. The need for a standardized HIS in India to better plan for water resources given the variability of water patterns and inadequacies of existing systems.
3. The Hydrology Project aims to improve existing HIS across 8 Indian states to provide more reliable hydrological data for planning and management.
This document provides guidance on working with the HYMOS software in a networked environment at hydrology data processing centers. It outlines procedures for controlled access to HYMOS databases, assigning user rights and responsibilities for individual river basin databases and a unified state database. It also describes the transfer of data between temporary and permanent databases, and maintaining fragmented raw data and processed data received from other centers.
Preservation, Publishing, and People: A SEAD ViewInna Kouper
The document discusses research objects (ROs) which bundle together primary research results, metadata, software, and other materials. It describes the roles of data creators, curators, and data scientists in working with ROs as they move from initial research to publication and later reuse. The SEAD Virtual Archive (VA) implements a model for ROs that allows them to transition between different states as they move through the research lifecycle from creation to publication and reuse.
IRJET- A Core Medical Treatment System forEmergency Management using CloudIRJET Journal
This document proposes a core medical treatment system using cloud computing to improve emergency management. The system would store patients' medical histories in the cloud to be accessible from any healthcare facility. This would allow doctors to access vital patient information during emergencies even if the history is from a different healthcare provider. The system would use encryption algorithms like Twofish to securely store private patient records in the cloud. This would help provide timely treatment, identify pre-existing conditions, and save more lives during medical emergencies by giving doctors access to full patient histories.
Presentation to the UM Library Emergent Research SeriesSEAD
SEAD is a 5-year project funded by the NSF to develop cyberinfrastructure for sustainable data preservation and access. It is a partnership between the universities of Michigan, Indiana, and Illinois. SEAD aims to serve researchers in sustainability science who work in small teams and have diverse data needs. It provides active curation tools, collaboration spaces, and interfaces that integrate data, publications, and people. Data can be deposited to university repositories through the SEAD Virtual Archive for long-term preservation and discovery. Lessons show more support is needed to bridge data production and long-term infrastructure. Future plans include expanding the user community and repository options.
Spring 2014 Data Management Lab: Session 1 Slides (more details at http://ulib.iupui.edu/digitalscholarship/dataservices/datamgmtlab)
What you will learn:
1. Build awareness of research data management issues associated with digital data.
2. Introduce methods to address common data management issues and facilitate data integrity.
3. Introduce institutional resources supporting effective data management methods.
4. Build proficiency in applying these methods.
5. Build strategic skills that enable attendees to solve new data management problems.
This document discusses the Sustainable Environment - Actionable Data (SEAD) project. SEAD aims to provide data services to sustainability researchers by developing tools that address challenges like heterogeneous and small datasets. It plans to move data curation upstream, involve domain scientists, and leverage social media and metadata. SEAD will integrate these active curation services into a federated infrastructure to preserve datasets long-term. The project is led by researchers from multiple institutions and funded by the National Science Foundation.
This document provides an overview of key concepts and measurement techniques in hydrometry. It defines relevant variables and units used to measure hydrological quantities. The document discusses network design, site selection, measurement frequency, and techniques for measuring stage, streamflow, and other hydrometric variables. A variety of equipment and methods are described, including staff gauges, data loggers, current meters, and acoustic Doppler current profilers. Guidelines are provided for equipment specifications, station design, construction, and installation.
This document provides guidance on working with the HYMOS software in a networked environment at hydrology data processing centers. It outlines procedures for controlled access to HYMOS databases, assigning user rights and responsibilities for individual river basin databases and a unified state database. It also describes the transfer of data between temporary and permanent databases, and maintaining fragmented raw data and processed data received from other centers.
Preservation, Publishing, and People: A SEAD ViewInna Kouper
The document discusses research objects (ROs) which bundle together primary research results, metadata, software, and other materials. It describes the roles of data creators, curators, and data scientists in working with ROs as they move from initial research to publication and later reuse. The SEAD Virtual Archive (VA) implements a model for ROs that allows them to transition between different states as they move through the research lifecycle from creation to publication and reuse.
IRJET- A Core Medical Treatment System forEmergency Management using CloudIRJET Journal
This document proposes a core medical treatment system using cloud computing to improve emergency management. The system would store patients' medical histories in the cloud to be accessible from any healthcare facility. This would allow doctors to access vital patient information during emergencies even if the history is from a different healthcare provider. The system would use encryption algorithms like Twofish to securely store private patient records in the cloud. This would help provide timely treatment, identify pre-existing conditions, and save more lives during medical emergencies by giving doctors access to full patient histories.
Presentation to the UM Library Emergent Research SeriesSEAD
SEAD is a 5-year project funded by the NSF to develop cyberinfrastructure for sustainable data preservation and access. It is a partnership between the universities of Michigan, Indiana, and Illinois. SEAD aims to serve researchers in sustainability science who work in small teams and have diverse data needs. It provides active curation tools, collaboration spaces, and interfaces that integrate data, publications, and people. Data can be deposited to university repositories through the SEAD Virtual Archive for long-term preservation and discovery. Lessons show more support is needed to bridge data production and long-term infrastructure. Future plans include expanding the user community and repository options.
Spring 2014 Data Management Lab: Session 1 Slides (more details at http://ulib.iupui.edu/digitalscholarship/dataservices/datamgmtlab)
What you will learn:
1. Build awareness of research data management issues associated with digital data.
2. Introduce methods to address common data management issues and facilitate data integrity.
3. Introduce institutional resources supporting effective data management methods.
4. Build proficiency in applying these methods.
5. Build strategic skills that enable attendees to solve new data management problems.
This document discusses the Sustainable Environment - Actionable Data (SEAD) project. SEAD aims to provide data services to sustainability researchers by developing tools that address challenges like heterogeneous and small datasets. It plans to move data curation upstream, involve domain scientists, and leverage social media and metadata. SEAD will integrate these active curation services into a federated infrastructure to preserve datasets long-term. The project is led by researchers from multiple institutions and funded by the National Science Foundation.
This document provides an overview of key concepts and measurement techniques in hydrometry. It defines relevant variables and units used to measure hydrological quantities. The document discusses network design, site selection, measurement frequency, and techniques for measuring stage, streamflow, and other hydrometric variables. A variety of equipment and methods are described, including staff gauges, data loggers, current meters, and acoustic Doppler current profilers. Guidelines are provided for equipment specifications, station design, construction, and installation.
This document provides guidance on network design and site selection for water level and streamflow stations. It outlines the key steps in the network design process, including defining objectives, evaluating the existing network, identifying gaps, prioritizing stations, and estimating costs. It emphasizes collecting relevant background information and maps. Site selection involves defining objectives, conducting desk studies and field surveys, and selecting locations suitable for specific measurement methods and equipment based on factors like hydrology, access, and costs. The document provides detailed guidelines for selecting sites for water level gauges, current meter measurements, and other streamflow estimation techniques.
This document describes procedures for network design and site selection for hydro-meteorological monitoring stations. It outlines 8 steps for network design optimization, including reviewing existing networks and data needs, setting objectives, prioritizing objectives, determining required network density using effectiveness measures, reviewing existing networks, selecting new sites and equipment if needed, estimating costs, and implementing and reviewing the network design. It also provides details on using relative root mean square error to determine required gauge density based on design area, coefficient of variation, and number of stations. Site selection considerations include technical, environmental, logistical, security, legal, financial, and practical aspects.
This document provides an overview of a Hydrological Information System (HIS) being developed for 9 states in India. It discusses the key components and activities of the HIS, which include: assessing user needs, establishing observation networks, managing historical data, collecting field data, processing and analyzing data, exchanging and reporting data, storing and disseminating data, and developing institutional and human resources. The overall goal of the HIS is to provide reliable hydrological data and information to support long-term water resources planning and management decisions in India.
This document provides guidance on network design and site selection for hydro-meteorological stations. It discusses the steps for network optimization which include reviewing existing networks, identifying data needs, prioritizing objectives, determining required network density, and cost estimation. Site selection considerations are also outlined, including technical, environmental, logistical, security, legal and financial aspects. Key factors for siting stations include exposure conditions, wind protection, level ground, and integrating with other monitoring networks.
This document provides guidance for managing hydro-meteorological data in India within a Hydrological Information System (HIS). It discusses the data lifecycle, from monitoring networks and data collection to analysis, dissemination and use. It directs the user to relevant manuals on topics like rainfall, snow, climate and evaporation data processing. The goal is to standardize procedures and provide high quality data to inform water resources planning and management.
This document provides an overview of guidance materials for the management of surface water data within India's Hydrological Information System (HIS). It describes the lifecycle of hydrometric data from collection through analysis and publication. Key documents that provide procedures for surface water data management are the HIS Manual Surface Water and various training modules developed under the Hydrology Project. The manual and modules cover topics like network design, data collection, entry, validation, processing, analysis, and dissemination of water level, stage-discharge, and flow data. The goal is to standardize surface water data management practices across states and agencies to improve data quality and usability.
The document provides details on a surface water data processing plan for India. It discusses distributing data processing activities across three levels - sub-divisional, divisional, and state data processing centers. It outlines the activities, computing facilities, staffing, and time schedules needed at each level to efficiently manage the large volume of hydrological data. The plan aims to ensure data is properly validated and processed within time limits while not overwhelming staff.
The document provides guidance on reporting stage discharge data from hydrological monitoring stations. It recommends including a table with summary information for each station such as maximum/minimum observed stages and flows, the number of discharge measurements and ratings developed in the current and previous years, and the standard error of ratings. The purpose is to evaluate monitoring efforts and provide information for planning while avoiding reporting all raw data. Stage discharge relationships and time series data should be made available upon request.
1. The document outlines the National Water Policy of India which establishes the need for a standardized national hydrological information system to collect, process, and disseminate reliable water resources data.
2. Key goals of the policy include maximizing water availability, integrating surface and groundwater management, preserving environmental and ecological balances, and involving stakeholders in water management.
3. The hydrological information system described in the document is intended to provide the hydrological data and analysis needed to inform planning, design, management, and policy decisions around India's water resources in accordance with the National Water Policy.
1. The document describes India's Hydrological Information System (HIS) which collects, processes, stores and disseminates hydrological data.
2. The HIS aims to provide reliable data to support long-term water resources planning and management by establishing observation networks, managing historical data, collecting and processing data, and storing and disseminating it to users.
3. Key activities of the HIS include assessing user needs, establishing and maintaining observation networks, managing historical data, collecting field data, processing and analyzing data, exchanging and reporting data, and storing and disseminating data to support water planning in India.
This document provides a final report on the Hydrology Project conducted from 2003 in India with technical assistance from organizations in the Netherlands and India. It summarizes the objectives of establishing a comprehensive Hydrological Information System across various agencies, the activities of the technical assistance provided, and achievements of the project. Key points:
- The project aimed to improve institutional capabilities for hydrological data measurement, collection, analysis and dissemination through a distributed hydrological information system.
- Technical assistance provided support in areas such as assessing user needs, establishing observation networks, data collection/processing, institutional development and training.
- A phased implementation approach was used, starting with planning and standardization before implementation and consolidation of the hydrological information
This slide deck provides an overview and resources to respond to the OSTP memo with the subject: Increasing Access to the Results of Federally Funded Scientific Research issued by John P. Holdren in February 2013. It provides resources and information agencies, foundations, and research projects can use to assemble achieve public access to scientific data in digital formats.
Data management planning in the Australian funding landscape by Sarah OlesenMarta Ribeiro
Data management planning in the Australian funding landscape by Sarah Olesen at eResearch Australasia Conference
1.Australian Code for the Responsible Conduct of Research (2007)
2. National Statement on Ethical Conductin Human Research (2007 – updated 2014)
Introduction to Data Management Planning at Alien Challenge COST workshopAaike De Wever
1. The document introduces data management planning and discusses typical components to include in a data management plan such as a description of the data, file formats and metadata standards, data sharing and dissemination methods, roles and responsibilities, and long-term data storage and preservation.
2. Key components discussed include describing the data, file formats and metadata standards, how the data will be shared or made accessible, data storage and preservation, and roles and responsibilities for managing the data.
3. Creating a data management plan facilitates effective data management both during and after a research project and ensures data is well-organized, documented and preserved for future use or reuse.
The Hydrology Project has been running in India since 1995 and has significantly improved the availability and reliability of hydro-meteorological data in the country. It has established networks for instrumenting, processing, and applying hydrological data across nine states and six central agencies. The project focuses on building blocks like instrumentation, data processing, dissemination and specific applications like river basin planning tools, flood management tools, and studies. While the project has achieved a lot, further development is still needed to ensure sufficient high quality data for optimal water resources management in India according to the National Water Policy.
Survey of research data management practices up2010digschol2011heila1
An analysis of data management practices at a large South African university was conducted through interviews with researchers and students to identify needs and challenges. The findings showed that while data collection methods vary, data storage is often ad hoc with no centralized support or resources. Researchers expressed a need for a central university server or repository for secure data storage and assistance with time constraints. It was concluded that a formal research data management program and staff support are needed to improve current practices.
This document describes the design of a hydrological data storage and dissemination system. It discusses the major components of the system including databases to store different types of hydrological data (e.g. field data, processed data, maps), a catalogue to allow users to search and access data, and interfaces to allow external organizations and users to input and retrieve data. It provides specifications for hardware, software, security, and other technical aspects required to build the hydrological information system. The overall aim is to create a centralized, standardized system for permanently storing all types of hydrological data from various agencies and making it accessible to authorized users.
This document discusses next steps after the completion of the Hydrology Project (HP) in India. It summarizes the gains from HP, including establishing an integrated hydrological monitoring network across agencies. Lessons learned include the need for clear expectations and benefits, improved management and implementation approaches, and addressing staffing and training issues. The document proposes expanding HP horizontally to other states and consolidating achievements in states already covered. It also suggests expanding vertically to enable real-time water data use, drought management, and an integrated water resources management system. Institutional reforms are recommended to establish river basin organizations for improved water governance.
This document provides guidance on how to review monitoring networks. It begins with an introduction on the objectives and physical characteristics that networks are based on. It then discusses the types of networks, including basic, secondary, dedicated, and representative networks. The document outlines the steps in network design, which include assessing data needs, setting objectives, determining required network density, reviewing the existing network, and conducting a cost-effectiveness analysis. Specific guidance is provided on reviewing rainfall and hydrometric networks.
This document provides guidance on how to review monitoring networks. It begins with an introduction on the objectives and physical characteristics that networks are based on. It then discusses the types of networks, including basic, secondary, dedicated, and representative networks. The document outlines the steps in network design, which include assessing data needs, setting objectives, determining required network density, reviewing the existing network, and conducting a cost-effectiveness analysis. Specific guidance is given on reviewing rainfall and hydrometric networks.
Meeting the NSF DMP Requirement: March 7, 2012IUPUI
March 7 version of the IUPUI workshop Meeting the NSF Data Management Plan Requirement: What you need to know. This workshop is co-sponsored by the Office of the Vice Chancellor for Research and the University Library.
This document provides guidance on network design and site selection for water level and streamflow stations. It outlines the key steps in the network design process, including defining objectives, evaluating the existing network, identifying gaps, prioritizing stations, and estimating costs. It emphasizes collecting relevant background information and maps. Site selection involves defining objectives, conducting desk studies and field surveys, and selecting locations suitable for specific measurement methods and equipment based on factors like hydrology, access, and costs. The document provides detailed guidelines for selecting sites for water level gauges, current meter measurements, and other streamflow estimation techniques.
This document describes procedures for network design and site selection for hydro-meteorological monitoring stations. It outlines 8 steps for network design optimization, including reviewing existing networks and data needs, setting objectives, prioritizing objectives, determining required network density using effectiveness measures, reviewing existing networks, selecting new sites and equipment if needed, estimating costs, and implementing and reviewing the network design. It also provides details on using relative root mean square error to determine required gauge density based on design area, coefficient of variation, and number of stations. Site selection considerations include technical, environmental, logistical, security, legal, financial, and practical aspects.
This document provides an overview of a Hydrological Information System (HIS) being developed for 9 states in India. It discusses the key components and activities of the HIS, which include: assessing user needs, establishing observation networks, managing historical data, collecting field data, processing and analyzing data, exchanging and reporting data, storing and disseminating data, and developing institutional and human resources. The overall goal of the HIS is to provide reliable hydrological data and information to support long-term water resources planning and management decisions in India.
This document provides guidance on network design and site selection for hydro-meteorological stations. It discusses the steps for network optimization which include reviewing existing networks, identifying data needs, prioritizing objectives, determining required network density, and cost estimation. Site selection considerations are also outlined, including technical, environmental, logistical, security, legal and financial aspects. Key factors for siting stations include exposure conditions, wind protection, level ground, and integrating with other monitoring networks.
This document provides guidance for managing hydro-meteorological data in India within a Hydrological Information System (HIS). It discusses the data lifecycle, from monitoring networks and data collection to analysis, dissemination and use. It directs the user to relevant manuals on topics like rainfall, snow, climate and evaporation data processing. The goal is to standardize procedures and provide high quality data to inform water resources planning and management.
This document provides an overview of guidance materials for the management of surface water data within India's Hydrological Information System (HIS). It describes the lifecycle of hydrometric data from collection through analysis and publication. Key documents that provide procedures for surface water data management are the HIS Manual Surface Water and various training modules developed under the Hydrology Project. The manual and modules cover topics like network design, data collection, entry, validation, processing, analysis, and dissemination of water level, stage-discharge, and flow data. The goal is to standardize surface water data management practices across states and agencies to improve data quality and usability.
The document provides details on a surface water data processing plan for India. It discusses distributing data processing activities across three levels - sub-divisional, divisional, and state data processing centers. It outlines the activities, computing facilities, staffing, and time schedules needed at each level to efficiently manage the large volume of hydrological data. The plan aims to ensure data is properly validated and processed within time limits while not overwhelming staff.
The document provides guidance on reporting stage discharge data from hydrological monitoring stations. It recommends including a table with summary information for each station such as maximum/minimum observed stages and flows, the number of discharge measurements and ratings developed in the current and previous years, and the standard error of ratings. The purpose is to evaluate monitoring efforts and provide information for planning while avoiding reporting all raw data. Stage discharge relationships and time series data should be made available upon request.
1. The document outlines the National Water Policy of India which establishes the need for a standardized national hydrological information system to collect, process, and disseminate reliable water resources data.
2. Key goals of the policy include maximizing water availability, integrating surface and groundwater management, preserving environmental and ecological balances, and involving stakeholders in water management.
3. The hydrological information system described in the document is intended to provide the hydrological data and analysis needed to inform planning, design, management, and policy decisions around India's water resources in accordance with the National Water Policy.
1. The document describes India's Hydrological Information System (HIS) which collects, processes, stores and disseminates hydrological data.
2. The HIS aims to provide reliable data to support long-term water resources planning and management by establishing observation networks, managing historical data, collecting and processing data, and storing and disseminating it to users.
3. Key activities of the HIS include assessing user needs, establishing and maintaining observation networks, managing historical data, collecting field data, processing and analyzing data, exchanging and reporting data, and storing and disseminating data to support water planning in India.
This document provides a final report on the Hydrology Project conducted from 2003 in India with technical assistance from organizations in the Netherlands and India. It summarizes the objectives of establishing a comprehensive Hydrological Information System across various agencies, the activities of the technical assistance provided, and achievements of the project. Key points:
- The project aimed to improve institutional capabilities for hydrological data measurement, collection, analysis and dissemination through a distributed hydrological information system.
- Technical assistance provided support in areas such as assessing user needs, establishing observation networks, data collection/processing, institutional development and training.
- A phased implementation approach was used, starting with planning and standardization before implementation and consolidation of the hydrological information
This slide deck provides an overview and resources to respond to the OSTP memo with the subject: Increasing Access to the Results of Federally Funded Scientific Research issued by John P. Holdren in February 2013. It provides resources and information agencies, foundations, and research projects can use to assemble achieve public access to scientific data in digital formats.
Data management planning in the Australian funding landscape by Sarah OlesenMarta Ribeiro
Data management planning in the Australian funding landscape by Sarah Olesen at eResearch Australasia Conference
1.Australian Code for the Responsible Conduct of Research (2007)
2. National Statement on Ethical Conductin Human Research (2007 – updated 2014)
Introduction to Data Management Planning at Alien Challenge COST workshopAaike De Wever
1. The document introduces data management planning and discusses typical components to include in a data management plan such as a description of the data, file formats and metadata standards, data sharing and dissemination methods, roles and responsibilities, and long-term data storage and preservation.
2. Key components discussed include describing the data, file formats and metadata standards, how the data will be shared or made accessible, data storage and preservation, and roles and responsibilities for managing the data.
3. Creating a data management plan facilitates effective data management both during and after a research project and ensures data is well-organized, documented and preserved for future use or reuse.
The Hydrology Project has been running in India since 1995 and has significantly improved the availability and reliability of hydro-meteorological data in the country. It has established networks for instrumenting, processing, and applying hydrological data across nine states and six central agencies. The project focuses on building blocks like instrumentation, data processing, dissemination and specific applications like river basin planning tools, flood management tools, and studies. While the project has achieved a lot, further development is still needed to ensure sufficient high quality data for optimal water resources management in India according to the National Water Policy.
Survey of research data management practices up2010digschol2011heila1
An analysis of data management practices at a large South African university was conducted through interviews with researchers and students to identify needs and challenges. The findings showed that while data collection methods vary, data storage is often ad hoc with no centralized support or resources. Researchers expressed a need for a central university server or repository for secure data storage and assistance with time constraints. It was concluded that a formal research data management program and staff support are needed to improve current practices.
This document describes the design of a hydrological data storage and dissemination system. It discusses the major components of the system including databases to store different types of hydrological data (e.g. field data, processed data, maps), a catalogue to allow users to search and access data, and interfaces to allow external organizations and users to input and retrieve data. It provides specifications for hardware, software, security, and other technical aspects required to build the hydrological information system. The overall aim is to create a centralized, standardized system for permanently storing all types of hydrological data from various agencies and making it accessible to authorized users.
This document discusses next steps after the completion of the Hydrology Project (HP) in India. It summarizes the gains from HP, including establishing an integrated hydrological monitoring network across agencies. Lessons learned include the need for clear expectations and benefits, improved management and implementation approaches, and addressing staffing and training issues. The document proposes expanding HP horizontally to other states and consolidating achievements in states already covered. It also suggests expanding vertically to enable real-time water data use, drought management, and an integrated water resources management system. Institutional reforms are recommended to establish river basin organizations for improved water governance.
This document provides guidance on how to review monitoring networks. It begins with an introduction on the objectives and physical characteristics that networks are based on. It then discusses the types of networks, including basic, secondary, dedicated, and representative networks. The document outlines the steps in network design, which include assessing data needs, setting objectives, determining required network density, reviewing the existing network, and conducting a cost-effectiveness analysis. Specific guidance is provided on reviewing rainfall and hydrometric networks.
This document provides guidance on how to review monitoring networks. It begins with an introduction on the objectives and physical characteristics that networks are based on. It then discusses the types of networks, including basic, secondary, dedicated, and representative networks. The document outlines the steps in network design, which include assessing data needs, setting objectives, determining required network density, reviewing the existing network, and conducting a cost-effectiveness analysis. Specific guidance is given on reviewing rainfall and hydrometric networks.
Meeting the NSF DMP Requirement: March 7, 2012IUPUI
March 7 version of the IUPUI workshop Meeting the NSF Data Management Plan Requirement: What you need to know. This workshop is co-sponsored by the Office of the Vice Chancellor for Research and the University Library.
Presentation given by Sarah Jones at a seminar run by LSHTM on 6th November 2012. http://www.lshtm.ac.uk/newsevents/events/2012/11/developing-data-management-expertise-in-research---half-day-event
IRJET- A Survey on Big Data Frameworks and Approaches in Health Care SectorIRJET Journal
This document discusses how big data frameworks and approaches can benefit the healthcare sector. It first introduces common big data tools like Hadoop, MapReduce, and Apache Sqoop that can be used to analyze large amounts of healthcare data from sources like electronic health records. It then discusses how data warehouse platforms like OpenEHR and EHR4CR can be used to store this healthcare data. The document proposes a framework to retrieve and analyze electronic health records using big data systems. Potential applications of this approach mentioned include improved healthcare analysis, prognosis, report management, and follow-up systems. In conclusion, the integration of big data technologies with healthcare data platforms and sources can provide benefits like personalized care, disease prediction, and support for clinical decision
This document provides guidance on managing groundwater data within India's Hydrological Information System (HIS). It discusses the lifecycle of hydrometric data from collection to dissemination. The document directs the user to relevant manuals within HIS, particularly the Groundwater manual, for guidance on groundwater level monitoring networks, data collection, processing, analysis and publication. It describes the various types of manuals within HIS - design, field operation, and reference - and lists the specific volumes and parts most pertinent to groundwater level data. The overall aim is to help users locate and understand documentation to standardize high quality groundwater data management and inform water resource planning.
This document provides guidance on collecting, entering, and validating hydrological data for storage and use in a water resources information system in India. It discusses the mandatory information needed for spatial (e.g. well locations) and temporal (e.g. water level measurements) data. It also describes proper data collection procedures like using field forms, maintaining a data collection register, and entering data directly from field forms to reduce errors. The document emphasizes validation of data at multiple stages and storing data according to standards to ensure long-term usability and reliability of the hydrological information system.
Similar to Download-manuals-general-his concepts-anditssetup (20)
The World Bank conducted a final supervision mission in May 2014 to review a water resources project in Chhattisgarh, India. The project aimed to strengthen water resource management institutions and expand hydrological monitoring networks. Over 90% of allocated funds had been spent as of March 2014, with additional expenditures expected through May 2014. Key achievements included upgrading data centers, installing rain and groundwater monitoring equipment, conducting trainings, and publishing water resources data. The project improved availability of hydrological data for use in planning irrigation projects, infrastructure design, and other development activities in Chhattisgarh.
The document summarizes the Hydrology Project-II being implemented in Punjab, India. Key points:
- The Rs. 46.65 crore project aims to improve water resource data collection and management. Around 80% of the work and funding has been used.
- Networks to monitor groundwater, surface water, and rainfall have been installed across 700, 25, and 81 stations respectively. Digital equipment transmits data in real time.
- Three data centers have been constructed to store and analyze water data. A state data center in Mohali will house various water resource offices and laboratories.
- Observed hydrological data will be shared with state agencies, CGWB, and other users to inform water
The document provides an overview of the World Bank Monitoring Mission for the Hydrology Project Phase II in India from May 06-09, 2014. It summarizes the key achievements and post-project plans for each of the implementing agencies. The agencies include 13 state organizations and 8 central agencies. The objectives of HP-II were to extend and promote the sustained use of hydrological information systems to improve water resources planning and management. The estimated cost was Rs. 631.83 crore with funding from the World Bank. Several agencies had completed construction of data centers, monitoring equipment installations, and pilot studies. Plans after the project included continuing maintenance and operations, staff training, and further developing applications.
This document summarizes the progress and completion of the Odisha Hydrology Project-II. The key points are:
1) The project had a total revised cost of Rs. 13.46 crore and ran from April 2006 to May 2014 to strengthen surface water data collection and decision support systems in Odisha.
2) Financial progress shows that Rs. 891.04 crore was spent out of the total revised cost of Rs. 1346 crore. Major components included installing a real-time data acquisition system and developing decision support systems for drought monitoring and conjunctive surface and groundwater use.
3) Key achievements were establishing the concept for a real-time data acquisition system,
The document summarizes a review meeting for the Hydrology Project Phase II in Madhya Pradesh, India. The project involves establishing surface water and groundwater monitoring stations. For surface water, 24 river gauge stations and 52 meteorological stations were set up across three river basins. For groundwater, 3750 observation wells and 625 piezometer wells were established. The project period was from 2004-2014 with a total cost of Rs. 24.67 crores. Major achievements included upgrading monitoring stations, establishing new stations, and developing decision support systems for reservoir management and groundwater planning. Lessons learned and plans for continuing activities after the project are also discussed.
The document provides information on the financial targets and achievements of a hydrological project in India. It summarizes that as of March 2014, expenditure was Rs. 304.959 crores out of the revised target of Rs. 399.808 crores. It also describes various components of the project including institutional strengthening activities conducted, the development of decision support systems and real-time data systems for river basins, and studies carried out on optimizing monitoring networks and evaluating the impacts of water allocation changes. Lessons learned included the need for stronger central-state linkages and continued consultant support to meet project goals.
The document summarizes two hydrology projects in Kerala, India from 1996-2004 and 2006-2014. It provides financial details and physical progress updates on the projects, including building construction, staff hiring, equipment procurement, and the establishment of data dissemination and decision support systems. Key accomplishments include the development of applications to study conjunctive use, artificial recharge, reservoir operation, and more. Lessons learned include the benefits of integrated surface and groundwater management and adopting techniques from other agencies.
The document summarizes the Hydrology Project-II implemented in Goa between 2006-2014 with funding from the World Bank. The key aspects include:
- Establishment of 11 river gauge stations, 4 automatic weather stations, and 6 automatic rain gauge stations to improve surface water and hydro-meteorological data collection.
- Installation of 47 open wells and 57 piezometers to monitor groundwater levels across 9 river basins in Goa.
- Construction of a new data center and level II+ laboratory to store, analyze and disseminate hydrological data to support water resource management and planning.
- Capacity building initiatives including training of over 200 local staff on hydrological monitoring and data management.
This document provides expenditure details and progress updates for the Phase II (2006-2014) implementation of the Narmada, Water Resources, Water Supply and Kalpsar Department in Gujarat, India. It outlines spending on civil works, goods, consultancy, and trainings. It also describes the physical progress made in consolidating hydrological data, raising awareness, implementing decision support systems, and conducting purpose-driven studies. Proposals are made for continuing certain activities in potential Phase III of the project.
Central Water and Power Research Station (CWPRS) in Pune saw several advancements under the World Bank's Hydrology Project II (HP-II) including:
1) Technical trainings for over 100 CWPRS officers in areas like water resources planning, climate change impacts, and more.
2) Infrastructure upgrades including a Supervisory Control and Data Acquisition system, laboratory equipment, and renovated buildings.
3) Research activities such as optimizing stream gauge networks in Maharashtra's Bhima river basin and hydrographic surveys of the Tawa reservoir.
4) Over Rs. 4 crore was spent on civil works, equipment, trainings and other costs aligned with the goals of
The document summarizes the major activities and achievements of the Central Pollution Control Board's Hydrology Project-II regarding water quality monitoring. Some of the key points include:
- Installation of 10 real-time water quality monitoring stations on the Ganga and Yamuna rivers
- Development of a GIS-based water quality web portal to visualize historical and current water quality data
- Organization of 30 training workshops on water quality monitoring that reached over 750 laboratory staff
- Renovation of the CPCB water laboratory and development of water quality criteria and standards
The project aims to continue activities like annual maintenance of monitoring stations and the web portal, as well as propose new initiatives for the next phase including nationwide water pollution
The document describes BBMB's Real Time Decision Support System (RTDSS) project. The objectives are to incorporate advanced data acquisition and communication systems to help with operational management of Bhakra and Beas reservoirs. The system collects telemetry data from over 80 stations, including rainfall, water levels, snow levels. It also downloads satellite data and forecasts. The data is analyzed using hydrological and hydrodynamic models to forecast reservoir inflows and water levels to help with flood control and water distribution.
The World Bank conducted a final supervision and completion mission for the Hydrology Project in Andhra Pradesh from May 7-8, 2014. The project aimed to strengthen surface water data collection networks and build institutional capacity for hydrological data management and use. Key achievements included establishing 25 additional data collection stations, procuring IT equipment, developing a project website, and providing training. Expenditures totaled Rs. 4.13 crore against the revised project cost of Rs. 8.92 crore. Moving forward, the document discusses continuing project activities in Andhra Pradesh and potential areas of focus for a phase III of the Hydrology Project.
This document provides a summary of the financial progress and achievements of the Gujarat - Ground Water hydrology project. Some key points:
- Total projected cost is 176.32 crore INR, of which 169.11 crore (96%) has been spent as of March 2014.
- Major activities include upgrading the piezometer network, procuring equipment like DWLRs, GIS data, and training programs.
- Key outcomes are improved groundwater data availability and monitoring networks, as well as awareness raising and decision support systems.
- Lessons learned include the importance of data quality control, coordination, and training to improve groundwater management.
This document outlines surface water monitoring procedures and maintenance norms for various types of stations and laboratories in India. It provides maintenance cost estimates for:
1. Standard and Autographic Rain Gauge stations, including costs for civil works, consumables, and staffing. The estimated annual cost is Rs. 5,750 for SRG stations and Rs. 8,200 for ARG stations.
2. Full Climate stations, including costs for civil works, equipment maintenance, consumables, and staffing. The estimated annual cost is Rs. 56,000.
3. GD (Gauge Discharge) stations of various types, including wading, bridge/cableway, and boat outfit stations. Annual maintenance costs are
The document describes methods for hydrological observations including rainfall, water level, discharge, and inspection of observation stations. It contains sections on ordinary and recording rainfall observation, ordinary and recording water level observation, observation of discharge using current meters and floats, and inspection of rainfall and water level observation stations. The document was produced by the Ministry of Construction in Japan.
This document provides information and instructions for conducting correlation and spectral analysis. It includes definitions of autocovariance, autocorrelation, cross-covariance, and cross-correlation functions. It also defines variance spectrum and spectral density functions. The document provides examples of applying these analytical techniques to time series data, including monthly rainfall and daily water level data. It demonstrates how these techniques can be used to identify periodicities and correlations in hydrological time series data.
This document provides guidance on statistical analysis of rainfall and discharge data. It discusses graphical representation of data including histograms, line diagrams, and cumulative frequency diagrams. It also covers measures of central tendency, dispersion, skewness, kurtosis and percentiles. The document emphasizes that hydrological time series must meet stationarity conditions to be suitable for statistical analysis and discusses evaluating and accounting for trends and periodic components when analyzing rainfall and discharge data.
This document provides operational details for groundwater data processing and analysis in India. It outlines the monitoring networks for water levels, quality, and hydro-meteorology. It describes the geological structures, soil types, typical groundwater issues, and the organizational setup of the responsible groundwater agency. The agency collects various dynamic data through monitoring networks to estimate groundwater resources and inform management recommendations in an annual groundwater yearbook.
This document provides an operations manual for water quality analysis. It discusses good laboratory practices and quality assurance protocols that should be followed, including proper handling of chemicals, cleaning of glassware, measurement techniques, and maintenance of laboratory equipment. Standard analytical procedures for over 30 water quality parameters are also described. The manual establishes guidelines for sample receipt, storage, analysis, and reporting results to ensure reliable and comparable water quality data.
Programming Foundation Models with DSPy - Meetup SlidesZilliz
Prompting language models is hard, while programming language models is easy. In this talk, I will discuss the state-of-the-art framework DSPy for programming foundation models with its powerful optimizers and runtime constraint system.
AppSec PNW: Android and iOS Application Security with MobSFAjin Abraham
Mobile Security Framework - MobSF is a free and open source automated mobile application security testing environment designed to help security engineers, researchers, developers, and penetration testers to identify security vulnerabilities, malicious behaviours and privacy concerns in mobile applications using static and dynamic analysis. It supports all the popular mobile application binaries and source code formats built for Android and iOS devices. In addition to automated security assessment, it also offers an interactive testing environment to build and execute scenario based test/fuzz cases against the application.
This talk covers:
Using MobSF for static analysis of mobile applications.
Interactive dynamic security assessment of Android and iOS applications.
Solving Mobile app CTF challenges.
Reverse engineering and runtime analysis of Mobile malware.
How to shift left and integrate MobSF/mobsfscan SAST and DAST in your build pipeline.
Taking AI to the Next Level in Manufacturing.pdfssuserfac0301
Read Taking AI to the Next Level in Manufacturing to gain insights on AI adoption in the manufacturing industry, such as:
1. How quickly AI is being implemented in manufacturing.
2. Which barriers stand in the way of AI adoption.
3. How data quality and governance form the backbone of AI.
4. Organizational processes and structures that may inhibit effective AI adoption.
6. Ideas and approaches to help build your organization's AI strategy.
What is an RPA CoE? Session 1 – CoE VisionDianaGray10
In the first session, we will review the organization's vision and how this has an impact on the COE Structure.
Topics covered:
• The role of a steering committee
• How do the organization’s priorities determine CoE Structure?
Speaker:
Chris Bolin, Senior Intelligent Automation Architect Anika Systems
Conversational agents, or chatbots, are increasingly used to access all sorts of services using natural language. While open-domain chatbots - like ChatGPT - can converse on any topic, task-oriented chatbots - the focus of this paper - are designed for specific tasks, like booking a flight, obtaining customer support, or setting an appointment. Like any other software, task-oriented chatbots need to be properly tested, usually by defining and executing test scenarios (i.e., sequences of user-chatbot interactions). However, there is currently a lack of methods to quantify the completeness and strength of such test scenarios, which can lead to low-quality tests, and hence to buggy chatbots.
To fill this gap, we propose adapting mutation testing (MuT) for task-oriented chatbots. To this end, we introduce a set of mutation operators that emulate faults in chatbot designs, an architecture that enables MuT on chatbots built using heterogeneous technologies, and a practical realisation as an Eclipse plugin. Moreover, we evaluate the applicability, effectiveness and efficiency of our approach on open-source chatbots, with promising results.
Monitoring and Managing Anomaly Detection on OpenShift.pdfTosin Akinosho
Monitoring and Managing Anomaly Detection on OpenShift
Overview
Dive into the world of anomaly detection on edge devices with our comprehensive hands-on tutorial. This SlideShare presentation will guide you through the entire process, from data collection and model training to edge deployment and real-time monitoring. Perfect for those looking to implement robust anomaly detection systems on resource-constrained IoT/edge devices.
Key Topics Covered
1. Introduction to Anomaly Detection
- Understand the fundamentals of anomaly detection and its importance in identifying unusual behavior or failures in systems.
2. Understanding Edge (IoT)
- Learn about edge computing and IoT, and how they enable real-time data processing and decision-making at the source.
3. What is ArgoCD?
- Discover ArgoCD, a declarative, GitOps continuous delivery tool for Kubernetes, and its role in deploying applications on edge devices.
4. Deployment Using ArgoCD for Edge Devices
- Step-by-step guide on deploying anomaly detection models on edge devices using ArgoCD.
5. Introduction to Apache Kafka and S3
- Explore Apache Kafka for real-time data streaming and Amazon S3 for scalable storage solutions.
6. Viewing Kafka Messages in the Data Lake
- Learn how to view and analyze Kafka messages stored in a data lake for better insights.
7. What is Prometheus?
- Get to know Prometheus, an open-source monitoring and alerting toolkit, and its application in monitoring edge devices.
8. Monitoring Application Metrics with Prometheus
- Detailed instructions on setting up Prometheus to monitor the performance and health of your anomaly detection system.
9. What is Camel K?
- Introduction to Camel K, a lightweight integration framework built on Apache Camel, designed for Kubernetes.
10. Configuring Camel K Integrations for Data Pipelines
- Learn how to configure Camel K for seamless data pipeline integrations in your anomaly detection workflow.
11. What is a Jupyter Notebook?
- Overview of Jupyter Notebooks, an open-source web application for creating and sharing documents with live code, equations, visualizations, and narrative text.
12. Jupyter Notebooks with Code Examples
- Hands-on examples and code snippets in Jupyter Notebooks to help you implement and test anomaly detection models.
Your One-Stop Shop for Python Success: Top 10 US Python Development Providersakankshawande
Simplify your search for a reliable Python development partner! This list presents the top 10 trusted US providers offering comprehensive Python development services, ensuring your project's success from conception to completion.
Driving Business Innovation: Latest Generative AI Advancements & Success StorySafe Software
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
Main news related to the CCS TSI 2023 (2023/1695)Jakub Marek
An English 🇬🇧 translation of a presentation to the speech I gave about the main changes brought by CCS TSI 2023 at the biggest Czech conference on Communications and signalling systems on Railways, which was held in Clarion Hotel Olomouc from 7th to 9th November 2023 (konferenceszt.cz). Attended by around 500 participants and 200 on-line followers.
The original Czech 🇨🇿 version of the presentation can be found here: https://www.slideshare.net/slideshow/hlavni-novinky-souvisejici-s-ccs-tsi-2023-2023-1695/269688092 .
The videorecording (in Czech) from the presentation is available here: https://youtu.be/WzjJWm4IyPk?si=SImb06tuXGb30BEH .
Introduction of Cybersecurity with OSS at Code Europe 2024Hiroshi SHIBATA
I develop the Ruby programming language, RubyGems, and Bundler, which are package managers for Ruby. Today, I will introduce how to enhance the security of your application using open-source software (OSS) examples from Ruby and RubyGems.
The first topic is CVE (Common Vulnerabilities and Exposures). I have published CVEs many times. But what exactly is a CVE? I'll provide a basic understanding of CVEs and explain how to detect and handle vulnerabilities in OSS.
Next, let's discuss package managers. Package managers play a critical role in the OSS ecosystem. I'll explain how to manage library dependencies in your application.
I'll share insights into how the Ruby and RubyGems core team works to keep our ecosystem safe. By the end of this talk, you'll have a better understanding of how to safeguard your code.
Discover top-tier mobile app development services, offering innovative solutions for iOS and Android. Enhance your business with custom, user-friendly mobile applications.
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-EfficiencyScyllaDB
Freshworks creates AI-boosted business software that helps employees work more efficiently and effectively. Managing data across multiple RDBMS and NoSQL databases was already a challenge at their current scale. To prepare for 10X growth, they knew it was time to rethink their database strategy. Learn how they architected a solution that would simplify scaling while keeping costs under control.
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Download-manuals-general-his concepts-anditssetup
1. World Bank & Government of The Netherlands funded
Training module # SWDP - 01
Understanding HIS concepts
and its set-up
New Delhi, November 1999
CSMRS Building, 4th Floor, Olof Palme Marg, Hauz Khas,
New Delhi – 11 00 16 India
Tel: 68 61 681 / 84 Fax: (+ 91 11) 68 61 685
E-Mail: dhvdelft@del2.vsnl.net.in
DHV Consultants BV & DELFT HYDRAULICS
with
HALCROW, TAHAL, CES, ORG & JPS
2. Hydrology Project Training Module File: “ 01 Understanding HIS concepts and its set up.doc” Version 15/02/02 Page 1
Table of contents
Page
1. Module context 2
2. Module profile 3
3. Session plan 4
4. Overhead/flipchart master 5
5. Handout 6
6. Additional handout 8
7. Main text 9
3. Hydrology Project Training Module File: “ 01 Understanding HIS concepts and its set up.doc” Version 15/02/02 Page 2
1. Module context
While designing a training course, the relationship between this module and the others,
would be maintained by keeping them close together in the syllabus and place them in a
logical sequence. The actual selection of the topics and the depth of training would, of
course, depend on the training needs of the participants, i.e. their knowledge level and skills
performance upon the start of the course.
4. Hydrology Project Training Module File: “ 01 Understanding HIS concepts and its set up.doc” Version 15/02/02 Page 3
2. Module profile
Title : Understanding HIS concepts and its set-up
Target group : Assistant Hydrologists, Hydrologists, Data Processing Centre
Managers
Duration : One session of 60 min
Objectives : After the training the participants will be able to:
• know the objectives of HIS
• know the set-up of HIS
• appreciate the need & scope of data processing under HIS
Key concepts : • observational network
• hydrological data
• historical data
• raw and processed data
• hydrological data processing
• hydrological data users
• hydrological information system
Training methods : Lecture
Training tools
required
: OHS
Handouts : As provided in this module
Further reading
and references
:
5. Hydrology Project Training Module File: “ 01 Understanding HIS concepts and its set up.doc” Version 15/02/02 Page 4
3. Session plan
No Activities Time Tools
1 What is a Hydrological Information System (HIS)?
• Introduction
• The hydrological cycle show but don’t discuss
• Sketch of “Everest climber”
• HIS definition
• System outline of hydrological cycle
10 min
OHS 1
OHS 2
OHS 3
OHS 4
OHS 5
2 Why a Hydrological Information System?
• Need for HIS
5 min
OHS 6
3 The Hydrology Project and Hydrological Information
Systems
• HP & HIS
• Aims of HP
• HP States
• HP agencies
5 min
OHS 7
OHS 8
OHS 9
OHS 10
4 The scope of Hydrological Information System
• Scope (role) of a HIS
• Text
5 min
OHS 11
OHS 12
5 Who needs a Hydrological Information System?
• HDUGs
5 min
OHS 13
6 Setting-up of a Hydrological Information System under
Hydrology Project
• HIS structure at state/regional level
10 min
OHS 14
7 Use of computers in hydrological data processing
• Computers in HIS
5 min
OHS 15
8 Wrap up 15 min
6. Hydrology Project Training Module File: “ 01 Understanding HIS concepts and its set up.doc” Version 15/02/02 Page 5
4. Overhead/flipchart master
7. Hydrology Project Training Module File: “ 01 Understanding HIS concepts and its set up.doc” Version 15/02/02 Page 6
5. Handout
8. Hydrology Project Training Module File: “ 01 Understanding HIS concepts and its set up.doc” Version 15/02/02 Page 7
Add copy of Main text in chapter 8, for all participants.
9. Hydrology Project Training Module File: “ 01 Understanding HIS concepts and its set up.doc” Version 15/02/02 Page 8
6. Additional handout
These handouts are distributed during delivery and contain test questions, answers to
questions, special worksheets, optional information, and other matters you would not like to
be seen in the regular handouts.
It is a good practice to pre-punch these additional handouts, so the participants can easily
insert them in the main handout folder.
10. Hydrology Project Training Module File: “ 01 Understanding HIS concepts and its set up.doc” Version 15/02/02 Page 9
7. Main text
Contents
1. What is a Hydrological Information
System (HIS)? 1
2. Why a Hydrological Information
System? 1
3. Hydrology Project and the Hydrological
Information System 2
4. Who needs a Hydrological Information
system? 2
5. Scope of the Hydrological Information
System 2
6. Setting-up of a Hydrological
Information System under Hydrology
Project 6
7. Use of computers in hydrological data
processing 8
11. Hydrology Project Training Module File: “ 01 Understanding HIS concepts and its set up.doc” Version 15/02/02 Page 1
Understanding HIS concepts and its set-up
1. What is a Hydrological Information System (HIS)?
The principles of a Hydrological Information Systemare implied in the words of the title.
Hydrological: Hydrology is the science of water in the hydrological or water cycle and is
concerned with its states, storages and fluxes in location, time and phase.
Hydrometry is the sister science of hydrology which is concerned with the
measurement of these states, storages and fluxes in the water cycle. It is a
science because it is concerned with the scientific principles of repeatability
and that measurements may be checked and validated.
Information Information is data which has been manipulated and processed to give
them meaning and purpose. By definition, information serves a function
and is created not simply because it is there to be measured or because of
our curiosity alone. Unlike the mountaineer, we are not climbing Everest
simply because it is there to be climbed - but because there is someone on
the top who needs help. Function is important, not only in establishing the
contents and structure of the information but also as a motivation for all
involved in the development and maintenance of the HIS.
Three key features of information are: reliability, availability and
presentation.
System The HIS is not simply a data collection or archive although it incorporates
an archive. It is a logical and structured system to collect data which are
subsequently entered into the computer , checked and stored and where
also data may be compared, associated, related and combined to provide
information in a form suitable to users. A system may also be seen as the
integration of the user and the machine.
2. Why a Hydrological Information System?
The need for information
The planning, design and management of water services - for domestic, industrial,
agricultural and power uses - and protection from the vagaries of floods and droughts,
requires information on storages and fluxes in water for safe and economic design and
operation. The need is growing with a growing population.
The variability of occurrence
The occurrence of water shows great variability in space and time and requires that
adequate measurement networks are established to define spatial variability and that they
are maintained over a sufficient period of time to define temporal variability of a water
variable.
The inadequacy of existing systems
Systems currently exist but do not meet current needs in terms of reliability, availability and
presentation, even where the networks themselves are of adequate density. Current
systems in India are operated by a number of Central and State, surface water and
groundwater agencies and are not standardised either in operational practice or in methods
of processing and management. They may provide information of varying reliability, they
may duplicate information and activities and there are often long delays between observation
and dissemination of information
12. Hydrology Project Training Module File: “ 01 Understanding HIS concepts and its set up.doc” Version 15/02/02 Page 2
3. Hydrology Project and the Hydrological Information System
Hydrology Project aims at developing and improving the existing set-up of hydrological
information systems available in various state and central agencies for the eight states of
Andhra Pradesh, Gujarat, Kerala, Karnataka, Madhya Pradesh, Maharastra, Orissa and
Tamil Nadu. This will assist in the development of more reliable and spatially intensive data
on the quantity and quality of water resources, and in making information available, from
computerised databases, for planning, designing and management of water resources and
water use systems. Special attention will be paid to standardisation of procedures for the
observation of variables and validation of information so that it is of acceptable quality and
thus compatible between different agencies and states. Adequate facilities will be built up for
proper storage, archival and dissemination of data for the system to be sustainable for the
long-term use. Infrastructural development and implementation of the proposed HIS in the
project area is vested with the relevant Central and State agencies operating in the project
area. These Central agencies are the Central Water Commission (CWC) and Central
Ground Water Board (CGWB) and the State agencies are the Irrigation (or Water Resources
Departments) and Ground Water Departments of the respective States.
4. Who needs a Hydrological Information system?
If a Hydrological Information System is understood as providing information for specific and
definable uses, then users must have a central role in the content of the system. The current
major data users are also the major data providers and have tailored the content and
structure of existing systems to meet their own needs. However, current practice does not
generally even meet current needs. Other users may find that data, if available, are in the
wrong form, of varying reliability and may take a long time to obtain.
For example, agencies concerned with the construction and maintenance of roads and
railways are required to build bridges and culverts to convey flood flows safely and require
data on flood flows with a given probability of occurrence as a basis for design. Inadequate
data may result on the one hand in costly construction with an unnecessary margin of safety
or on the other with the equally costly consequences of failure. Such agencies currently do
not maintain their own networks and depend on others to supply information with acceptable
reliability and timeliness.
In an efficient and effective system, there must be a strong linkage between data/information
producers and users, both those within the same department and legitimate external users
from other departments and agencies, consultants, universities for research, etc.
5. Scope of the Hydrological Information System
The Hydrological Information System (HIS) comprises the infrastructure of physical and
human resources to collect, process, store and disseminate data on (geo-)hydrological and
hydrometeorological variables. The physical infrastructure includes observation networks,
laboratories, data processing and data storage centres and data communication system.
The human resource is the well-trained staff with a variety of skills to carry out the desired
tasks for different operations of the system. Huge public funding and effort is required for the
operation of a hydrological information system. And therefore, the efficiency of the system
should be such that more and more data users make use of the reliable hydrological data so
that the resources spent are utilised in an optimal manner.
13. Hydrology Project Training Module File: “ 01 Understanding HIS concepts and its set up.doc” Version 15/02/02 Page 3
• DECISION MAKERS
• POLICY MAKERS
• DESIGNERS
• RESEARCHERS
• USER AGENCIES
USERS STORAGE
PROCESSING
VALIDATION
SENSINGACTIONS/STUDIES /USE
WATER RESOURCES / WATER USE
SYSTEM
OBJECT
SYSTEM
ADDITIONAL
INFORMATION
HIS
DATA
RECORDING
The primary role of the HIS (see Fig. 5.1) is to provide reliable data sets for long-term
planning, design and management of water resource and water use systems and for
research activities in the related aspects. It is also desired that the system will function in
such a manner that it provides the information to users in time and in proper form. The scope
of HIS is not extended to provide data to users on a real-time basis for short-term forecasting
or operational purposes.
Fig. 5.1: Role of Hydrological Information System
To be able to provide this information the first step is to obtain the information on the
temporal and spatial characteristics of this object system by having a network of
observational stations. The basic data collected for different hydrometeorological
phenomenon through this observational network is called the raw or observed data. Such
observed data have to be processed to ensure the reliability of the resulting information.
Both raw and processed data sets have to be properly stored, processed data for
dissemination and raw data to permit inspection and revalidation in response to queries from
users.
The activities under HIS can be broadly classified in the following categories:
• Assessing the needs of users
• Establishment of an observational network
• Management of historical data
• Data collection and transfer
• Data processing, analysis and reporting
• Data Exchange and reporting
• Data storage and dissemination
• Institutional and human resource development
14. Hydrology Project Training Module File: “ 01 Understanding HIS concepts and its set up.doc” Version 15/02/02 Page 4
5.1 Assessing the needs of users
The importance of considering user needs has already been discussed above. For this
purpose, Hydrological Data User Group (HDUG) for each state and for the central agencies
have been constituted. Potential hydrological data users and the members of HIS
implementing agencies are represented in these HDUGs. The main aim of such HDUGs is to
review hydrological information needs and, on a regular basis of about 3-4 years, identify
shortfalls and make suggestions and proposals for improvements. This will then require the
supplementing agency to reconsider its mandate and HIS objectives and incorporate
improvements where possible.
5.2 Establishment/review of observational networks
After the objectives of the system are laid down, the observational network has to be
accordingly planned, designed and established. It is also important to ensure that the
observational networks of different agencies are properly integrated so that duplication is
avoided. The equipment as per the revised objectives and design are installed at the
observational stations. The process may be repeated after a periodic review of requirements
for data.
5.3 Management of historical data
State and central agencies have maintained observational networks for many years and
voluminous records are held, the majority on manuscript or chart records, which are not
readily accessible for use and are of variable quality. A program of historical data entry will
require to be established in each agency holding such data, although priority in the first
instance will be given to ensuring that current data are entered validated and stored
effectively.
5.4 Data collection:
Institutional, human and budgetary supports are a prerequisite for smooth operation and
maintenance of the observation stations and the associated collection of data. The
established network has a number of observation stations and at each station a number of
variables is observed at a specified frequency. The observations are taken manually or
automatically depending upon the type of instrument available at the station. Suitable
number of persons having skills appropriate to their job requirement (e.g., Supervisors,
Technicians, Observers, Helpers etc.) are engaged and materials are provided at the
observation sites for carrying out day-to-day data collection work and also for regular
maintenance.
5.5 Data processing, analysis and reporting:
Data processing is a broad term covering all activities from receiving records of observed
raw data to making them available in a usable form. The raw data are in a variety of formats
such as hand-written records, charts and digital records. Raw data as observed and
recorded may contain many gaps and inconsistencies. These raw data are passed through a
series of operations, typically:
• Data entry
• Making necessary validation checks,
• In-filling missing values in a data series,
• Processing of raw data to estimate required variables,
• Compilation of data in different forms and
• Analysis of data for commonly required statistics etc.
15. Hydrology Project Training Module File: “ 01 Understanding HIS concepts and its set up.doc” Version 15/02/02 Page 5
Most of the data processing activities are to be accomplished with the help of computers
using dedicated hydrological data processing software. Of particular importance is assuring
the quality and reliability of the data provided to users through the application of a variety of
validation procedures and the flagging of suspect data. The user must be informed of the
quality of the data supplied and whether the values are estimated or observed.
Reports are prepared to bring out the salient characteristics of the hydrological regime of the
region for each year or season. Special reports are also prepared as and when required for
attracting the attention of the users towards unusual events, major changes in the
hydrological regime or to disseminate important revised long term statistics regularly.
5.6 Data exchange and communication:
Data processing activity is planned to be carried out at more than one level within each
agency and this makes it essential to have adequate data communication links between
them. The requirement for communication is to be based on a low frequency and high
volume of communication. There is need for exchange of information between various
agencies for the purpose of data validation as surface and groundwater networks are
operated by different state and central agencies.
5.7 Data storage and dissemination:
All available data sets are to be maintained in well-defined computerised databases using an
industry standard database management system. This is essential for the long-term
sustainability of the data sets in proper form and their dissemination to the end users. Both,
raw and processed data sets are be properly stored and archived to specified standards so
that there is no loss of information. All agencies will have standard procedures for the
dissemination of data to the users from the computerised databases.
5.8 Institutional and Human Resources development:
Since HIS is a vast system, the aspect of institutional and human resource development
needs to be given proper emphasis. The institutions supporting the implementation of HIS
must be developed in such a manner that the system is sustainable in a long run. The staff
required to carry out different activities under HIS are to be made available and very
importantly they must all be trained to carry out the desired tasks. Such training support is to
be ensured on a sustainable basis since there will always be a need for training more staff.
16. Hydrology Project Training Module File: “ 01 Understanding HIS concepts and its set up.doc” Version 15/02/02 Page 6
6. Setting-up of a Hydrological Information System under
Hydrology Project
In order to provide timely and reliable data of the water resources/water use system, the HIS
comprises the following components by Agency (see Fig. 6.1):
Fig. 6.1: HIS structure at State/Regional level
HIS STRUCTURE
AT
STATE/REGIONAL LEVEL
CWC
DATA
STORAGE
CENTRE
DATA
STORAGE
CENTRE
DATA
STORAGE
CENTRE
DATA
STORAGE
CENTRE
REGION.
PROCES.
CENTRE
FIELD
OFFICES/
STATIONS
SGW
PROCES.
CENTRE
FIELD
OFFICES/
STATIONS
USER
STORAGE &
DISSEMINA.
FINAL VALID.
& PROCESS.
DATA
COLLECTION
ENTRY &
PREL. VALID.
DIVISIONS
SUB
DIVISIONS
INFO. EXCHANGE
SSW
PROCES.
CENTRE
REGION.
PROCES.
CENTRE(S)
DIVISIONS
SUB
DIVISIONS
FIELD
OBSERV.
STATIONS
UNIT
PROCESS.
CENTRE
REGIONAL/
DIVISIONS
DISTRICT
FIELD
OBSERV.
STATIONS
STATEIMD CGWB
17. Hydrology Project Training Module File: “ 01 Understanding HIS concepts and its set up.doc” Version 15/02/02 Page 7
• in each State
• Hydrometeorological, Surface Water and Ground Water Observation Networks,
• Water Quality Laboratories,
• Sub-divisional/District Data Processing Centres, one in each Sub-division/District,
• Divisional/Regional Data Processing Centres, one in each Division/Region,
• State Data Processing Centres, one in the State Surface Water Department and one
in the State Groundwater Department, and
• a State Data Storage Centre.
• in the Central Water Commission
• Surface Water Observation Networks,
• Water Quality Laboratories,
• Divisional Data Processing Centres, one in each Division
• Circle Data Processing Centres, one in each Circle,
• for each Region a Data Processing and a Data Storage Centre, and
• at National level a National Data Centre.
• in the Central Ground Water Board
• Groundwater Observation Networks,
• for each Unit a Data Processing Centre,
• for each Region a Data Processing and a Data Storage Centre, and
• a National Data Centre.
• for data exchange within and between the states and central organisations a
Communication System.
The HIS may also be viewed as operating at different levels of sophistication and complexity
from simple measurement in the field to State and Agency Processing and Storage centres
as follows:
• At the observation stations/wells in the hydrometeorological, surface water and
groundwater observation networks field data and water quality samples are collected.
The water samples are brought to the Water Quality Laboratories. At regular intervals
(monthly/quarterly) the field data are submitted to the Sub-divisional/District Data
Processing Centres.
• In the Water Quality Laboratories, besides the analysis of water quality samples, the
analysis results are entered in the computer and subjected to primary validation. At
regular intervals, the laboratory passes the information on to the nearest Divisional or
Regional Data Processing Centre.
• In the Sub-divisional/District Data Processing Centres all field data are being entered
in the computer and stored in a temporary database. Next, primary validation (entry
control and reach checks) takes place on the data and feedback is given to the field
stations. The computerised data are passed on to the Divisional/Regional Data
Processing Centre immediately after finalisation of the primary processing. For purpose
of validation and analysis of groundwater data the District Data Processing Centre also
makes use of the data collected by CGWB, these are retrieved regularly from the Data
Storage Centre.
• In the Divisional/Regional Data Processing Centres, given their larger spatial
coverage, more advanced secondary data validation is carried out. The data are stored
in temporary databases. After validation, the surface water and groundwater data are
transferred to their respective State Data Processing Centres.
18. Hydrology Project Training Module File: “ 01 Understanding HIS concepts and its set up.doc” Version 15/02/02 Page 8
• In the State Data Processing Centres, after reception of the data from its
Divisions/Regions, a copy of the field data is transferred to the State Data Storage
Centre. The main activity of the State Data Processing Centre is final data validation,
completion, analysis and reporting. Here, the data are stored in temporary databases. At
the end of the hydrological year, once the data have been properly validated, the
(authenticated) processed data is transferred to the State Data Storage Centre. To
improve the effectiveness of the final validation, in the State Centres use is also made of
the relevant data collected by the Central Agencies.
• The State Data Storage Centre stores and administers the storage of all field and
(authenticated) processed hydrological data collected in the State, and makes the data
available to authorised Hydrological Data Users. As a State archive, it also maintains an
HIS-Catalogue of all data stored in its own database and those stored in the databases
of the other states and of the Central Agencies.
7. Use of computers in hydrological data processing
The rapid advance in computer technology, in hardware speed of operation and data storage
capacity as well as the capability of hydrological software has greatly simplified the
management of large quantities of hydrological data and has rendered obsolete those time-
consuming manual methods which were formerly the norm. Computer-based hydrological
information systems offer the following advantages:
• They permit and promote the standardisation of processing, validation and reporting
procedures
• Very large amounts of data can easily be handled
• They greatly speed up the progress from data collection to completion and storage
• Users can be provided with data in the required tabular or graphical format
• Their use promotes staff interest by removing the tedium of manual handling and
allowing results to emerge quickly
Such a computerised data processing system, maintained on a continuous basis, can now
be considered as an essential component of the hydrological information system.