Open Based Systems Eng 010706 Titech
•Download as PPT, PDF•
1 like•1,050 views
(1) The document proposes the development of two open-based systems called SOFIE and MARTIN to foster geo-spatial data sharing and technology applications for environmental management in Indonesia. (2) It outlines goals like providing open geo-databases and promoting open-source software to address issues from a lack of coordinated data and information sharing between stakeholders. (3) Key activities outlined in the action plan include creating comprehensive environmental databases, using ICT to disseminate information widely, and encouraging policy dialogue to develop open-based systems.
Report
Share
Report
Share
![Open based Systems? ,[object Object],[object Object],[object Object]](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recommended
The Future of Decision Making with a National Spatial Database Infrastructure...
This presentation has been presented in 2005 to show the potentials of NSDI and how it can support the E-government.
Geo visualization_why maps
This document discusses geovisualization and maps. It begins by defining key concepts like cartography, geographic data, and how maps represent reality through models. Maps are described as useful because they make invisible patterns and relationships visible. The document then discusses different types of maps, like paper maps, on-screen maps, and web maps, and how they disseminate geographic data. It explores trends in maps, like neogeography and user-generated content. Finally, it discusses using maps to both present and explore data, as well as areas of future research like user studies.
NSDI_ Concepts and Components
The document discusses the key components and concepts of a National Spatial Data Infrastructure (NSDI). An NSDI aims to integrate distributed geospatial data through partnerships between different levels of government and private organizations. It establishes standards, frameworks and metadata to facilitate discovery and sharing of geospatial data. Central to an NSDI is a clearinghouse that allows users to search metadata from distributed servers according to common protocols. When properly implemented through the coordination of stakeholders, an NSDI can help reduce data duplication, lower costs and make critical spatial information more accessible.
02 -how-will-inspire-influence-local-authorities-and-spatial-planning
Presentation describe, how INSPIRE legislation could be integrated into spatial planning on municiplaity level
Taking Citizen Science to Extremes: from the Arctic to the Rainforest
Citizen Science is hardly a new concept, but during the last decade it has seen a rise in both
academic and popular interest for the topic. This trend is in part driven by an increased
interest for open paradigms, as well as, Information Communication Technology (ICT)
innovations such as smartphones, mobile Internet and cloud computing. This has given
rise to the emergence of a growing and highly diverse crop of new – and often innovative –
initiatives that are being, or could be, labelled as Citizen Science.
Whilst there are often big differences between projects, for instance when it comes to
power relations – “Who is working for who?” – or the determination of goals and outcomes
– “Who is solving whose problems?” – there is hope that, at the very least, this rediscovery
of citizen science might lead to a renewed mutual interest, and perhaps understanding,
between scientists and the general public.
Most citizen science initiatives are set in affluent areas of the world, and by and large they
target an educated, or at least literate, public. Extreme Citizen Science aspires to extend the
reach and potential of citizen science beyond this restricted context and is defined as:
Extreme Citizen Science is a situated, bottom-up practice that takes into account local
needs, practices and culture and works with broad networks of people to design and build
new devices and knowledge creation processes that can transform the world.
In this presentation, we are going to explore the various ExCiteS projects that span from the
Arctic – where we aim to develop tools grounded in the needs of Yupik and Iñupiaq coastal
subsistence hunters who are adapting to the rapidly changing climate – to the Congo basin
rainforest – where we enable marginalised and forest communities to better to share their
vast environmental knowledge more effectively locally and with other regional, national and
global stakeholders.
We aim to design, develop, evaluate and deploy a generic platform that enables people with
no or limited literacy – in the strict and broader technological sense – to use smartphones
and tablets to collect, share, and analyse (spatial) data along with a methodology for
introducing, engaging and empowering marginalised communities to participate in and
benefit from citizen science. The platform is and will be used in a variety of concrete
projects, often related to environmental monitoring. Ultimately the goal is to let
communities build so-called Community Memories: evolving, shared representations of the
state of their environment, their relationship with it, and any threats it faces.
VGI Overview - Crowdsourcing Participatory Mapping
Volunteered Geographic Information (VGI) involves geographic data collected by volunteers and made available to others. Some key points about VGI include:
- It allows for faster updates of geographic data compared to traditional methods and can provide local spatial knowledge and attributes that are difficult for institutions to obtain.
- However, data quality can be inconsistent due to variations in positional accuracy, thematic consistency, and coverage biases depending on volunteer interests.
- For government use, VGI data collection should be separated from policy analysis. Projects need strategies for long-term volunteer engagement and consideration of licensing and intellectual property.
Crowdsourcing: A Geographic Approach to Identifying Policy Opportunities and ...
Crowdsourcing: A Geographic Approach to Identifying Policy Opportunities and ...Communication and Media Studies, Carleton University
This document summarizes a conference presentation on using crowdsourcing approaches like volunteered geographic information (VGI), citizen science (CS), and participatory mapping (PM) to engage the public in policymaking. It defines these approaches and provides examples. While governments have been reluctant to use crowdsourced data due to quality and legal concerns, the presenters argue that capitalizing on established crowdsourcing models and open data practices could help develop public policies to formally incorporate crowdsourcing into government decision-making and engagement. Recommendations are provided for overcoming barriers and assuaging government adoption of these approaches.Experiences as a producer, consumer and observer of open data
Peter Mooney, is an Environmental Protection Agency (EPA) funded Research Fellow at the Department of Computer Science, NUI Maynooth. He has been working with the EPA on making environmental data publicly accessibly for the last ten years.
Presentation was part of The 1st Seminar of the ERC Funded Programmable City Project based at NIRSA, NUI Maynooth, Republic of Ireland.
Recommended
The Future of Decision Making with a National Spatial Database Infrastructure...
This presentation has been presented in 2005 to show the potentials of NSDI and how it can support the E-government.
Geo visualization_why maps
This document discusses geovisualization and maps. It begins by defining key concepts like cartography, geographic data, and how maps represent reality through models. Maps are described as useful because they make invisible patterns and relationships visible. The document then discusses different types of maps, like paper maps, on-screen maps, and web maps, and how they disseminate geographic data. It explores trends in maps, like neogeography and user-generated content. Finally, it discusses using maps to both present and explore data, as well as areas of future research like user studies.
NSDI_ Concepts and Components
The document discusses the key components and concepts of a National Spatial Data Infrastructure (NSDI). An NSDI aims to integrate distributed geospatial data through partnerships between different levels of government and private organizations. It establishes standards, frameworks and metadata to facilitate discovery and sharing of geospatial data. Central to an NSDI is a clearinghouse that allows users to search metadata from distributed servers according to common protocols. When properly implemented through the coordination of stakeholders, an NSDI can help reduce data duplication, lower costs and make critical spatial information more accessible.
02 -how-will-inspire-influence-local-authorities-and-spatial-planning
Presentation describe, how INSPIRE legislation could be integrated into spatial planning on municiplaity level
Taking Citizen Science to Extremes: from the Arctic to the Rainforest
Citizen Science is hardly a new concept, but during the last decade it has seen a rise in both
academic and popular interest for the topic. This trend is in part driven by an increased
interest for open paradigms, as well as, Information Communication Technology (ICT)
innovations such as smartphones, mobile Internet and cloud computing. This has given
rise to the emergence of a growing and highly diverse crop of new – and often innovative –
initiatives that are being, or could be, labelled as Citizen Science.
Whilst there are often big differences between projects, for instance when it comes to
power relations – “Who is working for who?” – or the determination of goals and outcomes
– “Who is solving whose problems?” – there is hope that, at the very least, this rediscovery
of citizen science might lead to a renewed mutual interest, and perhaps understanding,
between scientists and the general public.
Most citizen science initiatives are set in affluent areas of the world, and by and large they
target an educated, or at least literate, public. Extreme Citizen Science aspires to extend the
reach and potential of citizen science beyond this restricted context and is defined as:
Extreme Citizen Science is a situated, bottom-up practice that takes into account local
needs, practices and culture and works with broad networks of people to design and build
new devices and knowledge creation processes that can transform the world.
In this presentation, we are going to explore the various ExCiteS projects that span from the
Arctic – where we aim to develop tools grounded in the needs of Yupik and Iñupiaq coastal
subsistence hunters who are adapting to the rapidly changing climate – to the Congo basin
rainforest – where we enable marginalised and forest communities to better to share their
vast environmental knowledge more effectively locally and with other regional, national and
global stakeholders.
We aim to design, develop, evaluate and deploy a generic platform that enables people with
no or limited literacy – in the strict and broader technological sense – to use smartphones
and tablets to collect, share, and analyse (spatial) data along with a methodology for
introducing, engaging and empowering marginalised communities to participate in and
benefit from citizen science. The platform is and will be used in a variety of concrete
projects, often related to environmental monitoring. Ultimately the goal is to let
communities build so-called Community Memories: evolving, shared representations of the
state of their environment, their relationship with it, and any threats it faces.
VGI Overview - Crowdsourcing Participatory Mapping
Volunteered Geographic Information (VGI) involves geographic data collected by volunteers and made available to others. Some key points about VGI include:
- It allows for faster updates of geographic data compared to traditional methods and can provide local spatial knowledge and attributes that are difficult for institutions to obtain.
- However, data quality can be inconsistent due to variations in positional accuracy, thematic consistency, and coverage biases depending on volunteer interests.
- For government use, VGI data collection should be separated from policy analysis. Projects need strategies for long-term volunteer engagement and consideration of licensing and intellectual property.
Crowdsourcing: A Geographic Approach to Identifying Policy Opportunities and ...
Crowdsourcing: A Geographic Approach to Identifying Policy Opportunities and ...Communication and Media Studies, Carleton University
This document summarizes a conference presentation on using crowdsourcing approaches like volunteered geographic information (VGI), citizen science (CS), and participatory mapping (PM) to engage the public in policymaking. It defines these approaches and provides examples. While governments have been reluctant to use crowdsourced data due to quality and legal concerns, the presenters argue that capitalizing on established crowdsourcing models and open data practices could help develop public policies to formally incorporate crowdsourcing into government decision-making and engagement. Recommendations are provided for overcoming barriers and assuaging government adoption of these approaches.Experiences as a producer, consumer and observer of open data
Peter Mooney, is an Environmental Protection Agency (EPA) funded Research Fellow at the Department of Computer Science, NUI Maynooth. He has been working with the EPA on making environmental data publicly accessibly for the last ten years.
Presentation was part of The 1st Seminar of the ERC Funded Programmable City Project based at NIRSA, NUI Maynooth, Republic of Ireland.
Data Commons Garvan - 2016
The document discusses the need for a "Data Commons" platform to foster sharing and analysis of biomedical big data. It describes how such a platform could treat research data, software and methods as digital assets within a shared virtual space. This would allow different parties to find, deposit, manage, share and reuse digital assets. The platform would form the basis of a digital ecosystem enabling interactions between producers and consumers of research outputs. It provides an overview of an NIH pilot project to test initial implementation of a Data Commons through co-locating data and tools on storage and computing infrastructure.
An open data story
Tracey P. Lauriault is a Postdoctoral Researcher at NIRSA NUIM working on the ERC funded Programmable City Project.
NIH Data Summit - The NIH Data Commons
The document discusses the need for an NIH Data Commons to address challenges with data sharing and storage. It describes how factors like increasing data volumes, availability of cloud technologies, and emphasis on FAIR data principles are driving the need for a centralized data platform. The proposed NIH Data Commons would provide findable, accessible, interoperable and reusable data through cloud-based services and tools. It would enable data-driven science by facilitating discovery, access and analysis of biomedical data across different sources. Plans are outlined to develop and test an initial Data Commons pilot using existing genomic and other biomedical datasets.
NIH Data Commons - Note: Presentation has animations
Presented at the Data Commons & Data Science Workshop (University of Chicago - Centre for Data Intensive Science):
NB- there are animations in these slides so static slides might not view well
Presentation on INSPIRE and Higher Education (1 of 2)
Presentation designed to explain the relationship between academic data and the EU INSPIRE Directive. Produced by staff from EDINA and the Digital Curation Centre.
EMBL Australian Bioinformatics Resource AHM - Data Commons
This document discusses the development of the NIH Data Commons, which aims to create a shared framework and infrastructure for biomedical data. It notes the increasing amounts of data being generated and the need for data sharing and interoperability. The Data Commons framework treats data, tools, and publications as digital objects that are findable, accessible, interoperable and reusable. Current pilots include deploying reference datasets in the cloud, indexing data and tools, and a credits system for cloud resources. Challenges discussed include metrics, costs, standards, incentives and sustainability. The framework's relevance for supporting open data in Australia is also addressed.
Bonazzi commons bd2 k ahm 2016 v2
The document provides an overview of the development of the NIH Data Commons. It discusses factors driving the need for a data commons, including large amounts of data being generated and increased support for data sharing. It outlines the goals of making data findable, accessible, interoperable and reusable. Several pilots are exploring the feasibility of the commons framework, including placing large datasets in the cloud and developing indexing methods. Considerations in fully realizing the commons are also discussed, such as standards, discoverability, policies and incentives.
David Park APAN Slid..
The document discusses how advanced networks and supercomputing facilities are enabling global collaboration on research, supporting commercial opportunities, and helping the New Zealand geospatial sector become sustainable. It provides examples of research projects using these technologies, such as software defined radio and GNSS simulation. The Geospatial Research Centre is also exploring commercial geospatial processing opportunities using these resources. Finally, the document discusses how these technologies can increase collaboration and engagement within the New Zealand academic community to help sustain the geospatial sector long term.
Bonazzi data commons nhgri council feb 2017
The NIH is developing a Data Commons to enable data-driven biomedical research. The Data Commons will treat research data, methods, and papers as digital objects stored in a shared virtual space according to FAIR principles. It will provide tools and infrastructure for users to find, deposit, manage, share, and reuse these digital objects at scale. The goal is to accelerate discoveries, therapies, and cures by enabling researchers to leverage all available data and analysis tools. The Data Commons is being designed as an interoperable platform that can integrate with other data commons through common APIs, container technologies, metadata standards, and authentication.
big_data_casestudies_2.ppt
The document discusses big data use cases and requirements. It provides 51 detailed use cases across various domains that generate many terabytes to petabytes of data. It also describes extracting 437 specific requirements from the use cases and analyzing trends. The next steps involve matching requirements to a reference architecture and prioritizing use cases for implementation.
IEDA: Making Small Data BIG Through Interdisciplinary Partnerships Among Long...
Presentation given at the AGU Fall Meeting 2014; abstract at
http://abstractsearch.agu.org/meetings/2014/FM/IN14B-01.html
Oxford University Geospatial Metadata Workshop 20110415
This document provides an overview of a geospatial metadata and spatial data workshop held at the University of Oxford. The workshop covered topics such as metadata standards, application profiles, geospatial metadata tools and portals for sharing spatial data and metadata. Hands-on sessions demonstrated how to create metadata using the Geodoc Metadata Editor tool and access spatial data repositories through the Go-Geo portal and ShareGeo open data portal.
BD2K and the Commons : ELIXR All Hands
ELIXR All Hands Meeting : Barcelona, SPAIN - March 2016
https://www.elixir-europe.org/events/elixir-all-hands-2016
The NIH Data Commons - BD2K All Hands Meeting 2015
Presentation given at the BD2K All Hands meeting in Bethesda, MD, USA in November 2015
https://datascience.nih.gov/bd2k/events/NOV2015-AllHands
Video cast of this presentation:
http://videocast.nih.gov/summary.asp?Live=17480&bhcp=1
talk starts at 2hrs 40min (its about 55mins long) - includes video!
Document describing the Commons : https://datascience.nih.gov/commons
Opportunities and Challenges for International Cooperation Around Big Data
Presented at the Open Session of the Big Data in Biomedicine conference, Barcelona, November 12, 2014.
Open Data Initiative of India
Open data is machine readable data that can be used, reused and redistributed by anyone. Here's an overview of the Open Data Initiative of India.
Into the Night - Technology for citizen science
Current citizen science seems effortless...just download an app and start using it. However, there are many technical aspects that are necessary to make a citizen science project work. In this session, we will provide an overview of all the technical elements that are required - from the process of designing an app., to designing and managing a back-end system, to testing the system end to end before deployment. Participants will have the opportunity to engage in a short exercise to consider the design of an app for a citizen science project that addresses light pollution.
INSPIRE - ensuring access or continuity of access?
Presentation given by Robin Rice (EDINA) and Marin Donnelly (DCC) at the INSPIRE Conference 2011 in Edinburgh, Scotland.
AHM 2014: The iPlant Collaborative, Community Cyberinfrastructure for Life Sc...
Presentation given by Nirvan Merchant in the afternoon Architecture Forum Session on Day 1, June 24, at the EarthCube All-Hands Meeting
100503 bioinfo instsymp
Presentation on the work we've done within BeSTGRID as it relates to bioinformatics in NZ, for the 2010 Bioinformatics Symposium https://www.bestgrid.org/NZ-Bioinformatics-Symposium-2010
Global Network Advancement Group Next Generation Network-Integrated Sys...
4th National Research Platform Workshop: NRP, GRP, GNA-G Partnership
Harvey Newman, Caltech, GNA DIS WG Chair February 9, 2023
Global Network Advancement Group - Next Generation Network-Integrated Systems
This document summarizes a presentation on global petascale to exascale workflows for data intensive sciences. It discusses a partnership convened by the GNA-G Data Intensive Sciences Working Group with the mission of meeting challenges faced by data-intensive science programs. Cornerstone concepts that will be demonstrated include integrated network and site resource management, model-driven frameworks for resource orchestration, end-to-end monitoring with machine learning-optimized data transfers, and integrating Qualcomm's GradientGraph with network services to optimize applications and science workflows.
More Related Content
What's hot
Data Commons Garvan - 2016
The document discusses the need for a "Data Commons" platform to foster sharing and analysis of biomedical big data. It describes how such a platform could treat research data, software and methods as digital assets within a shared virtual space. This would allow different parties to find, deposit, manage, share and reuse digital assets. The platform would form the basis of a digital ecosystem enabling interactions between producers and consumers of research outputs. It provides an overview of an NIH pilot project to test initial implementation of a Data Commons through co-locating data and tools on storage and computing infrastructure.
An open data story
Tracey P. Lauriault is a Postdoctoral Researcher at NIRSA NUIM working on the ERC funded Programmable City Project.
NIH Data Summit - The NIH Data Commons
The document discusses the need for an NIH Data Commons to address challenges with data sharing and storage. It describes how factors like increasing data volumes, availability of cloud technologies, and emphasis on FAIR data principles are driving the need for a centralized data platform. The proposed NIH Data Commons would provide findable, accessible, interoperable and reusable data through cloud-based services and tools. It would enable data-driven science by facilitating discovery, access and analysis of biomedical data across different sources. Plans are outlined to develop and test an initial Data Commons pilot using existing genomic and other biomedical datasets.
NIH Data Commons - Note: Presentation has animations
Presented at the Data Commons & Data Science Workshop (University of Chicago - Centre for Data Intensive Science):
NB- there are animations in these slides so static slides might not view well
Presentation on INSPIRE and Higher Education (1 of 2)
Presentation designed to explain the relationship between academic data and the EU INSPIRE Directive. Produced by staff from EDINA and the Digital Curation Centre.
EMBL Australian Bioinformatics Resource AHM - Data Commons
This document discusses the development of the NIH Data Commons, which aims to create a shared framework and infrastructure for biomedical data. It notes the increasing amounts of data being generated and the need for data sharing and interoperability. The Data Commons framework treats data, tools, and publications as digital objects that are findable, accessible, interoperable and reusable. Current pilots include deploying reference datasets in the cloud, indexing data and tools, and a credits system for cloud resources. Challenges discussed include metrics, costs, standards, incentives and sustainability. The framework's relevance for supporting open data in Australia is also addressed.
Bonazzi commons bd2 k ahm 2016 v2
The document provides an overview of the development of the NIH Data Commons. It discusses factors driving the need for a data commons, including large amounts of data being generated and increased support for data sharing. It outlines the goals of making data findable, accessible, interoperable and reusable. Several pilots are exploring the feasibility of the commons framework, including placing large datasets in the cloud and developing indexing methods. Considerations in fully realizing the commons are also discussed, such as standards, discoverability, policies and incentives.
David Park APAN Slid..
The document discusses how advanced networks and supercomputing facilities are enabling global collaboration on research, supporting commercial opportunities, and helping the New Zealand geospatial sector become sustainable. It provides examples of research projects using these technologies, such as software defined radio and GNSS simulation. The Geospatial Research Centre is also exploring commercial geospatial processing opportunities using these resources. Finally, the document discusses how these technologies can increase collaboration and engagement within the New Zealand academic community to help sustain the geospatial sector long term.
Bonazzi data commons nhgri council feb 2017
The NIH is developing a Data Commons to enable data-driven biomedical research. The Data Commons will treat research data, methods, and papers as digital objects stored in a shared virtual space according to FAIR principles. It will provide tools and infrastructure for users to find, deposit, manage, share, and reuse these digital objects at scale. The goal is to accelerate discoveries, therapies, and cures by enabling researchers to leverage all available data and analysis tools. The Data Commons is being designed as an interoperable platform that can integrate with other data commons through common APIs, container technologies, metadata standards, and authentication.
big_data_casestudies_2.ppt
The document discusses big data use cases and requirements. It provides 51 detailed use cases across various domains that generate many terabytes to petabytes of data. It also describes extracting 437 specific requirements from the use cases and analyzing trends. The next steps involve matching requirements to a reference architecture and prioritizing use cases for implementation.
IEDA: Making Small Data BIG Through Interdisciplinary Partnerships Among Long...
Presentation given at the AGU Fall Meeting 2014; abstract at
http://abstractsearch.agu.org/meetings/2014/FM/IN14B-01.html
Oxford University Geospatial Metadata Workshop 20110415
This document provides an overview of a geospatial metadata and spatial data workshop held at the University of Oxford. The workshop covered topics such as metadata standards, application profiles, geospatial metadata tools and portals for sharing spatial data and metadata. Hands-on sessions demonstrated how to create metadata using the Geodoc Metadata Editor tool and access spatial data repositories through the Go-Geo portal and ShareGeo open data portal.
BD2K and the Commons : ELIXR All Hands
ELIXR All Hands Meeting : Barcelona, SPAIN - March 2016
https://www.elixir-europe.org/events/elixir-all-hands-2016
The NIH Data Commons - BD2K All Hands Meeting 2015
Presentation given at the BD2K All Hands meeting in Bethesda, MD, USA in November 2015
https://datascience.nih.gov/bd2k/events/NOV2015-AllHands
Video cast of this presentation:
http://videocast.nih.gov/summary.asp?Live=17480&bhcp=1
talk starts at 2hrs 40min (its about 55mins long) - includes video!
Document describing the Commons : https://datascience.nih.gov/commons
Opportunities and Challenges for International Cooperation Around Big Data
Presented at the Open Session of the Big Data in Biomedicine conference, Barcelona, November 12, 2014.
Open Data Initiative of India
Open data is machine readable data that can be used, reused and redistributed by anyone. Here's an overview of the Open Data Initiative of India.
Into the Night - Technology for citizen science
Current citizen science seems effortless...just download an app and start using it. However, there are many technical aspects that are necessary to make a citizen science project work. In this session, we will provide an overview of all the technical elements that are required - from the process of designing an app., to designing and managing a back-end system, to testing the system end to end before deployment. Participants will have the opportunity to engage in a short exercise to consider the design of an app for a citizen science project that addresses light pollution.
INSPIRE - ensuring access or continuity of access?
Presentation given by Robin Rice (EDINA) and Marin Donnelly (DCC) at the INSPIRE Conference 2011 in Edinburgh, Scotland.
AHM 2014: The iPlant Collaborative, Community Cyberinfrastructure for Life Sc...
Presentation given by Nirvan Merchant in the afternoon Architecture Forum Session on Day 1, June 24, at the EarthCube All-Hands Meeting
100503 bioinfo instsymp
Presentation on the work we've done within BeSTGRID as it relates to bioinformatics in NZ, for the 2010 Bioinformatics Symposium https://www.bestgrid.org/NZ-Bioinformatics-Symposium-2010
What's hot (20)
NIH Data Commons - Note: Presentation has animations
NIH Data Commons - Note: Presentation has animations
Presentation on INSPIRE and Higher Education (1 of 2)
Presentation on INSPIRE and Higher Education (1 of 2)
EMBL Australian Bioinformatics Resource AHM - Data Commons
EMBL Australian Bioinformatics Resource AHM - Data Commons
IEDA: Making Small Data BIG Through Interdisciplinary Partnerships Among Long...
IEDA: Making Small Data BIG Through Interdisciplinary Partnerships Among Long...
Oxford University Geospatial Metadata Workshop 20110415
Oxford University Geospatial Metadata Workshop 20110415
The NIH Data Commons - BD2K All Hands Meeting 2015
The NIH Data Commons - BD2K All Hands Meeting 2015
Opportunities and Challenges for International Cooperation Around Big Data
Opportunities and Challenges for International Cooperation Around Big Data
INSPIRE - ensuring access or continuity of access?
INSPIRE - ensuring access or continuity of access?
AHM 2014: The iPlant Collaborative, Community Cyberinfrastructure for Life Sc...
AHM 2014: The iPlant Collaborative, Community Cyberinfrastructure for Life Sc...
Similar to Open Based Systems Eng 010706 Titech
Global Network Advancement Group Next Generation Network-Integrated Sys...
4th National Research Platform Workshop: NRP, GRP, GNA-G Partnership
Harvey Newman, Caltech, GNA DIS WG Chair February 9, 2023
Global Network Advancement Group - Next Generation Network-Integrated Systems
This document summarizes a presentation on global petascale to exascale workflows for data intensive sciences. It discusses a partnership convened by the GNA-G Data Intensive Sciences Working Group with the mission of meeting challenges faced by data-intensive science programs. Cornerstone concepts that will be demonstrated include integrated network and site resource management, model-driven frameworks for resource orchestration, end-to-end monitoring with machine learning-optimized data transfers, and integrating Qualcomm's GradientGraph with network services to optimize applications and science workflows.
Social Innovation For Resource Management
The document discusses the HABITATS project which aims to validate INSPIRE data structures related to habitats through a social, bottom-up approach. It involves building user communities, developing data models, designing a spatial data infrastructure service architecture, and implementing pilot projects to test the services. The pilots will focus on managing natural resources and economic activities through participatory co-design processes to help drive adoption of standards from the bottom-up. The expected results include multi-stakeholder communities, data models, network services, operational pilot services, and dissemination of lessons learned.
Unidata's Approach to Community Broadening through Data and Technology Sharing
Unidata's Approach to Community Broadening through Data and Technology SharingThe HDF-EOS Tools and Information Center
Unidata provides data services, tools, and cyberinfrastructure to advance Earth system science and broaden participation in the geosciences. It was created through a grassroots effort and is funded by the NSF and UCAR. Unidata's work is driven by science, education, technology, and social needs. It provides real-time data from various sources to over 260 sites worldwide and develops standards like netCDF and services like THREDDS to facilitate data sharing and access. Unidata is working to broaden its community through international collaborations and empowering users around the world.Future direction of geoinfomatics
1. The document discusses geo-informatics and its use for disaster risk reduction and sustainable development through digital platforms like Digital Earth and Digital Asia.
2. Key applications mentioned include public participatory GIS, adaptation for climate change, monitoring glacial lakes, and early warning systems using sensor networks.
3. The Graduate School of Media and Governance at Keio University conducts research related to global innovation systems, security, and emerging crises through its Global Security Research Center.
AAG panel discussion on great lakes africa
Presentation by Glenn Hyman (CIAT) on effort to develop a global roads database. Also includes a few slides related to work of the Consultative Group on International Agricultural Research (CGIAR) in Africa.
FGP Open Group Paris 2016 Presentation FINAL - EN
The document discusses Canada's Federal Geospatial Platform (FGP), which was created in 2014 to better manage and share geospatial data across the Canadian federal government. The FGP uses open standards and a collaborative approach to make geospatial data discoverable, usable, and interoperable among 21 federal departments and agencies. This has supported more evidence-based decision-making, program delivery, and open government. The vision is for Canada's government to be fully "geo-enabled" through continued investment in the FGP and open data.
Lesson1 esa summer_school_brovelli
The document provides an overview of Free and Open Source Software for Geoinformation (FOSS4G). It discusses topics like web mapping, global land coverage, open data quality, and citizen science. It describes the UN OpenGIS experiment and the Geoinformatics Engineering MSc program at Politecnico di Milano. It also gives an overview of the Future Earth initiative, the Digital Earth concept, and how geospatial data and services are provided via the web. FOSS4G and initiatives like OSGeo and GeoForAll that support the development and use of open source geospatial software are also summarized.
Data Management: Geo-informatics
This document discusses the role of geospatial science, technology, and applications (GeSTA) in agro-ecosystems and dryland systems. It addresses how GeSTA can be used to map land use/cover, characterize vulnerable areas, delineate suitable agricultural areas, and assess risks like drought. The document also outlines plans for a centralized data warehouse and geospatial data portals to store, process, and disseminate spatial data for use in research projects and by stakeholders.
SDI-Initiatives-in-Nepal (1).pptx
The term “Spatial Data Infrastructure” (SDI) is often used to denote the relevant base collection of technologies, policies and institutional arrangements that facilitate the availability of and access to spatial data. SDI describes the overall methodology, process, existing practice, terms, policies of Nepal.
land health surveillance highlights
This document summarizes a global research project aimed at reducing land health risks and targeting agroforestry interventions to enhance land productivity. Key points include:
- Developing methods for evidenced-based management of land health through land health surveillance.
- Applying these methods to multi-scale targeting of sustainable land management and assessing intervention outcomes.
- Establishing a sentinel site surveillance framework using stratified random sampling to monitor soil health.
- Developing soil-plant spectral diagnostics using spectroscopy to map soil properties.
- Creating regional spatial information systems and out-scaling the work through various initiatives.
B340614
International Journal of Engineering Research and Applications (IJERA) is an open access online peer reviewed international journal that publishes research and review articles in the fields of Computer Science, Neural Networks, Electrical Engineering, Software Engineering, Information Technology, Mechanical Engineering, Chemical Engineering, Plastic Engineering, Food Technology, Textile Engineering, Nano Technology & science, Power Electronics, Electronics & Communication Engineering, Computational mathematics, Image processing, Civil Engineering, Structural Engineering, Environmental Engineering, VLSI Testing & Low Power VLSI Design etc.
TOWARDS A NEW METHODOLOGY FOR WEB GIS DEVELOPMENT
There has been an increasing need for geospatial information that is delivered through internet
technologies. This broad category of systems is referred to as Web Geographic Information Systems (Web
GIS). These systems exhibit characteristics common to both stand-alone and web-based systems making it
necessary to apply a hybrid methodology during their development. This paper proposes a methodology for
developing Web GIS that is herein referred to as the Y-Model Web GIS Development Methodology
(YWDM) which has been adapted from existing software development methodologies and applied to the
context of Web GIS development. The paper outlines in details the phases of the methodology. Its viability
as a methodology has been tested through its use in the implementation of the Emuhaya Web GIS portal.
The methodology presented here is not intended to be a rigid guide for web GIS development but instead it
provides a useful framework for guiding the process.
A Framework for Geospatial Web Services for Public Health by Dr. Leslie Lenert
A Framework for Geospatial Web Services for Public Health
by Leslie Lenert, MD, MS, FACMI, Director
National Center for Public Health Informatics, CCHIS, CDC
June 8 2009 URISA Public Health Conference
uploaded by Wansoo Im, Ph.D.
URISA Membership Committee Chair
http://www.gisinpublichealth.org
Cambridge University Geospatial Metadata Workshop 20110524
The document summarizes a workshop on geospatial metadata and spatial data. It discusses the importance of metadata for discovering and managing spatial datasets. It introduces geospatial metadata standards like FGDC, ISO 19115, and INSPIRE. It also describes the UK AGMAP profile, Geodoc metadata editor tool, GoGeo portal, and ShareGeo open data repository for sharing spatial resources in academia. Hands-on sessions demonstrate creating metadata and accessing datasets.
Spatial data infrastructure in Kyrgyzstan
The document discusses the limitations of Kyrgyzstan's spatial data infrastructure and the implications for climate adaptation efforts. It finds that there is currently no national SDI, and data exists in silos with poor coordination and data sharing between institutions. This poses challenges for climate adaptation projects that require spatial data on topics like boundaries, satellite imagery, and climate/weather. The document recommends establishing a working group to develop an NSDI through improved data access, standards, and awareness of SDI benefits. This could help adaptation efforts and unlock economic opportunities through increased transparency, efficiency and investment.
Leeds University Geospatial Metadata Workshop 20110617
This document provides an overview of a geospatial metadata and spatial data workshop. It discusses the importance of metadata for discovering and managing spatial datasets. It introduces common geospatial metadata standards like FGDC, ISO 19115, and INSPIRE and the concept of application profiles. The document outlines tools and resources for UK academics to create and publish metadata, including the UK AGMAP profile, Geodoc editor, GoGeo portal, and ShareGeo repository. Hands-on sessions demonstrate using these resources to generate metadata and access open spatial data.
Maps for Solving the World’s Biggest Problems
Guest lecture for the course SIO 110, Introduction to GIS and GPS for Scientists, taught by Prof. Bernard Minster, UC-San Diego, San Diego, CA. Also presented to GEOL 371, Introduction to Geographic Information Systems, taught by Prof. James Clark, Wheaton College, Wheaton, IL.
Open Data Technological Citizenship & Imagined Futures
Open Data Technological Citizenship & Imagined FuturesCommunication and Media Studies, Carleton University
Tracey P. Lauriault discusses open data and technological citizenship. She makes three key points:
1) Data are not objective or politically neutral, but are inseparable from the ideas, technologies, and contexts that produce them.
2) Technological citizenship involves engaging with data and technology as a form of political participation and action.
3) Various definitions and principles of open data have emerged over time from organizations aiming to make data accessible and shareable.Social Space for Geospatial Information
The document discusses building a "fourth way" to develop spatial data infrastructures (SDI) by combining standards, commercial initiatives, and community contributions. It proposes a "Geoportal4everybody" that would allow sharing spatial and non-spatial information through social networks and other means. The approach is based on open-source software and aims to make SDI development more accessible and distributed.
Similar to Open Based Systems Eng 010706 Titech (20)
Global Network Advancement Group Next Generation Network-Integrated Sys...
Global Network Advancement Group Next Generation Network-Integrated Sys...
Global Network Advancement Group - Next Generation Network-Integrated Systems
Global Network Advancement Group - Next Generation Network-Integrated Systems
Unidata's Approach to Community Broadening through Data and Technology Sharing
Unidata's Approach to Community Broadening through Data and Technology Sharing
A Framework for Geospatial Web Services for Public Health by Dr. Leslie Lenert
A Framework for Geospatial Web Services for Public Health by Dr. Leslie Lenert
Cambridge University Geospatial Metadata Workshop 20110524
Cambridge University Geospatial Metadata Workshop 20110524
Leeds University Geospatial Metadata Workshop 20110617
Leeds University Geospatial Metadata Workshop 20110617
Open Data Technological Citizenship & Imagined Futures
Open Data Technological Citizenship & Imagined Futures
More from Farhan Helmy
Etika Publik untuk Integritas Pejabat Publik dan Politisi
Paparan kuliah Romo Haryatmoko di Lecture on Public Ethics and Policy, 8 Pebruari 2021, yang difasilitasi oleh phi-LAB fpr social innovation and movement.
SINOPSIS:
Bagaimana kita menempatkan etika didalam mengelola kehidupan bernergara? Barangkali inilah pertanyaan yang ingin digali dalam berbagai praktek penyelengaraan negara.
Etika publik merupakan standar kepatutan dan justifikasi moral yang tidak hanya diwujudkan terbatas pada penyusunan kebijakan publik dan menjalankannya oleh birokrasi, tetapi lebih dalam lagi menjaga keberpihakan terhadap nilai dan kepentingan publik secara inklusif dan berkeadilan.
Berbagai praktek penyimpangan etika publik bukanlah khas dari suatu negara, terjadi di berbagai negara. Kecanggihan dan modusnya bahkan menempel kepada suatu desain tata kelola yang lebih berpihak pada kelompok kepentingan tertentu.
Narasumber:
Romo Haryatmoko*
Universitas Sanata Dharma Yogjakarta, Penelititi etika publik dan Penulis Buku, "Etika Publik untuk Integritas Pejabat Publik dan Politisi" (Kanisius, 2011)
Green investment magazine vol 01 01/2013
The document discusses sustainable landscape management in Indonesia through several projects and initiatives:
1) A REDD+ project in Sulawesi aims to reduce deforestation and emissions through sustainable forest management and incentives for communities. It faces challenges in monitoring land use changes.
2) A sustainable forest management project in Berbak, Jambi engages stakeholders to preserve forests through zoning, infrastructure, and alternative livelihoods, but implementing plans requires coordination between agencies.
3) An expedition in West Java encountered issues like mining damage, pollution, deforestation, and waste, highlighting needs for environmental awareness and restoration. Stakeholders discussed ways to improve sustainable landscape management.
Green investment magazine vol 02 06/2013
This document discusses the lack of focus on climate change and environmental issues in Indonesian politics. It notes that no political party has outlined a clear vision to address climate change, and that environmental protection is not yet a major part of any party's agenda. Experts argue that environmental issues should be "politicized" to have a greater influence on policy and lawmaking. The article also evaluates ways to measure political parties' commitments to the environment and climate change mitigation.
Ambisi Persetujuan Paris 2.0/1.5 C: mungkinkah dicapai?
Dokumen tersebut membahas tiga hal penting yaitu: (1) memahami krisis iklim secara sistemik dan kompleks, (2) tata kelola perubahan iklim yang melibatkan berbagai aktor dan proses, (3) tantangan mencapai target Paris Agreement 1.5-2°C dengan catatan reflektif mengenai komitmen, kebijakan publik, dan keadilan.
Krisis Iklim: perubahan sosial, inovasi dan tata kelola (Climate Crisis: soci...
Presentasi yang disampaikan sebagai dosen tamu di Program Magister Studi Pembangunan, Institut Teknologi Bandung.
Sesi 4 - Simulasi En-ROADS: Tata Guna Lahan dan Kehutanan (En-ROADS Simulatio...
Paparan 4 dari 4 paparan Simulasi En-ROADS: Tataguna Lahan dan Kehutanan yang disampaikan pada Lokakarya Kebijakan Perubahan Iklim menggunakan En-ROADS. Paparan in akan membahas simulasi kebijakan, dinamika dan dampaknya
pada sektor kehutanan dan lahan.
Translation:
Presentation 4 of 4 presentation, En-ROADS Simulation: Land Use and Forestry presented at the Climate Change Policy Workshop using En-ROADS. This presentation will discuss policy simulations, their dynamics and impacts in the forestry and land sector.
Sesi 3 - Simulasi En-ROADS: Energi dan Carbon Pricing (En-ROADS Simulation: E...
- Krisis iklim merupakan masalah sistemik yang melibatkan interaksi antara alam dan aktivitas manusia melalui institusi sosial
- Simulasi En-ROADS menunjukkan hubungan dinamis antara 18 parameter kebijakan yang mempengaruhi perubahan iklim dengan mengungkapkan ketergantungan dan dampak serta perilaku non-linear
- Uji coba kebijakan menunjukkan dinamika utama, potensi manfaat bersama, pertimbangan kesetaraan,
Sesi-2 Pengantar En-ROADS (Introduction to En-ROADS)
Paparan 2 dari 4 paparan yang disampaikan pada Lokakarya Kebijakan Perubahan Iklim menggunakan En-ROADS. Paparan ini akan memberikan gambaran umum tentang En-ROADS baik struktur, asumsi dan basis sains yang mendasari permodelan. Berbagai menu dasar akan diperkenalkan untuk mengoperasikannya.
Translation: Presentation 2 of 4 presentations presented at the Climate Change Policy Workshop using En-ROADS. This presentation will provide an overview of En-ROADS both the structure, assumptions and scientific basis that underlies the modeling.
Sesi -1: Memahami Krisis iklim secara Sistem (Understanding Climate Crisis: A...
Paparan 1 dari 4 paparan yang disampaikan pada Lokakarya Kebikkan Perubahan Iklim menggunakan En-ROADS. Paparan ini membahas kompleksitas iklim sebagai suatu sistem yang dinamikanya digerakan baik secara fisik (physical system) maupun kegiatan manusia (antropogenik) yang kemudian melembaga dalam perilaku.
Translation:
"Presentation 1 of 4 presentations delivered at the Workshop on Wisdom of Climate Change using En-ROADS. This presentation discusses the complexity of climate as a system whose dynamics is moved both physically (physical system) and human activities (anthropogenic) which then institutionalizes in behavior."
EOfactory: from pixel to intelligence
EOfactory is a platform that aims to democratize access to Earth observation data and geospatial intelligence through machine learning and business intelligence tools. It provides interactive tools to build AI models using training data and feedback systems. Users can work privately or collaboratively on projects and share models, data, and results through a global marketplace. EOfactory also runs educational programs to empower individuals and train the next generation of geospatial analytics leaders.
Change Detection in Kalimantan using EOfactory Platform
The document outlines steps for detecting changes in forests using remote sensing imagery and machine learning. It discusses selecting and downloading images, creating mosaics for visual inspection, classifying land use and land cover with machine learning, analyzing changes detected, and concluding that the EOfactory platform allows for end-to-end monitoring of changes through image processing, classification, and sharing of workspaces.
Crowd based Geospatial Technology: State of the Art of Civic Engagement
My introductory presentation on the use of geospatial technology analytics for civic engagement in managing natural resource management and environment.
Green Recovery, Teknologi dan UUCK: Beberapa Catatan
Dokumen tersebut membahas tentang pentingnya pemulihan ekonomi yang ramah lingkungan (green recovery) melalui investasi besar-besaran dalam teknologi rendah karbon, ekonomi sirkular, dan restorasi lingkungan sesuai dengan target ilmiah untuk menjaga peningkatan suhu bumi di bawah 1,5 derajat Celsius. Dokumen tersebut juga membahas pentingnya pengakuan hak masyarakat adat dan penyelesaian sengketa agraria dalam ker
Memahami Krisis Iklim dan Potensi Solusinya berdarkan En-ROADS Simulation
My Presentation on climate change complexity and potential solutions using En-ROADS simulation developed by Climate Interactive, MIT and Ventana System. (in Bahasa Indonesia)
Civic Engagement via En-ROADS Simulation/Game and EOfactory Platform
My thoughts and the ongoing activities in using En-ROADS simulation and EOfactory platform as a tools ciivic engagement, particularly on natural resources, environment and climate change,
ASEAN and Climate Change Issues: Challenges and Opportunities
Shared ideas on the role of ASEAN countries in seeking common ground on climate change issues debated at UNFCCC
Promoting Sustainability Agenda at Micro Level: Translating Ideas into Reality
The advancement of science and technology and subsequent industrial processes such as Industry 4.0 should be perceived as an opportunity to transform society from unsustainable living to more sustainable future. One of the challenging issues is how to engage non-state actors, particularly community at grassroot level. The presentation will share some concerns of the issues based on the lesson learnt in promoting sustaibility agenda in some initiatives in Indonesia.
Perubahan Iklim: Peluang dan Tantanganya
Kuliah tentang perubahan tantangan dan peluang khususnya peran inovasi dalam mentransformasikan ekonomi ke arah pembangunan rendah emisi karbon (low emission development scenarios). Kuliah disampaikan di Center for Sustainability, Universitas Surya, www.surya.ac.id
Green Investment, Innovation and Productivity Vol. 2/2014
The document discusses Indonesia's climate change agenda and leadership under the newly elected President Joko Widodo. It outlines Indonesia's commitments and progress made under previous President Susilo Bambang Yudhoyono, including adopting a National Action Plan to reduce greenhouse gas emissions by 26-41% by 2020. The new president Joko Widodo has also expressed commitment to climate change issues in his agenda, with plans to preserve forests and rehabilitate degraded land, important for carbon storage and addressing climate change impacts. As the impacts of climate change affect Indonesia seriously, stakeholders hope the new leadership will continue prioritizing climate change mitigation and sustainable development.
Flood and Water Scarcity in Jakarta
The document discusses the root problems causing flooding and water scarcity in Jakarta, Indonesia. Jakarta has experienced land use changes without conservation efforts, relying solely on horizontal drainage methods. This has led to increased surface runoff and reduced infiltration. In the past during the time of Prabu Siliwangi, land use prioritized forests and villages, allowing high infiltration of 73-95% and low surface runoff of 5-27%. However, modern land use has reduced infiltration to just 5-27% and increased surface runoff. The document proposes solutions like developing green spaces, blue spaces, artificial recharge wells, and upstream dams and ponds to shift from horizontal to vertical drainage and
More from Farhan Helmy (20)
Etika Publik untuk Integritas Pejabat Publik dan Politisi
Etika Publik untuk Integritas Pejabat Publik dan Politisi
Ambisi Persetujuan Paris 2.0/1.5 C: mungkinkah dicapai?
Ambisi Persetujuan Paris 2.0/1.5 C: mungkinkah dicapai?
Krisis Iklim: perubahan sosial, inovasi dan tata kelola (Climate Crisis: soci...
Krisis Iklim: perubahan sosial, inovasi dan tata kelola (Climate Crisis: soci...
Sesi 4 - Simulasi En-ROADS: Tata Guna Lahan dan Kehutanan (En-ROADS Simulatio...
Sesi 4 - Simulasi En-ROADS: Tata Guna Lahan dan Kehutanan (En-ROADS Simulatio...
Sesi 3 - Simulasi En-ROADS: Energi dan Carbon Pricing (En-ROADS Simulation: E...
Sesi 3 - Simulasi En-ROADS: Energi dan Carbon Pricing (En-ROADS Simulation: E...
Sesi-2 Pengantar En-ROADS (Introduction to En-ROADS)
Sesi-2 Pengantar En-ROADS (Introduction to En-ROADS)
Sesi -1: Memahami Krisis iklim secara Sistem (Understanding Climate Crisis: A...
Sesi -1: Memahami Krisis iklim secara Sistem (Understanding Climate Crisis: A...
Change Detection in Kalimantan using EOfactory Platform
Change Detection in Kalimantan using EOfactory Platform
Crowd based Geospatial Technology: State of the Art of Civic Engagement
Crowd based Geospatial Technology: State of the Art of Civic Engagement
Green Recovery, Teknologi dan UUCK: Beberapa Catatan
Green Recovery, Teknologi dan UUCK: Beberapa Catatan
Memahami Krisis Iklim dan Potensi Solusinya berdarkan En-ROADS Simulation
Memahami Krisis Iklim dan Potensi Solusinya berdarkan En-ROADS Simulation
Civic Engagement via En-ROADS Simulation/Game and EOfactory Platform
Civic Engagement via En-ROADS Simulation/Game and EOfactory Platform
ASEAN and Climate Change Issues: Challenges and Opportunities
ASEAN and Climate Change Issues: Challenges and Opportunities
Promoting Sustainability Agenda at Micro Level: Translating Ideas into Reality
Promoting Sustainability Agenda at Micro Level: Translating Ideas into Reality
Green Investment, Innovation and Productivity Vol. 2/2014
Green Investment, Innovation and Productivity Vol. 2/2014
Recently uploaded
AppSec PNW: Android and iOS Application Security with MobSF
Mobile Security Framework - MobSF is a free and open source automated mobile application security testing environment designed to help security engineers, researchers, developers, and penetration testers to identify security vulnerabilities, malicious behaviours and privacy concerns in mobile applications using static and dynamic analysis. It supports all the popular mobile application binaries and source code formats built for Android and iOS devices. In addition to automated security assessment, it also offers an interactive testing environment to build and execute scenario based test/fuzz cases against the application.
This talk covers:
Using MobSF for static analysis of mobile applications.
Interactive dynamic security assessment of Android and iOS applications.
Solving Mobile app CTF challenges.
Reverse engineering and runtime analysis of Mobile malware.
How to shift left and integrate MobSF/mobsfscan SAST and DAST in your build pipeline.
"Scaling RAG Applications to serve millions of users", Kevin Goedecke
How we managed to grow and scale a RAG application from zero to thousands of users in 7 months. Lessons from technical challenges around managing high load for LLMs, RAGs and Vector databases.
Astute Business Solutions | Oracle Cloud Partner |
Your goto partner for Oracle Cloud, PeopleSoft, E-Business Suite, and Ellucian Banner. We are a firm specialized in managed services and consulting.
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
This LF Energy webinar took place June 20, 2024. It featured:
-Alex Thornton, LF Energy
-Hallie Cramer, Google
-Daniel Roesler, UtilityAPI
-Henry Richardson, WattTime
In response to the urgency and scale required to effectively address climate change, open source solutions offer significant potential for driving innovation and progress. Currently, there is a growing demand for standardization and interoperability in energy data and modeling. Open source standards and specifications within the energy sector can also alleviate challenges associated with data fragmentation, transparency, and accessibility. At the same time, it is crucial to consider privacy and security concerns throughout the development of open source platforms.
This webinar will delve into the motivations behind establishing LF Energy’s Carbon Data Specification Consortium. It will provide an overview of the draft specifications and the ongoing progress made by the respective working groups.
Three primary specifications will be discussed:
-Discovery and client registration, emphasizing transparent processes and secure and private access
-Customer data, centering around customer tariffs, bills, energy usage, and full consumption disclosure
-Power systems data, focusing on grid data, inclusive of transmission and distribution networks, generation, intergrid power flows, and market settlement data
MySQL InnoDB Storage Engine: Deep Dive - Mydbops
This presentation, titled "MySQL - InnoDB" and delivered by Mayank Prasad at the Mydbops Open Source Database Meetup 16 on June 8th, 2024, covers dynamic configuration of REDO logs and instant ADD/DROP columns in InnoDB.
This presentation dives deep into the world of InnoDB, exploring two ground-breaking features introduced in MySQL 8.0:
• Dynamic Configuration of REDO Logs: Enhance your database's performance and flexibility with on-the-fly adjustments to REDO log capacity. Unleash the power of the snake metaphor to visualize how InnoDB manages REDO log files.
• Instant ADD/DROP Columns: Say goodbye to costly table rebuilds! This presentation unveils how InnoDB now enables seamless addition and removal of columns without compromising data integrity or incurring downtime.
Key Learnings:
• Grasp the concept of REDO logs and their significance in InnoDB's transaction management.
• Discover the advantages of dynamic REDO log configuration and how to leverage it for optimal performance.
• Understand the inner workings of instant ADD/DROP columns and their impact on database operations.
• Gain valuable insights into the row versioning mechanism that empowers instant column modifications.
"What does it really mean for your system to be available, or how to define w...
We will talk about system monitoring from a few different angles. We will start by covering the basics, then discuss SLOs, how to define them, and why understanding the business well is crucial for success in this exercise.
From Natural Language to Structured Solr Queries using LLMs
This talk draws on experimentation to enable AI applications with Solr. One important use case is to use AI for better accessibility and discoverability of the data: while User eXperience techniques, lexical search improvements, and data harmonization can take organizations to a good level of accessibility, a structural (or “cognitive” gap) remains between the data user needs and the data producer constraints.
That is where AI – and most importantly, Natural Language Processing and Large Language Model techniques – could make a difference. This natural language, conversational engine could facilitate access and usage of the data leveraging the semantics of any data source.
The objective of the presentation is to propose a technical approach and a way forward to achieve this goal.
The key concept is to enable users to express their search queries in natural language, which the LLM then enriches, interprets, and translates into structured queries based on the Solr index’s metadata.
This approach leverages the LLM’s ability to understand the nuances of natural language and the structure of documents within Apache Solr.
The LLM acts as an intermediary agent, offering a transparent experience to users automatically and potentially uncovering relevant documents that conventional search methods might overlook. The presentation will include the results of this experimental work, lessons learned, best practices, and the scope of future work that should improve the approach and make it production-ready.
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Dmitrii Kamaev, PhD
Senior Product Owner - QIAGEN
Mutation Testing for Task-Oriented Chatbots
Conversational agents, or chatbots, are increasingly used to access all sorts of services using natural language. While open-domain chatbots - like ChatGPT - can converse on any topic, task-oriented chatbots - the focus of this paper - are designed for specific tasks, like booking a flight, obtaining customer support, or setting an appointment. Like any other software, task-oriented chatbots need to be properly tested, usually by defining and executing test scenarios (i.e., sequences of user-chatbot interactions). However, there is currently a lack of methods to quantify the completeness and strength of such test scenarios, which can lead to low-quality tests, and hence to buggy chatbots.
To fill this gap, we propose adapting mutation testing (MuT) for task-oriented chatbots. To this end, we introduce a set of mutation operators that emulate faults in chatbot designs, an architecture that enables MuT on chatbots built using heterogeneous technologies, and a practical realisation as an Eclipse plugin. Moreover, we evaluate the applicability, effectiveness and efficiency of our approach on open-source chatbots, with promising results.
Introducing BoxLang : A new JVM language for productivity and modularity!
Just like life, our code must adapt to the ever changing world we live in. From one day coding for the web, to the next for our tablets or APIs or for running serverless applications. Multi-runtime development is the future of coding, the future is to be dynamic. Let us introduce you to BoxLang.
Dynamic. Modular. Productive.
BoxLang redefines development with its dynamic nature, empowering developers to craft expressive and functional code effortlessly. Its modular architecture prioritizes flexibility, allowing for seamless integration into existing ecosystems.
Interoperability at its Core
With 100% interoperability with Java, BoxLang seamlessly bridges the gap between traditional and modern development paradigms, unlocking new possibilities for innovation and collaboration.
Multi-Runtime
From the tiny 2m operating system binary to running on our pure Java web server, CommandBox, Jakarta EE, AWS Lambda, Microsoft Functions, Web Assembly, Android and more. BoxLang has been designed to enhance and adapt according to it's runnable runtime.
The Fusion of Modernity and Tradition
Experience the fusion of modern features inspired by CFML, Node, Ruby, Kotlin, Java, and Clojure, combined with the familiarity of Java bytecode compilation, making BoxLang a language of choice for forward-thinking developers.
Empowering Transition with Transpiler Support
Transitioning from CFML to BoxLang is seamless with our JIT transpiler, facilitating smooth migration and preserving existing code investments.
Unlocking Creativity with IDE Tools
Unleash your creativity with powerful IDE tools tailored for BoxLang, providing an intuitive development experience and streamlining your workflow. Join us as we embark on a journey to redefine JVM development. Welcome to the era of BoxLang.
"Choosing proper type of scaling", Olena Syrota
Imagine an IoT processing system that is already quite mature and production-ready and for which client coverage is growing and scaling and performance aspects are life and death questions. The system has Redis, MongoDB, and stream processing based on ksqldb. In this talk, firstly, we will analyze scaling approaches and then select the proper ones for our system.
Lee Barnes - Path to Becoming an Effective Test Automation Engineer.pdf
So… you want to become a Test Automation Engineer (or hire and develop one)? While there’s quite a bit of information available about important technical and tool skills to master, there’s not enough discussion around the path to becoming an effective Test Automation Engineer that knows how to add VALUE. In my experience this had led to a proliferation of engineers who are proficient with tools and building frameworks but have skill and knowledge gaps, especially in software testing, that reduce the value they deliver with test automation.
In this talk, Lee will share his lessons learned from over 30 years of working with, and mentoring, hundreds of Test Automation Engineers. Whether you’re looking to get started in test automation or just want to improve your trade, this talk will give you a solid foundation and roadmap for ensuring your test automation efforts continuously add value. This talk is equally valuable for both aspiring Test Automation Engineers and those managing them! All attendees will take away a set of key foundational knowledge and a high-level learning path for leveling up test automation skills and ensuring they add value to their organizations.
Dandelion Hashtable: beyond billion requests per second on a commodity server
This slide deck presents DLHT, a concurrent in-memory hashtable. Despite efforts to optimize hashtables, that go as far as sacrificing core functionality, state-of-the-art designs still incur multiple memory accesses per request and block request processing in three cases. First, most hashtables block while waiting for data to be retrieved from memory. Second, open-addressing designs, which represent the current state-of-the-art, either cannot free index slots on deletes or must block all requests to do so. Third, index resizes block every request until all objects are copied to the new index. Defying folklore wisdom, DLHT forgoes open-addressing and adopts a fully-featured and memory-aware closed-addressing design based on bounded cache-line-chaining. This design offers lock-free index operations and deletes that free slots instantly, (2) completes most requests with a single memory access, (3) utilizes software prefetching to hide memory latencies, and (4) employs a novel non-blocking and parallel resizing. In a commodity server and a memory-resident workload, DLHT surpasses 1.6B requests per second and provides 3.5x (12x) the throughput of the state-of-the-art closed-addressing (open-addressing) resizable hashtable on Gets (Deletes).
GlobalLogic Java Community Webinar #18 “How to Improve Web Application Perfor...
Під час доповіді відповімо на питання, навіщо потрібно підвищувати продуктивність аплікації і які є найефективніші способи для цього. А також поговоримо про те, що таке кеш, які його види бувають та, основне — як знайти performance bottleneck?
Відео та деталі заходу: https://bit.ly/45tILxj
Apps Break Data
How information systems are built or acquired puts information, which is what they should be about, in a secondary place. Our language adapted accordingly, and we no longer talk about information systems but applications. Applications evolved in a way to break data into diverse fragments, tightly coupled with applications and expensive to integrate. The result is technical debt, which is re-paid by taking even bigger "loans", resulting in an ever-increasing technical debt. Software engineering and procurement practices work in sync with market forces to maintain this trend. This talk demonstrates how natural this situation is. The question is: can something be done to reverse the trend?
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Gursev Pirge, PhD
Senior Data Scientist - JohnSnowLabs
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
HERE IS YOUR WEBINAR CONTENT! 'Mastering Customer Journey Management with Dr. Graham Hill'. We hope you find the webinar recording both insightful and enjoyable.
In this webinar, we explored essential aspects of Customer Journey Management and personalization. Here’s a summary of the key insights and topics discussed:
Key Takeaways:
Understanding the Customer Journey: Dr. Hill emphasized the importance of mapping and understanding the complete customer journey to identify touchpoints and opportunities for improvement.
Personalization Strategies: We discussed how to leverage data and insights to create personalized experiences that resonate with customers.
Technology Integration: Insights were shared on how inQuba’s advanced technology can streamline customer interactions and drive operational efficiency.
Getting the Most Out of ScyllaDB Monitoring: ShareChat's Tips
ScyllaDB monitoring provides a lot of useful information. But sometimes it’s not easy to find the root of the problem if something is wrong or even estimate the remaining capacity by the load on the cluster. This talk shares our team's practical tips on: 1) How to find the root of the problem by metrics if ScyllaDB is slow 2) How to interpret the load and plan capacity for the future 3) Compaction strategies and how to choose the right one 4) Important metrics which aren’t available in the default monitoring setup.
Recently uploaded (20)
AppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSF
"Scaling RAG Applications to serve millions of users", Kevin Goedecke
"Scaling RAG Applications to serve millions of users", Kevin Goedecke
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
"What does it really mean for your system to be available, or how to define w...
"What does it really mean for your system to be available, or how to define w...
From Natural Language to Structured Solr Queries using LLMs
From Natural Language to Structured Solr Queries using LLMs
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Introducing BoxLang : A new JVM language for productivity and modularity!
Introducing BoxLang : A new JVM language for productivity and modularity!
Lee Barnes - Path to Becoming an Effective Test Automation Engineer.pdf
Lee Barnes - Path to Becoming an Effective Test Automation Engineer.pdf
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
GlobalLogic Java Community Webinar #18 “How to Improve Web Application Perfor...
GlobalLogic Java Community Webinar #18 “How to Improve Web Application Perfor...
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
Getting the Most Out of ScyllaDB Monitoring: ShareChat's Tips
Getting the Most Out of ScyllaDB Monitoring: ShareChat's Tips
Open Based Systems Eng 010706 Titech
- 1. Status Report and Proposed Actions S patial O pen based S ystems for I ndonesian E nvironment (SOFIE) and M anagement and A pplications of natural R esource and environmental sound T echnologies and I nformation N etwork (MARTIN) version 1.0 26.06.06 Farhan Helmy
- 17. JAVA Backbone (STM-1 fiber)
- 19. Further Information: Farhan Helmy Sakano Laboratory School of Decision Science and Technology Department of Social Engineering Tokyo Institute of Technology farhan@soc.titech.ac.jp atau farhan@menlh.go.id