Rich feeds policy, the cloud, and CAP
•Download as PPT, PDF•
1 like•180 views
This document discusses Rich Feeds, a system for capturing and sharing research data feeds over time in a flexible way. It describes the current goals of empowering additional data providers, enabling selective information dissemination to consumers, and scaling to dynamically meet bandwidth and storage needs. The system uses policies to define which users can store, access, and view which data. It is currently deployed using Windows and Linux servers and VMs, and may utilize Amazon Web Services. The system shares data using the Common Alert Protocol standard and plans to implement a scalable CAP server.
Report
Share
Report
Share
Recommended
Research Issues on Grid Resource Brokers
A Grid broker is a tool that matches user requests to available Grid resources. Brokers perform functions like resource discovery, selection, monitoring, job submission and monitoring. They act as a coordinator between resource providers, virtual organizations that interconnect Grid sites, and resource consumers. Brokers aim to provide a single point of access for users to Grid resources and can select resources according to policies like being consumer-oriented, provider-oriented or Grid-oriented.
Sample
This document discusses grid architecture and service modeling. It begins with a brief history of grid computing and identifies four main grid families (computational, information, business, and peer-to-peer grids). It then describes a layered grid architecture modeled after the Internet architecture. Next, it examines Open Grid Services Architecture (OGSA) and some of its core interfaces. It also discusses security models in OGSA. Finally, it covers data-intensive grid service models, data replication strategies, and different grid data access models.
Discover edina programmefinalmeeting-28-sep-2012
The document discusses the DiscoverEDINA project which has three strands of activity: 1) Geo, which enhances multimedia content metadata like geo tags, 2) MediaHub, which crowdsources metadata for MediaHub items, and 3) SUNCAT, which contributes open metadata to SUNCAT in different formats. Each strand optimizes data for reuse, adopts open licensing, and uses existing EDINA APIs. The conclusion questions how the tools and metadata will be used, discusses business models for open metadata, and whether metadata alone enables discovery and use.
Research Data Services: The EUDAT B2SERVICE SUITE | www.eudat.eu |
| www.eudat.eu | EUDAT offers common data services, supporting multiple research communities as well as individuals, through a geographically distributed, resilient network connecting general purpose data centres and community-specific data repositories.
David Reeve - UKAD 2016 forum
Jisc is a UK nonprofit that provides digital services and solutions for higher education, operating shared infrastructure like the Janet network and negotiating deals, with the goals of implementing an enterprise information strategy including improving data quality, governance and management through initiatives like a data warehouse and SharePoint upgrades.
Slide share assignment for thesis presentation
This document presents a network-centric information scheme for integrating sensor data and services using a messaging network and distributed data store grids. The scheme uses a structured overlay network to exchange and process application-level messages. Sensor data is sent directly to the content-aware messaging network and immediately distributed to data store grids. Publishers can send new content to the network whenever available. The data is then delivered to consumer applications based on their interests. The scheme provides functions like content-based routing and policy mediation between different overlay networks. It allows easy introduction of a sensor network system over existing IP networks.
Data as a service
Emerging Trends in Data Visualization and Dissemination discusses providing statistical data through application programming interfaces (APIs) and as a service rather than goods. It describes how mashups combine data from multiple sources into new applications and services. The document outlines benefits of mashups, how they work by retrieving data through APIs from different websites, and factors to consider when planning a mashup like data sources and programming languages. It provides examples of the United Nations' UNData and Comtrade initiatives that make international statistical databases freely available through APIs and web services.
UKCCSRC Data and Information Archive Briefing - UKCCSRC Strathclyde Biannual ...
UKCCSRC Data and Information Archive Briefing - UKCCSRC Strathclyde Biannual ...UK Carbon Capture and Storage Research Centre
The UKCCSRC Data and Information Archive holds digital data from UKCCSRC and EPSRC-funded CCS projects. Recent additions include presentations and posters from UKCCSRC events. EPSRC now requires research data supporting publications to be archived before publication, with metadata created within a year. The UKCCSRC Archive provides guidance on archiving project data, including describing data with metadata and addressing any confidentiality issues. Researchers should manage data properly throughout their projects and deliver the final data to their institutional or the UKCCSRC Archive.Recommended
Research Issues on Grid Resource Brokers
A Grid broker is a tool that matches user requests to available Grid resources. Brokers perform functions like resource discovery, selection, monitoring, job submission and monitoring. They act as a coordinator between resource providers, virtual organizations that interconnect Grid sites, and resource consumers. Brokers aim to provide a single point of access for users to Grid resources and can select resources according to policies like being consumer-oriented, provider-oriented or Grid-oriented.
Sample
This document discusses grid architecture and service modeling. It begins with a brief history of grid computing and identifies four main grid families (computational, information, business, and peer-to-peer grids). It then describes a layered grid architecture modeled after the Internet architecture. Next, it examines Open Grid Services Architecture (OGSA) and some of its core interfaces. It also discusses security models in OGSA. Finally, it covers data-intensive grid service models, data replication strategies, and different grid data access models.
Discover edina programmefinalmeeting-28-sep-2012
The document discusses the DiscoverEDINA project which has three strands of activity: 1) Geo, which enhances multimedia content metadata like geo tags, 2) MediaHub, which crowdsources metadata for MediaHub items, and 3) SUNCAT, which contributes open metadata to SUNCAT in different formats. Each strand optimizes data for reuse, adopts open licensing, and uses existing EDINA APIs. The conclusion questions how the tools and metadata will be used, discusses business models for open metadata, and whether metadata alone enables discovery and use.
Research Data Services: The EUDAT B2SERVICE SUITE | www.eudat.eu |
| www.eudat.eu | EUDAT offers common data services, supporting multiple research communities as well as individuals, through a geographically distributed, resilient network connecting general purpose data centres and community-specific data repositories.
David Reeve - UKAD 2016 forum
Jisc is a UK nonprofit that provides digital services and solutions for higher education, operating shared infrastructure like the Janet network and negotiating deals, with the goals of implementing an enterprise information strategy including improving data quality, governance and management through initiatives like a data warehouse and SharePoint upgrades.
Slide share assignment for thesis presentation
This document presents a network-centric information scheme for integrating sensor data and services using a messaging network and distributed data store grids. The scheme uses a structured overlay network to exchange and process application-level messages. Sensor data is sent directly to the content-aware messaging network and immediately distributed to data store grids. Publishers can send new content to the network whenever available. The data is then delivered to consumer applications based on their interests. The scheme provides functions like content-based routing and policy mediation between different overlay networks. It allows easy introduction of a sensor network system over existing IP networks.
Data as a service
Emerging Trends in Data Visualization and Dissemination discusses providing statistical data through application programming interfaces (APIs) and as a service rather than goods. It describes how mashups combine data from multiple sources into new applications and services. The document outlines benefits of mashups, how they work by retrieving data through APIs from different websites, and factors to consider when planning a mashup like data sources and programming languages. It provides examples of the United Nations' UNData and Comtrade initiatives that make international statistical databases freely available through APIs and web services.
UKCCSRC Data and Information Archive Briefing - UKCCSRC Strathclyde Biannual ...
UKCCSRC Data and Information Archive Briefing - UKCCSRC Strathclyde Biannual ...UK Carbon Capture and Storage Research Centre
The UKCCSRC Data and Information Archive holds digital data from UKCCSRC and EPSRC-funded CCS projects. Recent additions include presentations and posters from UKCCSRC events. EPSRC now requires research data supporting publications to be archived before publication, with metadata created within a year. The UKCCSRC Archive provides guidance on archiving project data, including describing data with metadata and addressing any confidentiality issues. Researchers should manage data properly throughout their projects and deliver the final data to their institutional or the UKCCSRC Archive.Rich Feeds for RESCUE and PALMS
Captures, preserves, integrates, and exposes
Unconventional and emergent data feeds
Real time or archivally
Serve emergency response networks and general public
Iscram 2008 presentation
This document discusses Rich Feeds, which captures, preserves, integrates, and exposes unconventional and emergent data feeds for the RESCUE project. The RESCUE project gathers and maintains emergency information to serve emergency response networks and the public. Rich Feeds aims to acquire data from various sources, distribute it to consumers while addressing challenges around policy, authentication, and long-term archiving. It presents an architecture using services and SOA principles to flexibly integrate heterogeneous data sources in a loosely coupled way.
Lecture1
This document provides an introduction to a course on big data. It outlines the instructor and TA contact information. The topics that will be covered include data analytics, Hadoop/MapReduce programming, graph databases and analytics. Big data is defined as data sets that are too large and complex for traditional database tools to handle. The challenges of big data include capturing, storing, analyzing and visualizing large, complex data from many sources. Key aspects of big data are the volume, variety and velocity of data. Cloud computing, virtualization, and service-oriented architectures are important enabling technologies for big data. The course will use Hadoop and related tools for distributed data processing and analytics. Assessment will include homework, a group project, and class
Big data.ppt
This document provides an introduction to a course on big data and analytics. It outlines the following key points:
- The instructor and TA contact information and course homepage.
- The course will cover foundational data analytics, Hadoop/MapReduce programming, graph databases, and other big data topics.
- Big data is defined as data that is too large or complex for traditional database tools to process. It is characterized by high volume, velocity, and variety.
- Examples of big data sources and the exponential growth of data volumes are provided. Real-time analytics and fast data processing are also discussed.
Data Tactics dhs introduction to cloud technologies wtc
Data Tactics Corporation is an established company that provides cloud computing and data management solutions. They operate several secure clouds for government customers and have experience hosting large scale data and applications. The document provides an overview of cloud computing definitions, models, and capabilities relevant for intelligence community applications. It describes Data Tactics' cloud solutions, experience, and the types of features and services they can provide such as scalable data storage, analytics, and user access tools.
Intelligent Cloud Enablement
Data continues to grow exponentially – especially with the advent of social content. Approximately 70% of data is unstructured. This impacts on storage costs and management, Data Protection, and SLAs.
New deployment options such as cloud provide alternatives but how do you know what you should move to the cloud?
Navigating the World of User Data Management and Data Discovery
This document discusses navigating user data management and data discovery. It provides an overview of evaluating and selecting data management tools for a Hadoop data lake. Key criteria for evaluation include metadata curation, lineage and versioning, integration capabilities, and performance. Several vendors were evaluated, with Global ID, Attivio, and Waterline Data scoring highest based on the criteria. The presentation emphasizes selecting a limited number of tools based on business and user requirements.
Lecture1 BIG DATA and Types of data in details
What exactly is big data? The definition of big data is data that contains greater variety, arriving in increasing volumes and with more velocity. This is also known as the three Vs. Put simply, big data is larger, more complex data sets, especially from new data sources.
Don't Be Scared. Data Don't Bite. Introduction to Big Data.
This document provides an introduction to big data, including definitions, characteristics, examples, and challenges. It defines big data as high-volume, high-velocity, and high-variety information assets that require new processing methods. Examples discussed include the Sloan Digital Sky Survey, Human Genome Project, and Large Hadron Collider experiments. Challenges of big data include storage, networking, data integrity, and the need for new technologies to handle the volume, velocity and variety. Emerging solutions involve distributed storage, local computation near data, and frameworks like Hadoop and MapReduce.
Unit i introduction to grid computing
Grid computing is the sharing of computer resources from multiple administrative domains to achieve common goals. It allows for independent, inexpensive access to high-end computational capabilities. Grid computing federates resources like computers, data, software and other devices. It provides a single login for users to access distributed resources for tasks like drug discovery, climate modeling and other data-intensive applications. Current grids are used for distributed supercomputing, high-throughput computing, on-demand computing and other methods. Grids benefit scientists, engineers and other users who need to solve large problems or collaborate globally.
Data Domain-Driven Design
Data Mesh is the decentralized architecture where your units of architecture is a domain driven data set that is treated as a product owned by domains or teams that most intimately know that data either creating it or they are consuming it and re-sharing it and allocated specific roles that have the accountability and the responsibility to provide that data as a product abstracting away complexity into infrastructure layer a self-serve infrastructure layer so that create these products more much more easily.
Big data beyond the hype may 2014
The document discusses big data and analytics technologies. It provides an overview of big data, describes how major companies are leveraging big data across industries, and outlines the capabilities and benefits of technologies like Hadoop, YARN, and Spark for processing and analyzing large datasets. The agenda indicates it will also cover organizational evolution with big data and a case study.
Creating a Centralized Consumer Profile Management Service with WebSphere Dat...
In this presentation will talk about how one of the world's leading Financial Institutions, leveraged WebSphere DataPower to provide a set of centralized consumer profile management services. This central service would be leveraged by internal and external applications, and would align with enterprise marketing capabilities. The solution included a complex security model which included the following products: Tivoli Directory Server, Tivoli Access Manager and Tivoli Federated Identity Manager. We will describe how to build complex orchestrations in WebSphere DataPower, and also go through some of the performance tuning options we implemented to achieve a high degree of efficiency.
Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)
This document discusses how Globus services can facilitate collaboration and data sharing through automated workflows. It describes how Globus Auth enables authentication for shared access to endpoints. APIs and command line tools allow applications to programmatically manage permissions and transfer data. JupyterHub can be configured with Globus Auth to provide tokens for accessing remote Globus services within notebooks. This enables collaborative and distributed data analysis. The document also outlines how Globus services can support automated publication of datasets through search, identifiers, and metadata.
Best Practices Using RTI Connext DDS
View On-Demand http://ecast.opensystemsmedia.com/403
Repeat Success, Not Mistakes; Use DDS Best Practices to Design Your Complex Distributed Systems
RTI Connext DDS is a powerful tool that lets you efficiently build and integrate complex distributed systems like no other technology – if you use it right. Be aware of how to get the most out of DDS and how to avoid common pitfalls when developing your system. We've developed RTI Connext best practices over the course of hundreds of customer projects and many years. In this webinar, you will learn how to apply the best practices we have developed to use RTI Connext DDS in ways that will enable your system to scale effectively with optimal performance, while avoiding missteps that will cause poor performance, non-determinism and scalability problems.
Data lake-itweekend-sharif university-vahid amiry
دومین ITWeekend دانشگاه صنعتی شریف
وحید امیری
معماری Data Lake در محیط کلان داده
VahidAmiry.ir
DataStack.ir
Building your big data solution
This document provides an overview of WSO2 and their offerings for building big data solutions. WSO2 provides open source components for building complete cloud platforms and is recognized as a leader in application infrastructure by Gartner and Forrester. They discuss the challenges of big data due to the large volumes and speeds at which data is generated today. WSO2's products like BAM and CEP help customers address the full data lifecycle from collection, storage, processing to analytics for big data use cases. The document outlines an example big data architecture implemented using WSO2 components along with other technologies like Cassandra.
bigdataintro.pptx
Big data refers to large, complex datasets that are difficult to process using traditional database management tools. It is characterized by the 3 V's - volume, referring to the large scale of data; variety, referring to different data types; and velocity, referring to the speed at which data is generated and processed. Common sources of big data include social media, sensors, and scientific instruments. Hadoop and Spark are commonly used to process and analyze big data in distributed, parallel systems. Cloud computing provides on-demand access to computing resources and is well-suited for flexible big data applications.
How Data Drives Business at Choice Hotels
3 Things to Learn:
-How data is driving digital transformation to help businesses innovate rapidly
-How Choice Hotels (one of largest hoteliers) is using Cloudera Enterprise to gain meaningful insights that drive their business
-How Choice Hotels has transformed business through innovative use of Apache Hadoop, Cloudera Enterprise, and deployment in the cloud — from developing customer experiences to meeting IT compliance requirements
Kanthaka - High Volume CDR Analyzer
'Kanthaka' is an attempt to bring the benefits of Big Data technologies to telecom industry. The objective of the system is to analyze the CDRs (Caller Detail Record) and give results in near real time.
This is carried out as a final year project for my degree B. Sc. of Engineering (Hons) at University of Moratuwa as a team with 3 more colleagues, under the supervision of a senior lecturer and an industry expert.
The presentation exhibits the background, findings after literature review and proposing architecture of the system as for now. Any feed backs on improvements that can be made, are warmly welcome!
Cytoscape Network Visualization and Analysis
This document provides an outline and introduction for a workshop on biological networks using Cytoscape. It summarizes Barry Demchak's background working on Cytoscape. It then introduces other members of the Cytoscape team, provides an overview of Cytoscape usage statistics, and discusses why biological networks are important to study. The remainder of the document outlines topics to be covered, including biological network taxonomy, analytical approaches for networks, visualization techniques, and hands-on tutorials for working with Cytoscape.
The New CyREST: Economical Delivery of Complex, Reproducible Network Biology ...
The document describes the CyREST platform for delivering complex and reproducible network biology workflows. CyREST uses a microservices architecture and Kubernetes deployment to provide scalable and repeatable Cytoscape applications and services. Currently available services include diffusion heat propagation, NDEx network repository, and cxMate universal CX adapter. Future work includes more cyberinfrastructure services, boosting network layouts, and availability on high performance infrastructure.
More Related Content
Similar to Rich feeds policy, the cloud, and CAP
Rich Feeds for RESCUE and PALMS
Captures, preserves, integrates, and exposes
Unconventional and emergent data feeds
Real time or archivally
Serve emergency response networks and general public
Iscram 2008 presentation
This document discusses Rich Feeds, which captures, preserves, integrates, and exposes unconventional and emergent data feeds for the RESCUE project. The RESCUE project gathers and maintains emergency information to serve emergency response networks and the public. Rich Feeds aims to acquire data from various sources, distribute it to consumers while addressing challenges around policy, authentication, and long-term archiving. It presents an architecture using services and SOA principles to flexibly integrate heterogeneous data sources in a loosely coupled way.
Lecture1
This document provides an introduction to a course on big data. It outlines the instructor and TA contact information. The topics that will be covered include data analytics, Hadoop/MapReduce programming, graph databases and analytics. Big data is defined as data sets that are too large and complex for traditional database tools to handle. The challenges of big data include capturing, storing, analyzing and visualizing large, complex data from many sources. Key aspects of big data are the volume, variety and velocity of data. Cloud computing, virtualization, and service-oriented architectures are important enabling technologies for big data. The course will use Hadoop and related tools for distributed data processing and analytics. Assessment will include homework, a group project, and class
Big data.ppt
This document provides an introduction to a course on big data and analytics. It outlines the following key points:
- The instructor and TA contact information and course homepage.
- The course will cover foundational data analytics, Hadoop/MapReduce programming, graph databases, and other big data topics.
- Big data is defined as data that is too large or complex for traditional database tools to process. It is characterized by high volume, velocity, and variety.
- Examples of big data sources and the exponential growth of data volumes are provided. Real-time analytics and fast data processing are also discussed.
Data Tactics dhs introduction to cloud technologies wtc
Data Tactics Corporation is an established company that provides cloud computing and data management solutions. They operate several secure clouds for government customers and have experience hosting large scale data and applications. The document provides an overview of cloud computing definitions, models, and capabilities relevant for intelligence community applications. It describes Data Tactics' cloud solutions, experience, and the types of features and services they can provide such as scalable data storage, analytics, and user access tools.
Intelligent Cloud Enablement
Data continues to grow exponentially – especially with the advent of social content. Approximately 70% of data is unstructured. This impacts on storage costs and management, Data Protection, and SLAs.
New deployment options such as cloud provide alternatives but how do you know what you should move to the cloud?
Navigating the World of User Data Management and Data Discovery
This document discusses navigating user data management and data discovery. It provides an overview of evaluating and selecting data management tools for a Hadoop data lake. Key criteria for evaluation include metadata curation, lineage and versioning, integration capabilities, and performance. Several vendors were evaluated, with Global ID, Attivio, and Waterline Data scoring highest based on the criteria. The presentation emphasizes selecting a limited number of tools based on business and user requirements.
Lecture1 BIG DATA and Types of data in details
What exactly is big data? The definition of big data is data that contains greater variety, arriving in increasing volumes and with more velocity. This is also known as the three Vs. Put simply, big data is larger, more complex data sets, especially from new data sources.
Don't Be Scared. Data Don't Bite. Introduction to Big Data.
This document provides an introduction to big data, including definitions, characteristics, examples, and challenges. It defines big data as high-volume, high-velocity, and high-variety information assets that require new processing methods. Examples discussed include the Sloan Digital Sky Survey, Human Genome Project, and Large Hadron Collider experiments. Challenges of big data include storage, networking, data integrity, and the need for new technologies to handle the volume, velocity and variety. Emerging solutions involve distributed storage, local computation near data, and frameworks like Hadoop and MapReduce.
Unit i introduction to grid computing
Grid computing is the sharing of computer resources from multiple administrative domains to achieve common goals. It allows for independent, inexpensive access to high-end computational capabilities. Grid computing federates resources like computers, data, software and other devices. It provides a single login for users to access distributed resources for tasks like drug discovery, climate modeling and other data-intensive applications. Current grids are used for distributed supercomputing, high-throughput computing, on-demand computing and other methods. Grids benefit scientists, engineers and other users who need to solve large problems or collaborate globally.
Data Domain-Driven Design
Data Mesh is the decentralized architecture where your units of architecture is a domain driven data set that is treated as a product owned by domains or teams that most intimately know that data either creating it or they are consuming it and re-sharing it and allocated specific roles that have the accountability and the responsibility to provide that data as a product abstracting away complexity into infrastructure layer a self-serve infrastructure layer so that create these products more much more easily.
Big data beyond the hype may 2014
The document discusses big data and analytics technologies. It provides an overview of big data, describes how major companies are leveraging big data across industries, and outlines the capabilities and benefits of technologies like Hadoop, YARN, and Spark for processing and analyzing large datasets. The agenda indicates it will also cover organizational evolution with big data and a case study.
Creating a Centralized Consumer Profile Management Service with WebSphere Dat...
In this presentation will talk about how one of the world's leading Financial Institutions, leveraged WebSphere DataPower to provide a set of centralized consumer profile management services. This central service would be leveraged by internal and external applications, and would align with enterprise marketing capabilities. The solution included a complex security model which included the following products: Tivoli Directory Server, Tivoli Access Manager and Tivoli Federated Identity Manager. We will describe how to build complex orchestrations in WebSphere DataPower, and also go through some of the performance tuning options we implemented to achieve a high degree of efficiency.
Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)
This document discusses how Globus services can facilitate collaboration and data sharing through automated workflows. It describes how Globus Auth enables authentication for shared access to endpoints. APIs and command line tools allow applications to programmatically manage permissions and transfer data. JupyterHub can be configured with Globus Auth to provide tokens for accessing remote Globus services within notebooks. This enables collaborative and distributed data analysis. The document also outlines how Globus services can support automated publication of datasets through search, identifiers, and metadata.
Best Practices Using RTI Connext DDS
View On-Demand http://ecast.opensystemsmedia.com/403
Repeat Success, Not Mistakes; Use DDS Best Practices to Design Your Complex Distributed Systems
RTI Connext DDS is a powerful tool that lets you efficiently build and integrate complex distributed systems like no other technology – if you use it right. Be aware of how to get the most out of DDS and how to avoid common pitfalls when developing your system. We've developed RTI Connext best practices over the course of hundreds of customer projects and many years. In this webinar, you will learn how to apply the best practices we have developed to use RTI Connext DDS in ways that will enable your system to scale effectively with optimal performance, while avoiding missteps that will cause poor performance, non-determinism and scalability problems.
Data lake-itweekend-sharif university-vahid amiry
دومین ITWeekend دانشگاه صنعتی شریف
وحید امیری
معماری Data Lake در محیط کلان داده
VahidAmiry.ir
DataStack.ir
Building your big data solution
This document provides an overview of WSO2 and their offerings for building big data solutions. WSO2 provides open source components for building complete cloud platforms and is recognized as a leader in application infrastructure by Gartner and Forrester. They discuss the challenges of big data due to the large volumes and speeds at which data is generated today. WSO2's products like BAM and CEP help customers address the full data lifecycle from collection, storage, processing to analytics for big data use cases. The document outlines an example big data architecture implemented using WSO2 components along with other technologies like Cassandra.
bigdataintro.pptx
Big data refers to large, complex datasets that are difficult to process using traditional database management tools. It is characterized by the 3 V's - volume, referring to the large scale of data; variety, referring to different data types; and velocity, referring to the speed at which data is generated and processed. Common sources of big data include social media, sensors, and scientific instruments. Hadoop and Spark are commonly used to process and analyze big data in distributed, parallel systems. Cloud computing provides on-demand access to computing resources and is well-suited for flexible big data applications.
How Data Drives Business at Choice Hotels
3 Things to Learn:
-How data is driving digital transformation to help businesses innovate rapidly
-How Choice Hotels (one of largest hoteliers) is using Cloudera Enterprise to gain meaningful insights that drive their business
-How Choice Hotels has transformed business through innovative use of Apache Hadoop, Cloudera Enterprise, and deployment in the cloud — from developing customer experiences to meeting IT compliance requirements
Kanthaka - High Volume CDR Analyzer
'Kanthaka' is an attempt to bring the benefits of Big Data technologies to telecom industry. The objective of the system is to analyze the CDRs (Caller Detail Record) and give results in near real time.
This is carried out as a final year project for my degree B. Sc. of Engineering (Hons) at University of Moratuwa as a team with 3 more colleagues, under the supervision of a senior lecturer and an industry expert.
The presentation exhibits the background, findings after literature review and proposing architecture of the system as for now. Any feed backs on improvements that can be made, are warmly welcome!
Similar to Rich feeds policy, the cloud, and CAP (20)
Data Tactics dhs introduction to cloud technologies wtc
Data Tactics dhs introduction to cloud technologies wtc
Navigating the World of User Data Management and Data Discovery
Navigating the World of User Data Management and Data Discovery
Don't Be Scared. Data Don't Bite. Introduction to Big Data.
Don't Be Scared. Data Don't Bite. Introduction to Big Data.
Creating a Centralized Consumer Profile Management Service with WebSphere Dat...
Creating a Centralized Consumer Profile Management Service with WebSphere Dat...
Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)
Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)
More from bdemchak
Cytoscape Network Visualization and Analysis
This document provides an outline and introduction for a workshop on biological networks using Cytoscape. It summarizes Barry Demchak's background working on Cytoscape. It then introduces other members of the Cytoscape team, provides an overview of Cytoscape usage statistics, and discusses why biological networks are important to study. The remainder of the document outlines topics to be covered, including biological network taxonomy, analytical approaches for networks, visualization techniques, and hands-on tutorials for working with Cytoscape.
The New CyREST: Economical Delivery of Complex, Reproducible Network Biology ...
The document describes the CyREST platform for delivering complex and reproducible network biology workflows. CyREST uses a microservices architecture and Kubernetes deployment to provide scalable and repeatable Cytoscape applications and services. Currently available services include diffusion heat propagation, NDEx network repository, and cxMate universal CX adapter. Future work includes more cyberinfrastructure services, boosting network layouts, and availability on high performance infrastructure.
Cytoscape Cyberinfrastructure
The Cytoscape Cyberinfrastructure (CI) is a web-based integration platform for processing biological networks.
No More Silos! Cytoscape CI Enables Interoperability
In Systems Biology, insights are often driven by a virtuous combination of collaboration, rich data sets, and robust computational and visualization algorithms. The application of Internet technologies in each of these areas has empowered researchers to discover and leverage prior work more quickly and effectively than ever before. At the same time, counterproductive technological and cultural silos have arisen, where resources are spent integrating incompatible data sources and reprising existing computations and visualizations. In this abstract, we describe how the Cytoscape Cyberinfrastructure (CI) can improve research productivity by enabling the integration of siloed collaboration, data, and computational systems while also providing a path to scalability and evolvability.
Systems Biology researchers increasingly create network analysis and visualization workflows using modern programming systems such as R, MATLAB, and iPython. These systems provide reusable components, common data formats, collaboration features, and user communities. However, by nature they also discourage collaboration between communities and component reuse across systems, thus creating silos. Web-based data sets create their own silos by delivering data in their own formats, different from all others.
The CI is a framework organized as a Service Oriented Architecture (SOA) where workflows and algorithms are each written in the language that best suits their function. Algorithms are packaged as Microservices that exchange network data in the common and extensible CX format, and which can execute on servers distributed across the Internet. For example, the NDEx service allows network data to be stored, retrieved, and shared between users and groups of users. Other services include an ID mapper (e.g., Gene Symbol to Entrez ID), heat dissipation, network layout, and Network Based Stratification, with others on the way.
We present a prototype of a CI-enabled web application that demonstrates how services can be organized into a workflow that fetches a network from an NDEx database, merges it with experiment data, visualizes it, and then writes it back to NDEx. The application is organized as a collection of user interface elements (called widgets) that call the CI services and are themselves reusable for building new Systems Biology applications.
By enabling the use of bioinformatic services regardless of the language in which they are written, CI applications encourage the creation and reuse of best-of-breed functionality while enabling the integration of siloed communities into a larger, more productive community. It incentivizes the constant sharing and iteration of information, thereby enabling more fluid, agile, reproducible, and opportunistic bioinformatic research.
Cytoscape CI Chapter 2
The Cytoscape Cyberinfrastructure extends Cytoscape and its community into web-connected services.The CI is a Service Oriented Architecture that supports network biology oriented computations that can be orchestrated into repeatable workflows.
Composable Chat Introduction
This document summarizes the objectives and approach of the Composable Chat Orientation project. The project aims to (1) study existing disparate chat systems and service-oriented architectures to make chat systems interoperable, and (2) manage complexity while improving features. The approach involves modeling the data and architecture of IRC, XMPP, and SIMP chat systems, identifying how they can be normalized and services identified to make them interoperable using a Rich Services pattern. Recommendations and deliverables including a paper and presentations will be provided.
Rich Services: Composable chat
This document discusses using a rich services approach to address challenges with complex chat systems. Rich services involve using a system-of-systems perspective combined with service-oriented architectures. This allows existing chat capabilities to be integrated as loosely coupled services. Case studies demonstrate how rich services can integrate heterogeneous systems at large scales for applications like ocean observatories. The development process focuses on incremental, concurrent development from logical to deployment models.
Ucsd tum workshop bd
State of the Art and Challenges of SOA Integration
Rich Services
Examples: Chat, Next-Generation Ocean Observatories, Rich Feeds
Deployment Strategies for Rich Services using ESB Technology
Summary and Outlook
Rich services to the Rescue
This document discusses Rich Services as an architectural pattern for managing complexity in systems of systems. Rich Services decompose a system horizontally and vertically into primary and crosscutting concerns. This provides flexible encapsulation of services and generates a model that can be leveraged for deployment. The document describes the RESCUE project, which uses Rich Services and an Enterprise Service Bus (ESB) to integrate multiple research data feeds and visualizations in a flexible, extensible manner. Future work plans to add additional services, feeds, and visualizations to further demonstrate the Rich Services approach.
Hicss 2012 presentation
This document proposes a policy-driven approach called PALMS (Personal Activity Location Measurement System) to enable collaboration and data sharing in a community studying human activity and health. PALMS uses policy injection and rich services to allow customization, meet technical requirements like security and scalability, and empower stakeholders to define behaviors. An emerging international PALMS community is collaborating using distributed data storage, algorithms, visualizations, and social features while policies ensure privacy, access control, and HIPAA compliance.
Policy 2012 presentation
The document discusses policy driven development for large scale systems. It describes the problem of requirements changing over time which can lead to buggy and obsolete code. The proposed solution is to use policy languages to allow flexible insertion of policies at runtime. This avoids hardcoding requirements and allows systems to adapt over time. Examples of using policy languages in the real-world PALMS system are provided to control access and perform auditing. The benefits of the policy approach include injecting control, filtering and adding new features via policy without changing code. This enables policy-driven composition of applications at runtime.
Rich feeds for rescue an integration story
This document provides an overview of policies for security and data sharing in the Physical Activity Location Measurement System (PALMS). PALMS aims to support data collection and analysis for exposure biology studies while being extensible, flexible, and HIPAA compliant. It discusses PALMS' logical architecture and policy composition, as well as the relationship between PALMS and caBIG (cancer Biomedical Informatics Grid) for security, identity management, and data sharing. Key components of PALMS include policy-driven access control, secure and customized studies, and collaboration.
Background scenario drivers and critical issues with a focus on technology ...
This document discusses technology trends driving changes in systems architecture. It notes rapid growth in computation, bandwidth, storage, and display capabilities (supply), creating demand from various stakeholders including corporations, individuals, and mobile users. This is making systems more complex, distributed, and community-oriented. It advocates for loosely coupled, service-oriented architectures and agile development processes to build scalable, interoperable, and manageable systems. Key roles discussed include web developers, utility providers, software providers, and virtual communities.
Rich feeds for rescue, palms cyberinfrastructure integration stories
This document provides an overview of policies for security and data sharing in the Physical Activity Location Measurement System (PALMS). PALMS aims to support data collection and analysis for exposure biology studies while maintaining security, extensibility, and HIPAA compliance. The document outlines PALMS objectives, organization, logical architecture, and how policy will be composed and executed. It also discusses how PALMS could integrate with existing frameworks like caBIG and GAARDS to leverage security standards and community resources.
Data quality and uncertainty visualization
This document discusses visualizing data quality and uncertainty in the context of the Wiisard project. Wiisard is a joint project between the VA and UC San Diego to aid in mass casualty triage using PDAs and tablet PCs. The problem is that if the wireless network becomes partitioned, the displayed patient information may become outdated, leading to poor medical resource deployment decisions. The document outlines research in visualizing uncertainty in data to help humans make better judgments. It provides examples of visualizing uncertainty in data using techniques like contour widths, transparency, and color hue. It concludes with research questions on determining relevant data quality metrics and developing visualizations suited to different users and contexts.
Web programming in clojure
The document discusses web programming in Clojure using the Compojure web framework. It covers using different REPL environments like Eclipse with Counterclockwise and Leiningen. It then provides a high-level overview of the Compojure framework, including its application structure, execution model, and components. Examples are given of defining routes and handling requests. Finally, it briefly mentions some Compojure addons and alternate Clojure web frameworks.
Structure and interpretation of computer programs modularity, objects, and ...
This document discusses object-oriented programming concepts in functional languages like Clojure. It presents an example of creating a simple "min object" in Clojure that encapsulates state using atoms. The document explains how Clojure implements objects using environments and binding of functions, allowing state to be retained despite immutability. It compares data encapsulation and scoping between Clojure, Java, and Pascal.
Requirements engineering from system goals to uml models to software specif...
This document provides an overview of requirements engineering using a goal-oriented approach. It discusses modeling system goals and deriving object models from goals to represent the conceptual design. The process involves building a preliminary goal model, deriving an initial object model, updating the goal model with new goals, and deriving an updated object model. The goal and object models can then be analyzed for obstacles, threats and conflicts. Future presentations will cover modeling agents and responsibilities, system operations, integrating different views, and various reasoning techniques.
Provinance in scientific workflows in e science
This document summarizes a survey of data provenance in e-science. It defines data provenance as information that helps determine the derivation history of a data product, starting from its original sources. The document outlines why data provenance is important, its key dimensions, examples of provenance techniques, existing provenance tools, and research frontiers. It also summarizes several systems that track provenance in scientific workflows and databases.
Introduction to es bs mule
An Enterprise Service Bus (ESB) addresses integration challenges by providing routing, transformation, and management of messages between disparate systems. Mule is an open-source ESB that uses connectors and transformations to integrate applications and services. Mule flows define the routing of messages between connectors using processing steps like transformers and routers. Mule provides flexibility but also complexity, as it aims to support many integration standards.
More from bdemchak (20)
The New CyREST: Economical Delivery of Complex, Reproducible Network Biology ...
The New CyREST: Economical Delivery of Complex, Reproducible Network Biology ...
No More Silos! Cytoscape CI Enables Interoperability
No More Silos! Cytoscape CI Enables Interoperability
Background scenario drivers and critical issues with a focus on technology ...
Background scenario drivers and critical issues with a focus on technology ...
Rich feeds for rescue, palms cyberinfrastructure integration stories
Rich feeds for rescue, palms cyberinfrastructure integration stories
Structure and interpretation of computer programs modularity, objects, and ...
Structure and interpretation of computer programs modularity, objects, and ...
Requirements engineering from system goals to uml models to software specif...
Requirements engineering from system goals to uml models to software specif...
Recently uploaded
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
👉👉 Click Here To Get More Info 👇👇
https://sumonreview.com/ai-fusion-buddy-review
AI Fusion Buddy Review: Key Features
✅Create Stunning AI App Suite Fully Powered By Google's Latest AI technology, Gemini
✅Use Gemini to Build high-converting Converting Sales Video Scripts, ad copies, Trending Articles, blogs, etc.100% unique!
✅Create Ultra-HD graphics with a single keyword or phrase that commands 10x eyeballs!
✅Fully automated AI articles bulk generation!
✅Auto-post or schedule stunning AI content across all your accounts at once—WordPress, Facebook, LinkedIn, Blogger, and more.
✅With one keyword or URL, generate complete websites, landing pages, and more…
✅Automatically create & sell AI content, graphics, websites, landing pages, & all that gets you paid non-stop 24*7.
✅Pre-built High-Converting 100+ website Templates and 2000+ graphic templates logos, banners, and thumbnail images in Trending Niches.
✅Say goodbye to wasting time logging into multiple Chat GPT & AI Apps once & for all!
✅Save over $5000 per year and kick out dependency on third parties completely!
✅Brand New App: Not available anywhere else!
✅ Beginner-friendly!
✅ZERO upfront cost or any extra expenses
✅Risk-Free: 30-Day Money-Back Guarantee!
✅Commercial License included!
See My Other Reviews Article:
(1) AI Genie Review: https://sumonreview.com/ai-genie-review
(2) SocioWave Review: https://sumonreview.com/sociowave-review
(3) AI Partner & Profit Review: https://sumonreview.com/ai-partner-profit-review
(4) AI Ebook Suite Review: https://sumonreview.com/ai-ebook-suite-review
#AIFusionBuddyReview,
#AIFusionBuddyFeatures,
#AIFusionBuddyPricing,
#AIFusionBuddyProsandCons,
#AIFusionBuddyTutorial,
#AIFusionBuddyUserExperience
#AIFusionBuddyforBeginners,
#AIFusionBuddyBenefits,
#AIFusionBuddyComparison,
#AIFusionBuddyInstallation,
#AIFusionBuddyRefundPolicy,
#AIFusionBuddyDemo,
#AIFusionBuddyMaintenanceFees,
#AIFusionBuddyNewbieFriendly,
#WhatIsAIFusionBuddy?,
#HowDoesAIFusionBuddyWorks
在线购买加拿大英属哥伦比亚大学毕业证本科学位证书原版一模一样
原版一模一样【微信：741003700 】【加拿大英属哥伦比亚大学毕业证本科学位证书】【微信：741003700 】学位证，留信认证（真实可查，永久存档）offer、雅思、外壳等材料/诚信可靠,可直接看成品样本，帮您解决无法毕业带来的各种难题！外壳，原版制作，诚信可靠，可直接看成品样本。行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备。十五年致力于帮助留学生解决难题，包您满意。
本公司拥有海外各大学样板无数，能完美还原海外各大学 Bachelor Diploma degree, Master Degree Diploma
1:1完美还原海外各大学毕业材料上的工艺：水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠。文字图案浮雕、激光镭射、紫外荧光、温感、复印防伪等防伪工艺。材料咨询办理、认证咨询办理请加学历顾问Q/微741003700
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
Artificia Intellicence and XPath Extension Functions
The purpose of this presentation is to provide an overview of how you can use AI from XSLT, XQuery, Schematron, or XML Refactoring operations, the potential benefits of using AI, and some of the challenges we face.
Graspan: A Big Data System for Big Code Analysis
We built a disk-based parallel graph system, Graspan, that uses a novel edge-pair centric computation model to compute dynamic transitive closures on very large program graphs.
We implement context-sensitive pointer/alias and dataflow analyses on Graspan. An evaluation of these analyses on large codebases such as Linux shows that their Graspan implementations scale to millions of lines of code and are much simpler than their original implementations.
These analyses were used to augment the existing checkers; these augmented checkers found 132 new NULL pointer bugs and 1308 unnecessary NULL tests in Linux 4.4.0-rc5, PostgreSQL 8.3.9, and Apache httpd 2.2.18.
- Accepted in ASPLOS ‘17, Xi’an, China.
- Featured in the tutorial, Systemized Program Analyses: A Big Data Perspective on Static Analysis Scalability, ASPLOS ‘17.
- Invited for presentation at SoCal PLS ‘16.
- Invited for poster presentation at PLDI SRC ‘16.
Automated software refactoring with OpenRewrite and Generative AI.pptx.pdf
https://2024.springio.net/sessions/automated-software-refactoring-with-openrewrite-and-generative-ai/
Codeigniter VS Cakephp Which is Better for Web Development.pdf
When deliberating between CodeIgniter vs CakePHP for web development, consider their respective strengths and your project requirements. CodeIgniter, known for its simplicity and speed, offers a lightweight framework ideal for rapid development of small to medium-sized projects. It's praised for its straightforward configuration and extensive documentation, making it beginner-friendly. Conversely, CakePHP provides a more structured approach with built-in features like scaffolding, authentication, and ORM. It suits larger projects requiring robust security and scalability. Ultimately, the choice hinges on your project's scale, complexity, and your team's familiarity with the frameworks.
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Dr. Jesús Barrasa, Head of Solutions Architecture for EMEA, Neo4j
Découvrez les dernières innovations de Neo4j, et notamment les dernières intégrations cloud et les améliorations produits qui font de Neo4j un choix essentiel pour les développeurs qui créent des applications avec des données interconnectées et de l’IA générative.
Atelier - Innover avec l’IA Générative et les graphes de connaissances
Atelier - Innover avec l’IA Générative et les graphes de connaissances
Allez au-delà du battage médiatique autour de l’IA et découvrez des techniques pratiques pour utiliser l’IA de manière responsable à travers les données de votre organisation. Explorez comment utiliser les graphes de connaissances pour augmenter la précision, la transparence et la capacité d’explication dans les systèmes d’IA générative. Vous partirez avec une expérience pratique combinant les relations entre les données et les LLM pour apporter du contexte spécifique à votre domaine et améliorer votre raisonnement.
Amenez votre ordinateur portable et nous vous guiderons sur la mise en place de votre propre pile d’IA générative, en vous fournissant des exemples pratiques et codés pour démarrer en quelques minutes.
What is Augmented Reality Image Tracking
Augmented Reality (AR) Image Tracking is a technology that enables AR applications to recognize and track images in the real world, overlaying digital content onto them. This enhances the user's interaction with their environment by providing additional information and interactive elements directly tied to physical images.
openEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain Security
LORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptx
WhatsApp offers simple, reliable, and private messaging and calling services for free worldwide. With end-to-end encryption, your personal messages and calls are secure, ensuring only you and the recipient can access them. Enjoy voice and video calls to stay connected with loved ones or colleagues. Express yourself using stickers, GIFs, or by sharing moments on Status. WhatsApp Business enables global customer outreach, facilitating sales growth and relationship building through showcasing products and services. Stay connected effortlessly with group chats for planning outings with friends or staying updated on family conversations.
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Dr. Jesús Barrasa, Head of Solutions Architecture for EMEA, Neo4j
Découvrez les dernières innovations de Neo4j, et notamment les dernières intégrations cloud et les améliorations produits qui font de Neo4j un choix essentiel pour les développeurs qui créent des applications avec des données interconnectées et de l’IA générative.
Empowering Growth with Best Software Development Company in Noida - Deuglo
Do you want Software for your Business? Visit Deuglo
Deuglo has top Software Developers in India. They are experts in software development and help design and create custom Software solutions.
Deuglo follows seven steps methods for delivering their services to their customers. They called it the Software development life cycle process (SDLC).
Requirement — Collecting the Requirements is the first Phase in the SSLC process.
Feasibility Study — after completing the requirement process they move to the design phase.
Design — in this phase, they start designing the software.
Coding — when designing is completed, the developers start coding for the software.
Testing — in this phase when the coding of the software is done the testing team will start testing.
Installation — after completion of testing, the application opens to the live server and launches!
Maintenance — after completing the software development, customers start using the software.
APIs for Browser Automation (MoT Meetup 2024)
APIs for Browser Automation:
Selenium, Cypress, Puppeteer, and Playwright. Ministry of Testing Athens. Meetup on the Beach. 30 May 2024.
Transform Your Communication with Cloud-Based IVR Solutions
Discover the power of Cloud-Based IVR Solutions to streamline communication processes. Embrace scalability and cost-efficiency while enhancing customer experiences with features like automated call routing and voice recognition. Accessible from anywhere, these solutions integrate seamlessly with existing systems, providing real-time analytics for continuous improvement. Revolutionize your communication strategy today with Cloud-Based IVR Solutions. Learn more at: https://thesmspoint.com/channel/cloud-telephony
Quarkus Hidden and Forbidden Extensions
Quarkus has a vast extension ecosystem and is known for its subsonic and subatomic feature set. Some of these features are not as well known, and some extensions are less talked about, but that does not make them less interesting - quite the opposite.
Come join this talk to see some tips and tricks for using Quarkus and some of the lesser known features, extensions and development techniques.
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Discover the essential features to incorporate in your Winzo clone app to boost business growth, enhance user engagement, and drive revenue. Learn how to create a compelling gaming experience that stands out in the competitive market.
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
This session covers GraalVM & Spring Boot, Spring AOT, performance optimizations and using libraries
Essentials of Automations: The Art of Triggers and Actions in FME
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
Recently uploaded (20)
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
Artificia Intellicence and XPath Extension Functions
Artificia Intellicence and XPath Extension Functions
Automated software refactoring with OpenRewrite and Generative AI.pptx.pdf
Automated software refactoring with OpenRewrite and Generative AI.pptx.pdf
Codeigniter VS Cakephp Which is Better for Web Development.pdf
Codeigniter VS Cakephp Which is Better for Web Development.pdf
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Atelier - Innover avec l’IA Générative et les graphes de connaissances
Atelier - Innover avec l’IA Générative et les graphes de connaissances
openEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain Security
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Empowering Growth with Best Software Development Company in Noida - Deuglo
Empowering Growth with Best Software Development Company in Noida - Deuglo
Transform Your Communication with Cloud-Based IVR Solutions
Transform Your Communication with Cloud-Based IVR Solutions
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Rich feeds policy, the cloud, and CAP
- 1. Rich Feeds Policy, the Cloud, and CAP Barry Demchak California Institute for Telecommunications and Information Technology (Calit2) June 18, 2008
- 2. Overview • Problems (RESCUE) – Research data feeds accessible over time – Needs for particular feeds cannot be predicted – Future restrictions and constraints can’t be anticipated • Objectives (RESCUE) – Capture Research Data Feeds – Expose Datasets – Remain Flexible and Extensible
- 3. User View and Status • Today’s Data Feeds – Traffic – Trackable Objects – UCSD Police Cameras – CalIT2 Cameras – Situation Aware • Today’s Visualizations – Google Maps
- 4. Current Goals • Empower Additional Providers • Enable Selective Information Dissemination • Scale to Dynamic Need
- 5. Current Goals • Empower Additional Providers – Allow Owners to – Define dataset – Define provider and privileges – Define consumer and privileges – Allow Providers to – Contribute data – Define consumer and privileges • Enable Selective Information Dissemination • Scale to Dynamic Need
- 6. Current Goals • Empower Additional Providers • Enable Selective Information Dissemination – Allow Consumers to – Fetch data – Restrict data based on data or provider attributes (e.g., reputation) • Scale to Dynamic Need
- 7. Current Goals • Empower Additional Providers • Enable Selective Information Dissemination • Scale to Dynamic Need – Data capacity – Incoming data bandwidth – Query bandwidth Amazon Web Services (AWS) S3 – Simple Storage Service EC2 – Elastic Compute Cloud
- 9. Logical Architecture w/Policy • Policies – the key to empowerment • Owner – Who can store data, who can read data • Producer – Who can read data • Consumer – Which providers to view
- 10. Physical Deployment • Currently – Windows Server 2003 – WinXP VM w/Mule, MySQL • Cloud – Amazon Servers – Linux VM w/Mule, MySQL,Apache/Tomcat RESCUE Virtual Machine Traffic Server Tracked Object Server Browser, Javascript, Google Maps Internet Physical Machine Other VMs Non- RESCUE clients
- 11. Current Goals • Empower Additional Providers • Enable Selective Information Dissemination • Scale to Dynamic Need • Common Alert Protocol (CAP) – Standard disaster alert format based on XML – Currently used as interchange format • CAP Server – Always on – Quickly scalable – Provider-driven – Opportunity for consumer-grade viewers (e.g., Google Maps, Twitter, SMS, etc)
Editor's Notes
- <number> Thank the host!