This document discusses web services and provides examples of common web service standards and implementations. It defines web services as applications that interact dynamically over the web using open standards like XML, SOAP and WSDL. It then summarizes key web service specifications including SOAP, WSDL, REST, and OGC standards like WFS, WCS and WMS. Examples are given of implementing and using these standards to access real-time environmental data.
Processing massive amount of data with Map Reduce using Apache Hadoop - Indi...IndicThreads
Session presented at the 2nd IndicThreads.com Conference on Cloud Computing held in Pune, India on 3-4 June 2011.
http://CloudComputing.IndicThreads.com
Abstract: The processing of massive amount of data gives great insights into analysis for business. Many primary algorithms run over the data and gives information which can be used for business benefits and scientific research. Extraction and processing of large amount of data has become a primary concern in terms of time, processing power and cost. Map Reduce algorithm promises to address the above mentioned concerns. It makes computing of large sets of data considerably easy and flexible. The algorithm offers high scalability across many computing nodes. This session will introduce Map Reduce algorithm, followed by few variations of the same and also hands on example in Map Reduce using Apache Hadoop.
Speaker: Allahbaksh Asadullah is a Product Technology Lead from Infosys Labs, Bangalore. He has over 5 years of experience in software industry in various technologies. He has extensively worked on GWT, Eclipse Plugin development, Lucene, Solr, No SQL databases etc. He speaks at the developer events like ACM Compute, Indic Threads and Dev Camps.
Processing massive amount of data with Map Reduce using Apache Hadoop - Indi...IndicThreads
Session presented at the 2nd IndicThreads.com Conference on Cloud Computing held in Pune, India on 3-4 June 2011.
http://CloudComputing.IndicThreads.com
Abstract: The processing of massive amount of data gives great insights into analysis for business. Many primary algorithms run over the data and gives information which can be used for business benefits and scientific research. Extraction and processing of large amount of data has become a primary concern in terms of time, processing power and cost. Map Reduce algorithm promises to address the above mentioned concerns. It makes computing of large sets of data considerably easy and flexible. The algorithm offers high scalability across many computing nodes. This session will introduce Map Reduce algorithm, followed by few variations of the same and also hands on example in Map Reduce using Apache Hadoop.
Speaker: Allahbaksh Asadullah is a Product Technology Lead from Infosys Labs, Bangalore. He has over 5 years of experience in software industry in various technologies. He has extensively worked on GWT, Eclipse Plugin development, Lucene, Solr, No SQL databases etc. He speaks at the developer events like ACM Compute, Indic Threads and Dev Camps.
Slides of the workshop conducted in Model Engineering College, Ernakulam, and Sree Narayana Gurukulam College, Kadayiruppu
Kerala, India in December 2010
This was the first session about Hadoop and MapReduce. It introduces what Hadoop is and its main components. It also covers the how to program your first MapReduce task and how to run it on pseudo distributed Hadoop installation.
This session was given in Arabic and i may provide a video for the session soon.
The web has dramatically evolved over the last 20+ years, yet HTTP - the workhorse of the Web - has not. Web developers have worked around HTTP's limitations, but:
--> Performance still falls short of full bandwidth utilization
--> Web design and maintenance are more complex
--> Resource consumption increases for client and server
--> Cacheability of resources suffers
HTTP/2 attempts to solve many of the shortcomings and inflexibilities of HTTP/1.1
In this session you will learn:
Flume Overview
Flume Agent
Sinks
Flume Installation
What is Netcat & Telnet?
For more information, visit: https://www.mindsmapped.com/courses/big-data-hadoop/hadoop-developer-training-a-step-by-step-tutorial/
The slides provide a major overview on SOAP protocol, and demonstrates a working example that uses SOAP for RPC. It uses WCF/visual studio and Apache Axis for the implementation.
The Internet of Things if growing, but how can you build your own connected objects?
Together with MQTT, CoAP is one of the popular IoT protocols. It provides answers to the typical IoT constraints: it is bandwidth efficient and fits in constrained embedded environment while providing friendly and discoverable RESTful API.
This tutorial aims at giving you a hands-on experience with CoAP by showing you the power and simplicity of the Eclipse Californium library for developing real world IoT application.
Agenda:
- Introduction to CoAP
- Live discovery of connected CoAP objects using the Copper plugin for Firefox
- Presentation of more advanced CoAP topics (proxy, resource directory, device management with LWM2M)
- Presentation of Eclipse Californium, a CoAP library for Java
- Exercise: complete the provided Java code to create your own Internet of Things... thing!
Slides of the workshop conducted in Model Engineering College, Ernakulam, and Sree Narayana Gurukulam College, Kadayiruppu
Kerala, India in December 2010
This was the first session about Hadoop and MapReduce. It introduces what Hadoop is and its main components. It also covers the how to program your first MapReduce task and how to run it on pseudo distributed Hadoop installation.
This session was given in Arabic and i may provide a video for the session soon.
The web has dramatically evolved over the last 20+ years, yet HTTP - the workhorse of the Web - has not. Web developers have worked around HTTP's limitations, but:
--> Performance still falls short of full bandwidth utilization
--> Web design and maintenance are more complex
--> Resource consumption increases for client and server
--> Cacheability of resources suffers
HTTP/2 attempts to solve many of the shortcomings and inflexibilities of HTTP/1.1
In this session you will learn:
Flume Overview
Flume Agent
Sinks
Flume Installation
What is Netcat & Telnet?
For more information, visit: https://www.mindsmapped.com/courses/big-data-hadoop/hadoop-developer-training-a-step-by-step-tutorial/
The slides provide a major overview on SOAP protocol, and demonstrates a working example that uses SOAP for RPC. It uses WCF/visual studio and Apache Axis for the implementation.
The Internet of Things if growing, but how can you build your own connected objects?
Together with MQTT, CoAP is one of the popular IoT protocols. It provides answers to the typical IoT constraints: it is bandwidth efficient and fits in constrained embedded environment while providing friendly and discoverable RESTful API.
This tutorial aims at giving you a hands-on experience with CoAP by showing you the power and simplicity of the Eclipse Californium library for developing real world IoT application.
Agenda:
- Introduction to CoAP
- Live discovery of connected CoAP objects using the Copper plugin for Firefox
- Presentation of more advanced CoAP topics (proxy, resource directory, device management with LWM2M)
- Presentation of Eclipse Californium, a CoAP library for Java
- Exercise: complete the provided Java code to create your own Internet of Things... thing!
Improving profitability for small businessBen Wann
In this comprehensive presentation, we will explore strategies and practical tips for enhancing profitability in small businesses. Tailored to meet the unique challenges faced by small enterprises, this session covers various aspects that directly impact the bottom line. Attendees will learn how to optimize operational efficiency, manage expenses, and increase revenue through innovative marketing and customer engagement techniques.
Implicitly or explicitly all competing businesses employ a strategy to select a mix
of marketing resources. Formulating such competitive strategies fundamentally
involves recognizing relationships between elements of the marketing mix (e.g.,
price and product quality), as well as assessing competitive and market conditions
(i.e., industry structure in the language of economics).
Kseniya Leshchenko: Shared development support service model as the way to ma...Lviv Startup Club
Kseniya Leshchenko: Shared development support service model as the way to make small projects with small budgets profitable for the company (UA)
Kyiv PMDay 2024 Summer
Website – www.pmday.org
Youtube – https://www.youtube.com/startuplviv
FB – https://www.facebook.com/pmdayconference
RMD24 | Debunking the non-endemic revenue myth Marvin Vacquier Droop | First ...BBPMedia1
Marvin neemt je in deze presentatie mee in de voordelen van non-endemic advertising op retail media netwerken. Hij brengt ook de uitdagingen in beeld die de markt op dit moment heeft op het gebied van retail media voor niet-leveranciers.
Retail media wordt gezien als het nieuwe advertising-medium en ook mediabureaus richten massaal retail media-afdelingen op. Merken die niet in de betreffende winkel liggen staan ook nog niet in de rij om op de retail media netwerken te adverteren. Marvin belicht de uitdagingen die er zijn om echt aansluiting te vinden op die markt van non-endemic advertising.
Discover the innovative and creative projects that highlight my journey throu...dylandmeas
Discover the innovative and creative projects that highlight my journey through Full Sail University. Below, you’ll find a collection of my work showcasing my skills and expertise in digital marketing, event planning, and media production.
The world of search engine optimization (SEO) is buzzing with discussions after Google confirmed that around 2,500 leaked internal documents related to its Search feature are indeed authentic. The revelation has sparked significant concerns within the SEO community. The leaked documents were initially reported by SEO experts Rand Fishkin and Mike King, igniting widespread analysis and discourse. For More Info:- https://news.arihantwebtech.com/search-disrupted-googles-leaked-documents-rock-the-seo-world/
Falcon stands out as a top-tier P2P Invoice Discounting platform in India, bridging esteemed blue-chip companies and eager investors. Our goal is to transform the investment landscape in India by establishing a comprehensive destination for borrowers and investors with diverse profiles and needs, all while minimizing risk. What sets Falcon apart is the elimination of intermediaries such as commercial banks and depository institutions, allowing investors to enjoy higher yields.
3.0 Project 2_ Developing My Brand Identity Kit.pptxtanyjahb
A personal brand exploration presentation summarizes an individual's unique qualities and goals, covering strengths, values, passions, and target audience. It helps individuals understand what makes them stand out, their desired image, and how they aim to achieve it.
LA HUG - Video Testimonials with Chynna Morgan - June 2024Lital Barkan
Have you ever heard that user-generated content or video testimonials can take your brand to the next level? We will explore how you can effectively use video testimonials to leverage and boost your sales, content strategy, and increase your CRM data.🤯
We will dig deeper into:
1. How to capture video testimonials that convert from your audience 🎥
2. How to leverage your testimonials to boost your sales 💲
3. How you can capture more CRM data to understand your audience better through video testimonials. 📊
What is the TDS Return Filing Due Date for FY 2024-25.pdfseoforlegalpillers
It is crucial for the taxpayers to understand about the TDS Return Filing Due Date, so that they can fulfill your TDS obligations efficiently. Taxpayers can avoid penalties by sticking to the deadlines and by accurate filing of TDS. Timely filing of TDS will make sure about the availability of tax credits. You can also seek the professional guidance of experts like Legal Pillers for timely filing of the TDS Return.
Affordable Stationery Printing Services in Jaipur | Navpack n PrintNavpack & Print
Looking for professional printing services in Jaipur? Navpack n Print offers high-quality and affordable stationery printing for all your business needs. Stand out with custom stationery designs and fast turnaround times. Contact us today for a quote!
RMD24 | Retail media: hoe zet je dit in als je geen AH of Unilever bent? Heid...BBPMedia1
Grote partijen zijn al een tijdje onderweg met retail media. Ondertussen worden in dit domein ook de kansen zichtbaar voor andere spelers in de markt. Maar met die kansen ontstaan ook vragen: Zelf retail media worden of erop adverteren? In welke fase van de funnel past het en hoe integreer je het in een mediaplan? Wat is nu precies het verschil met marketplaces en Programmatic ads? In dit half uur beslechten we de dilemma's en krijg je antwoorden op wanneer het voor jou tijd is om de volgende stap te zetten.
Business Valuation Principles for EntrepreneursBen Wann
This insightful presentation is designed to equip entrepreneurs with the essential knowledge and tools needed to accurately value their businesses. Understanding business valuation is crucial for making informed decisions, whether you're seeking investment, planning to sell, or simply want to gauge your company's worth.
[Note: This is a partial preview. To download this presentation, visit:
https://www.oeconsulting.com.sg/training-presentations]
Sustainability has become an increasingly critical topic as the world recognizes the need to protect our planet and its resources for future generations. Sustainability means meeting our current needs without compromising the ability of future generations to meet theirs. It involves long-term planning and consideration of the consequences of our actions. The goal is to create strategies that ensure the long-term viability of People, Planet, and Profit.
Leading companies such as Nike, Toyota, and Siemens are prioritizing sustainable innovation in their business models, setting an example for others to follow. In this Sustainability training presentation, you will learn key concepts, principles, and practices of sustainability applicable across industries. This training aims to create awareness and educate employees, senior executives, consultants, and other key stakeholders, including investors, policymakers, and supply chain partners, on the importance and implementation of sustainability.
LEARNING OBJECTIVES
1. Develop a comprehensive understanding of the fundamental principles and concepts that form the foundation of sustainability within corporate environments.
2. Explore the sustainability implementation model, focusing on effective measures and reporting strategies to track and communicate sustainability efforts.
3. Identify and define best practices and critical success factors essential for achieving sustainability goals within organizations.
CONTENTS
1. Introduction and Key Concepts of Sustainability
2. Principles and Practices of Sustainability
3. Measures and Reporting in Sustainability
4. Sustainability Implementation & Best Practices
To download the complete presentation, visit: https://www.oeconsulting.com.sg/training-presentations
1. What is a Web Service
or some relevant web services
(for) Developing Applications for
Real-time Environmental Data
Bryan Lawrence
Head, NCAS British Atmospheric Data Centre
P.I. The NERC DataGrid.
2. Outline
Question: What is a Web Service?
Answer: Acronym Soup!
Fundamentals (XML+)
• SOAP and REST
• WSDL
OGC Web Services
• WFS, WCS, WFS
UNIDATA
• LDM
NDG Web Services
British Atmospheric Data Centre
http://badc.nerc.ac.uk
3. What is a web service?
Googling gives:
• Answers.Com: Web-based applications that dynamically interact
with other Web applications using open standards that include XML,
UDDI and SOAP.
• (Yuck: UDDI?)
• emergingtech.ittoolbox.com:
– A Service-Oriented Architecture (SOA) is a collection of services
or software agents that communicate freely with each other.
– Sub-topic definition: Web Services protocols and standards are
the technology that promote the sharing and distribution of
information and business data. A protocol is a standard method
for transmitting data through a network. There are many
different specialized protocols to accommodate the many kinds
of data that might be transmitted.
British Atmospheric Data Centre
http://badc.nerc.ac.uk
4. SOAP
Simple Object Access Protocol
Horrible looking XML specification, but
lots of SOAP pacakges available which
are (generally easy to use), eg:
from SOAPpy import SOAPproxy
url=http://services.xmethods.net:80/soap/
servlet/rpcrouter’
n=‘urn:xmethods-Temperature’
server=SOAPProxy(url,namespace=n)
temperature=server.getTemp(‘27502’)
Returns the temperature at U.S. zipcode 27502 (from
Dive Into Python, Mark Pilgrim)
(One knew a priori that a method named getTEmp would return a float given an argument of a zip
code, provided one used the right namespace – How?)
British Atmospheric Data Centre
http://badc.nerc.ac.uk
5. WSDL :Web Services Description Language
>>>from SOAPpy import WSDL
>>>Server=WDSL.Proxy(‘path/to/WSDL’)
>>>server.method.keys()
[u’doGoogleSearch’,u’doGetCachedPage’ …]
>>>callInfo=server.methods[‘doGoogleSearch’]
>>>for arg in callInfo.inparams:
S
. . . print arg.name, arg.type IE
RT
PE
key (u’http://www.w3.org/2001/XMLSchema’,u’string’)
. . .
RO
T P for a service, and
AC parameters).
Define expected messages
their (input orR
T output
A BS will group together a number of
An interface
messages (operations)
Bind an Interface via a definition to
a specific transport (e.g. HTTP) and The network location where the service is
messaging (e.g. SOAP) protocol implemented , e.g. http://localhost:8080
British Atmospheric Data Centre
http://badc.nerc.ac.uk
6. REST’ful Web Services
• REST (representational state transfer) is an
approach for getting information content
from a Web site by reading a designated
(ok, you need a URI) Web page that
contains an XML (Extensible Markup
Language) file that describes and includes
the desired content.
• That’s it! You use HTTP (get,put,…) to a
URI, with XML as the payload …
British Atmospheric Data Centre
http://badc.nerc.ac.uk
7. Web Services the confusion:
(Tim Ewald): “Today, I see three camps:
1) It's all about SOAP messages …,
2) It's all about WSDL,
3) It's all about XML/HTTP.
Microsoft is definitely in the first camp, focusing on doing things
with SOAP whether or not they are ultimately represented
as XML or a binary data rep.
IBM and Iona are in the second camp, focusing on describing in
WSDL, whether or not they are ultimately represented as
SOAP or a binary protocol.
Lots of developers and some big companies like Amazon are in
the XML/HTTP camp, focusing on getting data from one
place to another in a way they can consume it.
[Tim Ewald: http://pluralsight.com/blogs/tewald/archive/2004/10/18/2875.aspx]
British Atmospheric Data Centre
http://badc.nerc.ac.uk
8. Standards
• Dimensions of interoperability for
earth science data dis
co
very
ISO / OGC
access
e
us
British Atmospheric Data Centre
http://badc.nerc.ac.uk
9. OGC web services
• Data access services, e.g.:
– Live Access Server, NDG DataExtractor
– GADS
– DODS/OPeNDAP
– OGC web services
• OGC web services
– Web Map Service
– Web Feature Service
– Web Coverage Service
[Open Geospatial Consortium (OGC): International consortium of nearly 300
companies, government agencies and universities participating in a
consensus process to develop publicly available geoprocessing
specifications]
British Atmospheric Data Centre
http://badc.nerc.ac.uk
10. OGC web services
• Web Map Service (WMS)
• Three operations: eg, GLOBE program WMS server
– GetCapabilities (required) GetCapabilities:
http://viz.globe.gov/viz-bin/wmt.cgi
– GetMap (required) ?REQUEST=GetCapabilities&SERVICE=WMS
– GetFeatureInfo (optional)
• Typically support HTTP GET binding, SOAP
being considered
• GetCapabilities request
– <Service> metadata for service as a whole (ISO 19115 compliant)
– <Capability> metadata describes request bindings, exceptions, and:
– <Layer>s: title, name, SRS, bounding box, keywords, style; nested
layers inherit from parent
British Atmospheric Data Centre
http://badc.nerc.ac.uk
11. OGC web services
• e.g.: ERA40 re-analysis surface air temperature, 2001-04-27
– deegree open-source WMS modified with netCDF connector
Overlaid with rainfall from
globe.digitalearth.govData Centre
British Atmospheric
WMS server
http://badc.nerc.ac.uk
12. OGC web services
Web Coverage Service (WCS) – cf DODS/OPeNDAP/GADS
A geographic coverage is raw (typically gridded) data
WCS similar to WMS, but provides data, not images
(cf DODS/OPeNDAP, GADS)
Operations:
• GetCapabilities
• DescribeCoverage
• GetCoverage
Coverages supplied in well-known-binary format:
• GeoTIFF, HDF-EOS, DTED, NITF, GML, netCDF???
British Atmospheric Data Centre
http://badc.nerc.ac.uk
13. OGC web services
Web Feature Service (WFS)
Provides access to geographic feature instances
Features are defined by application schema compliant with the Geography
Markup Language (GML)
Operations:
• DescribeFeatureType (required): returns XML schema for the feature
• GetFeature (required): allows retrieval of features in XML compliant to the feature
schema. Selected features may be constrained through Xpath expressions
• Transaction and LockFeature (optional): for inserting, updating and deleting
feature instances
• GetCapabilities: describes capabilities of WFS (as for WMS)
Typically used for vector data (eg cruise tracks), but can be any
application schema
British Atmospheric Data Centre
http://badc.nerc.ac.uk
14. OGC web services
• FOSS implementations
– server:
• deegree
• geoserver
• mapserver
– client:
• quickWMS
• www.wmsviewer.com
– List maintained on NDG wiki at
http://ndg.nerc.ac.uk/kwiki/ndg/index.cgi?
OtherProjects
British Atmospheric Data Centre
http://badc.nerc.ac.uk
15. OGC web services
Summary
– Web Map Service (WMS, ISO 19128)
• GetCapabilities
• GetMap
– Web Feature Service (WFS)
• GetCapabilities
• DescribeFeatureType
• GetFeature
• Transaction, LockFeature
– Web Coverage Service (WCS)
• GetCapabilities
• DescribeCoverage
• GetCoverage
– Catalog Service for the Web (CSW) – very new!
– REST, not SOAP (currently)
British Atmospheric Data Centre
http://badc.nerc.ac.uk
16. NDG: CSML
Climate Science Modelling Language
(CSML, a GML application schema)
http://ndg.nerc.ac.uk/csml
– Defines seven features of interest!
CSML feature type Description Examples
TrajectoryFeature Discrete path in time and space of a ship’s cruise track, aircraft’s flight path
platform or instrument.
PointFeature Single point measurement raingauge measurement
ProfileFeature Single ‘profile’ of some parameter along a wind sounding, XBT, CTD, radiosonde
directed line in space.
GridFeature Single time-snapshot of a gridded field gridded analysis field
PointSeriesFeature Series of single datum measurements tidegauge, rainfall timeseries
ProfileSeriesFeature Series of profile-type measurements vertical or scanning radar, shipborne ADCP,
thermistor chain timeseries
GridSeriesFeature Timeseries of gridded parameter fields. numerical weather prediction model, ocean
general circulation model
British Atmospheric Data Centre
http://badc.nerc.ac.uk
17. CSML
ProfileSeriesFeature
ProfileFeature
GridFeature
British Atmospheric Data Centre
http://badc.nerc.ac.uk
18. NERC DataGrid; web services coming soon
Discovery Service (here now)
Data Extractor (next week)
Vocab Service (next month)
Attribute Authority (next couple of months)
Data Provider (next couple of months)
DeliveryBroker (later this year)
Browse Service (a long way off)
All Open Source, documented, clear APIs
British Atmospheric Data Centre
http://badc.nerc.ac.uk
21. UNIDATA
Unidata (www.unidata.ucar.edu) provide data feeds
using their Local Data Manager (LDM) technology
to push data around the U.S. (and further afield) in
the Internet Data Distribution system (IDD).
• Users to specify in advance which data should be
delivered to their local systems. The IDD then
delivers the data as soon as they are available.
• The IDD is a data subscription service,
implemented in such a way that delivery (and
often processing) are triggered by external events.
• WMO considering the use of LDM for some data
movement.
British Atmospheric Data Centre
http://badc.nerc.ac.uk
22. Unidata: LDM
LDM Delivery
•Scalable
•Hierarchical fan out
•Relying on relay sites with
appropriate resources
•Flexible
•New data products can be
introduced from any node in
the system
British Atmospheric Data Centre
http://badc.nerc.ac.uk
24. Summary
• Web services not just about SOAP and WSDL …
• We should use
• web service standards,
• WS mechanisms optimised for environmental
applications
• Currently need to extend GML (CSML)
• Options for data push if UK community want it
based on LDM (or similar) technologies …
• NDG can (and is) building a range of
environmental web services
British Atmospheric Data Centre
http://badc.nerc.ac.uk