SlideShare a Scribd company logo

ScienceBase Architecture - Access Methods

•
•
S
Sky Bristol

This is a rough diagram of the basic elements of the ScienceBase architecture. www.sciencebase.gov

1 of 1
Download to read offline
Data File Inputs GeoDatabase Service Definition ShapeFile NetCDF GeoTIFF Image Any Other Files Primary Output Interfaces HTML "landing pages" with schema.org sbJSON ISO19139 ISO19139 ISO19139 ATOM MODS CSV CSDGM Metadata (Item) Inputs CSDGM XML MODS XML XLS/CSV Process Web Accessible Folders CSW Harvest ArcGIS REST Harvest sbJSON Custom ETL ScienceBase Tech Stack (major components) GeoServer GeoTools ArcGIS Server THREDDS Java Image Library Search Index (ElasticSearch) Complex Geometry Store (PostGIS) MetaBase ScienceBase Item Store (MongoDB) Java Core Plugin Inbound API Service Layer Java Core Plugin OGC-CSW OAI-PMH OpenSearch WMS, WFS, WCS, KML ArcGIS REST OpenDAP Outbound API sbREST Compressed Download MetadataServicesDataServices REST Image Delivery Downstream Uses Python and R methods JQuery and Similar Front- ends Drupal Modules ArcGIS Desktop CSW Search OAI-PMH Harvest USGS ScienceBase Overview of Major Components

Recommended

ScienceBase and CINERGI - thoughts
ScienceBase and CINERGI - thoughtsScienceBase and CINERGI - thoughts
ScienceBase and CINERGI - thoughtsSky Bristol
 
(ARC309) Building and Scaling Amazon Cloud Drive to Millions of Users | AWS r...
(ARC309) Building and Scaling Amazon Cloud Drive to Millions of Users | AWS r...(ARC309) Building and Scaling Amazon Cloud Drive to Millions of Users | AWS r...
(ARC309) Building and Scaling Amazon Cloud Drive to Millions of Users | AWS r...Amazon Web Services
 
Red Hat Summit 2017 - LT107508 - Better Managing your Red Hat footprint with ...
Red Hat Summit 2017 - LT107508 - Better Managing your Red Hat footprint with ...Red Hat Summit 2017 - LT107508 - Better Managing your Red Hat footprint with ...
Red Hat Summit 2017 - LT107508 - Better Managing your Red Hat footprint with ...Miguel Pérez Colino
 
Presto Summit 2018 - 08 - FINRA
Presto Summit 2018 - 08 - FINRAPresto Summit 2018 - 08 - FINRA
Presto Summit 2018 - 08 - FINRAkbajda
 
Hello cloud 3
Hello cloud 3Hello cloud 3
Hello cloud 3Gireesh Kumar
 
Bleeding Edge Databases
Bleeding Edge DatabasesBleeding Edge Databases
Bleeding Edge DatabasesLynn Langit
 
Etl with talend (data integeration)
Etl with talend (data integeration)Etl with talend (data integeration)
Etl with talend (data integeration)Pooja Mishra
 
Grafana
GrafanaGrafana
GrafanaNoelMc Grath
 

Recommended

ScienceBase and CINERGI - thoughts
ScienceBase and CINERGI - thoughtsScienceBase and CINERGI - thoughts
ScienceBase and CINERGI - thoughtsSky Bristol
 
(ARC309) Building and Scaling Amazon Cloud Drive to Millions of Users | AWS r...
(ARC309) Building and Scaling Amazon Cloud Drive to Millions of Users | AWS r...(ARC309) Building and Scaling Amazon Cloud Drive to Millions of Users | AWS r...
(ARC309) Building and Scaling Amazon Cloud Drive to Millions of Users | AWS r...Amazon Web Services
 
Red Hat Summit 2017 - LT107508 - Better Managing your Red Hat footprint with ...
Red Hat Summit 2017 - LT107508 - Better Managing your Red Hat footprint with ...Red Hat Summit 2017 - LT107508 - Better Managing your Red Hat footprint with ...
Red Hat Summit 2017 - LT107508 - Better Managing your Red Hat footprint with ...Miguel Pérez Colino
 
Presto Summit 2018 - 08 - FINRA
Presto Summit 2018 - 08 - FINRAPresto Summit 2018 - 08 - FINRA
Presto Summit 2018 - 08 - FINRAkbajda
 
Hello cloud 3
Hello cloud 3Hello cloud 3
Hello cloud 3Gireesh Kumar
 
Bleeding Edge Databases
Bleeding Edge DatabasesBleeding Edge Databases
Bleeding Edge DatabasesLynn Langit
 
Etl with talend (data integeration)
Etl with talend (data integeration)Etl with talend (data integeration)
Etl with talend (data integeration)Pooja Mishra
 
Grafana
GrafanaGrafana
GrafanaNoelMc Grath
 
Kafka Streams - From the Ground Up to the Cloud
Kafka Streams - From the Ground Up to the CloudKafka Streams - From the Ground Up to the Cloud
Kafka Streams - From the Ground Up to the CloudVMware Tanzu
 
Azure Data Factory Data Flow Limited Preview for January 2019
Azure Data Factory Data Flow Limited Preview for January 2019Azure Data Factory Data Flow Limited Preview for January 2019
Azure Data Factory Data Flow Limited Preview for January 2019Mark Kromer
 
eXtensible Catalog - afternoon session - Tilburg
eXtensible Catalog - afternoon session - TilburgeXtensible Catalog - afternoon session - Tilburg
eXtensible Catalog - afternoon session - TilburgUniversity of Rochester
 
Hello cloud 2
Hello cloud 2Hello cloud 2
Hello cloud 2Gireesh Kumar
 
Druid + Superset (資料的快速通道)
Druid + Superset (資料的快速通道)Druid + Superset (資料的快速通道)
Druid + Superset (資料的快速通道)二文 郭
 
k8-meetup-sushaant-final
k8-meetup-sushaant-finalk8-meetup-sushaant-final
k8-meetup-sushaant-finalSushaant Mujoo
 
An Intro to Elasticsearch and Kibana
An Intro to Elasticsearch and KibanaAn Intro to Elasticsearch and Kibana
An Intro to Elasticsearch and KibanaObjectRocket
 
Working Experience_V5.0
Working Experience_V5.0Working Experience_V5.0
Working Experience_V5.0Danny Lai
 
Grafana selectel
Grafana selectelGrafana selectel
Grafana selectelalexanderzobnin
 
Presto Summit 2018 - 09 - Netflix Iceberg
Presto Summit 2018 - 09 - Netflix IcebergPresto Summit 2018 - 09 - Netflix Iceberg
Presto Summit 2018 - 09 - Netflix Icebergkbajda
 
Time Series Analytics for Big Fast Data
Time Series Analytics for Big Fast DataTime Series Analytics for Big Fast Data
Time Series Analytics for Big Fast DataSouth West Data Meetup
 
CSharp
CSharpCSharp
CSharpVera Ekimenko
 
Kibana + timelion: time series with the elastic stack
Kibana + timelion: time series with the elastic stackKibana + timelion: time series with the elastic stack
Kibana + timelion: time series with the elastic stackSylvain Wallez
 
Spark in 15 min
Spark in 15 minSpark in 15 min
Spark in 15 minChristophe Marchal
 
Graphs are everywhere! Distributed graph computing with Spark GraphX
Graphs are everywhere! Distributed graph computing with Spark GraphXGraphs are everywhere! Distributed graph computing with Spark GraphX
Graphs are everywhere! Distributed graph computing with Spark GraphXAndrea Iacono
 
Gis meetup 111913
Gis meetup 111913Gis meetup 111913
Gis meetup 111913Josh Gage
 
Log Data Analysis Platform
Log Data Analysis PlatformLog Data Analysis Platform
Log Data Analysis PlatformValentin Kropov
 
Log Data Analysis Platform by Valentin Kropov
Log Data Analysis Platform by Valentin KropovLog Data Analysis Platform by Valentin Kropov
Log Data Analysis Platform by Valentin KropovSoftServe
 
Code-first GraphQL Server Development with Prisma
Code-first GraphQL Server Development with PrismaCode-first GraphQL Server Development with Prisma
Code-first GraphQL Server Development with PrismaNikolas Burk
 
From logging to monitoring to reactive insights - C Schneider
From logging to monitoring to reactive insights - C SchneiderFrom logging to monitoring to reactive insights - C Schneider
From logging to monitoring to reactive insights - C Schneidermfrancis
 
Product Media Magazine: January - February 2016
Product Media Magazine: January - February 2016Product Media Magazine: January - February 2016
Product Media Magazine: January - February 2016The BPMA
 
curso-de-fotografia-digital by Thewebfoto
curso-de-fotografia-digital by Thewebfoto curso-de-fotografia-digital by Thewebfoto
curso-de-fotografia-digital by Thewebfoto chikuy
 

More Related Content

What's hot

Kafka Streams - From the Ground Up to the Cloud
Kafka Streams - From the Ground Up to the CloudKafka Streams - From the Ground Up to the Cloud
Kafka Streams - From the Ground Up to the CloudVMware Tanzu
 
Azure Data Factory Data Flow Limited Preview for January 2019
Azure Data Factory Data Flow Limited Preview for January 2019Azure Data Factory Data Flow Limited Preview for January 2019
Azure Data Factory Data Flow Limited Preview for January 2019Mark Kromer
 
eXtensible Catalog - afternoon session - Tilburg
eXtensible Catalog - afternoon session - TilburgeXtensible Catalog - afternoon session - Tilburg
eXtensible Catalog - afternoon session - TilburgUniversity of Rochester
 
Druid + Superset (資料的快速通道)
Druid + Superset (資料的快速通道)Druid + Superset (資料的快速通道)
Druid + Superset (資料的快速通道)二文 郭
 
k8-meetup-sushaant-final
k8-meetup-sushaant-finalk8-meetup-sushaant-final
k8-meetup-sushaant-finalSushaant Mujoo
 
An Intro to Elasticsearch and Kibana
An Intro to Elasticsearch and KibanaAn Intro to Elasticsearch and Kibana
An Intro to Elasticsearch and KibanaObjectRocket
 
Working Experience_V5.0
Working Experience_V5.0Working Experience_V5.0
Working Experience_V5.0Danny Lai
 
Presto Summit 2018 - 09 - Netflix Iceberg
Presto Summit 2018 - 09 - Netflix IcebergPresto Summit 2018 - 09 - Netflix Iceberg
Presto Summit 2018 - 09 - Netflix Icebergkbajda
 
Time Series Analytics for Big Fast Data
Time Series Analytics for Big Fast DataTime Series Analytics for Big Fast Data
Time Series Analytics for Big Fast DataSouth West Data Meetup
 
Kibana + timelion: time series with the elastic stack
Kibana + timelion: time series with the elastic stackKibana + timelion: time series with the elastic stack
Kibana + timelion: time series with the elastic stackSylvain Wallez
 
Graphs are everywhere! Distributed graph computing with Spark GraphX
Graphs are everywhere! Distributed graph computing with Spark GraphXGraphs are everywhere! Distributed graph computing with Spark GraphX
Graphs are everywhere! Distributed graph computing with Spark GraphXAndrea Iacono
 
Gis meetup 111913
Gis meetup 111913Gis meetup 111913
Gis meetup 111913Josh Gage
 
Log Data Analysis Platform
Log Data Analysis PlatformLog Data Analysis Platform
Log Data Analysis PlatformValentin Kropov
 
Log Data Analysis Platform by Valentin Kropov
Log Data Analysis Platform by Valentin KropovLog Data Analysis Platform by Valentin Kropov
Log Data Analysis Platform by Valentin KropovSoftServe
 
Code-first GraphQL Server Development with Prisma
Code-first GraphQL Server Development with PrismaCode-first GraphQL Server Development with Prisma
Code-first GraphQL Server Development with PrismaNikolas Burk
 
From logging to monitoring to reactive insights - C Schneider
From logging to monitoring to reactive insights - C SchneiderFrom logging to monitoring to reactive insights - C Schneider
From logging to monitoring to reactive insights - C Schneidermfrancis
 

What's hot (20)

Kafka Streams - From the Ground Up to the Cloud
Kafka Streams - From the Ground Up to the CloudKafka Streams - From the Ground Up to the Cloud
Kafka Streams - From the Ground Up to the Cloud
 
Azure Data Factory Data Flow Limited Preview for January 2019
Azure Data Factory Data Flow Limited Preview for January 2019Azure Data Factory Data Flow Limited Preview for January 2019
Azure Data Factory Data Flow Limited Preview for January 2019
 
eXtensible Catalog - afternoon session - Tilburg
eXtensible Catalog - afternoon session - TilburgeXtensible Catalog - afternoon session - Tilburg
eXtensible Catalog - afternoon session - Tilburg
 
Hello cloud 2
Hello cloud 2Hello cloud 2
Hello cloud 2
 
Druid + Superset (資料的快速通道)
Druid + Superset (資料的快速通道)Druid + Superset (資料的快速通道)
Druid + Superset (資料的快速通道)
 
k8-meetup-sushaant-final
k8-meetup-sushaant-finalk8-meetup-sushaant-final
k8-meetup-sushaant-final
 
An Intro to Elasticsearch and Kibana
An Intro to Elasticsearch and KibanaAn Intro to Elasticsearch and Kibana
An Intro to Elasticsearch and Kibana
 
Working Experience_V5.0
Working Experience_V5.0Working Experience_V5.0
Working Experience_V5.0
 
Grafana selectel
Grafana selectelGrafana selectel
Grafana selectel
 
Presto Summit 2018 - 09 - Netflix Iceberg
Presto Summit 2018 - 09 - Netflix IcebergPresto Summit 2018 - 09 - Netflix Iceberg
Presto Summit 2018 - 09 - Netflix Iceberg
 
Time Series Analytics for Big Fast Data
Time Series Analytics for Big Fast DataTime Series Analytics for Big Fast Data
Time Series Analytics for Big Fast Data
 
CSharp
CSharpCSharp
CSharp
 
Kibana + timelion: time series with the elastic stack
Kibana + timelion: time series with the elastic stackKibana + timelion: time series with the elastic stack
Kibana + timelion: time series with the elastic stack
 
Spark in 15 min
Spark in 15 minSpark in 15 min
Spark in 15 min
 
Graphs are everywhere! Distributed graph computing with Spark GraphX
Graphs are everywhere! Distributed graph computing with Spark GraphXGraphs are everywhere! Distributed graph computing with Spark GraphX
Graphs are everywhere! Distributed graph computing with Spark GraphX
 
Gis meetup 111913
Gis meetup 111913Gis meetup 111913
Gis meetup 111913
 
Log Data Analysis Platform
Log Data Analysis PlatformLog Data Analysis Platform
Log Data Analysis Platform
 
Log Data Analysis Platform by Valentin Kropov
Log Data Analysis Platform by Valentin KropovLog Data Analysis Platform by Valentin Kropov
Log Data Analysis Platform by Valentin Kropov
 
Code-first GraphQL Server Development with Prisma
Code-first GraphQL Server Development with PrismaCode-first GraphQL Server Development with Prisma
Code-first GraphQL Server Development with Prisma
 
From logging to monitoring to reactive insights - C Schneider
From logging to monitoring to reactive insights - C SchneiderFrom logging to monitoring to reactive insights - C Schneider
From logging to monitoring to reactive insights - C Schneider
 

Viewers also liked

Product Media Magazine: January - February 2016
Product Media Magazine: January - February 2016Product Media Magazine: January - February 2016
Product Media Magazine: January - February 2016The BPMA
 
curso-de-fotografia-digital by Thewebfoto
curso-de-fotografia-digital by Thewebfoto curso-de-fotografia-digital by Thewebfoto
curso-de-fotografia-digital by Thewebfoto chikuy
 
Spohrer darwin woi 20151119 v2
Spohrer darwin woi 20151119 v2Spohrer darwin woi 20151119 v2
Spohrer darwin woi 20151119 v2ISSIP
 
Enfermedades respiratorias en niños de 0 a un
Enfermedades respiratorias en niños de 0 a unEnfermedades respiratorias en niños de 0 a un
Enfermedades respiratorias en niños de 0 a uneveryn
 
Stomp out bullying !
Stomp out bullying !Stomp out bullying !
Stomp out bullying !Salley King
 
Intro to Creditera for SBDC
Intro to Creditera for SBDCIntro to Creditera for SBDC
Intro to Creditera for SBDCTim Graczewski
 
Cool twitterconference taphunter
Cool twitterconference taphunterCool twitterconference taphunter
Cool twitterconference taphuntergWave Consulting
 
5 praktische tips voor een veilige opslag
5 praktische tips voor een veilige opslag5 praktische tips voor een veilige opslag
5 praktische tips voor een veilige opslagManutan
 
Manutan: samen naar een nieuwe horizon
Manutan: samen naar een nieuwe horizonManutan: samen naar een nieuwe horizon
Manutan: samen naar een nieuwe horizonManutan-Overtoom
 
XCEED for Venues: Nightgraph + Venuegraph
XCEED for Venues: Nightgraph + VenuegraphXCEED for Venues: Nightgraph + Venuegraph
XCEED for Venues: Nightgraph + VenuegraphXceed
 
Cis 100 power point
Cis 100 power pointCis 100 power point
Cis 100 power pointTwitchKid27
 
Destiny Development Profile July 2011
Destiny Development Profile July 2011Destiny Development Profile July 2011
Destiny Development Profile July 2011fanzhibo
 
Airiti books user_guide
Airiti books user_guideAiriti books user_guide
Airiti books user_guideairitiBooks
 
Grow talks presentation final
Grow talks presentation finalGrow talks presentation final
Grow talks presentation finalDealmaker Media
 
San Marcos Anexo 11
San Marcos Anexo 11San Marcos Anexo 11
San Marcos Anexo 11pactvm
 

Viewers also liked (20)

Product Media Magazine: January - February 2016
Product Media Magazine: January - February 2016Product Media Magazine: January - February 2016
Product Media Magazine: January - February 2016
 
curso-de-fotografia-digital by Thewebfoto
curso-de-fotografia-digital by Thewebfoto curso-de-fotografia-digital by Thewebfoto
curso-de-fotografia-digital by Thewebfoto
 
Spohrer darwin woi 20151119 v2
Spohrer darwin woi 20151119 v2Spohrer darwin woi 20151119 v2
Spohrer darwin woi 20151119 v2
 
Enfermedades respiratorias en niños de 0 a un
Enfermedades respiratorias en niños de 0 a unEnfermedades respiratorias en niños de 0 a un
Enfermedades respiratorias en niños de 0 a un
 
What We Do In My Lab
What We Do In My LabWhat We Do In My Lab
What We Do In My Lab
 
Stomp out bullying !
Stomp out bullying !Stomp out bullying !
Stomp out bullying !
 
Intro to Creditera for SBDC
Intro to Creditera for SBDCIntro to Creditera for SBDC
Intro to Creditera for SBDC
 
Cool twitterconference taphunter
Cool twitterconference taphunterCool twitterconference taphunter
Cool twitterconference taphunter
 
5 praktische tips voor een veilige opslag
5 praktische tips voor een veilige opslag5 praktische tips voor een veilige opslag
5 praktische tips voor een veilige opslag
 
Manutan: samen naar een nieuwe horizon
Manutan: samen naar een nieuwe horizonManutan: samen naar een nieuwe horizon
Manutan: samen naar een nieuwe horizon
 
XCEED for Venues: Nightgraph + Venuegraph
XCEED for Venues: Nightgraph + VenuegraphXCEED for Venues: Nightgraph + Venuegraph
XCEED for Venues: Nightgraph + Venuegraph
 
Cis 100 power point
Cis 100 power pointCis 100 power point
Cis 100 power point
 
Destiny Development Profile July 2011
Destiny Development Profile July 2011Destiny Development Profile July 2011
Destiny Development Profile July 2011
 
The 3 C's of Compliance
The 3 C's of ComplianceThe 3 C's of Compliance
The 3 C's of Compliance
 
Made in italy
Made in italyMade in italy
Made in italy
 
Airiti books user_guide
Airiti books user_guideAiriti books user_guide
Airiti books user_guide
 
The education system in cuba
The education system in cubaThe education system in cuba
The education system in cuba
 
Grow talks presentation final
Grow talks presentation finalGrow talks presentation final
Grow talks presentation final
 
San Marcos Anexo 11
San Marcos Anexo 11San Marcos Anexo 11
San Marcos Anexo 11
 
Sekai design impact
Sekai design impactSekai design impact
Sekai design impact
 

Similar to ScienceBase Architecture - Access Methods

OWB11gR2 - Extending ETL
OWB11gR2 - Extending ETL OWB11gR2 - Extending ETL
OWB11gR2 - Extending ETL Suraj Bang
 
Cloud State of the Union for Java Developers
Cloud State of the Union for Java DevelopersCloud State of the Union for Java Developers
Cloud State of the Union for Java DevelopersBurr Sutter
 
Latest Developments in Oceanographic Applications of GIS, including Near-real...
Latest Developments in Oceanographic Applications of GIS, including Near-real...Latest Developments in Oceanographic Applications of GIS, including Near-real...
Latest Developments in Oceanographic Applications of GIS, including Near-real...Dawn Wright
 
Deep Dive on the Microsoft Dynamics AX Platform
Deep Dive on the Microsoft Dynamics AX PlatformDeep Dive on the Microsoft Dynamics AX Platform
Deep Dive on the Microsoft Dynamics AX PlatformJuan Fabian
 
Ajax Frameworks in the J(2)EE Environment
Ajax Frameworks in the J(2)EE EnvironmentAjax Frameworks in the J(2)EE Environment
Ajax Frameworks in the J(2)EE Environmentstarchaser
 
Dev Summit 2011 - Talk
Dev Summit 2011 - TalkDev Summit 2011 - Talk
Dev Summit 2011 - TalkArc2Earth
 
Leveraging Hadoop in Polyglot Architectures
Leveraging Hadoop in Polyglot ArchitecturesLeveraging Hadoop in Polyglot Architectures
Leveraging Hadoop in Polyglot ArchitecturesThanigai Vellore
 
Analytics Metrics delivery and ML Feature visualization: Evolution of Data Pl...
Analytics Metrics delivery and ML Feature visualization: Evolution of Data Pl...Analytics Metrics delivery and ML Feature visualization: Evolution of Data Pl...
Analytics Metrics delivery and ML Feature visualization: Evolution of Data Pl...Chester Chen
 
Icefaces Proto Type
Icefaces Proto TypeIcefaces Proto Type
Icefaces Proto Typeravireddy76
 
Data Con LA 2022 - What's new with MongoDB 6.0 and Atlas
Data Con LA 2022 - What's new with MongoDB 6.0 and AtlasData Con LA 2022 - What's new with MongoDB 6.0 and Atlas
Data Con LA 2022 - What's new with MongoDB 6.0 and AtlasData Con LA
 
Sf big analytics_2018_04_18: Evolution of the GoPro's data platform
Sf big analytics_2018_04_18: Evolution of the GoPro's data platformSf big analytics_2018_04_18: Evolution of the GoPro's data platform
Sf big analytics_2018_04_18: Evolution of the GoPro's data platformChester Chen
 
EKO-System Map Viewer Technology Overview
EKO-System Map Viewer Technology OverviewEKO-System Map Viewer Technology Overview
EKO-System Map Viewer Technology OverviewPaladin EKO
 
Apache spark - Architecture , Overview & libraries
Apache spark - Architecture , Overview & librariesApache spark - Architecture , Overview & libraries
Apache spark - Architecture , Overview & librariesWalaa Hamdy Assy
 
Building highly scalable data pipelines with Apache Spark
Building highly scalable data pipelines with Apache SparkBuilding highly scalable data pipelines with Apache Spark
Building highly scalable data pipelines with Apache SparkMartin Toshev
 
Ado.Net Data Services (Astoria)
Ado.Net Data Services (Astoria)Ado.Net Data Services (Astoria)
Ado.Net Data Services (Astoria)Igor Moochnick
 
DataFinder: A Python Application for Scientific Data Management
DataFinder: A Python Application for Scientific Data ManagementDataFinder: A Python Application for Scientific Data Management
DataFinder: A Python Application for Scientific Data ManagementAndreas Schreiber
 
Customer Intelligence: Using the ELK Stack to Analyze ForgeRock OpenAM Audit ...
Customer Intelligence: Using the ELK Stack to Analyze ForgeRock OpenAM Audit ...Customer Intelligence: Using the ELK Stack to Analyze ForgeRock OpenAM Audit ...
Customer Intelligence: Using the ELK Stack to Analyze ForgeRock OpenAM Audit ...ForgeRock
 

Similar to ScienceBase Architecture - Access Methods (20)

Phnom penh mapping meetup #15
Phnom penh mapping meetup #15Phnom penh mapping meetup #15
Phnom penh mapping meetup #15
 
Aws slide
Aws slideAws slide
Aws slide
 
OWB11gR2 - Extending ETL
OWB11gR2 - Extending ETL OWB11gR2 - Extending ETL
OWB11gR2 - Extending ETL
 
Cloud State of the Union for Java Developers
Cloud State of the Union for Java DevelopersCloud State of the Union for Java Developers
Cloud State of the Union for Java Developers
 
Latest Developments in Oceanographic Applications of GIS, including Near-real...
Latest Developments in Oceanographic Applications of GIS, including Near-real...Latest Developments in Oceanographic Applications of GIS, including Near-real...
Latest Developments in Oceanographic Applications of GIS, including Near-real...
 
Deep Dive on the Microsoft Dynamics AX Platform
Deep Dive on the Microsoft Dynamics AX PlatformDeep Dive on the Microsoft Dynamics AX Platform
Deep Dive on the Microsoft Dynamics AX Platform
 
Ajax Frameworks in the J(2)EE Environment
Ajax Frameworks in the J(2)EE EnvironmentAjax Frameworks in the J(2)EE Environment
Ajax Frameworks in the J(2)EE Environment
 
Dev Summit 2011 - Talk
Dev Summit 2011 - TalkDev Summit 2011 - Talk
Dev Summit 2011 - Talk
 
Leveraging Hadoop in Polyglot Architectures
Leveraging Hadoop in Polyglot ArchitecturesLeveraging Hadoop in Polyglot Architectures
Leveraging Hadoop in Polyglot Architectures
 
Analytics Metrics delivery and ML Feature visualization: Evolution of Data Pl...
Analytics Metrics delivery and ML Feature visualization: Evolution of Data Pl...Analytics Metrics delivery and ML Feature visualization: Evolution of Data Pl...
Analytics Metrics delivery and ML Feature visualization: Evolution of Data Pl...
 
Icefaces Proto Type
Icefaces Proto TypeIcefaces Proto Type
Icefaces Proto Type
 
Data Con LA 2022 - What's new with MongoDB 6.0 and Atlas
Data Con LA 2022 - What's new with MongoDB 6.0 and AtlasData Con LA 2022 - What's new with MongoDB 6.0 and Atlas
Data Con LA 2022 - What's new with MongoDB 6.0 and Atlas
 
Sf big analytics_2018_04_18: Evolution of the GoPro's data platform
Sf big analytics_2018_04_18: Evolution of the GoPro's data platformSf big analytics_2018_04_18: Evolution of the GoPro's data platform
Sf big analytics_2018_04_18: Evolution of the GoPro's data platform
 
EKO-System Map Viewer Technology Overview
EKO-System Map Viewer Technology OverviewEKO-System Map Viewer Technology Overview
EKO-System Map Viewer Technology Overview
 
20170126 big data processing
20170126 big data processing20170126 big data processing
20170126 big data processing
 
Apache spark - Architecture , Overview & libraries
Apache spark - Architecture , Overview & librariesApache spark - Architecture , Overview & libraries
Apache spark - Architecture , Overview & libraries
 
Building highly scalable data pipelines with Apache Spark
Building highly scalable data pipelines with Apache SparkBuilding highly scalable data pipelines with Apache Spark
Building highly scalable data pipelines with Apache Spark
 
Ado.Net Data Services (Astoria)
Ado.Net Data Services (Astoria)Ado.Net Data Services (Astoria)
Ado.Net Data Services (Astoria)
 
DataFinder: A Python Application for Scientific Data Management
DataFinder: A Python Application for Scientific Data ManagementDataFinder: A Python Application for Scientific Data Management
DataFinder: A Python Application for Scientific Data Management
 
Customer Intelligence: Using the ELK Stack to Analyze ForgeRock OpenAM Audit ...
Customer Intelligence: Using the ELK Stack to Analyze ForgeRock OpenAM Audit ...Customer Intelligence: Using the ELK Stack to Analyze ForgeRock OpenAM Audit ...
Customer Intelligence: Using the ELK Stack to Analyze ForgeRock OpenAM Audit ...
 

More from Sky Bristol

CanyonViews.pptx
CanyonViews.pptxCanyonViews.pptx
CanyonViews.pptxSky Bristol
 
USGS research infrastructure - AGU2016 - in13 e
USGS research infrastructure - AGU2016 - in13 eUSGS research infrastructure - AGU2016 - in13 e
USGS research infrastructure - AGU2016 - in13 eSky Bristol
 
Science base usage analysis - AGU2016 - in21d08
Science base usage analysis - AGU2016 - in21d08Science base usage analysis - AGU2016 - in21d08
Science base usage analysis - AGU2016 - in21d08Sky Bristol
 
Ocean Biogeographic Information System - for NOPP Biodiversity Ad Hoc Working...
Ocean Biogeographic Information System - for NOPP Biodiversity Ad Hoc Working...Ocean Biogeographic Information System - for NOPP Biodiversity Ad Hoc Working...
Ocean Biogeographic Information System - for NOPP Biodiversity Ad Hoc Working...Sky Bristol
 
Judicious use of custom development in an open source component architecture
Judicious use of custom development in an open source component architectureJudicious use of custom development in an open source component architecture
Judicious use of custom development in an open source component architectureSky Bristol
 
Standards promote interoperability of USGS data on the U.S. Geoscience Inform...
Standards promote interoperability of USGS data on the U.S. Geoscience Inform...Standards promote interoperability of USGS data on the U.S. Geoscience Inform...
Standards promote interoperability of USGS data on the U.S. Geoscience Inform...Sky Bristol
 
Big Data R&D Strategy - Ensure the long term sustainability, access, and deve...
Big Data R&D Strategy - Ensure the long term sustainability, access, and deve...Big Data R&D Strategy - Ensure the long term sustainability, access, and deve...
Big Data R&D Strategy - Ensure the long term sustainability, access, and deve...Sky Bristol
 

More from Sky Bristol (7)

CanyonViews.pptx
CanyonViews.pptxCanyonViews.pptx
CanyonViews.pptx
 
USGS research infrastructure - AGU2016 - in13 e
USGS research infrastructure - AGU2016 - in13 eUSGS research infrastructure - AGU2016 - in13 e
USGS research infrastructure - AGU2016 - in13 e
 
Science base usage analysis - AGU2016 - in21d08
Science base usage analysis - AGU2016 - in21d08Science base usage analysis - AGU2016 - in21d08
Science base usage analysis - AGU2016 - in21d08
 
Ocean Biogeographic Information System - for NOPP Biodiversity Ad Hoc Working...
Ocean Biogeographic Information System - for NOPP Biodiversity Ad Hoc Working...Ocean Biogeographic Information System - for NOPP Biodiversity Ad Hoc Working...
Ocean Biogeographic Information System - for NOPP Biodiversity Ad Hoc Working...
 
Judicious use of custom development in an open source component architecture
Judicious use of custom development in an open source component architectureJudicious use of custom development in an open source component architecture
Judicious use of custom development in an open source component architecture
 
Standards promote interoperability of USGS data on the U.S. Geoscience Inform...
Standards promote interoperability of USGS data on the U.S. Geoscience Inform...Standards promote interoperability of USGS data on the U.S. Geoscience Inform...
Standards promote interoperability of USGS data on the U.S. Geoscience Inform...
 
Big Data R&D Strategy - Ensure the long term sustainability, access, and deve...
Big Data R&D Strategy - Ensure the long term sustainability, access, and deve...Big Data R&D Strategy - Ensure the long term sustainability, access, and deve...
Big Data R&D Strategy - Ensure the long term sustainability, access, and deve...
 

ScienceBase Architecture - Access Methods

  • 1. Data File Inputs GeoDatabase Service Definition ShapeFile NetCDF GeoTIFF Image Any Other Files Primary Output Interfaces HTML "landing pages" with schema.org sbJSON ISO19139 ISO19139 ISO19139 ATOM MODS CSV CSDGM Metadata (Item) Inputs CSDGM XML MODS XML XLS/CSV Process Web Accessible Folders CSW Harvest ArcGIS REST Harvest sbJSON Custom ETL ScienceBase Tech Stack (major components) GeoServer GeoTools ArcGIS Server THREDDS Java Image Library Search Index (ElasticSearch) Complex Geometry Store (PostGIS) MetaBase ScienceBase Item Store (MongoDB) Java Core Plugin Inbound API Service Layer Java Core Plugin OGC-CSW OAI-PMH OpenSearch WMS, WFS, WCS, KML ArcGIS REST OpenDAP Outbound API sbREST Compressed Download MetadataServicesDataServices REST Image Delivery Downstream Uses Python and R methods JQuery and Similar Front- ends Drupal Modules ArcGIS Desktop CSW Search OAI-PMH Harvest USGS ScienceBase Overview of Major Components