1. The document describes the configuration of the LIM, DIM, and GTWAY systems used for data management. It outlines the baseline configuration and options for each component.
2. The LIM and DIM can each be configured in different ways to control access to data servers and collections. The baseline has the LIM and DIM configured for broad access.
3. When a new collection is added to a data server, the process involves exporting metadata, replication to other sites, and manual configuration of the LIM and DIM by database administrators to integrate the new collection.
IBM System x and DB2 process more than 56 million account transactions per hour—a new world
record result for transaction banking on the SAP Transaction Banking benchmark
September 13, 2011 ... IBM® today announced the first clustered database result published for the SAP®
Transaction Banking (TRBK) standard application benchmark. The system processed more than 56 million
posting transactions per hour and more than 22 million balanced accounts per hour, at the same time
supporting demanding banking industry system availability requirements. This result sets a new record for the
highest number of account transactions processed per hour on the SAP TRBK standard application
benchmark.
IBM System x and DB2 process more than 56 million account transactions per hour—a new world
record result for transaction banking on the SAP Transaction Banking benchmark
September 13, 2011 ... IBM® today announced the first clustered database result published for the SAP®
Transaction Banking (TRBK) standard application benchmark. The system processed more than 56 million
posting transactions per hour and more than 22 million balanced accounts per hour, at the same time
supporting demanding banking industry system availability requirements. This result sets a new record for the
highest number of account transactions processed per hour on the SAP TRBK standard application
benchmark.
3 12 la construcción pública y la arquitectura bioarmónica – diseño iiiplanarqubvbolivar
En esta unidad curricular el estudiante desarrollará las herramientas necesarias para el diseño de edificaciones de carácter público a escala parroquial, cuya
característica fundamental sea un desarrollo en profundidad de dispositivos constructivos de control ambiental con bajo impacto ecológico, y su adaptación a
condiciones sociales específicas. Se explora la complejidad tectónica, funcional y semántica de edificios públicos, analizando su impacto ambiental como
insumo para la toma de decisiones de diseño. El estudiante desarrollará respuestas de diseño arquitectónico que aporten soluciones viables a los problemas
socio-ambientales característicos del entorno parroquial. Asimismo empleará formatos estándares de presentación de proyectos ante instituciones del estado.
Interconnect session 3498: Deployment Topologies for Jazz Reporting ServiceRosa Naranjo
This presentation will assist you design deployment topologies for your reporting needs, as well as make decisions on which components are right for you. On the data collection side, it describes both data warehouses (and related ETL mechanisms like DCC ETL and DM ETL) and IBM Lifecycle Query Engine, as well as the Jazz application setup to feed into LQE. On the reporting side, there is focus on Jazz Reporting Service Report Builder, but also the options when Report Builder is not enough; e.g., Cognos integration through the ALM Cognos Connector. The session will also cover various questions on how to group those applications/servers, hardware needs, etc.
Disaster Recovery Experience at CACIB: Hardening Hadoop for Critical Financia...DataWorks Summit
Hadoop is becoming a standard platform for building critical financial applications such as risk reporting, trading and fraud detection. These applications require high level of SLAs (service-level agreement) in terms of RPO (Recovery Point Objective) and RTO (Recovery Time Objective). To achieve these SLAs, organizations need to build a disaster recovery plan that cover several layers ranging from the infrastructure to the clients going through the platform and the applications. In this talk, we will present the different architecture blueprints for disaster recovery as well as their corresponding SLA objectives. Then, we will focus on the stretch cluster solution that Crédit Agricole CIB is using in production. We will discuss the solution’s advantages, drawbacks and the impact of this approach on the global architecture. Finally, we will explain in detail how to configure and deploy this solution and how to integrate each layer (storage layer, processing layer...) into the architecture.
SQL Server 2017 - Mejoras Impulsadas por la ComunidadJavier Villegas
Con SQL Sever 2017 Microsoft incorpora nuevas funcionalidades propuestas por la comunidad de profesionales de Data Platform, hablaremos acerca de las mismas así como también sobre las funcionalidades más destacadas de la próxima versión de SQL
Study Notes - Event-Driven Data Management for MicroservicesRick Hwang
Microservices from Design to Deployment (https://www.nginx.com/resources/library/designing-deploying-microservices/)
- CH05 Event-Driven Data Management for Microservices
Moments after you move data into your Hadoop cluster or target database, new transactions on source systems make that data incomplete, and analyses done on that data inaccurate.
However, there are several strategies for keeping data in sync between data platforms.
View this webcast on-demand to learn about the advantages and disadvantages of various change data capture strategies, as well as:
• The latest improvements in Syncsort DMX and DMX-h
• The new DMX Change Data Capture software
• How Syncsort can help you keep your data analytics current and accurate
3 12 la construcción pública y la arquitectura bioarmónica – diseño iiiplanarqubvbolivar
En esta unidad curricular el estudiante desarrollará las herramientas necesarias para el diseño de edificaciones de carácter público a escala parroquial, cuya
característica fundamental sea un desarrollo en profundidad de dispositivos constructivos de control ambiental con bajo impacto ecológico, y su adaptación a
condiciones sociales específicas. Se explora la complejidad tectónica, funcional y semántica de edificios públicos, analizando su impacto ambiental como
insumo para la toma de decisiones de diseño. El estudiante desarrollará respuestas de diseño arquitectónico que aporten soluciones viables a los problemas
socio-ambientales característicos del entorno parroquial. Asimismo empleará formatos estándares de presentación de proyectos ante instituciones del estado.
Interconnect session 3498: Deployment Topologies for Jazz Reporting ServiceRosa Naranjo
This presentation will assist you design deployment topologies for your reporting needs, as well as make decisions on which components are right for you. On the data collection side, it describes both data warehouses (and related ETL mechanisms like DCC ETL and DM ETL) and IBM Lifecycle Query Engine, as well as the Jazz application setup to feed into LQE. On the reporting side, there is focus on Jazz Reporting Service Report Builder, but also the options when Report Builder is not enough; e.g., Cognos integration through the ALM Cognos Connector. The session will also cover various questions on how to group those applications/servers, hardware needs, etc.
Disaster Recovery Experience at CACIB: Hardening Hadoop for Critical Financia...DataWorks Summit
Hadoop is becoming a standard platform for building critical financial applications such as risk reporting, trading and fraud detection. These applications require high level of SLAs (service-level agreement) in terms of RPO (Recovery Point Objective) and RTO (Recovery Time Objective). To achieve these SLAs, organizations need to build a disaster recovery plan that cover several layers ranging from the infrastructure to the clients going through the platform and the applications. In this talk, we will present the different architecture blueprints for disaster recovery as well as their corresponding SLA objectives. Then, we will focus on the stretch cluster solution that Crédit Agricole CIB is using in production. We will discuss the solution’s advantages, drawbacks and the impact of this approach on the global architecture. Finally, we will explain in detail how to configure and deploy this solution and how to integrate each layer (storage layer, processing layer...) into the architecture.
SQL Server 2017 - Mejoras Impulsadas por la ComunidadJavier Villegas
Con SQL Sever 2017 Microsoft incorpora nuevas funcionalidades propuestas por la comunidad de profesionales de Data Platform, hablaremos acerca de las mismas así como también sobre las funcionalidades más destacadas de la próxima versión de SQL
Study Notes - Event-Driven Data Management for MicroservicesRick Hwang
Microservices from Design to Deployment (https://www.nginx.com/resources/library/designing-deploying-microservices/)
- CH05 Event-Driven Data Management for Microservices
Moments after you move data into your Hadoop cluster or target database, new transactions on source systems make that data incomplete, and analyses done on that data inaccurate.
However, there are several strategies for keeping data in sync between data platforms.
View this webcast on-demand to learn about the advantages and disadvantages of various change data capture strategies, as well as:
• The latest improvements in Syncsort DMX and DMX-h
• The new DMX Change Data Capture software
• How Syncsort can help you keep your data analytics current and accurate
Hadoop Security in Big-Data-as-a-Service Deployments - Presented at Hadoop Su...Abhiraj Butala
The talk covers limitations of current Hadoop eco-system components in handling security (Authentication, Authorization, Auditing) in multi-tenant, multi-application environments. Then it proposes how we can use Apache Ranger and HDFS super-user connections to enforce correct HDFS authorization policies and achieve the required auditing.
Découvrez les nouveautés d'EDB Postgres 11. Cette édition comprend une version mise à jour d'EDB Postgres Advanced Server, laquelle vient améliorer les possibilités offertes par la version open source de PostgreSQL 11, sur laquelle elle se base, en apportant de nouveaux diagnostics de performances, commandes de transactions autonomes et capacités de rédaction de données. Au programme du webinaire :
Une introduction à EDB Postgres, notamment sur BART, EFM et les conteneurs.
Les nouveautés d'EDB Postgres 11
Rapide présentation et démonstration de PEM 7
Equnix Business Solutions (Equnix) is an IT Solution provider in Indonesia, providing comprehensive solution services especially on the infrastructure side for corporate business needs based on research and Open Source. Equnix has 3 (three) main services known as the Trilogy of Services: Support (Maintenance/Managed), World class level of Software Development, and Expert Consulting and Assessment for High Performance Transactions System. Equnix is customer oriented, not product or principal. Equal opportunity based on merit is our credo in managing HR development.
Erfahren Sie, welche Neuerungen EDB Postgres 11 bringt. Dieses Update umfasst eine aktualisierte Version von EDB Postgres Advanced Server, die auf den Kapazitäten der Open-Source-Version PostgreSQL 11 basiert und diese erweitert. Sie profitieren von neuen Datenredaktionsfunktionen, autonomen Transaktionsbefehlen und Performance-Diagnose. Webinar-Agenda:
Eine Einführung in EDB Postgres, einschließlich BART, EFM und Containern
Neuerungen in EDB Postgres 11
Kurzer Überblick und Demo zu PEM 7
2. HR2-2
706-CD-003-001 Day 4 Book B2
Presentation Overview
1. Data Management Software Architecture
2. LIM/DIM/GTWAY Configuration Baseline
3. Operator Activities to Data Management
4. Scenario for LIM/DIM Configuration
3. HR2-3
706-CD-003-001 Day 4 Book B2
Data Management Software
Architecture
DMS WS Database
(Sybase)
Working
Storage
DDICT &
Config Info
DMS DDICT Database
(Sybase)
DDICT
GTWAY
DIMGR
LIMGR
Data Dict.
Maintenance
Tool
Sybase
DBA
Tools
Data Management Server - GSFC
Data Management Server - EDC
Data Management Server - JPL
Data Management Server - Other DAAC ...
4. HR2-4
706-CD-003-001 Day 4 Book B2
LIM Configuration
• Physical Layout:
One LIMGR at each DAAC, configured to access the one SDSRV,
DDSRV, and V0 GTWAY colocated at that DAAC.
• Configuration Options:
1A Make Advertisements for SDSRV and DDSRV private so only access to the
DAAC is through the LIMGR.
- Features:
Can control the pull side user access more effectively if one
entry point. One monitoring point for user requests.
Performance and resource penalty for queries that may have
been able to skip the LIM route.
1B Make Advertisements for SDSRV and DDSRV public as well as LIMGR
- Features:
Eliminates bottleneck at LIM by allowing direct connection from client to
SDSRV.
Lacks the ability to monitor requests from a single point.
• Baseline Configuration: Option 1B
6. HR2-6
706-CD-003-001 Day 4 Book B2
LIM Configuration (cont.)
LIM Configuration Options (cont.)
2A Provide all holdings as one collection (a multiple type collection that is a
collection of the collections at the data server)
- Features:
Gives the user one view of the holdings of the DAAC.
User has to dig to a lower level in the data dictionary to find the individual
collections at the data server.
One interpretation of valid value or term.
2B Provide the LIM services as just another access to the data server
collections
- Features:
Gives the user insight to each individual collection directly at the LIM
level.
Multiple entry points to access the same collection.
Baseline Configuration: Option 2A
7. HR2-7
706-CD-003-001 Day 4 Book B2
LIM<WKBCH>
GSFC
collection A
collection B
|
|
|
|
collection Z
Option 2A During Operations
GSFC Collection
8. HR2-8
706-CD-003-001 Day 4 Book B2
DIM Configuration
Baseline Configuration:
• One DIMGR at each DAAC with global access to all LIMs and public
SDSRVs and DDSRVs.
Configuration Options:
• Same configuration options available as the LIMGR in terms of the
advertisements and collections.
• Can add additional DIMGRs to limit the scope to less collections and
information managers. For example, one DIMGR might be ECS DAACs
only, where another might be for international partners, etc.
- Use this option for performance by providing redundant services.
9. HR2-9
706-CD-003-001 Day 4 Book B2
GTWAY Configuration Baseline
• One GTWAY per DAAC encompassing all the holdings accessible
through the V0 IMS Server at that DAAC.
• Services accessible through the LIMGR and DIMGR.
10. HR2-10
706-CD-003-001 Day 4 Book B2
Operator Activities Related to
Data Management
Configuration of LIMGR, DIMGR, and GTWAY to provide synchronization
with collection information exported from SDSRVs or external data
providers.
• Notification of changes can be detected through subscriptions on Data
Dictionary inserts, updates, or deletes.
Maintenance of Sybase and Replication Environment
• Monitor Replication Environment for errors on replication transactions
from other sites.
• Coordinate with other sites upon error detection of replicated
transaction
Monitor requests
• Check for consistency of schema information with data server when
query error rates are increasing.
• Monitor system load.
11. HR2-11
706-CD-003-001 Day 4 Book B2
Maintaining DIM/LIM
Configurations with Data Server
Scenario for new collection (ESDT) at Data Server:
• Step 1: Data Specialist defines new ESDT in Data Server and Data
Server administration tools send new ESDT information to Data
Dictionary and Advertising Service.
• Step 2: DDICT service receives schema information and marks it
private so clients do not see new information yet. Same for
Advertisments.
• Step 3: Sybase replicates the information to the other DAACs.
• Step 4: DBA receives notification of new collection in DDICT database.
DBA starts Data Dictionary Maintenance Tool and looks for collections
specified in the notification.
• Step 5: DBA/Data Specialist links the new collection to the LIMGR and
DIMGR configuration. The Data Dictionary Maintenance Tool updates
the advertising service if necessary.
• Step 6: DBA/Data Specialist makes advertisements and schema
information public at the appropriate time (such as when sufficient data
exists to make it useful to a user).
12. HR2-12
706-CD-003-001 Day 4 Book B2
Info Manager
Other
Attributes
ECS Attributes
Collections
DIM
DDICT
Main
Tool
LIM
Mail
Reader
Gateway ADSRV
SDSRV
DDICT
SITE 1 SITE 2
DDICT
4 Notification
6 Makes public5 Links
Data Collection
to LIMGR and
DIMGR
3 Sybase replicates
2 Export Schema
(Collections,
Attributes, Valids)
1 Create new
ESDT
Data
Specialist
DBA
DBA/Data
Specialist
Maintaining DIM/LIM
Configurations with Data Server