Tutorial Expert How-To - Docker-based automation

•

0 likes•16 views

Install the Hackolade Studio CLI on a server, and trigger it to run concurrent multi-threaded sessions in a Docker container, as part of that environment. As part of your CI/CD pipeline, you can trigger data modeling automations and have it perform things like creation of artifacts, forward- and reverse-engineering, model comparisons, documentation generation, ...

Technology

Hackolade Tutorial
Docker-based data modeling automation
Copyright © 2016-2023 Hackolade 1

Design
Data Model
Generate
Schema
Catalog
Publish
Use
Evaluate
Data
Modeler
Data
Architect
Subject
Matter
Expert
Data
Engineer
Data
Analyst
Business
Analyst
Data models lifecycle unified with DevOps applications
Copyright © 2016-2023 Hackolade
Application
Metadata Dev Ops

Role of Data Modeling in an Agile/DevOps context
Copyright © 2016-2022 Hackolade 3
Domain-Driven
Design
Physical Data
Modeling
Iterative
Evolution
Fake data
Generation
Optimization
Governance
& Compliance
Maintenance &
Performance,
Documentation
& Facilitation

Data models
Schema contracts
Application code
Git repository DevOps CI/CD
pipeline
Application
Database
Copyright © 2016-2023 Hackolade 5
Using GIT to Co-locate metadata with application code
Environments:
• Dev
• Test
• Integration
• Production
ALTER scripts

… …
Consumers
Subject area models
Project models
Models
Local
Repo
Local
Repo
Local
Repo
Clone
Push
Pull
Merge …
Copyright © 2016-2022 Hackolade 6
Hackolade Studio to Schema Repo workflow
CLI
Schemas
DDL files
OAS files
JSON Schema files
Avro Schema files
…

Why Docker-based automation?
Copyright © 2016-2023 Hackolade 7

Governance first use case
Copyright © 2016-2023 Hackolade 8

Code-first use case
Copyright © 2016-2023 Hackolade 9

Principle: Event triggers Actions
Copyright © 2016-2023 Hackolade 10

Run concurrent multi-threaded CLI commands in Docker containers
• Resources:
• Documentation: https://github.com/hackolade/docker/tree/main/Studio
• Script for this tutorial:
https://github.com/hackolade/docker/blob/main/Studio/tutorial/Docker%2B
CLI-tutorial.md
• GitHub Actions procedure: https://docs.github.com/en/actions/creating-
actions/creating-a-docker-container-action
• Using provided Dockerfile.app in the repo
Copyright © 2016-2023 Hackolade 11

Example scenarios
1. Reverse-engineer database instance overnight
2. Compare reverse-engineered model with baseline model, and
generate delta model
3. Generate documentation in html+pdf format for reverse-
engineered data model
Copyright © 2016-2023 Hackolade 12

Reading material
• See Hackolade online documentation
• The Hackolade Blog
• Hackolade’s on social media: LinkedIn page, Twitter page
• Download Hackolade Studio for free
• This excellent new book:
MongoDB Data Modeling & Schema Design
• Many of the principles in the book are related to query
driven modeling based on access patterns
Copyright © 2016-2023 Hackolade 13

Order on Amazon
Copyright © 2016-2023 Hackolade 14
Pre-order

Upcoming
Copyright © 2016-2023 Hackolade 15

Questions?
Answers!
Copyright © 2016-2023 Hackolade 16

Similar to Tutorial Expert How-To - Docker-based automation

Ця розповідь розкриє підходи для вирішення багатьох проблем в PHP проєктах через: None-Breaking change development підхід, cross-stack контракти, Trunk Based development, еволюція з Polyrepo до Monorepo з компонентами на різних технологіях, Boilerplat’и компонентів, різні Architecture View, Continuous Testing & Quality, Infrastructure View, Infrastructure as a code як основний інструмент.

"Different software evolutions from Start till Release in PHP product" Oleksa...

Fwdays

Apache Arrow: Open Source Standard Becomes an Enterprise Necessity

Wes McKinney

For organisations to successfully adopt data mesh, setting up and maintaining infrastructure needs to be easy. We believe the best way to achieve this is to leverage the learnings from building a ‘central nervous system‘, commonly used in modern data-streaming ecosystems. This approach formalises and automates of the manual parts of building a data mesh. This presentation introduces SpecMesh; a methodology and supporting developer toolkit to enable business to build the foundations of their data mesh.

The Enterprise Guide to Building a Data Mesh - Introducing SpecMesh

IanFurlong4

Achieving the Digital Thread through PLM and ALM Integration using OSLC

Koneksys

Achieving the digital thread through PLM and ALM integration using oslc

Axel Reichwein

Accelerating the Path to Digital with a Cloud Data Strategy

MongoDB

Hackolade Tutorial - part 9 - Export or forward-engineer.pdf

PascalDesmarets1

Bhadale group of companies projects portfolio

Vijayananda Mohire

Serverless machine learning architectures at Helixa

Data Science Milan

Architecting an Open Source AI Platform 2018 edition

David Talby

How to reinvent your organization in an iterative and pragmatic way? This is the result of using our digital toolbox. It allows you to transform your business model, expand your ecosystem by setting up your digital platform. This reinvention is also supported by the adaptation of your governance allowing you to innovate while guaranteeing the performance of your organization. For any information / suggestion / collaboration - william.poos@nrb.be Comment réinventer votre organisation de manière itérative et pragmatique ? C'est le résultat de l'utilisation de notre boîte à outils digitale. Elle vous permet de transformer votre modèle métier, d'étendre votre écosystème en mettant en place votre plateforme digitale. Cette réinvention est également supportée par l'adaptation de votre gouvernance vous permettant d'innover tout en garantissant la performance de votre organisation. Pour toute information / suggestion / collaboration - william.poos@nrb.be

Digital Reinvention by NRB

William Poos

DevOps Digital Transformation: A real life use case enabled by Alien4Cloud

Cloudify Community

黑豹 ch4 ddd pattern practice (2)

Fong Liou

Looking to design and build a centralized, scalable Feature Store for your Data Science & Machine Learning teams to take advantage of? Come and learn from experts of Provectus and Amazon Web Services (AWS) how to! Feature Store is a key component of the ML stack and data infrastructure, which enables feature engineering and management. By having a Feature Store, organizations can save massive amounts of resources, innovate faster, and drive ML processes at scale. In this webinar, you will learn how to build a Feature Store with a data mesh pattern and see how to achieve consistency between real-time and training features, to improve reproducibility with time-traveling for data. Agenda - Modern Data Lakes & Modern ML Infrastructure - Existing and Emerging Architectural Shifts - Feature Store: Overview and Reference Architecture - AWS Perspective on Feature Store Intended Audience Technology executives & decision makers, manager-level tech roles, data architects & analysts, data engineers & data scientists, ML practitioners & ML engineers, and developers Presenters - Stepan Pushkarev, Chief Technology Officer, Provectus - Gandhi Raketla, Senior Solutions Architect, AWS - German Osin, Senior Solutions Architect, Provectus Feel free to share this presentation with your colleagues and don't hesitate to reach out to us at info@provectus.com if you have any questions! REQUEST WEBINAR: https://provectus.com/webinar-feature-store-as-data-foundation-for-ml-nov-2020/

Feature Store as a Data Foundation for Machine Learning

Provectus

What do developers choose when they need a fast performing datastore with a flexible data model? Hands-down, they choose Redis. But, waiting for a Redis instance to be set up is not a favorite activity for many developers. This is why on-demand services for Redis have become popular. Developers can start building their applications with Redis right away. There is no fiddling around with installing, configuring, and operating the service. Redis for Pivotal Cloud Foundry offers dedicated and pre-provisioned service plans for Cloud Foundry developers that work in any cloud. These plans are tailored for typical patterns such as application caching and providing an in-memory datastore. These cover the most common requirements for developers creating net new applications or who are replatforming existing Redis applications. We'd like to invite you to a webinar discussing different ways to use Redis in cloud-native applications. We'll cover: - Use cases and requirements for developers - Alternative ways to access and manage Redis in the cloud - Features and roadmap of Redis for Pivotal Cloud Foundry - Quick demo Presenters: Greg Chase, Director of Products, Pivotal and Craig Olrich, Platform Architect, Pivotal

The Fastest Way to Redis on Pivotal Cloud Foundry

VMware Tanzu

Tutorial Getting Started part 1 - Overview

PascalDesmarets1

Links described during the presentation - Paran Yo, http://paran-yo-staging.appspot.com/ - AppEngine administration console: https://appengine.google.com - SDK Release notes (Python, PHP): https://code.google.com/p/googleappengine/wiki/SdkReleaseNotes - Google APIs Console: https://code.google.com/apis/console - CapeDwarf: Running Google App Engine apps in JBossAS7: http://www.jboss.org/capedwarf 2013-09-03 techtalk3-googleappengine-v0.00

ALT-F1 Techtalk 3 - Google AppEngine

Abdelkrim Boujraf

At ING we needed a way to implement Data science models from exploration into production. I will do this talk from my experience on the exploration and production Hadoop environment as a senior Ops engineer. For this we are using OpenShift to run Docker containers that connect to the big data Hadoop environment. During this talk I will explain why we need this and how this is done at ING. Also how to set up a docker container running a data science model using Hive, Python, and Spark. I’ll explain how to use Docker files to build Docker images, add all the needed components inside the Docker image, and how to run different versions of software in different containers. In the end I will also give a demo of how it runs and is automated using Git with webhook connecting to Jenkins and start the docker service that will connect to a big data Hadoop environment. This is going to be a great technical talk for engineers and data scientist. Speaker Lennard Cornelis, Ops Engineer, ING

Docker data science pipeline

DataWorks Summit

Cloud computing is now becoming the most cost effective, flexible, and innovative phenomenon of deploying enterprise applications. It brings speed, agility, elasticity, better resource utilization, and many other advantages over conventional computing systems. Implementing such a solution in an organization, might need a clear strategy that considers cloud computing models, platforms, standards, security and privacy, legacy applications, virtualization and computation power among other things. In this session Imesh will explain why your organization needs a Cloud strategy and what you need in order to successfully implement it. It will also discuss how WSO2 can help you do this with key products such as WSO2 API Manager, WSO2 Enterprise Service Bus (WSO2 ESB), WSO2 ESB connectors, WSO2 Identity Server, and WSO2 Cloud platform.

WSO2Con EU 2016: Planning Your Cloud Strategy

WSO2

DevOps on Oracle Cloud

Mee Nam Lee

More from PascalDesmarets1

With the fork & pull strategy, contributors create their own (remote) copy of the original repository and push changes to that copy, which is referred to as a fork. Once a contribution is ready, it can be submitted through a pull request: the contributor basically requests the maintainer(s) of the original repository to pull into that repository the work that has been prepared in a fork. Note that nothing prevents multiple contributors from working together in the same fork prior to submitting their changes to the original repository. The main advantage of the fork & pull strategy is that the contributors do not need to be explicitly granted push access rights to the original repository. That's why that strategy is typically used for large-scale open source projects where most contributors are not known by the maintainers of the repository. Another advantage of the fork & pull strategy is that it prevents the original repository from being polluted with branches that are created and then abandoned but never deleted by their author.

Tutorial Workgroup - Working with Forks

PascalDesmarets1

Tutorial Advanced How-To - Oracle 23c Duality views

PascalDesmarets1

Tackling complexity at the heart of data. With Domain-Driven Data Modeling (DDDM) the main principles are: - focus on your core ("domain and sub-domains") - break down complex problems into smaller ones ("bounded context") - use data modeling as a communication tool ("ubiquitous language") - keep together what belongs together ("aggregates") - reach a shared understanding between business and tech ("collaboration of domain experts and developers") - iterate and evolve ("continuous refinement")

Tutorial Getting Started part 4 - Domain-Driven Data Modeling

PascalDesmarets1

Tutorial Getting Started part 2 - Polyglot Data Modeling

PascalDesmarets1

Apache Avro is a language-neutral data serialization system, developed by Doug Cutting, the father of Hadoop. Avro is a preferred tool to serialize data in Hadoop. It is also the best choice as file format for data streaming with Kafka. Avro serializes the data which has a built-in schema. Avro serializes the data into a compact binary format, which can be deserialized by any application. Avro schemas defined in JSON, facilitate implementation in the languages that already have JSON libraries. Avro creates a self-describing file named Avro Data File, in which it stores data along with its schema in the metadata section.

Tutorial Expert How-To - Create a model for Avro schemas

PascalDesmarets1

Tutorial Expert How-To - Verify Data Model

PascalDesmarets1

Hackolade Studio includes the ability to maintain both a ‘business name’ and a ‘technical name’ for objects (containers, entities, and attributes.) To facilitate the maintenance of these 2 names, it is possible to keep them synchronized and transformed based on a set of user-driven parameters, and optionally based on a conversion file maintained outside of the application. Name conversion can go both directions: Business-to-Technical, or Technical-to-Business. Furthermore, when performing reverse-engineering, it is assumed that the database instance contains technical names, to be transformed in business names.

Tutorial Expert How-To - Naming Conventions

PascalDesmarets1

Exchanging data with Excel provides the ability to export a data model, or parts of it, to Microsoft Excel so properties could be easily edited in a tabular format, to be re-imported back into the application. It facilitates productive bulk actions for the maintenance of properties. It also allows creation of a new model - or additions to an existing model - by team members that might not have access to the application.

Tutorial Expert How-To - Export-Import with Excel template

PascalDesmarets1

An organization may create several different versions through the lifecycle of a model. That may be because of the natural evolution of the application in a design-first process, or just to keep up with changes being applied to the database instance. In any case, it is often required to compare different versions of a model to understand the differences, and optionally to merge these differences and create a new reference model.

Tutorial Expert How-To - Compare and Merge

PascalDesmarets1

Tutorial Expert How-To - Custom properties

PascalDesmarets1

Tutorial Expert How-To - Add reusable Definitions

PascalDesmarets1

Hackolade Tutorial - part 13 - Leverage a Polyglot data model

PascalDesmarets1

Hackolade Tutorial - part 12 - Create a REST API model

PascalDesmarets1

Hackolade Tutorial - part 8 - Import or reverse-engineer.pdf

PascalDesmarets1

Hackolade Tutorial - part 6 - Add choice, conditional, pattern fields.pdf

PascalDesmarets1

Hackolade Tutorial - part 4 - Create your first data model

PascalDesmarets1

Data modeling for relational databases is performed according to the rules of normalization, so larger tables are divided into smaller ones linked together with relationships. The purpose is to eliminate redundant or duplicate data. But NoSQL databases are completely different. They require a mindshift in schema design in order to leverage their capabilities, as well as a data modeling tool built specially for this new breed of state-of-the art technology.

Hackolade Tutorial - part 3 - Query-driven data modeling based on access patt...

PascalDesmarets1

Hackolade Tutorial - part 2 - Overview of JSON and JSON schema

PascalDesmarets1

Hackolade Tutorial - part 1 - What is a data model

PascalDesmarets1

More from PascalDesmarets1 (19)

Tutorial Workgroup - Working with Forks

Tutorial Advanced How-To - Oracle 23c Duality views

Tutorial Getting Started part 4 - Domain-Driven Data Modeling

Tutorial Getting Started part 2 - Polyglot Data Modeling

Tutorial Expert How-To - Create a model for Avro schemas

Tutorial Expert How-To - Verify Data Model

Tutorial Expert How-To - Naming Conventions

Tutorial Expert How-To - Export-Import with Excel template

Tutorial Expert How-To - Compare and Merge

Tutorial Expert How-To - Custom properties

Tutorial Expert How-To - Add reusable Definitions

Hackolade Tutorial - part 13 - Leverage a Polyglot data model

Hackolade Tutorial - part 12 - Create a REST API model

Hackolade Tutorial - part 8 - Import or reverse-engineer.pdf

Hackolade Tutorial - part 6 - Add choice, conditional, pattern fields.pdf

Hackolade Tutorial - part 4 - Create your first data model

Hackolade Tutorial - part 3 - Query-driven data modeling based on access patt...

Hackolade Tutorial - part 2 - Overview of JSON and JSON schema

Hackolade Tutorial - part 1 - What is a data model

Recently uploaded

What is a good lead in your organisation? Which leads are priority? What happens to leads? When sales and marketing give different answers to these questions, or perhaps aren't sure of the answers at all, frustrations build and opportunities are left on the table. Join us for an illuminating session with Cian McLoughlin, HubSpot Principal Customer Success Manager, as we look at that crucial piece of the customer journey in which leads are transferred from marketing to sales.

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

HampshireHUG

As privacy and data protection regulations evolve rapidly, organizations operating in multiple jurisdictions face mounting challenges to ensure compliance and safeguard customer data. With state-specific privacy laws coming up in multiple states this year, it is essential to understand what their unique data protection regulations will require clearly. How will data privacy evolve in the US in 2024? How to stay compliant? Our panellists will guide you through the intricacies of these states' specific data privacy laws, clarifying complex legal frameworks and compliance requirements. This webinar will review: - The essential aspects of each state's privacy landscape and the latest updates - Common compliance challenges faced by organizations operating in multiple states and best practices to achieve regulatory adherence - Valuable insights into potential changes to existing regulations and prepare your organization for the evolving landscape

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc

Histor y of HAM Radio presentation slide

vu2urc

Sara Mae O’Brien Scott and Tatiana Baquero Cakici, Senior Consultants at Enterprise Knowledge (EK), presented “AI Fast Track to Search-Focused AI Solutions” at the Information Architecture Conference (IAC24) that took place on April 11, 2024 in Seattle, WA. In their presentation, O’Brien-Scott and Cakici focused on what Enterprise AI is, why it is important, and what it takes to empower organizations to get started on a search-based AI journey and stay on track. The presentation explored the complexities of enterprise search challenges and how IA principles can be leveraged to provide AI solutions through the use of a semantic layer. O’Brien-Scott and Cakici showcased a case study where a taxonomy, an ontology, and a knowledge graph were used to structure content at a healthcare workforce solutions organization, providing personalized content recommendations and increasing content findability. In this session, participants gained insights about the following: Most common types of AI categories and use cases; Recommended steps to design and implement taxonomies and ontologies, ensuring they evolve effectively and support the organization’s search objectives; Taxonomy and ontology design considerations and best practices; Real-world AI applications that illustrated the value of taxonomies, ontologies, and knowledge graphs; and Tools, roles, and skills to design and implement AI-powered search solutions.

IAC 2024 - IA Fast Track to Search Focused AI Solutions

Enterprise Knowledge

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Neo4j

Discord is a free app offering voice, video, and text chat functionalities, primarily catering to the gaming community. It serves as a hub for users to create and join servers tailored to their interests. Discord’s ecosystem comprises servers, each functioning as a distinct online community with its own channels dedicated to specific topics or activities. Users can engage in text-based discussions, voice calls, or video chats within these channels. Understanding Discord Servers Discord servers are virtual spaces where users congregate to interact, share content, and build communities. Servers may revolve around gaming, hobbies, interests, or fandoms, providing a platform for like-minded individuals to connect. Communication Features Discord offers a range of communication tools, including text channels for messaging, voice channels for real-time audio conversations, and video channels for face-to-face interactions. These features facilitate seamless communication and collaboration. What Does NSFW Mean? The acronym NSFW stands for “Not Safe For Work,” indicating content that may be inappropriate for professional or public settings. NSFW Content NSFW content encompasses material that is sexually explicit, violent, or otherwise graphic in nature. It often includes nudity, profanity, or depictions of sensitive topics.

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

UK Journal

Heather Hedden, Senior Consultant at Enterprise Knowledge, presented “The Role of Taxonomy and Ontology in Semantic Layers” at a webinar hosted by Progress Semaphore on April 16, 2024. Taxonomies at their core enable effective tagging and retrieval of content, and combined with ontologies they extend to the management and understanding of related data. There are even greater benefits of taxonomies and ontologies to enhance your enterprise information architecture when applying them to a semantic layer. A survey by DBP-Institute found that enterprises using a semantic layer see their business outcomes improve by four times, while reducing their data and analytics costs. Extending taxonomies to a semantic layer can be a game-changing solution, allowing you to connect information silos, alleviate knowledge gaps, and derive new insights. Hedden, who specializes in taxonomy design and implementation, presented how the value of taxonomies shouldn’t reside in silos but be integrated with ontologies into a semantic layer. Learn about: - The essence and purpose of taxonomies and ontologies in information and knowledge management; - Advantages of semantic layers leveraging organizational taxonomies; and - Components and approaches to creating a semantic layer, including the integration of taxonomies and ontologies

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

Enterprise Knowledge

BooK Now Call us at +918448380779 to hire a gorgeous and seductive call girl for sex. Take a Delhi Escort Service. The help of our escort agency is mostly meant for men who want sexual Indian Escorts In Delhi NCR. It should be noted that any impersonator will get 100 attention from our Young Girls Escorts in Delhi. They will assume the position of reliable allies. VIP Call Girl With Original Photos Book Tonight +918448380779 Our Cheap Price 1 Hour not available 2 Hours 5000 Full Night 8000 TAG: Call Girls in Delhi, Noida, Gurgaon, Ghaziabad, Connaught Place, Greater Kailash Delhi, Lajpat Nagar Delhi, Mayur Vihar Delhi, Chanakyapuri Delhi, New Friends Colony Delhi, Majnu Ka Tilla, Karol Bagh, Malviya Nagar, Saket, Khan Market, Noida Sector 18, Noida Sector 76, Noida Sector 51, Gurgaon Mg Road, Iffco Chowk Gurgaon, Rajiv Chowk Gurgaon All Delhi Ncr Free Home Deliver

08448380779 Call Girls In Friends Colony Women Seeking Men

Delhi Call girls

Finology Group – Insurtech Innovation Award 2024

The Digital Insurer

Imagine a world where information flows as swiftly as thought itself, making decision-making as fluid as the data driving it. Every moment is critical, and the right tools can significantly boost your organization’s performance. The power of real-time data automation through FME can turn this vision into reality. Aimed at professionals eager to leverage real-time data for enhanced decision-making and efficiency, this webinar will cover the essentials of real-time data and its significance. We’ll explore: FME’s role in real-time event processing, from data intake and analysis to transformation and reporting An overview of leveraging streams vs. automations FME’s impact across various industries highlighted by real-life case studies Live demonstrations on setting up FME workflows for real-time data Practical advice on getting started, best practices, and tips for effective implementation Join us to enhance your skills in real-time data automation with FME, and take your operational capabilities to the next level.

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Safe Software

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

The 7 Things I Know About Cyber Security After 25 Years | April 2024

Rafal Los

How to convert PDF to text with Nanonets

naman860154

MySQL Webinar, presented on the 25th of April, 2024. Summary: MySQL solutions enable the deployment of diverse Database Architectures tailored to specific needs, including High Availability, Disaster Recovery, and Read Scale-Out. With MySQL Shell's AdminAPI, administrators can seamlessly set up, manage, and monitor these solutions, ensuring efficiency and ease of use in their administration. MySQL Router, on the other hand, provides transparent routing from the application traffic to the backend servers in the architectures, requiring minimal configuration. Completely built in-house and supported by Oracle, these solutions have been adopted by enterprises of all sizes for their business-critical applications. In this presentation, we'll delve into various database architecture solutions to help you choose the right one based on your business requirements. Focusing on technical details and the latest features to maximize the potential of these solutions.

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Miguel Araújo

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

Evaluating the top large language models.pdf

ChristopherTHyatt

Automating Google Workspace (GWS) & more with Apps Script

wesley chun

Data Cloud, More than a CDP by Matt Robison

Anna Loughnan Colquhoun

Partners Life - Insurer Innovation Award 2024

The Digital Insurer

08448380779 Call Girls In Civil Lines Women Seeking Men

Delhi Call girls

Recently uploaded (20)

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

Histor y of HAM Radio presentation slide

IAC 2024 - IA Fast Track to Search Focused AI Solutions

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

08448380779 Call Girls In Friends Colony Women Seeking Men

Finology Group – Insurtech Innovation Award 2024

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

presentation ICT roal in 21st century education

The 7 Things I Know About Cyber Security After 25 Years | April 2024

How to convert PDF to text with Nanonets

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

How to Troubleshoot Apps for the Modern Connected Worker

Evaluating the top large language models.pdf

Automating Google Workspace (GWS) & more with Apps Script

Data Cloud, More than a CDP by Matt Robison

Partners Life - Insurer Innovation Award 2024

08448380779 Call Girls In Civil Lines Women Seeking Men

Tutorial Expert How-To - Docker-based automation

2. Design Data Model Generate Schema Catalog Publish Use Evaluate Data Modeler Data Architect Subject Matter Expert Data Engineer Data Analyst Business Analyst Data models lifecycle unified with DevOps applications Copyright © 2016-2023 Hackolade Application Metadata Dev Ops

3. Role of Data Modeling in an Agile/DevOps context Copyright © 2016-2022 Hackolade 3 Domain-Driven Design Physical Data Modeling Iterative Evolution Fake data Generation Optimization Governance & Compliance Maintenance & Performance, Documentation & Facilitation

4. We call this Metadata-as-Code 4

5. Data models Schema contracts Application code Git repository DevOps CI/CD pipeline Application Database Copyright © 2016-2023 Hackolade 5 Using GIT to Co-locate metadata with application code Environments: • Dev • Test • Integration • Production ALTER scripts

6. … … Consumers Subject area models Project models Models Local Repo Local Repo Local Repo Clone Push Pull Merge … Copyright © 2016-2022 Hackolade 6 Hackolade Studio to Schema Repo workflow CLI Schemas DDL files OAS files JSON Schema files Avro Schema files …

11. Run concurrent multi-threaded CLI commands in Docker containers • Resources: • Documentation: https://github.com/hackolade/docker/tree/main/Studio • Script for this tutorial: https://github.com/hackolade/docker/blob/main/Studio/tutorial/Docker%2B CLI-tutorial.md • GitHub Actions procedure: https://docs.github.com/en/actions/creating- actions/creating-a-docker-container-action • Using provided Dockerfile.app in the repo Copyright © 2016-2023 Hackolade 11

12. Example scenarios 1. Reverse-engineer database instance overnight 2. Compare reverse-engineered model with baseline model, and generate delta model 3. Generate documentation in html+pdf format for reverse- engineered data model Copyright © 2016-2023 Hackolade 12

13. Reading material • See Hackolade online documentation • The Hackolade Blog • Hackolade’s on social media: LinkedIn page, Twitter page • Download Hackolade Studio for free • This excellent new book: MongoDB Data Modeling & Schema Design • Many of the principles in the book are related to query driven modeling based on access patterns Copyright © 2016-2023 Hackolade 13

Tutorial Expert How-To - Docker-based automation

Recommended

Recommended

More Related Content

Similar to Tutorial Expert How-To - Docker-based automation

Similar to Tutorial Expert How-To - Docker-based automation (20)

More from PascalDesmarets1

More from PascalDesmarets1 (19)

Recently uploaded

Recently uploaded (20)

Tutorial Expert How-To - Docker-based automation