Tutorial Expert How-To - Add reusable Definitions

•

0 likes•12 views

This document provides an overview of reusable definitions in Hackolade: - Definitions can be created at the entity, model, and external levels to increase productivity, consistency, and data quality - Definitions can be converted from objects and referenced in multiple places - The Model Definitions tab allows maintaining and viewing where definitions are used - JSON Schema previews show how definitions are resolved and converted to internal structures - Definitions can be extended or replaced as needed, and referenced from external files

Technology

Hackolade Tutorial
Tutorial Expert – Add Reusable Definitions
Copyright © 2016-2023 Hackolade 1

Why reusable definitions?
• To increase productivity
• To increase convenience
• To increase consistency
• To achieve higher data quality
• To achieve higher degrees of governance
• To stitch together different domain models into an umbrella model
• Create and maintain object definitions that can be reused in multiple
places
Copyright © 2016-2023 Hackolade 2

About definitions
• At 3 levels:
• Internal definitions: at the entity level
• Ensure JSON schema compatibility
• Noted as (i) in the ERD view
• Model definitions: at the model level
• Noted as (m) in the ERD view
• Different names in some targets:
• “User Defined Types” in some relational targets
• “Definitions” in Swagger
• “Components” in OpenAPI
• External definitions: across data models
• Noted as (e) in the ERD view
Copyright © 2016-2023 Hackolade 3

Convert an object into a model definition
• ERD and schema tree view updated
• Model definitions tab is updated
Copyright © 2016-2023 Hackolade 4

Reference an existing definition
• Via context menu
Copyright © 2016-2023 Hackolade 5

Maintain definitions
• In Model Definitions tab: changes immediately reflected wherever
referenced
Copyright © 2016-2023 Hackolade 6

JSON Schema Preview
• Using $ref syntax
• Referenced, Resolved and Internal
views
Copyright © 2016-2023 Hackolade 7

Resolved and Internal view
Copyright © 2016-2023 Hackolade 8
Resolved: the $ref pointer is replaced by the actual
structure of the definition
Internal: the model definition is converted into an internal
definition for the entity, according to the JSON Schema standard

Deviate from a definition
• By creating a 2nd definition that
matches new needs
• By replacing the definition with
attributes
Copyright © 2016-2023 Hackolade 9

Display Where-Used
• When definitions are used in
multiple places
Copyright © 2016-2023 Hackolade 10

External definitions
• External files:
• Hackolade data model
• JSON schema
• Swagger/OpenAPI specs
• Can be referenced in whole or in
part
• Note choice of path!
• Avoid too many recursive
references!
Copyright © 2016-2023 Hackolade 11

Reading material
• See Hackolade online documentation
• The Hackolade Blog
• This excellent new book:
MongoDB Data Modeling & Schema Design
• Many of the principles in the book are related to query
driven modeling based on access patterns!
• Hackolade’s on social media: LinkedIn page, Twitter page
• Download Hackolade studio for free
Copyright © 2016-2023 Hackolade 12

Questions?
Answers!
Copyright © 2016-2023 Hackolade 13

Similar to Tutorial Expert How-To - Add reusable Definitions

Apache Avro is a language-neutral data serialization system, developed by Doug Cutting, the father of Hadoop. Avro is a preferred tool to serialize data in Hadoop. It is also the best choice as file format for data streaming with Kafka. Avro serializes the data which has a built-in schema. Avro serializes the data into a compact binary format, which can be deserialized by any application. Avro schemas defined in JSON, facilitate implementation in the languages that already have JSON libraries. Avro creates a self-describing file named Avro Data File, in which it stores data along with its schema in the metadata section.

Tutorial Expert How-To - Create a model for Avro schemas

PascalDesmarets1

Hackolade Studio has native integration with Git repositories to provide state-of-the-art collaboration, versioning, branching, conflict resolution, peer review workflows, change tracking and traceability. Mostly, it allows to co-locate data models and schemas with application code, and further integrate with DevOps CI/CD pipelines as part of our vision for Metadata-as-Code. Co-located application code and data models provide the single source-of-truth for business and technical stakeholders.

Tutorial Workgroup - Model versioning and collaboration

PascalDesmarets1

Tutorial Expert How-To - Verify Data Model

PascalDesmarets1

NoSQL Simplified: Schema vs. Schema-less

InfiniteGraph

Tackling complexity at the heart of data. With Domain-Driven Data Modeling (DDDM) the main principles are: - focus on your core ("domain and sub-domains") - break down complex problems into smaller ones ("bounded context") - use data modeling as a communication tool ("ubiquitous language") - keep together what belongs together ("aggregates") - reach a shared understanding between business and tech ("collaboration of domain experts and developers") - iterate and evolve ("continuous refinement")

Tutorial Getting Started part 4 - Domain-Driven Data Modeling

PascalDesmarets1

W3C Web Annotation WG Update (I Annotate 2016)

Robert Sanderson

Tutorial Getting Started part 2 - Polyglot Data Modeling

PascalDesmarets1

Which Questions We Should Have

Oracle Korea

In this Chapter, we consider relational databases as a data source for the generation of Linked Data, given that they constitute one of the most popular data storage media, containing huge data volumes that feed the vast majority of information systems worldwide. In this context, we review the related literature and reveal the main motivations that fuel the relevant approaches, and the benefits that arise from their application. We present a categorization of approaches that map relational databases to the Semantic Web and identify tool implementations that extract RDF graphs from relational database instances. We also sketch a proof-of-concept use case scenario regarding how a repository with scholarly information can be converted to a Linked Data endpoint. The Chapter ends with a discussion of the open issues and future outlook for the problem of RDF generation from relational databases.

Creating Linked Data from Relational Databases

Nikolaos Konstantinou

First Steps in Semantic Data Modelling and Search & Analytics in the Cloud

Ontotext

Intresting changes in mongo 2.6

David Murphy

Tutorial Expert How-To - Docker-based automation

PascalDesmarets1

Arches Getty Brownbag Talk

benosteen

Hackolade Tutorial - part 2 - Overview of JSON and JSON schema

PascalDesmarets1

Co-locate data models and their schema artifacts with application code, so they can follow the lifecycle of application changes. Provides a single source-of-truth for business and technical stakeholders as the data model in the Git repo is the source of the technical schemas used by applications, databases, and APIs at the same time as it is the source for the business-facing data dictionaries. This architecture contributes to the shared understanding of the context and meaning of data by all the stakeholders.

Tutorial Getting Started part 3 - Metadata-as-Code

PascalDesmarets1

With Adobe Experience Manager 6.2 a new template editor has been introduced that provides new, powerful ways to build, structure and configure digital properties. Explore the feature from a super-author perspective to understand how it allows to compose different page templates and control exactly what content authors are allowed to do on the corresponding pages. Finally, dive into the inner mechanics to understand how it works under the hood. In this session: - Learn how the template editor can make sites more flexible - Have an overview of how the templating mechanics operate View the on-demand session at http://bit.ly/AEMGEMS91416 or the MP4 version http://bit.ly/AEMGEM91416MP4

AEM GEMS Session Template Editor Sept 14 2016

AdobeMarketingCloud

Whats new in search in SharePoint 2013

Michal Pisarek

NHSPUG June 2015 - Must Love Term Sets: The New and Improved Managed Metadat...

Jonathan Ralton

Mongo DB

Tata Consultancy Services

Mongo db 3.4 Overview

Norberto Leite

More from PascalDesmarets1

With the fork & pull strategy, contributors create their own (remote) copy of the original repository and push changes to that copy, which is referred to as a fork. Once a contribution is ready, it can be submitted through a pull request: the contributor basically requests the maintainer(s) of the original repository to pull into that repository the work that has been prepared in a fork. Note that nothing prevents multiple contributors from working together in the same fork prior to submitting their changes to the original repository. The main advantage of the fork & pull strategy is that the contributors do not need to be explicitly granted push access rights to the original repository. That's why that strategy is typically used for large-scale open source projects where most contributors are not known by the maintainers of the repository. Another advantage of the fork & pull strategy is that it prevents the original repository from being polluted with branches that are created and then abandoned but never deleted by their author.

Tutorial Workgroup - Working with Forks

PascalDesmarets1

Tutorial Getting Started part 1 - Overview

PascalDesmarets1

Hackolade Studio includes the ability to maintain both a ‘business name’ and a ‘technical name’ for objects (containers, entities, and attributes.) To facilitate the maintenance of these 2 names, it is possible to keep them synchronized and transformed based on a set of user-driven parameters, and optionally based on a conversion file maintained outside of the application. Name conversion can go both directions: Business-to-Technical, or Technical-to-Business. Furthermore, when performing reverse-engineering, it is assumed that the database instance contains technical names, to be transformed in business names.

Tutorial Expert How-To - Naming Conventions

PascalDesmarets1

Exchanging data with Excel provides the ability to export a data model, or parts of it, to Microsoft Excel so properties could be easily edited in a tabular format, to be re-imported back into the application. It facilitates productive bulk actions for the maintenance of properties. It also allows creation of a new model - or additions to an existing model - by team members that might not have access to the application.

Tutorial Expert How-To - Export-Import with Excel template

PascalDesmarets1

An organization may create several different versions through the lifecycle of a model. That may be because of the natural evolution of the application in a design-first process, or just to keep up with changes being applied to the database instance. In any case, it is often required to compare different versions of a model to understand the differences, and optionally to merge these differences and create a new reference model.

Tutorial Expert How-To - Compare and Merge

PascalDesmarets1

Tutorial Expert How-To - Custom properties

PascalDesmarets1

Tutorial Expert How-To - Command Line Interface (CLI)

PascalDesmarets1

Hackolade Tutorial - part 13 - Leverage a Polyglot data model

PascalDesmarets1

Hackolade Tutorial - part 12 - Create a REST API model

PascalDesmarets1

Hackolade Tutorial - part 8 - Import or reverse-engineer.pdf

PascalDesmarets1

Hackolade Tutorial - part 4 - Create your first data model

PascalDesmarets1

Hackolade Tutorial - part 1 - What is a data model

PascalDesmarets1

More from PascalDesmarets1 (12)

Tutorial Workgroup - Working with Forks

Tutorial Getting Started part 1 - Overview

Tutorial Expert How-To - Naming Conventions

Tutorial Expert How-To - Export-Import with Excel template

Tutorial Expert How-To - Compare and Merge

Tutorial Expert How-To - Custom properties

Tutorial Expert How-To - Command Line Interface (CLI)

Hackolade Tutorial - part 13 - Leverage a Polyglot data model

Hackolade Tutorial - part 12 - Create a REST API model

Hackolade Tutorial - part 8 - Import or reverse-engineer.pdf

Hackolade Tutorial - part 4 - Create your first data model

Hackolade Tutorial - part 1 - What is a data model

Recently uploaded

Histor y of HAM Radio presentation slide

vu2urc

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

Developing An App To Navigate The Roads of Brazil

V3cube

This presentation explores the impact of HTML injection attacks on web applications, detailing how attackers exploit vulnerabilities to inject malicious code into web pages. Learn about the potential consequences of such attacks and discover effective mitigation strategies to protect your web applications from HTML injection vulnerabilities. for more information visit https://bostoninstituteofanalytics.org/category/cyber-security-ethical-hacking/

HTML Injection Attacks: Impact and Mitigation Strategies

Boston Institute of Analytics

Discord is a free app offering voice, video, and text chat functionalities, primarily catering to the gaming community. It serves as a hub for users to create and join servers tailored to their interests. Discord’s ecosystem comprises servers, each functioning as a distinct online community with its own channels dedicated to specific topics or activities. Users can engage in text-based discussions, voice calls, or video chats within these channels. Understanding Discord Servers Discord servers are virtual spaces where users congregate to interact, share content, and build communities. Servers may revolve around gaming, hobbies, interests, or fandoms, providing a platform for like-minded individuals to connect. Communication Features Discord offers a range of communication tools, including text channels for messaging, voice channels for real-time audio conversations, and video channels for face-to-face interactions. These features facilitate seamless communication and collaboration. What Does NSFW Mean? The acronym NSFW stands for “Not Safe For Work,” indicating content that may be inappropriate for professional or public settings. NSFW Content NSFW content encompasses material that is sexually explicit, violent, or otherwise graphic in nature. It often includes nudity, profanity, or depictions of sensitive topics.

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

UK Journal

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

Handwritten Text Recognition for manuscripts and early printed texts

Maria Levchenko

GenCyber Cyber Security Day Presentation

Michael W. Hawkins

GenAI Risks & Security Meetup 01052024.pdf

lior mazor

As privacy and data protection regulations evolve rapidly, organizations operating in multiple jurisdictions face mounting challenges to ensure compliance and safeguard customer data. With state-specific privacy laws coming up in multiple states this year, it is essential to understand what their unique data protection regulations will require clearly. How will data privacy evolve in the US in 2024? How to stay compliant? Our panellists will guide you through the intricacies of these states' specific data privacy laws, clarifying complex legal frameworks and compliance requirements. This webinar will review: - The essential aspects of each state's privacy landscape and the latest updates - Common compliance challenges faced by organizations operating in multiple states and best practices to achieve regulatory adherence - Valuable insights into potential changes to existing regulations and prepare your organization for the evolving landscape

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc

Created by Mozilla Research in 2012 and now part of Linux Foundation Europe, the Servo project is an experimental rendering engine written in Rust. It combines memory safety and concurrency to create an independent, modular, and embeddable rendering engine that adheres to web standards. Stewardship of Servo moved from Mozilla Research to the Linux Foundation in 2020, where its mission remains unchanged. After some slow years, in 2023 there has been renewed activity on the project, with a roadmap now focused on improving the engine’s CSS 2 conformance, exploring Android support, and making Servo a practical embeddable rendering engine. In this presentation, Rakhi Sharma reviews the status of the project, our recent developments in 2023, our collaboration with Tauri to make Servo an easy-to-use embeddable rendering engine, and our plans for the future to make Servo an alternative web rendering engine for the embedded devices industry. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://ossna2024.sched.com/event/1aBNF/a-year-of-servo-reboot-where-are-we-now-rakhi-sharma-igalia

A Year of the Servo Reboot: Where Are We Now?

Igalia

A Domino Admins Adventures (Engage 2024)

Gabriella Davis

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

Real Time Object Detection Using Open CV

Khem

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

apidays

Tech Trends Report 2024 Future Today Institute.pdf

hans926745

Building Digital Trust in a Digital Economy Veronica Tan, Director - Cyber Security Agency of Singapore Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

apidays

Automating Google Workspace (GWS) & more with Apps Script

wesley chun

Abhishek Deb(1), Mr Abdul Kalam(2) M. Des (UX) , School of Design, DIT University , Dehradun. This paper explores the future potential of AI-enabled smartphone processors, aiming to investigate the advancements, capabilities, and implications of integrating artificial intelligence (AI) into smartphone technology. The research study goals consist of evaluating the development of AI in mobile phone processors, analyzing the existing state as well as abilities of AI-enabled cpus determining future patterns as well as chances together with reviewing obstacles as well as factors to consider for more growth.

Exploring the Future Potential of AI-Enabled Smartphone Processors

debabhi2

Recently uploaded (20)

Histor y of HAM Radio presentation slide

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Developing An App To Navigate The Roads of Brazil

HTML Injection Attacks: Impact and Mitigation Strategies

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Handwritten Text Recognition for manuscripts and early printed texts

GenCyber Cyber Security Day Presentation

GenAI Risks & Security Meetup 01052024.pdf

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

A Year of the Servo Reboot: Where Are We Now?

A Domino Admins Adventures (Engage 2024)

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

Strategies for Landing an Oracle DBA Job as a Fresher

Real Time Object Detection Using Open CV

Apidays New York 2024 - The value of a flexible API Management solution for O...

Tech Trends Report 2024 Future Today Institute.pdf

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Automating Google Workspace (GWS) & more with Apps Script

Exploring the Future Potential of AI-Enabled Smartphone Processors

Tutorial Expert How-To - Add reusable Definitions

2. Why reusable definitions? • To increase productivity • To increase convenience • To increase consistency • To achieve higher data quality • To achieve higher degrees of governance • To stitch together different domain models into an umbrella model • Create and maintain object definitions that can be reused in multiple places Copyright © 2016-2023 Hackolade 2

3. About definitions • At 3 levels: • Internal definitions: at the entity level • Ensure JSON schema compatibility • Noted as (i) in the ERD view • Model definitions: at the model level • Noted as (m) in the ERD view • Different names in some targets: • “User Defined Types” in some relational targets • “Definitions” in Swagger • “Components” in OpenAPI • External definitions: across data models • Noted as (e) in the ERD view Copyright © 2016-2023 Hackolade 3

8. Resolved and Internal view Copyright © 2016-2023 Hackolade 8 Resolved: the $ref pointer is replaced by the actual structure of the definition Internal: the model definition is converted into an internal definition for the entity, according to the JSON Schema standard

11. External definitions • External files: • Hackolade data model • JSON schema • Swagger/OpenAPI specs • Can be referenced in whole or in part • Note choice of path! • Avoid too many recursive references! Copyright © 2016-2023 Hackolade 11

12. Reading material • See Hackolade online documentation • The Hackolade Blog • This excellent new book: MongoDB Data Modeling & Schema Design • Many of the principles in the book are related to query driven modeling based on access patterns! • Hackolade’s on social media: LinkedIn page, Twitter page • Download Hackolade studio for free Copyright © 2016-2023 Hackolade 12

Tutorial Expert How-To - Add reusable Definitions

Recommended

Recommended

More Related Content

Similar to Tutorial Expert How-To - Add reusable Definitions

Similar to Tutorial Expert How-To - Add reusable Definitions (20)

More from PascalDesmarets1

More from PascalDesmarets1 (12)

Recently uploaded

Recently uploaded (20)

Tutorial Expert How-To - Add reusable Definitions