Data Models [DATABASE SYSTEMS: Design, Implementation, and Management]Usman Tariq
In this PPT, you will learn:
• About data modeling and why data models are important
• About the basic data-modeling building blocks
• What business rules are and how they influence database design
• How the major data models evolved
• About emerging alternative data models and the needs they fulfill
• How data models can be classified by their level of abstraction
Author: Carlos Coronel | Steven Morris
Project PlanFor our Project Plan, we are going to develop.docxwkyra78
Project Plan
For our Project Plan, we are going to develop a new information system for a mid-size organization that will automate the payroll transactions. Since we already have all the information that the new system needed, we propose to use the Waterfall Development Methodology because we are going from one phase to the next.
Planning
System
Implementation
Design
Analysis
Estimated Projected Time Frame:
For Estimating the Project Time Frame, the project manager will develop a preliminary estimation of how long it will take to build the new system. There are several sources that the project manager uses to estimate the time frame. First is they can take it from projects that had similar tasks and technologies, an experienced developers can provided the estimation, or the type of methodology that is being used. It is a good practice to keep track of actual time and effort values during the SDLC so the data can be redefine and are used as a guide for future projects. For now, I will use the Industry standard to estimate the project time frame. Within the Industry standard for a typical business application system, they will spends 15% of effort in the planning phase, 20% in the analysis phase, 35% in the design phase, and 30% in the implementation phase. With the planning phase take 5 month to complete, then for the total project time is 33.3 person-month to complete the project.
Project time line
Planning
Analysis
Design
Implementation
15%
20%
35%
30%
5 person-month
6.66 person-month
11.66 person-month
10 person-month
Developing the Work Plan:
Once the project schedule has been established, the project manager can start creating a work plan for the project. The work plan is a schedule that he projects manager use to keep record and keep track of all the tasks that need to be accomplished over the entire project. The project manager will need to identify the entire task that are needed and determine how long each of the tasks will take. Then the task will be organized within the work breakdown structure. For the main task to be complete, the subtask has to be completed first.
Staffing the Project:
The project manager needs to figure out how many staff is needed for the project. The amount of staff is needed depend on how fast they want to finish the project. Increase in staff does not mean increases in productivity. If more staff is needed, make sure to have some kind of reporting structure. The project manager needs to know the staff capabilities and assign task according to their skills. Project manager needs to know how to motivate the staff for a project success.
Coordinating Project Activities:
The project manager needs to have activities put in place during the entire SDLC. Activities are tools that is use to ensure that he project stays on track and that the chance of failure is kept to a minimum. Case Tools (computer-aided software engineering), Standards, and Documentation are all activi ...
This video will give you an idea about Data science for beginners.
Also explain Data Science Process , Data Science Job Roles , Stages in Data Science Project
May Marketo Masterclass, London MUG May 22 2024.pdfAdele Miller
Can't make Adobe Summit in Vegas? No sweat because the EMEA Marketo Engage Champions are coming to London to share their Summit sessions, insights and more!
This is a MUG with a twist you don't want to miss.
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...Globus
The Earth System Grid Federation (ESGF) is a global network of data servers that archives and distributes the planet’s largest collection of Earth system model output for thousands of climate and environmental scientists worldwide. Many of these petabyte-scale data archives are located in proximity to large high-performance computing (HPC) or cloud computing resources, but the primary workflow for data users consists of transferring data, and applying computations on a different system. As a part of the ESGF 2.0 US project (funded by the United States Department of Energy Office of Science), we developed pre-defined data workflows, which can be run on-demand, capable of applying many data reduction and data analysis to the large ESGF data archives, transferring only the resultant analysis (ex. visualizations, smaller data files). In this talk, we will showcase a few of these workflows, highlighting how Globus Flows can be used for petabyte-scale climate analysis.
Understanding Globus Data Transfers with NetSageGlobus
NetSage is an open privacy-aware network measurement, analysis, and visualization service designed to help end-users visualize and reason about large data transfers. NetSage traditionally has used a combination of passive measurements, including SNMP and flow data, as well as active measurements, mainly perfSONAR, to provide longitudinal network performance data visualization. It has been deployed by dozens of networks world wide, and is supported domestically by the Engagement and Performance Operations Center (EPOC), NSF #2328479. We have recently expanded the NetSage data sources to include logs for Globus data transfers, following the same privacy-preserving approach as for Flow data. Using the logs for the Texas Advanced Computing Center (TACC) as an example, this talk will walk through several different example use cases that NetSage can answer, including: Who is using Globus to share data with my institution, and what kind of performance are they able to achieve? How many transfers has Globus supported for us? Which sites are we sharing the most data with, and how is that changing over time? How is my site using Globus to move data internally, and what kind of performance do we see for those transfers? What percentage of data transfers at my institution used Globus, and how did the overall data transfer performance compare to the Globus users?
Quarkus Hidden and Forbidden ExtensionsMax Andersen
Quarkus has a vast extension ecosystem and is known for its subsonic and subatomic feature set. Some of these features are not as well known, and some extensions are less talked about, but that does not make them less interesting - quite the opposite.
Come join this talk to see some tips and tricks for using Quarkus and some of the lesser known features, extensions and development techniques.
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTier1 app
Even though at surface level ‘java.lang.OutOfMemoryError’ appears as one single error; underlyingly there are 9 types of OutOfMemoryError. Each type of OutOfMemoryError has different causes, diagnosis approaches and solutions. This session equips you with the knowledge, tools, and techniques needed to troubleshoot and conquer OutOfMemoryError in all its forms, ensuring smoother, more efficient Java applications.
Globus Connect Server Deep Dive - GlobusWorld 2024Globus
We explore the Globus Connect Server (GCS) architecture and experiment with advanced configuration options and use cases. This content is targeted at system administrators who are familiar with GCS and currently operate—or are planning to operate—broader deployments at their institution.
Experience our free, in-depth three-part Tendenci Platform Corporate Membership Management workshop series! In Session 1 on May 14th, 2024, we began with an Introduction and Setup, mastering the configuration of your Corporate Membership Module settings to establish membership types, applications, and more. Then, on May 16th, 2024, in Session 2, we focused on binding individual members to a Corporate Membership and Corporate Reps, teaching you how to add individual members and assign Corporate Representatives to manage dues, renewals, and associated members. Finally, on May 28th, 2024, in Session 3, we covered questions and concerns, addressing any queries or issues you may have.
For more Tendenci AMS events, check out www.tendenci.com/events
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar
The European Union Agency for Law Enforcement Cooperation (Europol) has suffered an alleged data breach after a notorious threat actor claimed to have exfiltrated data from its systems. Infamous data leaker IntelBroker posted on the even more infamous BreachForums hacking forum, saying that Europol suffered a data breach this month.
The alleged breach affected Europol agencies CCSE, EC3, Europol Platform for Experts, Law Enforcement Forum, and SIRIUS. Infiltration of these entities can disrupt ongoing investigations and compromise sensitive intelligence shared among international law enforcement agencies.
However, this is neither the first nor the last activity of IntekBroker. We have compiled for you what happened in the last few days. To track such hacker activities on dark web sources like hacker forums, private Telegram channels, and other hidden platforms where cyber threats often originate, you can check SOCRadar’s Dark Web News.
Stay Informed on Threat Actors’ Activity on the Dark Web with SOCRadar!
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisGlobus
JASMIN is the UK’s high-performance data analysis platform for environmental science, operated by STFC on behalf of the UK Natural Environment Research Council (NERC). In addition to its role in hosting the CEDA Archive (NERC’s long-term repository for climate, atmospheric science & Earth observation data in the UK), JASMIN provides a collaborative platform to a community of around 2,000 scientists in the UK and beyond, providing nearly 400 environmental science projects with working space, compute resources and tools to facilitate their work. High-performance data transfer into and out of JASMIN has always been a key feature, with many scientists bringing model outputs from supercomputers elsewhere in the UK, to analyse against observational or other model data in the CEDA Archive. A growing number of JASMIN users are now realising the benefits of using the Globus service to provide reliable and efficient data movement and other tasks in this and other contexts. Further use cases involve long-distance (intercontinental) transfers to and from JASMIN, and collecting results from a mobile atmospheric radar system, pushing data to JASMIN via a lightweight Globus deployment. We provide details of how Globus fits into our current infrastructure, our experience of the recent migration to GCSv5.4, and of our interest in developing use of the wider ecosystem of Globus services for the benefit of our user community.
A Comprehensive Look at Generative AI in Retail App Testing.pdfkalichargn70th171
Traditional software testing methods are being challenged in retail, where customer expectations and technological advancements continually shape the landscape. Enter generative AI—a transformative subset of artificial intelligence technologies poised to revolutionize software testing.
How to Position Your Globus Data Portal for Success Ten Good PracticesGlobus
Science gateways allow science and engineering communities to access shared data, software, computing services, and instruments. Science gateways have gained a lot of traction in the last twenty years, as evidenced by projects such as the Science Gateways Community Institute (SGCI) and the Center of Excellence on Science Gateways (SGX3) in the US, The Australian Research Data Commons (ARDC) and its platforms in Australia, and the projects around Virtual Research Environments in Europe. A few mature frameworks have evolved with their different strengths and foci and have been taken up by a larger community such as the Globus Data Portal, Hubzero, Tapis, and Galaxy. However, even when gateways are built on successful frameworks, they continue to face the challenges of ongoing maintenance costs and how to meet the ever-expanding needs of the community they serve with enhanced features. It is not uncommon that gateways with compelling use cases are nonetheless unable to get past the prototype phase and become a full production service, or if they do, they don't survive more than a couple of years. While there is no guaranteed pathway to success, it seems likely that for any gateway there is a need for a strong community and/or solid funding streams to create and sustain its success. With over twenty years of examples to draw from, this presentation goes into detail for ten factors common to successful and enduring gateways that effectively serve as best practices for any new or developing gateway.
Cyaniclab : Software Development Agency Portfolio.pdfCyanic lab
CyanicLab, an offshore custom software development company based in Sweden,India, Finland, is your go-to partner for startup development and innovative web design solutions. Our expert team specializes in crafting cutting-edge software tailored to meet the unique needs of startups and established enterprises alike. From conceptualization to execution, we offer comprehensive services including web and mobile app development, UI/UX design, and ongoing software maintenance. Ready to elevate your business? Contact CyanicLab today and let us propel your vision to success with our top-notch IT solutions.
Enterprise Resource Planning System includes various modules that reduce any business's workload. Additionally, it organizes the workflows, which drives towards enhancing productivity. Here are a detailed explanation of the ERP modules. Going through the points will help you understand how the software is changing the work dynamics.
To know more details here: https://blogs.nyggs.com/nyggs/enterprise-resource-planning-erp-system-modules/
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamtakuyayamamoto1800
In this slide, we show the simulation example and the way to compile this solver.
In this solver, the Helmholtz equation can be solved by helmholtzFoam. Also, the Helmholtz equation with uniformly dispersed bubbles can be simulated by helmholtzBubbleFoam.
Unleash Unlimited Potential with One-Time Purchase
BoxLang is more than just a language; it's a community. By choosing a Visionary License, you're not just investing in your success, you're actively contributing to the ongoing development and support of BoxLang.
Navigating the Metaverse: A Journey into Virtual Evolution"Donna Lenk
Join us for an exploration of the Metaverse's evolution, where innovation meets imagination. Discover new dimensions of virtual events, engage with thought-provoking discussions, and witness the transformative power of digital realms."
3. A PREVIEW: GETTING STARTED WITH A DATABASE
PROJECT
SQL and Scripting
Training
4. 4
HOW TO GET STARTED WITH A DATABASE PROJECT
1. Explore the project
a) Size, scope, depth and breath
b) Executive sponsor and/or funding
2. Review data to be modeled (for Capstone, NIH database)
3. Develop SoW (define scope, depth, limits)
4. Develop ERD (entities, attributes, relationships)
5. Normalize the Model (remove anomalies from the model)
5. 5
HOW TO GET STARTED WITH A DATABASE PROJECT
6. Apply the Normalized Model
a. Create the Database (create database)
b. Create tables with fields using Data Definition Language (DDL)
c. Create Data Manipulation Language (DML) to query (question) the data
7. Implement Functionality
a. Use Python to extract data from a data source
b. Load extracted data into the database
c. Be able to report on the data loaded into the database
6. 6
EXPLORATION OF THE PROJECT
Essential starter questions:
a) Size, scope, depth, and breadth
b) Executive sponsor and/or funding
This information is usually obtained in company meetings, IT staff meetings, previous project
documentation, etc.
The data collection and associated information will be used in the SoW, which we will
discuss.
8. 8
STARTING A DATABASE PROJECT
When starting a Database Project, we need to
understand, through research and user
interviews:
Use Cases are how users will specifically use the
database (for example; a user will add; a user will
change; a user will delete data in the database)
Business Rules are what we can/can’t do, or
restrictions and limits on the database (or software).
9. 9
WHAT IS A USE CASE?
In software and systems engineering (which includes database
development), a use case is a list of actions or event steps typically
defining the interactions between a role and a system to achieve a goal.
Use case = how to users interact with the software (database)
Example (via diagram): next slide
Typically, a diagram is used and supported by a narrative
UML is the most common use-case diagramming tool
10. 10
EXAMPLE USE CASE DIAGRAM (UML)
UML (Unified Modeling Language)
is diagramming software can be
used to identify many use cases in
a database and/or software system.
11. 11
BUSINESS RULES
A business rule is, at the most basic level, a specific
directive that constrains or defines a business activity
(related to use case).
These rules can apply to nearly any aspect of a business, in
topics as diverse as supply chain protocols, data
management, and customer relations.
Business rules help to provide a more concrete set of
parameters for an operation or business process.
Business rules are expressed in the RDBMS (ERD).
12. 12
BUSINESS RULE EXAMPLE 1
Finalized business rules must be bidirectional.
Draft: one sentence
Finalized: two sentences
A professor advises many students (professor to
student). Each student is advised by one professor
(student to professor).
A professor must teach many classes. Each class
must be taught by one professor.
13. 13
BUSINESS RULE 1
Business rules are used to define
entities, attributes, relationships, and
constraints.
Business rules explain a policy,
procedure, or principle.
14. 14
BUSINESS RULE 2
Sources of business rules:
Direct interviews with
internal & external
stakeholders
Site visitations (collect
data) and observation of
the work process or
procedure
Review and study of
documents (policies,
procedures, forms,
operation manuals, etc..)
When creating business rules, keep them
simple, easy to understand, and broad…
so everyone has a similar understanding and
interpretation.
15. 15
DISCOVERING BUSINESS RULES
Example on the class website
After reviewing and reviewing notes from the
interview and various forms, develop a set of
draft business rules.
For draft business rules, the initial narrative
does not need to be stated in bidirectional
relational manner and the narrative can use
less precise wording.
Iterative: Business rules are continually
developed; keep going until optimized.
Then, at one point when the rules are finalized,
business rules must state the bidirectional
relationship.
Source: Microsoft Images, used under license
16. 16
BUSINESS RULE EXAMPLE 2
A sales representative writes many
invoices. Each invoice is written by one
sales representative.
Each sales representative is assigned to
many departments. Each department has
only one sales representative.
A customer generates many invoices. Each
invoice is generated by only one customer.
17. 17
SUMMARY: PROCESS FOR USE CASES AND
BUSINESS RULES
Start documenting use cases (list how users will use the software/database)
Example: Our users will:
extract data from the National Institutes of Health Database
report on the extracted data
Identify business rules (items that define, restrict, or even enhance the
software)
Example: We must comply with state-mandated security requirements for our customer
records.
This is not a one-pass item: It is iterative.
18. 18
WHAT IS A STATEMENT OF WORK (SOW)?
The SoW is the document that captures and defines all aspects of your
project. You’ll note the activities, deliverables, and the timetable for the
project. It’s an extremely detailed document that will lay the groundwork
for the project plan.
It’s one of the first documents you’ll create to lay out the landscape of
the project before you plan and execute. Because of the amount of
detail required, the prospect of writing one can be daunting. Therefore,
let’s break it down into more digestible parts.
20. 20
SOW – A FEW KEY STEPS
What is the purpose of the project? Start with the big question: Why are you initiating this project? Why does
the project need to be done? Create a purpose statement to lead off this section and provide a thorough
answer to these questions. Examples: What are the deliverables, objectives, and return on investment?
Scope of work: What work needs to be done in the project? What is the process you’ll use to complete the
work? This includes outcomes, time involved, and even general steps it’ll take to achieve that.
Where will the work be done? The team you employ will have to work somewhere. The project might be site
specific, at a central facility, or some, if not all, the team members could work remotely.
Tasks: Take those general steps outlined in the scope of work and break them down into more detailed tasks.
Be specific and don’t leave out any action that is required of the project to produce its deliverables.
21. 21
SOW STEPS
Milestones: Define the amount of time that is scheduled to complete the project, from the start date
to the proposed finish date. Detail the billable hours per week and month, and whatever else
relates to the scheduling of the project.
Deliverables: What are the deliverables of the project? List them and explain what is due and when
it is due.
Schedule: Include a detailed list of when the deliverables need to get done, beginning with which
vendor will be selected to achieve this goal, the kickoff, what the period of performance is, the
review stage, development, implementation, testing, close of the project, etc.
22. 22
KEY CONCEPT: DATA DICTIONARY
As you are examining your data and developing a preliminary concept of what your
ERD will be, save your work in a data dictionary.
A data dictionary is an organizing tool that consists of the following information:
name of the tables in the database
constraints of a table: i.e., keys, relationships, etc.
columns of the tables that related to each other
owner of the table
last accessed information of the object
last updated information of the object
and more …
24. 24
TYPES OF DATA DICTIONARIES
Active Data Dictionary
The DBMS software manages the active data dictionary automatically. The
modification is an automatic task, and most RDBMS have an active data
dictionary. It is also known as an integrated data dictionary.
Passive Data Dictionary
Managed by the users and is modified manually when the database structure changes. Also known as a non-
integrated data dictionary.
For the Capstone, we will use a Passive Data Dictionary.
25. 25
DATA DICTIONARY AND THE SYSTEM
CATALOG
Data Dictionary: contains metadata to provide detailed information of
all tables within the database
System Catalog: a very detailed system data dictionary that describes
all objects within the database
It is a system-created database whose tables store the database characteristics
and contents.
Its tables can be queried just like any other table.
It automatically produces database documentation.
27. 27
DEFINING DATA TYPES
We have entities, attributes, and relationships (a first pass).
Collect the information in your data dictionary.
Add into your data dictionary the field name, data type, and field
length for each attribute. Be sure to include a detailed description of the
field name, too.
Example attributes:
Data_Sequence_no:
Spl_version:
Published_date:
Title:
Setid:
28. 28
SQLITE DATA TYPES
NULL. The value is a NULL value.
INTEGER. The value is a signed integer, stored in 1, 2, 3, 4, 6, or 8 bytes depending
on the magnitude of the value.
REAL. The value is a floating-point value, stored as an 8-byte IEEE floating point
number.
TEXT. The value is a text string, stored using the database encoding (UTF-8, UTF-16BE
or UTF-16LE).
BLOB. The value is a blob of data, stored exactly as it was input.
29. 29
DEVELOP A PRELIMINARY DATA DICTIONARY
Develop a preliminary data dictionary for the Capstone project. At present, not all
items are known. Please keep in mind that this document is iteratively developed. The
data dictionary should include the following items:
• Develop a template using Excel that you will eventually use for the Capstone. For the first pass, fill in as much as
you can (column headings/rows). Keep in mind that the data dictionary will be constantly revisited during the
project life cycle. You are not expected to have this done on the first pass!
• entities/tables • field defaults
• attributes/fields (within entities) • relationships
• primary key/foreign key • descriptions (for entities, attributes, descriptions)
• field data type and size • where each field is used (report, screen, etc.)
30. 30
REFERENCES
McFarland, R. (2020). Published Articles: Ron McFarland.
Retrieved December 03, 2020,
from https://medium.com/@highervista
Shenoy, S. (2020). “Developing A Project Charter: One of the Critical
Documents of Project.” PM Exam Smart Notes. Retrieved
December 03, 2020, from
https://www.pmexamsmartnotes.com/develop-project-charter-
process/
32. 32
ABOUT THIS COURSE
This course is distributed free. I use several
sources. But importantly, I use the book noted
on the next slide.
If you are using these PowerPoints, please
attribute Highervista, LLC and me (Ron
McFarland). IN ADDITION, please attribute
the author noted on the next slide, as the
author’s textbook provides essential
information for this course.
Source: Microsoft Images
33. 33
INTRODUCTION
This course is offered to you free. HOWEVER, please
purchase the following book, as it is a primary resource for
this course. I do not make any $ from this course or this
book. So, since a handful of good content is derived from the
following text, please support this author!
Title: SQL Quickstart Guide
Author: Walter Shields
Available: Amazon, B&N, and through ClydeBank media
website at:
https://www.clydebankmedia.com/books/programming-
tech/sql-quickstart-guide