This document provides an overview of new capabilities for hierarchical and multipath processing in ANSI SQL. Key points include:
- SQL can now dynamically model hierarchical structures using LEFT JOINs, allowing powerful hierarchical and multipath processing within standard SQL syntax.
- Two major discoveries enable this - integrating hierarchical processing into relational processing, and inherent lowest common ancestor (LCA) processing in SQL's relational operations.
- Hierarchical structures can now be combined dynamically, increasing flexibility. The user does not need to know the structure to query it. This adds significant power and analytics to SQL processing.
New Relational Discoveries Produce a Powerful Semantic SQLMichael M David
Four new ANSI SQL relational processing discoveries and their 15 breakthrough capabilities, fundamental principles, and operation are explained in this presentation producing a new generation of powerful semantic SQL.
TRANSFORMATION RULES FOR BUILDING OWL ONTOLOGIES FROM RELATIONAL DATABASEScsandit
Relational Databases (RDB) are used as the backend database by most of information systems.
RDB encapsulate conceptual model and metadata needed in the ontology construction. Schema
mapping is a technique that is used by all existing approaches for ontology building from RDB.
However, most of those methods use poor transformation rules that prevent advanced database
mining for building rich ontologies. In this paper, we propose transformation rules for building
owl ontologies from RDBs. It allows transforming all possible cases in RDBs into ontological
constructs. The proposed rules are enriched by analyzing stored data to detect disjointness and
totalness constraints in hierarchies, and calculating the participation level of tables in n-ary
relations. In addition, our technique is generic; hence it can be applied to any RDB. The
proposed rules were evaluated using a normalized and open RDB. The obtained ontology is
richer in terms of non- taxonomic relationships.
Implementation of multidimensional databases with document-oriented NoSQL
Implémentation des entrepôts de données NoSQL dans les bases de données NoSQL orienté documents.
New Relational Discoveries Produce a Powerful Semantic SQLMichael M David
Four new ANSI SQL relational processing discoveries and their 15 breakthrough capabilities, fundamental principles, and operation are explained in this presentation producing a new generation of powerful semantic SQL.
TRANSFORMATION RULES FOR BUILDING OWL ONTOLOGIES FROM RELATIONAL DATABASEScsandit
Relational Databases (RDB) are used as the backend database by most of information systems.
RDB encapsulate conceptual model and metadata needed in the ontology construction. Schema
mapping is a technique that is used by all existing approaches for ontology building from RDB.
However, most of those methods use poor transformation rules that prevent advanced database
mining for building rich ontologies. In this paper, we propose transformation rules for building
owl ontologies from RDBs. It allows transforming all possible cases in RDBs into ontological
constructs. The proposed rules are enriched by analyzing stored data to detect disjointness and
totalness constraints in hierarchies, and calculating the participation level of tables in n-ary
relations. In addition, our technique is generic; hence it can be applied to any RDB. The
proposed rules were evaluated using a normalized and open RDB. The obtained ontology is
richer in terms of non- taxonomic relationships.
Implementation of multidimensional databases with document-oriented NoSQL
Implémentation des entrepôts de données NoSQL dans les bases de données NoSQL orienté documents.
10 ways to teach kids to code. From puzzles and games to software, hardware, and robots. With appropriate ages and a variety of techniques to choose from, both parents and kids alike are sure to find something they can learn from and enjoy!
EVALUATING CASSANDRA, MONGO DB LIKE NOSQL DATASETS USING HADOOP STREAMINGijiert bestjournal
An unstructured data poses challenges to storing da ta. Experts estimate that 80 to 90 percent of the d ata in any organization is unstructured. And the amount of uns tructured data in enterprises is growing significan tly� often many times faster than structured databases are gro wing. As structured data is existing in table forma t i,e having proper scheme but unstructured data is schema less database So it�s directly signifying the importance of NoSQL storage Model and Map Reduce platform. For processi ng unstructured data,where in existing it is given to Cassandra dataset. Here in present system along wit h Cassandra dataset,Mongo DB is to be implemented. As Mongo DB provide flexible data model and large amou nt of options for querying unstructured data. Where as Cassandra model their data in such a way as to mini mize the total number of queries through more caref ul planning and renormalizations. It offers basic secondary ind exes but for the best performance it�s recommended to model our data as to use them infrequently. So to process
What is NoSQL? How does it come to the picture? What are the types of NoSQL? Some basics of different NoSQL types? Differences between RDBMS and NoSQL. Pros and Cons of NoSQL.
What is MongoDB? What are the features of MongoDB? Nexus architecture of MongoDB. Data model and query model of MongoDB? Various MongoDB data management techniques. Indexing in MongoDB. A working example using MongoDB Java driver on Mac OSX.
10 ways to teach kids to code. From puzzles and games to software, hardware, and robots. With appropriate ages and a variety of techniques to choose from, both parents and kids alike are sure to find something they can learn from and enjoy!
EVALUATING CASSANDRA, MONGO DB LIKE NOSQL DATASETS USING HADOOP STREAMINGijiert bestjournal
An unstructured data poses challenges to storing da ta. Experts estimate that 80 to 90 percent of the d ata in any organization is unstructured. And the amount of uns tructured data in enterprises is growing significan tly� often many times faster than structured databases are gro wing. As structured data is existing in table forma t i,e having proper scheme but unstructured data is schema less database So it�s directly signifying the importance of NoSQL storage Model and Map Reduce platform. For processi ng unstructured data,where in existing it is given to Cassandra dataset. Here in present system along wit h Cassandra dataset,Mongo DB is to be implemented. As Mongo DB provide flexible data model and large amou nt of options for querying unstructured data. Where as Cassandra model their data in such a way as to mini mize the total number of queries through more caref ul planning and renormalizations. It offers basic secondary ind exes but for the best performance it�s recommended to model our data as to use them infrequently. So to process
What is NoSQL? How does it come to the picture? What are the types of NoSQL? Some basics of different NoSQL types? Differences between RDBMS and NoSQL. Pros and Cons of NoSQL.
What is MongoDB? What are the features of MongoDB? Nexus architecture of MongoDB. Data model and query model of MongoDB? Various MongoDB data management techniques. Indexing in MongoDB. A working example using MongoDB Java driver on Mac OSX.
Presentation on NoSQL Database related RDBMSabdurrobsoyon
This Presentation is about NoSQL which means Not Only SQL. This presentation covers the aspects of using NoSQL for Big Data and the differences from RDBMS.
A Comparison between Relational Databases and NoSQL Databasesijtsrd
Databases are used for storing and managing large amounts of data. Relational model is useful when it comes to reliability but when it comes to the modern applications dealing with large amounts of data and the data is unstructured; non-relational models are usable. NoSQL databases are used to store large amounts of data. NoSQL databases are non-relational, distributed, open source and are horizontally scalable. This paper provides the comparison of the relational model with NoSQL Behjat U Nisa"A Comparison between Relational Databases and NoSQL Databases" Published in International Journal of Trend in Scientific Research and Development (ijtsrd), ISSN: 2456-6470, Volume-2 | Issue-3 , April 2018, URL: http://www.ijtsrd.com/papers/ijtsrd11214.pdf http://www.ijtsrd.com/computer-science/database/11214/a-comparison-between-relational-databases-and-nosql-databases/behjat-u-nisa
OUTCOME ANALYSIS IN ACADEMIC INSTITUTIONS USING NEO4Jijcsity
Databases are an integral part of a computing system and users heavily rely on the services they provide.When interact with a computing system, we expect that data be stored for future use, that the data is able to be looked up fastly, and we can perform complex queries against the data stored in the database. Many
different emerging database types available for use such as relational databases, object databases, keyvalue databases, graph databases, and RDF databases. Each type of database provides unique qualities that have applications in certain domains. Our work aims to investigate and compare the performance and
scalability of relational databases to graph databases in terms of handling multilevel queries such as finding the impact of a particular subject with the working area of pass out students. MySQL was chosen as the relational database, Neo4j as the graph database.
Adjusting primitives for graph : SHORT REPORT / NOTESSubhajit Sahu
Graph algorithms, like PageRank Compressed Sparse Row (CSR) is an adjacency-list based graph representation that is
Multiply with different modes (map)
1. Performance of sequential execution based vs OpenMP based vector multiply.
2. Comparing various launch configs for CUDA based vector multiply.
Sum with different storage types (reduce)
1. Performance of vector element sum using float vs bfloat16 as the storage type.
Sum with different modes (reduce)
1. Performance of sequential execution based vs OpenMP based vector element sum.
2. Performance of memcpy vs in-place based CUDA based vector element sum.
3. Comparing various launch configs for CUDA based vector element sum (memcpy).
4. Comparing various launch configs for CUDA based vector element sum (in-place).
Sum with in-place strategies of CUDA mode (reduce)
1. Comparing various launch configs for CUDA based vector element sum (in-place).
The Building Blocks of QuestDB, a Time Series Databasejavier ramirez
Talk Delivered at Valencia Codes Meetup 2024-06.
Traditionally, databases have treated timestamps just as another data type. However, when performing real-time analytics, timestamps should be first class citizens and we need rich time semantics to get the most out of our data. We also need to deal with ever growing datasets while keeping performant, which is as fun as it sounds.
It is no wonder time-series databases are now more popular than ever before. Join me in this session to learn about the internal architecture and building blocks of QuestDB, an open source time-series database designed for speed. We will also review a history of some of the changes we have gone over the past two years to deal with late and unordered data, non-blocking writes, read-replicas, or faster batch ingestion.
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Data and AI
Round table discussion of vector databases, unstructured data, ai, big data, real-time, robots and Milvus.
A lively discussion with NJ Gen AI Meetup Lead, Prasad and Procure.FYI's Co-Found
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...Subhajit Sahu
Abstract — Levelwise PageRank is an alternative method of PageRank computation which decomposes the input graph into a directed acyclic block-graph of strongly connected components, and processes them in topological order, one level at a time. This enables calculation for ranks in a distributed fashion without per-iteration communication, unlike the standard method where all vertices are processed in each iteration. It however comes with a precondition of the absence of dead ends in the input graph. Here, the native non-distributed performance of Levelwise PageRank was compared against Monolithic PageRank on a CPU as well as a GPU. To ensure a fair comparison, Monolithic PageRank was also performed on a graph where vertices were split by components. Results indicate that Levelwise PageRank is about as fast as Monolithic PageRank on the CPU, but quite a bit slower on the GPU. Slowdown on the GPU is likely caused by a large submission of small workloads, and expected to be non-issue when the computation is performed on massive graphs.
Techniques to optimize the pagerank algorithm usually fall in two categories. One is to try reducing the work per iteration, and the other is to try reducing the number of iterations. These goals are often at odds with one another. Skipping computation on vertices which have already converged has the potential to save iteration time. Skipping in-identical vertices, with the same in-links, helps reduce duplicate computations and thus could help reduce iteration time. Road networks often have chains which can be short-circuited before pagerank computation to improve performance. Final ranks of chain nodes can be easily calculated. This could reduce both the iteration time, and the number of iterations. If a graph has no dangling nodes, pagerank of each strongly connected component can be computed in topological order. This could help reduce the iteration time, no. of iterations, and also enable multi-iteration concurrency in pagerank computation. The combination of all of the above methods is the STICD algorithm. [sticd] For dynamic graphs, unchanged components whose ranks are unaffected can be skipped altogether.
Enhanced Enterprise Intelligence with your personal AI Data Copilot.pdfGetInData
Recently we have observed the rise of open-source Large Language Models (LLMs) that are community-driven or developed by the AI market leaders, such as Meta (Llama3), Databricks (DBRX) and Snowflake (Arctic). On the other hand, there is a growth in interest in specialized, carefully fine-tuned yet relatively small models that can efficiently assist programmers in day-to-day tasks. Finally, Retrieval-Augmented Generation (RAG) architectures have gained a lot of traction as the preferred approach for LLMs context and prompt augmentation for building conversational SQL data copilots, code copilots and chatbots.
In this presentation, we will show how we built upon these three concepts a robust Data Copilot that can help to democratize access to company data assets and boost performance of everyone working with data platforms.
Why do we need yet another (open-source ) Copilot?
How can we build one?
Architecture and evaluation
1. Slide1:TheMostPowerful andAccurateSQL
Four new ANSISQLrelational processingdiscoveriesandtheir 15 breakthroughcapabilities,
fundamental principles,andoperationare explained inthispresentation. These capabilities add
powerful new operations whileeliminatingproblemSQLareas.The firstdiscoverysupportsadvanced
capabilitiesthroughthe natural integrationof multipathhierarchical processing intothe frontendof the
relational processing.Thissupportsrelational processingin apowerful hierarchical multipathnonlinear
fashion. ThisisbothrelationallysoundandhierarchicallyprincipledusingstandardSQLsyntax. Ontop of
thisSQL hierarchical processingmodel,apowerfulnetwork structure iscontrolled bydynamically
referencingany dataitems concurrently acrossanddownpathssolvingthe queryfrommultiple
directionsproducinganewleapinanalysis.Thisusesasecondpowerfulprocessingdiscovery of
inherentLCA processingthatnaturally determines andprocesses the semanticmeaningacrosspathways
naturally.These capabilities produce anextremely advancednew generationof powerful SQLsemantic
operation.
2. Slide2:Powerful NewSQL Hierarchical CapabilitiesCanbeUtilizedTogether
The 15 new breakthroughsinhierarchical ANSISQLonthisslide are made possible by the new relational
processingdiscoveries.Theyare extremelypowerful and canbe usedinany combination synergistically
increasingtheircapabilities.Thiscreatesnew usesandcapabilitiesnot previouslyavailable orpossible.
These will covereachof these newcapabilitieslistedonthisslide usingvisual examples.The current
bulletedsubtopicbeingshownanddescribedineachfollowingslide will be highlighted andunderlined.
A coloredarrow may alsobe usedto draw attentionto active areasinthe current slide.The following
slidesare connectedwiththe mainheadingorbulleteditembeingdescribed. Someinfomaybe
repeatedacrossslidestoestablishcontext.
3. Slide3:Defining theSQL MultipathHierarchical DataModel
StartingwithSQL’snewhierarchical datamodeling of relational tablesonthisslide,itisshown how
relational tables (ornodes) A,B& C can be dynamically modeledhierarchicallyusingonly the SQLLeft
Joinoperation. Itisusedto establishthe dynamichierarchical datamodelledroadmapusedto control
the active query.The introductionof LEFT Joins inthe SQL-92 standard enablespowerfulhierarchical
structuresto be modeled.Non-hierarchical datamodelingwilltriggeranerrorconditionpreventing
incorrecthierarchical operation.The inherentlysupportedSQLmultipathhierarchicallymodelled
structure naturallyenables powerful concurrentmultipathhierarchical LCA processingforderivinga
solution frommultiple paths.Thisenables SQLtoconcurrently testdatafrommultiple pathwaysto
naturally produce apowerful semanticallymeaningful LCA result.The WHEREclause can thenalsobe
usedto reference dataitems acrossthe datamodel pathwaysina powerful networkfashion.
4. Slide4: IntegratingHierarchical Processinginto RelationalProcessing
Thisis the 1st
of 4 newrelational breakthroughdiscoveries.SQL’sstandardrelational processing
naturallyutilizes the hierarchical processingcapabilitiesof only the SQL-92Left Outerjoin where less
syntax produces more powerful processing.Itpreservesdataonthe leftside of the LeftJoinoperation
whenthere are no matchingdata valuesonthe rightside.Thismakesitoperate fully hierarchically. The
multiple “ON”clausesreplace the oldersingle WHEREclause allowingittoprecisely datamodel
hierarchical multipathstructures.Thisdatamodelingis shownatthe greenarrow.With the redarrow at
the start of the hierarchicallymodelledstructure,nodesA,B,C,D and E are modelledinturn.They each
add a path usingthe ON clausesto preciselyconnect eachnode asshown. Whenthe multipath
hierarchicallymodelledSQLat the greenarrow is processed, SQLisoperatingata greatly increased
semanticprocessinglevel.Thisisbecause the semantics are knownfromthe datamodelingalready
appliedandcan be internallyutilized.
5. Slide5:Hierarchical Processingis Usedin Relational Processing
The inherenthierarchical processingpossible instandardSQLisan importantanduseful basicdiscovery.
It has shownthatpowerful hierarchical processingisa validsubsetof relational processingandcan be
usedforcomplete natural integration.Thisalsoallowsrelational dataindependenceandhierarchical
data modelingtonaturallycombinethe advantagesof both.The redarrow pointsto the box that uses
onlyLeftouterjoinsoperationstoenable powerful hierarchical multipathdatamodelingandprocessing.
The hierarchical processingfollowsnatural datapreservationprinciples.Thisaddstothe inherent
correctnessalongwithrelational processing’spowerful mathematical foundation.Thisproducesanew
semanticSQLoperatingat a much higher processinglevel.Itnaturally interprets hierarchical data
modelingfromitssyntax.Thisenables hierarchical processingthatnaturallyutilizesthe new SQL
hierarchical semantics betweenandacrosspathways.Thisalsomeansthatthere isno new code to
support.
6. Slide6:SQL Hierarchical ProcessingSupportsOnly Structured Data
UsingSQL to supportfull multipathhierarchical processingrequireslimitingthe processingtostructured
data. ThismakesSQL more powerful andeasiertouse usingonlypowerful structuredprocessing.This
meansthere are onlysingle pathstoeach node type inthe structure diagramstartingfrom the red
arrow. Thismakesthe hierarchical structure unambiguousenablingittobe naturally navigatedeven
withitsnew more powerful hierarchical structure capability. This natural internal navigationoperates
by nothavingto make any navigational pathselectiondecisions. All referencednodesare accessedusing
onlya single path.Thisunambiguous automaticnavigationof hierarchical structuresintegrates naturally
withrelational processing’sstandardnavigationlessaccess.
7. Slide7:SQL Hierarchical Data ModelingLanguage has Principles
SQL’s seamlesshierarchical datamodelinglanguage andsyntax shownatthe redarrow isbasedon well-
knownhierarchical datapreservationprinciples.A parentnode canexistW/Oa child,buta child cannot
existW/Oa parentand a childcan have onlyone parent. If thisis followed,it resultsinnatural
correctness.ThismeansSQLhierarchical processingisbasedoncombinedrelational andhierarchical
principles.Itstill supportsboththe dataindependence of relational andthe semanticsinhierarchical
structures.Thisallowsanyhierarchical andflatstructurestobe dynamically modeled togetherinany
way and processedas semanticallyrich hierarchicalstructures.Relational processingutilizing dynamic
hierarchical processing nowbecomesextremelypowerful anduseful for accurate complex processing.
8. Slide8UsesON Clausesand Not WHERE Clause for Data Modeling
Startingat the redarrow,it can be seenhow multiple ON clausesare muchmore precise fordata
modelingthanthe oldersingleWHEREclause was.Anotherreasonforthisisthat the ON clause
operatesmore locally. Itonlyaffectsthe paththatit isused on and onlyfromitsinitial pointof use
downward.Thisalsoincreasesthe precisenessof the datamodeling.The WHEREclause isused now
only forglobal operations whichcanselectivelyaffectanynodesinthe entire structure. Thisisavery
powerful operationinitsownright. Soit shouldbe usedonlyforglobal hierarchical datafilteringand
leave the ON clause formore local and precise datamodelingoperationswhere itismore useful and
flexible. Thisseparationof dutiesmakeseachoperationmore powerful anddistinct.
9. Slide9:Use the WHERE Clause for Hierarchical Global Data Filtering
Unlike the local ON clause,the WHERE clause isglobal and can specify dataanywhere in the structure to
be matched.Thisis shownbypreservingdatathatreliesonWHERE C.val=‘C2’ bythe redarrow. When
the “C2” value matches,the searchgoesinall directions from‘C2’to the SELECTed data typesinnodes
A,B, C, D andE to retrieve them.NodesDandE are below node C, root A isabove.If a node A data
occurrence match isfound,the pathwill deflect naturallyand hierarchically filtereddowntonode B
because itsparentexists whichisstandardSQLoperation. Thisisshowninboththe flat relational
structure and itshierarchical ViewX datastructure where the shadedboxesrepresentthe data
retrieved. Atthe blue arrow,itisshownthatthe relational structure canbe automatically convertedto
itshierarchical internal representation makingiteasiertoutilize. Thisisachievedbyremovingreplicated
data, while preservingduplicate data byusinga new duplicate datadata-type tag.
11. Slide11: Multiple Data Occurrence OrganizationFullySupported
Multipathhierarchical structures cansupportthe powerful feature of multiplenode occurrences.These
are showninthe currentslide where nodesB, C,D and E each have multiple occurrences. Notice that
node occurrencesE1 and E2 are locatedunderoccurrence C1 while node occurrencesE3andE4 are
undernode occurrence C2. Theyare inseparate node occurrence groupsandcannot be processed
togetherbecause they have separate parentoccurrencesC1andC2. This supports a muchhigherlevel
of data organization thatnaturally processes the dataoccurrences. Thisenables multiplenode
occurrences to have theirownsetof data combinations makingtheiroverall operationmore flexibleand
precise.
12. Slide12 MultipathConcurrent ProcessingGreatlyIncreasesAnalytics
The two differentqueriesatthe big greenarrow produce the same internal hierarchical processing
loopsbecause theyuse the same structure shownandthe same SELECTed multipathlocationsatnodes
B, D and E. This producesresultstailoredtotheirdifferentqueryspecifications shown.The multipath
hierarchical processingrequires very specialprocessingforqueries connectingdataandusingthe
semantics acrosspathways. ThisisknowntechnicallyandacademicallyasLowestCommonAncestor
(LCA) processingwithitsnew use now performedby SQLmultipathhierarchical processing.This
concurrentmultipathhierarchical processing showninred canbe furtherenhanced byreferencing
across active pathwayswhich utilizes LCA processing.Thisgreatlyincreases the analytical processing
capabilitiesinnew,more:meaningful,accurate andpowerful ways by utilizingconcurrentmultiple
active and connectedpathwaysthatcansupportpowerful networkstructures.
13. Slide13: InherentLowestCommon Ancestor (LCA) MultipathProcessing
The 2nd of 4 relational breakthroughdiscoveriesisthe verypowerfulLCA processingfoundoperating
naturallyandinherentlyinANSISQL.Olderphysical hierarchical structuresrequiredacomplex search
for LCAs.For example,the datareferencesB,D& E showninred arrows wouldhave requiredsearching
upwardsfromthe referencednodesB,D and E to locate LCA nodesC andthenA. But SQL hierarchical
LCA processingisoccurringinherentlyinSQLrequiringnosearchingorcodingat all.Thisnatural LCA
processingutilizesthe relationalprocessing’sCartesianproduct’soperation. The generatedCartesian
productcontrollingthe searchupto the LCAs isshown in red.LCAsare at the connectionpointwhere
the pathways meet.Thisnatural andcomplex operationenablesLCA’soperationtoany nestinglevel.
ThisLCA processingis necessary because the required dynamicLCA codingwould become very complex
and costly to code by hand as shownlater.WithSQL inherentlyperformingall the LCA processingitis
alwaysoperatingcorrectlyandefficiently.
14. Slide14: LCA Naturally Determinesthe Most Meaningful Results
LCA processingis naturally triggeredby aWHERE clause reference to connectmultiple pathways shown
inred. Bothof these queriesare shownonthisslide atthe biggreenarrow.Thisproducesa combination
of valuesusedtotestfora matching datacombinationproducedfromthe inherentCartesianproduct
shownbythe blackbox.Thisresultsinthe tightestmostlimitingrange of datareferencesforthe active
queryto derive the mostmeaningful resultusingthe smallestprocessingarearequired.Thisisnaturally
correct and takesintoaccount all the differentmultipathqueryreferences. Any numberof nodescanbe
connectedacrosspathwaysgreatlyincreasingthe analytical queryingpower. Thismakesconcurrent
multipathprocessingwithLCA processing very accurate andefficient.The LCA processingbetweenthe
pathwaysutilizesthe implied semanticsbetweenthe pathways. The Cartesianproductdataaroundan
LCA extends naturally toitslowestnode references, DandE for node C and thenB and C for node A as
shownonthis slide.
15. Slide15: LCA ProcessingCan AlsoInclude Multiple LCA Nesting
Thisdiagramshows howLCA processinginthe redcircle occurs and nestsnaturallywhen multiple LCAs
are needed.Asfew LCAsasnecessarywill be naturally usedacrossmultiple pathways showningreen.
Two pathreferencestriggersanLCA processing,athirdtriggersanotherone andso on fromthe bottom
up.This keepseachLCA processingassmall as possible withnatural LCA nestingshownbythe red
upwardarrows. This iscontrolledbythe relational Cartesianproduct processing.WhenSQLis
performinghierarchically,itsCartesianproductisnaturallyperformingthe requiredLCA processing,so
the operationistransparent occurringinherently. Iwas notaware of thisLCA operationoccurring
inherently until Irealizedsomething hadtobe naturallycausingit because the multipathresultswere
alwayscorrect.I found thisnatural LCA processingin the Cartesianproduct controlled withinthe initial
hierarchical processing model.More onhow andwhy thisworksnaturallycanbe foundon slide #49.
16. Slide16: MultipathHierarchical StructuresCan ProcessNetworks
Multipathhierarchical structures use LCA processingtoenable nodesinthe structure tobe connected
by referencingtheirdata.Forexample,nodereferencesBandY bythe greenarrows are notdirectly
connected,butcan be naturally connected atLCA node A by referencingasin“SELECT B.bWHERE
Y.y=4” inred. AddingNode Zat the orange arrow, “SELECT B.b WHERE Y.y=Z.z”in redconnectsall three
B, Y, Z nodes.ThisnestsLCA X underLCA A. The bottomleftshowsthe white structure asthe underlying
hierarchical model boxing-inLCA operation.All 25connections possiblefromthe 7 nodes are shown in
blackat bottomleft.These canbe createdbya single extremelypowerful WHEREclause reference using
AND,OR and parenthesis operationslinkingthemtogetherinanyway. Thisenablesall connectionsto
be testedbecause everynode canreferenceeveryothernode shownbythe blacklinesoverthe white
lines. Thissupports an extremely powerful networkeddataanalysis frommanyconcurrentdirections.
Operational Overview of Semantic SQL with Concurrent Multipath Networking
1 2 3
3
Hierarchical DataModeling WHERE Clause Use Networking
Define desired
hierarchical datamodel
and multipathprocessing
usinginput:flattables,
nodesandstructure
views. Thenmove to
WHERE clause at position
2 to performWHERE
clause.
Dynamicallycompose
and execute WHERE
clause to create complex
networkacrossdata
model nodes from
position1.This allowsall
nodestobe connectedin
any way at position2 as
shown above.
Networkingcompletes
LCA processingatposition
3. Then the usercan go
back to position2to
specifyanotherqueryor
the usercan go back to
position1to re-specifya
new data model andre-
start fromposition2.
18. Slide18: UserDoes Not Need to Know the Data Structure to Query
Aftera logical structure is dynamically created,itisprocessedasa single structure.Inaddition,
hierarchical structurescanalsobe heterogeneouslycombinedfrom:fixed;dynamic;remote;andview
structures whichare also processedasa final logical structure. Mostimportantly,the userdoesnot
needtoknowthe structure or have to navigate the heterogeneousmultipath structure.Thisisbecause
all typesof hierarchical structuresare unambiguouswithonlyasingle pathtoeachnode.Thisallows
navigationless schema-free navigation regardlessof how the final heterogeneous hierarchical structure
iscomposed.
19. Slide19: JoiningStructuresIncreases DataValue&Semantics
The increasingof hierarchical semanticsbydynamicallycombiningstructuresorpartsof structuresalso
resultsineverincreasingdatavalues.Asmultipathstructurescontinue togrow downwardsshownby
the red arrows,theysplitpathscontinuallyincreasingthe numberof paths.Asthis occurs,the data and
impliedsemantics are sharedacrossmore andmore pathsincreasingdatavalue andsemanticswhich
are naturally utilized.Thisiswhyhierarchical structureshave aninherentcapabilitytocreate more value
than iscaptured.The sharingof data across paths alsoincreasesthe numberof possiblequeries.
References betweenmultiple pathsuse powerfulLCA processingtoutilize thiscomplex concurrent
multipathprocessingfurtherenhancingthe semantics.Thisenablesthe abilitytoutilize node datafrom
hierarchicallyrelatedpathwaysthatalwaysderivesmeaningful results performedbythe LCA processing.
20. Slide20: JoiningHierarchical ViewsDone Same as in Hierarchical Data Modeling
The joiningof hierarchical viewsisalsoperformedinthe exactsame easyway the hierarchical data
model wascreatedshowninthe boxes inthisslide.ThisisbyusingLeftjoinstohierarchicallymodel
structures.Inthis example,hierarchical viewsABCandXYZare easilyhierarchicallyjoineddynamically
usingLeftjoins.Thisisshowninthe dynamicSELECT statementatthe redarrow. Thisisalso how logical
hierarchical viewsare dynamicallycombinedonthe fly. Thisisperformedwithasimple SQLSELECT
querythat modelsstructuresandjoinsviewsbothinthe same exactway.Thismakesthemseamless
and intuitiveoperationsasshown.
21. Slide21: QueryResult Saved as a Viewfor Reuse inQuerying
The queryresultcan be savedfor reuse infollowingqueriesusingthe SAVEkeyword. “SAVEVIEWas
XYZ” will save the queryasa viewwiththe givenname XYZ. “SAVEDATA as XYZ” will save the queryas
data withthe givenname XYZ. “SAVEDATA …” will preserve the exactdataresultandwill operate asa
view,while“SAVEVIEW…”will save the view whichwillalwaysproduce the mostcurrentresultsof the
view.Eitherone canbe usedanywhere inaquerythat a view canbe used. Asan example,the redarrow
pointstothe combinedview syntaxof the joinof twoview structuresfromapreviousjoin thatcan be
savedas DATA or a VIEW.
22. Slide22: DataDrivenHierarchical StructureModeling
Data drivenprocessing isanotherverypowerful additional use of the ON clause thatisnot generally
realized.Itcanbe usedtospecifysimple tocomplexvariable data-drivenbuildingof hierarchical
structures.Itusesa compoundON clause argumentthatteststhe value of storeddata itemstocontrol
the dynamicdata-drivenstructure generation.Thisexample will onlyperformthe joinof XYZtoABC if
the data argumentX=4 isalsotrue. Thisisshowninthe SELECT statementdirectlyabove the redarrow.
Thisalsocan allowmultiple SELECTstobe usedto selecta view fromanumberof manypossible views
dependingonadatabase data value match.Thisis a powerful natural selection capabilitythatis
available touse whenneeded.
23. Slide23: Structure-AwareProcessing ExtendsDynamicUses
EnablingSQLto performmore powerful andextendeddynamiccapabilitiesisanextremelyusefuland
powerful enhancementforSQL.SQL has alwaysbeenadynamiclanguage allowingthe SQLtobe defined
dynamically.Butpreviouslyitcouldnotuse thisdynamiccapabilityanyfurther.AfterSQLhad
dynamicallybeenspecifiedandexecuted,itremainedstatic.Dynamicspecifyingof structurestobe
joinedispossible.Butfurtherdynamicoperationsrequiredmetadataknowledge of the completely
formedstructure thatwas not previously available.Thisnew extendeddynamiclevel of processingin
SQL is nowpossible using the newStructure-Aware processing.
24. Slide24: Structure-Aware Processingfor Dynamic Structures
WithStructure-Aware processingshownatthe redarrow,SQL processingcan be seamlesslyextendedto
the furtherprocessingof dynamicallycreatedstructures.Thisiswhere SQLcancontinue tooperate on
dynamically fully createdstructures.Thistakesintoconsiderationnewcapabilitiesrequiringknowledge
of the dynamicallycreatedstructures.WiththisStructure-aware processing,processingcanbe applied
afterdynamicallycreatedstructuresare fullycreated.Thisextendedstructure-aware processingcan
seamlesslysupport unlimited new internalandexternal operations inSQL.
25. Slide25: Data Structure Extraction (DSE) ExposesMetadata 4 Use
The dynamicmetainformationrequiredforstructure-awareprocessingisderivedautomatically.With
SQL limitedtousingonlythe Leftjointoperformhierarchically,the SQLcontainsthismetadata
information.Thismeansthe run-time hierarchical SQLLeftouterjoinsyntax atthe redarrow can be
automatically parsed.Thisisperformed bythe new DataStructure Extraction(DSE) processor at the
greenarrow.It interpretsthe dynamichierarchical structure usingthe DSEprocessto parse the Left
joinsandON clausestodynamicallydetermine the datastructure.Thisisthe 3rd of 4 new breakthrough
discoveries.Itenablesstructure-aware processingto greatly extendthe dynamicstructure processingto
unlimitednewandpreviouslyunavailablecapabilities.
26. Slide26: This DSE Enables Powerful NewDynamic Capabilities
The Data Structure Extraction(DSE) syntax parsing at the redarrow dynamicallyconvertsthe combined
inputstructure viewsyntax intometadatarepresentingthe combinedstructure.Thisishandedoff to
the Structure-Aware routinepointedtobythe greenarrow to seamlesslysupplyall the advanced
capabilitiesrequiringthisdynamicinformation.Anexampleuse isthe furtherconvertingof the dynamic
or internal hierarchical structure toexternalformatssuchasXML formattedoutput.Thisrequires
knowledge of the structure metadatasuppliedfromthe Structure-Aware routine.Anotherexample is
supportinghierarchical optimizationwhichalsorequiresknowledge of the structure size andstructure
metadatasuppliedby the newStructure-Aware routine.
27. Slide27: followingSlidesmayUtilize thisNewDynamic Ability
The newcapabilities described inthe followingslidesmayuse the structure-awarecapabilitytosupport
theirnewcapability. Theseslidesmayinherentlyuse the structure-aware processingcapabilitytoenable
advancednewextendeddynamiccapabilitiesautomatically.The structure-aware capability extractsthe
final combined metadatastructure whichisunderthe redarrow as the resulthierarchical structure.The
executingSQLcanutilize thisresultforfurtherprocessing. ThisDSEfinal structure informationwill also
be usedto transformthe final relational structure resulttoa hierarchical multipathresult.Thisadds
considerablytoitsfinal flexibility andfurtheruse.
28. Slide 28: Advanced Hierarchical Data ModelingBreakthrough
The 4th of 4 breakthroughdiscoveriesisthatSQL inherentlysupportslinkinghierarchically anywhere
belowthe lowerlevel structure’sroot.Thiscanbe to anylowerlevel node locationtojoinhierarchical
structures.Anexample is shownatthe redarrow node Z location.Before thisdiscovery,hierarchical
data modelinghadbeenlimitedtoonlylinkingtothe lowerstructure root entry,node Xin thiscase.
Linkingdirectlybelowthe rootcanbe freelyperformed hierarchically.Thisisbecause the rootisalways
the hierarchicallydatamodelledpointof entryshownasX nexttothe greenarrow. Linkingbelow the
root worksinANSISQL because the lowerstructure isfullyconstructedandself-containedbyview
materialization before itislinkedto.Thisis described furtherinthe followingslides.
29. Slide29: PerformsPowerful SemanticallyAccurate Mashups
Linkinghierarchicallydirectlybelowthe rootatthe redarrow meansthatlinking toany node belowthe
root isvalid.Thissignificantlyincreasesthe numberof wayshierarchical structurescanbe linked
together.The upperlevel structure alsohasnorestrictionsfromwhereitcanbe linkedfromaslong as
the paths outare hierarchicallyvalid.Creatingnon-hierarchical structureswill terminatethe current
operation. The newerlowerlevel linkingrequiresnorestrictionstojoininganywhere inthe lower
structure enablingamuchwiderrange of validqueries.Thisoperation alsosupports averypowerful
mashupthat fullymaintainsthe hierarchical semantics naturallyand correctly.
30. Slide30: ProducesExtremelyPrecise SemanticMeaning
Beingable toLink anywhere belowthe lowerlevel structure rootalsoallowsmore precisesemantic
meaninginthe result.Inthisslide,node Cislinkeddirectlytothe lowerlevel structure’snode Zwhichis
at the redarrow.The resultwouldbe semanticallydifferentif ithadbeenlinkedtonode Y at the green
arrow. Thismultiple choiceaddsconsiderablymore accuracyandprecisenessforthe queryandits
processing.Thislevel of automatichierarchicalqueryprecisenesshasnotbeenpossible before.This
precise lowerlevel joiningresultsinthe same datamodelingwhichisalwaystothe lowerlevel root
shownat the blue arrow.Thisoccurs regardlessof whichlowerlevel linkpointwaslinkedtobecause the
root has alreadybeenestablishedas node X.Thisalsoallowsadditional andvariable datafiltering
controlledbythe choice of differentlowerlevel node linkpoints addingsignificantflexibility.
31. Slide31: Supports UnlimitedLinkingBelowRoot Capability
Linkingbelowthe rootof the lower level structure XYZrequiresthatitto be fullymaterializedbeforeitis
linkedto.This will treatthe lowerstructure asa solidfullyformedstructure inisolationwithitsown
semanticsalreadyestablished.This causes ittoalwaysbe modelled startingatitsrootby the red arrow
to be semantically accurate whilebeingdirectly joinedtoanynode inthe fullyformedlowerstructure.
Thisenables ittobe data filteredstartingatthislowernode linkpoint node Zatthe greenarrow.This
viewmaterializationinisolationisaccomplishedbyANSISQL’spowerful andflexible outerjoinsyntax
processing.Itisnaturallyperformedasshowninthe nextslide.
32. Slide32: UsesPowerful Little Known Natural SQL ViewSyntax
The SQL inthe box showshowSQL’s Leftjoinprocessingcausesaview’sfull expansionbefore Ibeing
joined.Thisoccursin SQL generationproducingmultiple “LeftJoins”withnointerveningON clauses.
ThisANSISQL syntax naturally producesnestingof viewsonone side,andsequential ON clauseswithno
intervening“Join”onthe otherside causingun-nesting.This triggersthe full expansionof view XYZin
boldat the blue arrow before itisjoinedtoview ABC.Thisnestingis natural withviewexpansion as
shownat the greenarrow pointingtothe SQL expandedsyntax:“LEFTJOIN X LEFT JOIN Y“andending
withthissyntax:“ON X.x=Z.zON C.c=Z,z. Thisview expansion shown occursnaturally inthe expanded
boldsyntax at the blue arrow provingthissyntax naturallyoccurs and executescorrectly.Thisdelays
joiningview XYZtoview ABCuntil viewXYZisfullyexpanded. Thisseamless andlittleknown natural
capability makesviews more powerful andeasiertouse.Ihave neverseenthisnatural syntax operation
and itssignificantnew use, flexibilityandcapability documentedanywhere. Havingbeendocumented
and itsoperationdescribedhere,itcannow be usedsafely.
33. Slide33: Remote HeterogeneousInputAccess & Processing
The red arrow inthisslide pointstoviewXYZwhichinthisexample representsaremote XML view.Itis
retrievedand heterogeneously combinedtransparentlyandseamlesslywiththe SQLhierarchical ABC
viewshownbythe greenarrow.Thisenablesintroducingdatafromremote locationsseamlesslysuchas
XML andcombiningitheterogeneouslywithSQLsource.Thisispossible andseamlessbecauseXMLis
alsohierarchical. The XML definitionpointedtobythe blue arrow inthe lowerbox requires amore
specifichierarchical definitionasshown.Thisisbecause the XML definitionisexternal andrequires
additional dataspecifictoXML to be made.The hierarchical structure inthe XML definitionisdefinedby
the Parentkeywordsindicatedbythe doublepointedpurplearrow. Thismayrequire furtherSQL
additionstohandle the differenttypesof remote hierarchical databases butthe remote heterogeneous
capabilityisalreadyinplace.
34. Slide34: SimpleSpecifications NaturallyControlProcessing
Usingthe ANSISQL SELECT listat the greenarrow,onlythe data itemsto be retrieved,circledinred
(A.a,B.b,D.d),needtobe specified.Theyare specifiedinanyorderwithnochange in result.A change in
processingonlyrequiresaddingorremovingdataitemsinthe SELECT list.The SELECT’sFROM clause
generatesthe hierarchical datamodel tobe semanticallyfollowedandinvokesthe SQLatthe red arrow.
Thisis furtherprocessedif multipathconcurrentprocessingisperformedusingthe WHEREclause to
make the cross-pathconnections.Thisisperformedbythe inherentrelational Cartesianproductandits
natural LCA processingproducingthe resultshownbythe blue arrow.Thisishow the data SELECT list,
FROMclause and WHERE clause naturally come togethertoveryeasilyandpowerfully controlscomplex
processingeasilyandaccurately.
35. Slide35: Hierarchical OptimizedData Access withNode Removal
Usingthe SQL hierarchical SELECTlistoperationatthe greenarrow, and the structure-aware capability
alreadycovered, itcanbe automatically determinedwhichnodesare outsidethe hierarchicalrange of
the active query.These nodes willnotrequire accessing.Theyare removedfromconsiderationbefore
queryprocessingstarts.Thishierarchical optimizationisshowninthisslidewhere nodeEisnot
referencedandisoutof range,so it isnot accessed.Thisisindicatedbyaslashthroughnode E whichis
pointedtobythe redarrow. Thishierarchical optimizationcanalsoincrease the efficiencyand
effectivenessof the standardrelational optimizationthatfollows.Thisisbecause ithas increased the
required relational optimizationbymakingitsimplertoprocessandmore effective.
36. Slide36: Automatic Data Aggregationwith Node Promotion
WithSQL’s non-procedural SELECTlistprocessingatthe greenarrow;automaticdata aggregation,node
promotionand node collectionare performedbyonlyspecifyingwhichdatatypesare tobe retrieved.
Thisis showninthisslide’sresultpointedtobythe red arrow where node C wascompressedout
betweennodesA andD.Thishappensbecause node Cwasnot referenced,butit isstill requiredfor
internal navigationfromnode A tonode D.In relational databasesthisremoval is calledrelational
projection.Inhierarchical processing,thisremoval iscallednode promotion.Withnode promotion,the
remainingoutputnodesare collected hierarchically togetherautomaticallyproducinganicely
aggregateddataresult.
37. Slide37: EnablesGlobal Views,EasierTo Use,Has No Overhead
Withhierarchical optimizationbeingautomaticallyperformedineachview,hierarchical views become
global views by alsosupportingsubsetsof the global view.They canhandle more thanone view cutting
downon the numberof viewsnecessary.Thismeansagivenglobal view canservice more thanone
queryafterthe viewisoptimized.Thisreducesthe numberof differentviewsnecessary,whichmakes
queryingmucheasier, automaticandefficientforthe user.Withhierarchical optimizationalways
operating,there isnooverheadforglobal views.Thisis because eachqueryonlyaccessesthe datait
needsto.
38. Slide38: Allowsan Infinite Numberof Dynamic NewCapabilities
The natural powerof the SQL data SELECT controllinginternal processingcombinedwiththe additionof
structure-aware processingcanenable aninfinite numberof new capabilities. Forexample,thiscan
supportSQL transparent processingof any hierarchical operation suchas performingXMLor evenIBM’s
still used hierarchical processing,XMLaccesswill be shownlater.Anotherexampleissupporting
hierarchical optimization.These are possible because these operationsoccurafter the dynamic
structure isgenerated andknown.Thisenables unlimitednew capabilities usingstructure aware
processingaspreviouslydescribed.
39. Slide39: NewDuplicate Data Type FixesReplicatedData Problems
Joiningrelational tablesusuallyproducesthe relationalCartesianproductwhichexplodesdatainserting
replicateddataasplace holdersformissingrow matches.Thisaddssevere inefficienciesandcancause
problemswhenremovingreplicateddatawhenthere isduplicate data.Thisisbecause the duplicate
rowsmay be removedwhentheyshouldbe preserved.The duplicatedatatype solutionabove works
seamlesslybysupportingbothduplicate dataandreplicateddatatotell themapart.Thisrequires
internal additionstoSQL tokeeptrack and separate real datafrom duplicate databytaggingit.The
duplicate datatype alsodecreasesunnecessarydatareplicationfurtherincreasinghierarchical
optimization efficiency alreadydescribed.Thisreducingof the replicateddataalsoincreasesaccuracy
and correctness.
40. Slide40: Hierarchical SQL Transparently Supports XML
Thisslide showsthe SQLSELECT statementusedtoproduce the automaticallyformattedhierarchical
XML pointedtobythe red arrow.This ispossible becauseSQLhierarchical processingcansupport
dynamicandautomaticstructuredXML formattedI/O.Thisusesstructure-aware processingtoknow
howto format the XML from the final physical hierarchical structure result.The unambiguousmultipath
structureddata alsoenablesnavigationless,schema-free XMLaccess.Notice thatthe node promotion
causedthe unreferencedCustandEmpnodes nexttothe greenarrowsare correctlyslicedoutintheir
dynamicallyproducedXML.Thisproducesanicelyaggregatedresult.Thiscansupportanyhierarchical
structure such as IBM’s IMS database.
41. Slide41: SQL/XML Std Has Hierarchical Inner JoinProblems
Secretagendasandpoliticskeptthe Innerjoinasthe defaultjoinforthe SQL/XML Standardand XQuery.
The designers believedthiswouldmore easilyleadthe wayfromSQLto XML. This wasa terrible
decision,becausethe InnerjoindoesnotsupporthierarchicalstructureslikeXML.Infact it destroys
themturningthemintoflatstructures.The SQL/XML Standarddesignerswanted tomove beyondSQL
and replace SQLwithXQuery.Theythoughtkeepingthe Innerjoinwouldhelp the transitionfromSQLto
XQuerybykeepingthe familiarInnerjoin.Ihave some inside knowledge andinsightintothese problems
havingbeenone of the initial memberstothe SQLXGroup workingonthe SQL/XML Standard.These
decisionshave causedthe XMLproblemsdiscussedinthe followingslides
42. Slide42: SQL/XML Std RequiresProcedural Code & Navigation
The SQL/XML Standardrequiresprocedural code anduser navigationforaccessingXMLfromSQL. Thisis
because itsupportssemi-structureddatarequiringusernavigation.Semi-structureddatarequiresuser
navigationbecause anode type canbe locatedfrommore thanone path, eachhas a different
semantics.The newSQLhierarchical navigationlessaccessusesonlystructureddatawithsinglepathsto
each node type. Itdoesnotneedto be usernavigatedbecause the structure isunambiguousenabling
automaticnavigation.Forthese reasons, the automaticfully hierarchical SQLXML supportisconsistently
accurate and correct forstandardstructuredSQL and can be seamlesslyextendedtoall other
hierarchical languages.Onthe otherhand, the SQL/XMLStandardsemi-structured processingwith
multiple pathstonodes requiresusernavigation.Thisisbetterforunderstandingandusing
unstructureddata. Both wayshave theirgood and badpoints and shouldhave beenkept separate.
43. Slide43: SQL/XML Std Doesn’tSupport Automatic LCA Logic
Finally, withthe SQL/XMLStdsupportingthe Innerjoin asexplainedpreviously, there wasafailure to
supportautomaticLCA processingbyXQuery.Eventryingtouse a specializedLCA functiondidnotwork
well andoftenenough.LCA processingisextremelycomplexandimpractical tocode byhand.On the
otherhand,ANSI hierarchically structured SQLcannaturallyandautomaticallysupportfullLCA
multipathprocessing.ThisincludesXMLkeywordsearchusingSQL.Thishas now beenutilizedin
hierarchical SQL’snewlydiscoveredinherentmultipathhierarchical processingcapability. This
significantlysynergizes thiscombinationandintegrationof relational andhierarchical processing’snew
semanticprocessing capabilitiesof hierarchical SQL.
44. Slide44: Hierarchical SQL Also SupportsMultipath Ordering
Rowsin standard ANSISQL are unordered andflatwhile XMLisorderedandsupportsmultiplepath
processing.The standardANSI SQLprocessingdoessupportordering of multipathprocessing.Soitwas
supportedinhierarchical multipathSQL. Thisallowsthe XMLinputorderand multipathprocessing to
be preservedinSQLhierarchical processing.Notice inthe diagramthatthe Invoice andEaddr data types
are independentlyorderedontheir differentpathsatthe greenarrows. Theirseparate dataoccurrences
are pointedtobythe red arrows.Thismultipathorderingcan alsobe usedto performmultipath
summaries. The XML queryabove producesthe XML outputshownwhichwasproducedfromthe SQL
hierarchical prototype processor.Itcontainsthe ordering capability.Multipathaggregatesand
summariescouldalsobe supported inthe same way.
45. Slide45: SeamlessPeer-to-PeerReal-TimeAutomaticMetadataMaintenance
Peer-to-peerprocessingsupports global concurrentmulti-pathSQLmetadata:communication,design
and coding.ThisallowsSQLdesignandcodingto be performedcollaborativelytobuildandtestSQLin
real-time.Inthe example shown,P1forpeer1starts thiscollaborative SQLoperationinputtingand
combiningof separate relational tablesA,B,C and the fixedhierarchical structure XYZ shown bythe
greenarrows. P1 passesthemto separate pathsP2 and P3 at the purple arrowsforseparate processing
that buildsthe SQLin parallel.This proceeds until the two differentpathsare joinedcombiningthe two
SQL structuresintoa single SQLresult at P4 by the red arrows.The final SQL source at P4 is shownat the
blue arrow.Transparentlysupportingthe entire P-to-P metadataprocessingautomatically isseamlessly
performedby a new AutomaticMetadataMaintenance.Thisautomatically hidesall global metadata
processingfromthe user.
46. Slide46: Connecting UnrelatedStructures
ViewsCustView andEmpView fromdifferentstructures atthe blue arrows have no directrelationships
intheirdata values.They canstill be relatedthroughasimple relational associationtable that supplies
the needed relationships.Anadvantage of thisassociationtable isthatMto M relationshipslike Parts
and Supplierscanbe defined andusedfromeitherdirection.Thismeanseithersuppliersorpartscould
be on top.M to M relationshipsare appliedas1to M relationshipson topand the matchingM to 1 on
the bottom.Thisalsoallowsforthe addition of intersectingdatato be storedinthe associationtable
that isdifferentforeachmatchingrelationship.Inthisexample this isthe specificcustomer/employee
associateddatacombinationfoundinthe intersectingdatacolumn pointedtoby the red dashedarrow.
47. Slide47: AdvancedStructureTransformationsinTest
Evenwithall the relational discoveriesandtheiradvance new capabilitiesalreadyshown,we are still
pursuingandresearchingnewadvancedcapabilitieslike those shown onthisslide.These include
dynamicstructure transformationsthatallow dynamicallyandflexiblychangingthe datastructure as
needed dynamically.They use differentandnew relationships torestructure the data. Thisalsoincludes
our powerful new dynamicdatastructure reshaping capability. Thisusesthe existingsemanticsto
reshape the datastructure inany waydynamicallywhile preservingthe semantics.Eachof these
dynamicrestructuringmethods hasitsownspecificuses,andbothmethodscanbe usedtogether.
48. Slide48: NewSemanticSQL is More Efficient
StandardSQL producesa flatstructure withno semanticsproducedbyCartesianprocessing keepingit
inefficient.Efficiencyisthe ratioof powersuppliedtoworkperformed.Increasingworkperformed
withoutincreasingpowersupplied isperformedby increasesefficiency. The new semanticSQL
hierarchical processingsignificantlyincreasesSQLprocessingby naturallyutilizingthe LeftJoin’simplied
semanticsproducingahigherperformance.Besidesthispowerfulsemanticsusage there are twoother
areas were semanticscome intoplayincreasingefficiency.These are fixedsemanticsinhierarchical
structures and dynamicsemanticswhere hierarchical structuresare joined increasingsemantics. All of
these differentsemanticscanbuildoneachotherto supporta significantly higherperformance
multipathenginebyincreasingefficiency toproduce aleapinanalytical andcomplex processing. The
bestincrease insemanticsisthe powerfuldynamicnatural semanticgenerationcreatedfrommultipath
processingwhichisusedforpowerful LCA processingbetween pathways.
49. Slide49: Relational Discoveries ProofofConcept
All of the newANSISQL hierarchical processingcapabilitiesshownhave beensupportedinour
functioningprototypelistedbelow.ThisbreakthroughmultipathSQLnatural hierarchical processorand
technologyhasbeenimplementedandtested.Itisoperatingfullyonanintegrationof relational algebra
and hierarchical principlesthathave beenmathematicallyandlogicallyprovento existandfunction
togethersynergistically. Thisnew SQLnow includes manycapabilities thatwere outside the current
domainof SQL but are nowwithinitbecause of the native relational hierarchical processing.
One final deeperexplanation andproof of LCA operationshowninthispresentationthat demonstrates
and proveshowandwhyit works is mypaper:The PowerbehindSQL's InherentMultipathLCA
Hierarchical Processingat: http://www.databasejournal.com/features/article.php/3882741/article.htm
See the SQL multipathhierarchical processorinaction fromactual processing outputfromanearlier
versionat:http://www.adatinc.com/images/Verifying_SQLfX_Current.pdf
My new book AdvancedStandard SQL Dynamic Structured Data ModelingandHierarchical Processing
fromArtechHouse Publishers describesmanyof the capabilitiesdescribedinthispresentationinmore
detail.Thisnewbook canbe foundat: http://www.artechhouse.com/Main/Books/Advanced-Standard-
SQL-Dynamic-Structured-Data-Mode-2071.aspx
Anycompanyhavingan interestoruse for thispowerful new breakthroughanddisruptive semanticSQL
querytechnology andproductcan contact Mike at: mmdavid@acm.org.
50. Slide50: SQL CHALLENGE
I will sendacopy of mynewbook: Advanced Standard SQL Dynamic Structured Data Modelingand
Hierarchical ProcessingfromArtechHouse Publisherstothe firsttwopeople thatfindanuncorrectable
error inthe newSQL processinglogic(syntax,semantics,operation) Iampresentinghere.Describe the
SQL error foundor questionyouhave andspecifyyouremail.See thisnew bookat:
http://www.artechhouse.com/Main/Books/Advanced-Standard-SQL-Dynamic-Structured-Data-Mode-
2071.aspx