DataPortal Presentation


Published on

With DataPortal Business Data Sharing Software, business data can be shared with hundreds of partners within minutes, with “Point­-and­-Click” ease.

No development, works across database vendors, minimal setup and configuration, (no cost, no manual installation for client), SSL encryption, no firewall modification, no unnecessary conversion (e.g. XML).

Published in: Entertainment & Humor
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

DataPortal Presentation

  1. 1. DataPortal - Database Sharing In the Cloud A simpler way to transfer complex data Connection Concepts, Inc. 2141 Industrial Parkway, Suite 202 Silver Spring, MD, 20904-7824, USA 860 729-3117 ; Contact: Gary Whitten, Pres., CIO
  2. 2. Data Sharing TodaySharing structured, complex data (e.g. Relation Database Data) is too burdensome Current Options: Simple: Convert to flat files Difficult: Legacy EDI or similar Structure, Information and (Electronic Data Interchange) Value is lost • Requires development • Rigid, Inflexible • Requires Conversion for data Provider AND ConsumerEase ofTransfer • Requires Firewall Modification Practical Limit Data Complexity/ Value Goal: “YouTube for data” ● Push-button sharing of complex data over the Web ● Agile - Instant, Effortless Publishing, Retrieval 2
  3. 3. Database Sharing NeedsExperts call for sharing data in its original form: (from CNET January 27, 2009 CNE David Robinson Associate Director of the Center for Information Technology Policy at Princeton University: "(no) one person or organization could possibly anticipate all the ways that Americans will want to analyze, reuse, or cross-reference the information that will offer. And no one person or organization needs to do so, as long as the data itself is readily available." In 2008, Robinson and his colleagues at Princeton published a paper calling for the government to provide open access to the raw data used by all federal Web sites. The highly influential paper has been widely circulated among technology policy circles in recent months. Jim Harper Director of Information Policy Studies at the Cato Institute: ...the entire back-end database should be made available. "This is a little tricky, because people have to settle on a format, and then require submissions in that format from contractors and state and local entities, etc.," 3
  4. 4. Database Sharing NeedsExperts call for easier, more agile data sharing: From Information Week, June 21, 2010, cover story (page 26) “Share”, “Why IT Needs To Push Data Sharing Efforts” one of the single best things (IT departments) can do for their businesses is enable effective data sharing. … Yetdata sharing, particularly automated systems that give your external business partners access to your data when theywant it, are not ubiquitous or easy, and the level of data sharing of any kind is surprisingly low. *******************************When it comes to what frustrates data sharing efforts, the classic culprit, budget limitations, tops the list of surveyrespondents, followed by complaints about the multiple sets of tools and the care and feeding required by legacyconnections. *******************************A bigger problem is if IT simply doesnt have the ability to respond quickly to new requests. Too many companiescant move fast enough. 4
  5. 5. Database Sharing TodayNeed for more agile Supply Chain managementReal world example - Sikorsky Aircraft Company: Resistance from potential new suppliers to burdensome EDI process to share order data 5
  6. 6. DataPortal Database Sharing In the CloudDataPortal transfers business datain database form over the Web • No development • SSL encryption • Works across database vendors • Multiple layers of password protection • Minimal setup and configuration • No firewall modification (no manual installation for Web client) • Serves a wide audience • Data NOT exposed directly to network • Instant database migration • No unnecessary conversion at either end • Maintains database value and complexityAppropriate when source and destination data reside in arelational database system DataPortal - “Push-button” solution for instantly sharing complex database data in the Cloud 6
  7. 7. DataPortal Operation Client DataPortal Client DataPortal Server Request Database Host Host Database System System DataPortal Web DataPortal Client Server HTTPClient requests a DataSource (published database) 7
  8. 8. DataPortal Operation DataPortal Client Server DataPortal Server Host Response HostDatabase Database System System DataPortal Web DataPortal Client Server HTTP Snapshot of requested DataSource is transferred over the Web, through unmodified firewall, to users preferred database system available for immediate processing using existing infrastructure 8
  9. 9. DataPortal Write Data Modes Original Data to be Original Data to be Original Data to be Data Written Data Written Data Written Replace Edit Append Database Resulting Resulting Resulting Data Data DataCreates and populates Writes new data Appends new datanew database – replaces over old After oldAny pre-existing databasewith same name 9
  10. 10. Shared Data Selection OptionsShared Data Selection Options • Share Full Database Structure and Content • Share Only Selected Tables • Share Data Filtered by Authenticated ID 10
  11. 11. Data Sharing Usage ExampleBroadcast – central database is distributed to many partners (e.g. - Replace Database mode) DataPortal DataPortal DataPortal Client Client Client DataPortal DataPortal DataPortal Client Server Client DataPortal DataPortal DataPortal Client Client Client 11
  12. 12. Data Sharing Usage ExampleMerge and Integrate – many partners add data to central database (e.g. - Append mode) DataPortal DataPortal DataPortal Server Server Server DataPortal DataPortal DataPortal Server Client Server DataPortal DataPortal DataPortal Server Server Server 12
  13. 13. DataPortal SecurityDataPortal Security• Uses Web standard SSL (Secure Socket Layer) for • Encryption • Authentication • Other Web security standards can be applied when available• Mulitple levels of password authentication • Web level • Application level • Database level• Data filtering based on authenticated ID• Database never exposed to network (stays behind firewall) 13
  14. 14. DataPortal Applet Client DataPortal Client ● No installation requiredwithin Web browser ● Uses standard Java-enabled Web browser Usage: ● URL selects DataPortal Server ● Selection Fields  DataSource  Data Destination  DB Vendor  Host/Port  User/Password  Initial DB (if required)  New DB Name  Info/Status Display ** standalone client also available ** 14
  15. 15. DataPortal Standalone Client Application DataPortal Client ● Includes all functionality of Web clientStandalone Application Transfer Control View ● Defines and saves data transfers ● Web listener transfers data based on authenticated Web requests from programs or browsers DataPortal Client Standalone Application Listener View 15
  16. 16. DataPortal Server Management Publishing a DataSourceAdd DataSource Web Form DataSource Form Parameters DB Vendor Type Host/Port DB Name DataSource Name (as seen by client) Database User/Password Min/Max Number of Connections Require Client User/Password for DataSource access 16
  17. 17. DataPortal Security DesignDataPortal Security Diagram Manual Submission Standard SSL Applet RDBMS GUI Data Path Data Path DataPortal RDBMS Client Programatic DataPortal Server DataPortal Client URL Request Host Applet Manual Web Form (Browser) URL DataPortal Manual Submission Request Server Submission Application HTTP/SSL GUI Listerner(s) RDBMS DataPortal Client DataPortal Client Application 17
  18. 18. DataPortal Data Transfer Integrity: Implicit Verification DataPortal Transfer Integrity – Implicit Verfication● DataPortal transfer requires many Java component actions● Each action is monitored for material exceptions● Data corruption without exception is highly unlikely (supported by testing)● Transfer is treated atomically - If any action throws any material exception, the entire transfer is aborted – Transfer results reported – Transfer can be repeated, in its entirety, until successful 18
  19. 19. DataPortal Data Transfer Integrity: Explicit Verification DataPortal Transfer Integrity – Explicit Verification● Element Size at Destination is compared to Size at Source – can be done inline, not currently included in standard transfer (overhead not justified)● DataPortal infrastructure is used to compare structure and data of two DataBases, across DB vendors – Compare 2 DB separate utility 19
  20. 20. DataPortal Data Transfer Integrity: Database Compare UtilityDataPortal infrastructure is used to compare structure and data of two DataBases, across DB vendors Example: In a DB of ~150 MBs, an improper handling of the “ ” character by the database was discovered 20
  21. 21. DataPortal Deployment DataPortal Deployed by loadingDataPortal Server Host WAR (Web ARchive) File into Servlet Engine Web Server Client Applet JAR (Java Archive) File Servlet Engine is contained within WAR File WAR File (Server) Client is automatically downloaded and installed into Web browser JAR File (Client) 21
  22. 22. DataPortal Demo 22
  23. 23. Patented DataPortal TechnologyDataPortal IP Status:Connection Concepts awardedU.S. Patent 7,346,635 for DataPortal technologyConnection Concepts owns patent 23
  24. 24. DataPortal Advantage • With DataPortal, data is read/written directly from/to database without conversion to intermediate formats • More complex, high value data can be transferred with the ease of a simple flat file Ease of Traditional Database Data Transfer Over the Web Transfer Practical Limit Export Setup Convert Convert Dilute ImportDatabase CSV, CSV, DatabaseData Source XML... XML... Data Destination Data Complexity/ Value Web Direct Database Data Transfer Over the Web with DataPortal DataPortal DataPortal Ease of Transfer Practical LimitDatabase DatabaseData Source Data Destination Web Data Complexity/ Value 24
  25. 25. DataPortal ValueUsers can share complex database data over the Web...● directly from/to their databases (provider and consumer) without conversion to intermediate forms● immediately● effortlessly (“push-button” ease)● without development effort or need for programmers● directly from the browser so consumer does not need to install software● without limit on data complexity (value) e.g. tables, primary/foreign keys, images, docs...● while serving a wide audience● no firewall modification Complex data can be shared among millions of users within minutes 25
  26. 26. Standards-Based SolutionDataPortal uses standards based technologies● Relational Database Systems – standard for storing data (e.g. Oracle, DB2, Access, MySQL, SQL Server...)● Web● SQL (Structured Query Language)● Standard port – no firewall modification● Client runs in browser – no software installation● SSL (Secure Socket Layer) for authentication and encryption● Java● Server deployed as Java Servlet within Web server● Java Applet runs in Web browser● JDBC – Java standard for database connectivity 26
  27. 27. DataPortal ApplicationsDataPortal applications DataPortal is a potential solution whenever parties want to quickly and easily share database data● Many existing or new EDI applications (e.g. Supply-chain management, Order Processing or Status reporting...)● Putting catalog, product and pricing info on the Web● Supplying sales force with current data in the field● Government data sharing ● Providing users original data for data-centric public facing Web sites (,, ● Public data reporting to government (e.g Recovery funds usage reporting) ● Inter-agency/department data sharing DataPortal Potential: Standard for Sharing Business and Government Data 27
  28. 28. DataPortal Design DB Database Abstract DB Structure, Data Vendor “A” Representation Serialized Objects DataPortal Server (DB Vendor Neutral) Host To DB Structure, DataDataPortal DataPortal Requests Client Server DB Structure, Data Info DB Vendor “B” Database DataPortal Client Create DB, Tables Host from DataPortal Client DataPortal Populate Tables Server 28
  29. 29. Competitive AdvantagesNon-Web based competition:EDI (Legacy), Database Development Tools● Difficult to use – intended for programmers● Restrictive – must conform to specific formats or database vendors/versions● Requires firewall modification, network programing● Client must install software● Must add in security and authentication● Persistent connections use network resources● Intended for narrow audience 29
  30. 30. Competitive AdvantagesWeb based competition● CSV, Excel files Ease of – Requires conversion Transfer – Limits complexity/value of data DataPortal CSV● XML XML Practical Limit – Requires conversion API – Requires programming – Limits complexity/value of data Data Complexity/ Value – Inefficient – high data overhead● API – Requires programming, expertise, time, effort 30
  31. 31. Where Can DataPortal Be Used?Provide Standard Tool for Sharing Complex, Structured Data Within or Across:● Departments● Offices● Partners● Suppliers● Customers● Sales Force● Government (Federal, State, City, Local)● ….. 31
  32. 32. Database Sharing In the Cloud A simpler way to transfer complex dataContact Information:Connection Concepts, Inc.2141 Industrial Parkway, Suite 202Silver Spring, MD, 20904-7824, USA ; http://con2inc.comGary Whitten, President., CIOwhitteng@con2inc.com860 729-3117