SlideShare a Scribd company logo
1 of 13
Jon Crosier – Concordia University Irvine
jon.crosier@cui.edu
Building a CRM to Banner Bridge
Using Argos for
Data Integration and Automation
@CUI_Crosier #evisions
 No documentation or support
(Original developer no longer available)
 Unreliable and no logging or error output
 Complicated and convoluted architecture
 24 hours to complete a full cycle
 Time consuming to manage and update
 Rapidly becoming more mission critical
The Challenge
@CUI_Crosier #evisions
 Track down the original developer for help
(Whether by bribery or coercion)
 Rebuild the broken “black-box” parts on our own
 Scrap it all and build it better
(Whether we use home-grown or off-the-shelf components)
The Options
@CUI_Crosier #evisions
 Develop Argos Datablocks to execute
 Use Argos to schedule processes
 Build Argos extract reports for return data
The Architecture – Design Process
@CUI_Crosier #evisions
The Architecture – Components
20
21
1
2
3
8
9
10
17
18
19
11
12
13 14
15
16
5
6
7
1. AY Application Started Dataset
2. AY Application Submitted Dataset
3. Web Inquiry Form Submitted Dataset
4. Bulk Loaded Dataset
5. CAO Application In Progress Dataset
6. CAO Application Completed Dataset
7. CAO Application Supplement Submitted Dataset
8. CRM Application Create/Update Dataset
9. CRM Application Decision/Deposit Dataset
10. CRM Merit Award Dataset
11. MySQL Application Submitted Dataset
12. MySQL Application Decision/Deposit Dataset
13. MySQL Merit Award Dataset
14. Banner ID Dataset
15. Banner Financial Aid Award Dataset
16. Banner Enrolled / Cancelled Dataset
17. MySQL Banner ID Dataset
18. MySQL Financial Aid Award Dataset
19. MySQL Enrolled / Cancelled Dataset
20. Argos Admissions Application Funnel Dataset
21. Banner Student Records Information Dataset
Hobsons Apply
Yourself (AY)
CUI Web Inquiry
Form
Common App
Online (CAO)
Local Application
BridgeSchema
Hobsons Connect
(CRM)
Banner Student
Schema
Argos Application
Engine &
Scheduler
External Bulk
Dataload & Paper
Applications
4
@CUI_Crosier #evisions
The Architecture – Dataflow Overview
Student
Applies
in AY/CAO
or CUI App
App Bridged
to Connect
App
Submitted
App Submit
Set in
Connect
Connect App
Bridged to
Banner
ID Created
in Banner
ID Bridged
to Connect
Accept /
Deposit in
Connect
Dec/Dep
Bridged to
Banner
SAADMS
Updated in
Banner
SGASTDN
Record
Generated
IT Process
Creates
Accounts
FA
Information
Bridged to
Hobsons
Student
Registers in
Banner Self-
Service
Enroll
Bridged to
Hobsons
@CUI_Crosier #evisions
App
Submit
Data
Banner ID
Extract
Financial
Aid Extract
Decision
Data
Deposit
Data
Enroll
Extract
Other Data
Extract
The Architecture – Dataflow & Datablocks
Misc Data Datablock Apps Datablock
CID/BID Datablock
FINAID DatablockDec/Dep Datablock
Reg Datablock
@CUI_Crosier #evisions
 Develop Argos Datablocks to execute
 Use Argos to schedule processes
 Build Argos extract reports for return data
 Use the existing Oracle “bolt-on” schema
 Develop new packages and procedures
 Continue using internal Banner App Processing
The Architecture – Design Process
@CUI_Crosier #evisions
The Architecture – Technical
@CUI_Crosier #evisions
Show-&-Tell
@CUI_Crosier #evisions
 Reliable bridging with verbose error logs
 4+ hours/week maintaining is now > 5 min/week
 Complete documentation and source code
 Most bridge process run hourly or on-demand
 Average failure rate from ~12% to > 2%
 Very simple to extend and expand as needed
The Results
@CUI_Crosier #evisions
 Incorporate Web Services for App/Dec data
 Update App Submit to hourly, rather than 4x/day
 Update Dec/Dep to hourly, rather than 4x/day
 Add New Race/ New Ethnicity to bridge
 Add new reporting dataset for Argos
 Add error detection and auto-mitigation
What’s Next
@CUI_Crosier #evisions
Questions
&
Answers
Jon Crosier – Concordia University Irvine
jon.crosier@cui.edu
@CUI_Crosier #evisions

More Related Content

Similar to Evisions conference 2014_argos_data_automation

Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New Heights
Safe Software
 
Introduction to WorksLink
Introduction to WorksLinkIntroduction to WorksLink
Introduction to WorksLink
Andrew McGrath
 

Similar to Evisions conference 2014_argos_data_automation (20)

Rhf2019 how totackle barriersofapplicationmodernization_ap16_en
Rhf2019 how totackle barriersofapplicationmodernization_ap16_enRhf2019 how totackle barriersofapplicationmodernization_ap16_en
Rhf2019 how totackle barriersofapplicationmodernization_ap16_en
 
Cloud computing pioneers - remarkable examples 2010-11-05
Cloud computing pioneers - remarkable examples 2010-11-05Cloud computing pioneers - remarkable examples 2010-11-05
Cloud computing pioneers - remarkable examples 2010-11-05
 
odkk.pptx
odkk.pptxodkk.pptx
odkk.pptx
 
AVM-2016-Updated
AVM-2016-UpdatedAVM-2016-Updated
AVM-2016-Updated
 
open data kit app development
open data kit app developmentopen data kit app development
open data kit app development
 
What’s in Your Data Warehouse?
What’s in Your Data Warehouse?What’s in Your Data Warehouse?
What’s in Your Data Warehouse?
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New Heights
 
Kapow Web Data Server 7.0 Presentation
Kapow Web Data Server 7.0 PresentationKapow Web Data Server 7.0 Presentation
Kapow Web Data Server 7.0 Presentation
 
Update on eTicketing technologies for the asphalt pavement industry
Update on eTicketing technologies for the asphalt pavement industryUpdate on eTicketing technologies for the asphalt pavement industry
Update on eTicketing technologies for the asphalt pavement industry
 
Introduction to WorksLink
Introduction to WorksLinkIntroduction to WorksLink
Introduction to WorksLink
 
Cast cloud april_2019
Cast cloud april_2019Cast cloud april_2019
Cast cloud april_2019
 
GraphSummit - Process Tempo - Build Graph Applications.pdf
GraphSummit - Process Tempo - Build Graph Applications.pdfGraphSummit - Process Tempo - Build Graph Applications.pdf
GraphSummit - Process Tempo - Build Graph Applications.pdf
 
Mobile data collection using odk
Mobile data collection using odkMobile data collection using odk
Mobile data collection using odk
 
Indonesia Truck Entry Project Proposal (1) [Autosaved].pptx
Indonesia Truck Entry Project Proposal (1) [Autosaved].pptxIndonesia Truck Entry Project Proposal (1) [Autosaved].pptx
Indonesia Truck Entry Project Proposal (1) [Autosaved].pptx
 
[Keynote] Data Driven Organizations with AWS Data - 발표자: Agnes Panosian, Head...
[Keynote] Data Driven Organizations with AWS Data - 발표자: Agnes Panosian, Head...[Keynote] Data Driven Organizations with AWS Data - 발표자: Agnes Panosian, Head...
[Keynote] Data Driven Organizations with AWS Data - 발표자: Agnes Panosian, Head...
 
SUGCON NA 2023 - Crafting Lightning Fast Composable Experiences.pptx
SUGCON NA 2023 - Crafting Lightning Fast Composable Experiences.pptxSUGCON NA 2023 - Crafting Lightning Fast Composable Experiences.pptx
SUGCON NA 2023 - Crafting Lightning Fast Composable Experiences.pptx
 
IoT Scale Event-Stream Processing for Connected Fleet at Penske
IoT Scale Event-Stream Processing for Connected Fleet at PenskeIoT Scale Event-Stream Processing for Connected Fleet at Penske
IoT Scale Event-Stream Processing for Connected Fleet at Penske
 
Open Data Kit
Open Data KitOpen Data Kit
Open Data Kit
 
Wisis Ajax Rapid Application Framework
Wisis Ajax Rapid Application FrameworkWisis Ajax Rapid Application Framework
Wisis Ajax Rapid Application Framework
 
Feast Feature Store - An In-depth Overview Experimentation and Application in...
Feast Feature Store - An In-depth Overview Experimentation and Application in...Feast Feature Store - An In-depth Overview Experimentation and Application in...
Feast Feature Store - An In-depth Overview Experimentation and Application in...
 

Recently uploaded

Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
AroojKhan71
 
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
amitlee9823
 
FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdf
MarinCaroMartnezBerg
 
Schema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdfSchema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdf
Lars Albertsson
 

Recently uploaded (20)

CebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxCebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptx
 
Smarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxSmarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptx
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
 
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
 
Ravak dropshipping via API with DroFx.pptx
Ravak dropshipping via API with DroFx.pptxRavak dropshipping via API with DroFx.pptx
Ravak dropshipping via API with DroFx.pptx
 
100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptx100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptx
 
Midocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxMidocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFx
 
Data-Analysis for Chicago Crime Data 2023
Data-Analysis for Chicago Crime Data  2023Data-Analysis for Chicago Crime Data  2023
Data-Analysis for Chicago Crime Data 2023
 
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
 
VidaXL dropshipping via API with DroFx.pptx
VidaXL dropshipping via API with DroFx.pptxVidaXL dropshipping via API with DroFx.pptx
VidaXL dropshipping via API with DroFx.pptx
 
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 nightCheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
 
Edukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFxEdukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFx
 
Generative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusGenerative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and Milvus
 
Introduction-to-Machine-Learning (1).pptx
Introduction-to-Machine-Learning (1).pptxIntroduction-to-Machine-Learning (1).pptx
Introduction-to-Machine-Learning (1).pptx
 
FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdf
 
Schema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdfSchema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdf
 
Best VIP Call Girls Noida Sector 39 Call Me: 8448380779
Best VIP Call Girls Noida Sector 39 Call Me: 8448380779Best VIP Call Girls Noida Sector 39 Call Me: 8448380779
Best VIP Call Girls Noida Sector 39 Call Me: 8448380779
 
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
 
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptxBPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
 
BabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxBabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptx
 

Evisions conference 2014_argos_data_automation

  • 1. Jon Crosier – Concordia University Irvine jon.crosier@cui.edu Building a CRM to Banner Bridge Using Argos for Data Integration and Automation @CUI_Crosier #evisions
  • 2.  No documentation or support (Original developer no longer available)  Unreliable and no logging or error output  Complicated and convoluted architecture  24 hours to complete a full cycle  Time consuming to manage and update  Rapidly becoming more mission critical The Challenge @CUI_Crosier #evisions
  • 3.  Track down the original developer for help (Whether by bribery or coercion)  Rebuild the broken “black-box” parts on our own  Scrap it all and build it better (Whether we use home-grown or off-the-shelf components) The Options @CUI_Crosier #evisions
  • 4.  Develop Argos Datablocks to execute  Use Argos to schedule processes  Build Argos extract reports for return data The Architecture – Design Process @CUI_Crosier #evisions
  • 5. The Architecture – Components 20 21 1 2 3 8 9 10 17 18 19 11 12 13 14 15 16 5 6 7 1. AY Application Started Dataset 2. AY Application Submitted Dataset 3. Web Inquiry Form Submitted Dataset 4. Bulk Loaded Dataset 5. CAO Application In Progress Dataset 6. CAO Application Completed Dataset 7. CAO Application Supplement Submitted Dataset 8. CRM Application Create/Update Dataset 9. CRM Application Decision/Deposit Dataset 10. CRM Merit Award Dataset 11. MySQL Application Submitted Dataset 12. MySQL Application Decision/Deposit Dataset 13. MySQL Merit Award Dataset 14. Banner ID Dataset 15. Banner Financial Aid Award Dataset 16. Banner Enrolled / Cancelled Dataset 17. MySQL Banner ID Dataset 18. MySQL Financial Aid Award Dataset 19. MySQL Enrolled / Cancelled Dataset 20. Argos Admissions Application Funnel Dataset 21. Banner Student Records Information Dataset Hobsons Apply Yourself (AY) CUI Web Inquiry Form Common App Online (CAO) Local Application BridgeSchema Hobsons Connect (CRM) Banner Student Schema Argos Application Engine & Scheduler External Bulk Dataload & Paper Applications 4 @CUI_Crosier #evisions
  • 6. The Architecture – Dataflow Overview Student Applies in AY/CAO or CUI App App Bridged to Connect App Submitted App Submit Set in Connect Connect App Bridged to Banner ID Created in Banner ID Bridged to Connect Accept / Deposit in Connect Dec/Dep Bridged to Banner SAADMS Updated in Banner SGASTDN Record Generated IT Process Creates Accounts FA Information Bridged to Hobsons Student Registers in Banner Self- Service Enroll Bridged to Hobsons @CUI_Crosier #evisions
  • 7. App Submit Data Banner ID Extract Financial Aid Extract Decision Data Deposit Data Enroll Extract Other Data Extract The Architecture – Dataflow & Datablocks Misc Data Datablock Apps Datablock CID/BID Datablock FINAID DatablockDec/Dep Datablock Reg Datablock @CUI_Crosier #evisions
  • 8.  Develop Argos Datablocks to execute  Use Argos to schedule processes  Build Argos extract reports for return data  Use the existing Oracle “bolt-on” schema  Develop new packages and procedures  Continue using internal Banner App Processing The Architecture – Design Process @CUI_Crosier #evisions
  • 9. The Architecture – Technical @CUI_Crosier #evisions
  • 11.  Reliable bridging with verbose error logs  4+ hours/week maintaining is now > 5 min/week  Complete documentation and source code  Most bridge process run hourly or on-demand  Average failure rate from ~12% to > 2%  Very simple to extend and expand as needed The Results @CUI_Crosier #evisions
  • 12.  Incorporate Web Services for App/Dec data  Update App Submit to hourly, rather than 4x/day  Update Dec/Dep to hourly, rather than 4x/day  Add New Race/ New Ethnicity to bridge  Add new reporting dataset for Argos  Add error detection and auto-mitigation What’s Next @CUI_Crosier #evisions
  • 13. Questions & Answers Jon Crosier – Concordia University Irvine jon.crosier@cui.edu @CUI_Crosier #evisions