SlideShare a Scribd company logo
1 of 20
Download to read offline
How to Make Your
Data Processors
Love You
HELLO!
Maryann Reissig
St. John Fisher College
Rochester, NY
@stpha6
maryannreissig.com/auto
About
About SJFC:
St. John Fisher College
Rochester, NY
2,600 full-time and 200 part-time
undergraduate students, as well as 1,000
graduate students
About Me:
7 years at SJFC, 20+ years in
higher ed
WordCamp ROC organizer
Overview
Forms.
What is Gravity Forms?
History of web forms on our
campus (the short version)
Wrangling Data.
How can we automate the
process so we can minimally
process the data on a
schedule?
What’s next.
How has this been
successful, and what are
the next steps?
FormsWere everywhere, data went nowhere
(you know that Talking Heads song?)
we needed a better builder and
process for data collection
● Created WP Site ~2015 with GF
● In 2018, Went from a single WP site to
a multisite with ~150 forms
● The success of the forms site created
new problems to solve
Enter Gravity Forms
Admissions Forms
The Good Problem - “Request More Information” Forms
https://www.sjfc.edu/admissions-aid/request-information/
● Data started rolling in via email only, leaving our processing
center to deal with the incoming data in a manual,
labor-intensive way (one email at a time)
● We had to find a way to provide this data in a standardized
format for upload into our SIS
Let’s Work Together!
● Began meeting with Admissions and Information Coordinators
● Process Discovery (wow, did we learn a lot!)
● Collaboration Tools (Get your communication out of email and
into Google Drive or other sharing tool)
● Google Drive will write your process documentation for you from
the end-user perspective!
The Fun Begins
Scripted.
How can we script the
process to get clean data
out of Gravity Forms?
Automated.
How can we automate the
process so we can
minimally process the data
on a schedule?
Done. (Really?)
How has this been
successful, and what are
the next steps?
Scripting
Gravity Forms API
● First tried to use front end tools like Gravity View
● Too many steps to get clean data from UI
● The API proved the best choice to be able to schedule a
standard export file that could be used by our processing
center to get the data in the time they needed, in the format
that worked (for SIS import)
Setup
Automate it!
● Small php app that connects to GF API, pulls the data
specified into a custom CSV file
● Copies file to a shared drive where the data
processors can access it
● Cron job controls timing of data extract along with
control of date intervals of data export (you can control
the interval of data pull via the api call to only get form
entries in your specified date/time range)
App
Done! (Really?)
More GF API uses
● Extract GF data into PDF files using Gravity PDF
● Document Imaging of program application data not held in
database fields (like application essays)
● Data Retention (GF does it for you!)
● Security discussion
○ my scripts are stored on an internal server, not
accessible off-campus
Just the Beginning
As the process has evolved, the demand has grown
Growth
More types of forms
● Internal program applications (Nursing, School of Ed)
● Enrollment profile forms (Incoming Freshmen)
● More opportunities to work with data processors
(Yay, I love these people!)
● Setting up forms properly on front end to send data in a
usable format for SIS (termcodes, major codes, control
dates for better data collection/user choices, etc.)
● Data was lost during maintenance windows, but we
adjusted so that no data is extracted on weekends
● Don’t deliver empty files if there are no entries (we had
too many empty files, which wastes the processors’ time)
● Streamlining this data has saved our processing centers
hours of time each week
● The relationship built has led to success for both teams
(💜 for us!)
Lessons Learned
Recap
Scripted.
Use Gravity Forms API to
extract data from your
forms.
Automated.
Use cron jobs and API
intervals to pull data on a
schedule that works for
you.
Done. (Really?)
Keep improving your
process by working with
your data processors and
finding new ways to help
them get the data they
need from your web
applications.
There is more hunger for
love and appreciation in this
world than for bread.
-Mother Teresa
“
Thanks!
Questions and Feedback
● Questions: 2019.wpcampus.org
● Feedback: https://2019.wpcampus.org/feedback/how-to-make-your-data-processors-love-you/
● Find me later:
○ in the hall
○ on WPCampus slack: Maryann Reissig
○ mreissig@sjfc.edu
You can also find me at @stpha6 slides and resources: maryannreissig.com/auto

More Related Content

Similar to How to make your data processors love you

E-Tender System
E-Tender SystemE-Tender System
E-Tender SystemSmit Patel
 
How to Use Your Existing ODI On-Premise to Seamlessly Integrate PBCS
How to Use Your Existing ODI On-Premise to Seamlessly Integrate PBCSHow to Use Your Existing ODI On-Premise to Seamlessly Integrate PBCS
How to Use Your Existing ODI On-Premise to Seamlessly Integrate PBCSRodrigo Radtke de Souza
 
What You Don't Know About 3rd Party Scripts Can Hurt You!
What You Don't Know About 3rd Party Scripts Can Hurt You!What You Don't Know About 3rd Party Scripts Can Hurt You!
What You Don't Know About 3rd Party Scripts Can Hurt You!Jennifer Finney
 
Baby Got Batch: SEVIS Batching and You
Baby Got Batch: SEVIS Batching and YouBaby Got Batch: SEVIS Batching and You
Baby Got Batch: SEVIS Batching and YouNAFSA Tech MIG
 
Baby Got Batch: SEVIS Batching and You
Baby Got Batch: SEVIS Batching and YouBaby Got Batch: SEVIS Batching and You
Baby Got Batch: SEVIS Batching and YouTracy Kaan
 
Project proposal of school managment software
Project proposal of school managment softwareProject proposal of school managment software
Project proposal of school managment softwareProshanta Halder
 
WEBINAR: Proven Patterns for Loading Test Data for Managed Package Testing
WEBINAR: Proven Patterns for Loading Test Data for Managed Package TestingWEBINAR: Proven Patterns for Loading Test Data for Managed Package Testing
WEBINAR: Proven Patterns for Loading Test Data for Managed Package TestingCodeScience
 
payroll management -1.
payroll management -1.payroll management -1.
payroll management -1.DJananiJanani
 
Modern Product Data Workflows: How and Why: Embedded Analytics Interfaces For...
Modern Product Data Workflows: How and Why: Embedded Analytics Interfaces For...Modern Product Data Workflows: How and Why: Embedded Analytics Interfaces For...
Modern Product Data Workflows: How and Why: Embedded Analytics Interfaces For...Hannah Flynn
 
How and Why: Embedded Analytics Interfaces For Your SaaS Product
How and Why: Embedded Analytics Interfaces For Your SaaS ProductHow and Why: Embedded Analytics Interfaces For Your SaaS Product
How and Why: Embedded Analytics Interfaces For Your SaaS ProductAggregage
 
OpenSource for Enterprise Business Presentation 010
OpenSource for Enterprise Business Presentation 010OpenSource for Enterprise Business Presentation 010
OpenSource for Enterprise Business Presentation 010Passapong Thaithatgoon
 
P _n___l_accounting_website
P  _n___l_accounting_websiteP  _n___l_accounting_website
P _n___l_accounting_websiteAshish Sharma
 
SAS Global Forum 2015 Presentation
SAS Global Forum 2015 PresentationSAS Global Forum 2015 Presentation
SAS Global Forum 2015 PresentationDhanashree Arole
 
Fee collection system
Fee collection systemFee collection system
Fee collection systemharryz18
 
Choosing a Database
Choosing a DatabaseChoosing a Database
Choosing a DatabaseTechSoup
 
Accrosoft End of Year Presentation
Accrosoft End of Year PresentationAccrosoft End of Year Presentation
Accrosoft End of Year PresentationRachel Lindsay
 

Similar to How to make your data processors love you (20)

E-Tender System
E-Tender SystemE-Tender System
E-Tender System
 
How to Use Your Existing ODI On-Premise to Seamlessly Integrate PBCS
How to Use Your Existing ODI On-Premise to Seamlessly Integrate PBCSHow to Use Your Existing ODI On-Premise to Seamlessly Integrate PBCS
How to Use Your Existing ODI On-Premise to Seamlessly Integrate PBCS
 
What You Don't Know About 3rd Party Scripts Can Hurt You!
What You Don't Know About 3rd Party Scripts Can Hurt You!What You Don't Know About 3rd Party Scripts Can Hurt You!
What You Don't Know About 3rd Party Scripts Can Hurt You!
 
Baby Got Batch: SEVIS Batching and You
Baby Got Batch: SEVIS Batching and YouBaby Got Batch: SEVIS Batching and You
Baby Got Batch: SEVIS Batching and You
 
Baby Got Batch: SEVIS Batching and You
Baby Got Batch: SEVIS Batching and YouBaby Got Batch: SEVIS Batching and You
Baby Got Batch: SEVIS Batching and You
 
RecruitPro 360 - Recruitment Software
RecruitPro 360 - Recruitment SoftwareRecruitPro 360 - Recruitment Software
RecruitPro 360 - Recruitment Software
 
Project proposal of school managment software
Project proposal of school managment softwareProject proposal of school managment software
Project proposal of school managment software
 
WEBINAR: Proven Patterns for Loading Test Data for Managed Package Testing
WEBINAR: Proven Patterns for Loading Test Data for Managed Package TestingWEBINAR: Proven Patterns for Loading Test Data for Managed Package Testing
WEBINAR: Proven Patterns for Loading Test Data for Managed Package Testing
 
payroll management -1.
payroll management -1.payroll management -1.
payroll management -1.
 
Modern Product Data Workflows: How and Why: Embedded Analytics Interfaces For...
Modern Product Data Workflows: How and Why: Embedded Analytics Interfaces For...Modern Product Data Workflows: How and Why: Embedded Analytics Interfaces For...
Modern Product Data Workflows: How and Why: Embedded Analytics Interfaces For...
 
How and Why: Embedded Analytics Interfaces For Your SaaS Product
How and Why: Embedded Analytics Interfaces For Your SaaS ProductHow and Why: Embedded Analytics Interfaces For Your SaaS Product
How and Why: Embedded Analytics Interfaces For Your SaaS Product
 
javed ahmed
javed ahmedjaved ahmed
javed ahmed
 
Net banking
Net banking Net banking
Net banking
 
OpenSource for Enterprise Business Presentation 010
OpenSource for Enterprise Business Presentation 010OpenSource for Enterprise Business Presentation 010
OpenSource for Enterprise Business Presentation 010
 
P _n___l_accounting_website
P  _n___l_accounting_websiteP  _n___l_accounting_website
P _n___l_accounting_website
 
SAS Global Forum 2015 Presentation
SAS Global Forum 2015 PresentationSAS Global Forum 2015 Presentation
SAS Global Forum 2015 Presentation
 
MYRESUME
MYRESUMEMYRESUME
MYRESUME
 
Fee collection system
Fee collection systemFee collection system
Fee collection system
 
Choosing a Database
Choosing a DatabaseChoosing a Database
Choosing a Database
 
Accrosoft End of Year Presentation
Accrosoft End of Year PresentationAccrosoft End of Year Presentation
Accrosoft End of Year Presentation
 

Recently uploaded

Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactPECB
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room servicediscovermytutordmt
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13Steve Thomason
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...PsychoTech Services
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingTeacherCyreneCayanan
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsTechSoup
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationnomboosow
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpinRaunakKeshri1
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdfQucHHunhnh
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Celine George
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 

Recently uploaded (20)

Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room service
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communication
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpin
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 

How to make your data processors love you

  • 1. How to Make Your Data Processors Love You
  • 2. HELLO! Maryann Reissig St. John Fisher College Rochester, NY @stpha6 maryannreissig.com/auto
  • 3. About About SJFC: St. John Fisher College Rochester, NY 2,600 full-time and 200 part-time undergraduate students, as well as 1,000 graduate students About Me: 7 years at SJFC, 20+ years in higher ed WordCamp ROC organizer
  • 4. Overview Forms. What is Gravity Forms? History of web forms on our campus (the short version) Wrangling Data. How can we automate the process so we can minimally process the data on a schedule? What’s next. How has this been successful, and what are the next steps?
  • 5. FormsWere everywhere, data went nowhere (you know that Talking Heads song?) we needed a better builder and process for data collection
  • 6. ● Created WP Site ~2015 with GF ● In 2018, Went from a single WP site to a multisite with ~150 forms ● The success of the forms site created new problems to solve Enter Gravity Forms
  • 7. Admissions Forms The Good Problem - “Request More Information” Forms https://www.sjfc.edu/admissions-aid/request-information/ ● Data started rolling in via email only, leaving our processing center to deal with the incoming data in a manual, labor-intensive way (one email at a time) ● We had to find a way to provide this data in a standardized format for upload into our SIS
  • 8. Let’s Work Together! ● Began meeting with Admissions and Information Coordinators ● Process Discovery (wow, did we learn a lot!) ● Collaboration Tools (Get your communication out of email and into Google Drive or other sharing tool) ● Google Drive will write your process documentation for you from the end-user perspective!
  • 9. The Fun Begins Scripted. How can we script the process to get clean data out of Gravity Forms? Automated. How can we automate the process so we can minimally process the data on a schedule? Done. (Really?) How has this been successful, and what are the next steps?
  • 10. Scripting Gravity Forms API ● First tried to use front end tools like Gravity View ● Too many steps to get clean data from UI ● The API proved the best choice to be able to schedule a standard export file that could be used by our processing center to get the data in the time they needed, in the format that worked (for SIS import)
  • 11. Setup
  • 12. Automate it! ● Small php app that connects to GF API, pulls the data specified into a custom CSV file ● Copies file to a shared drive where the data processors can access it ● Cron job controls timing of data extract along with control of date intervals of data export (you can control the interval of data pull via the api call to only get form entries in your specified date/time range)
  • 13. App
  • 14. Done! (Really?) More GF API uses ● Extract GF data into PDF files using Gravity PDF ● Document Imaging of program application data not held in database fields (like application essays) ● Data Retention (GF does it for you!) ● Security discussion ○ my scripts are stored on an internal server, not accessible off-campus
  • 15. Just the Beginning As the process has evolved, the demand has grown
  • 16. Growth More types of forms ● Internal program applications (Nursing, School of Ed) ● Enrollment profile forms (Incoming Freshmen) ● More opportunities to work with data processors (Yay, I love these people!)
  • 17. ● Setting up forms properly on front end to send data in a usable format for SIS (termcodes, major codes, control dates for better data collection/user choices, etc.) ● Data was lost during maintenance windows, but we adjusted so that no data is extracted on weekends ● Don’t deliver empty files if there are no entries (we had too many empty files, which wastes the processors’ time) ● Streamlining this data has saved our processing centers hours of time each week ● The relationship built has led to success for both teams (💜 for us!) Lessons Learned
  • 18. Recap Scripted. Use Gravity Forms API to extract data from your forms. Automated. Use cron jobs and API intervals to pull data on a schedule that works for you. Done. (Really?) Keep improving your process by working with your data processors and finding new ways to help them get the data they need from your web applications.
  • 19. There is more hunger for love and appreciation in this world than for bread. -Mother Teresa “
  • 20. Thanks! Questions and Feedback ● Questions: 2019.wpcampus.org ● Feedback: https://2019.wpcampus.org/feedback/how-to-make-your-data-processors-love-you/ ● Find me later: ○ in the hall ○ on WPCampus slack: Maryann Reissig ○ mreissig@sjfc.edu You can also find me at @stpha6 slides and resources: maryannreissig.com/auto