1. Analytics to inform Continual
Improvement
The Experience of Lingnan University,
Hong Kong to implement Blackboard
Analytics
Terence Kwok
terence@LN.edu.hk
2. Agenda
• Who are we?
• Background of Business Intelligence Project
• Implementation Schedule and Approach
• Benefit to the Institution
• Challenges encountered
• Next phase of project
• Conclusion
3. Who are we?
• A Publicly-funded Liberal Arts University in Hong Kong
– 2,300 student
• Characteristics
– Small Class Teaching
– Multi-disciplinary Programmes
– Internationalization
– Close to Full Residence
3
4. Background of Business Intelligence Project
• Recommendation from Quality Assurance Council in July 2010
• No data warehouse
– Most data are captured in Banner but some essential data are spread
over Excel files and paper records
• A BI solution is therefore considered essential!!
4
5. Implementation Schedule and Approach
• Step 1 – Preparation Works
– September 2010
• Set up a Task Force on Evaluation Framework
• Define 5 University-wide KPIs
5
6. Implementation Schedule and Approach
• Step 2 - Acquisition of BI system
– September 2010 – February 2011
• sourcing of a suitable BI solution for higher education in Hong
Kong
– March 2011
• benchmarking with overseas institutions on using different BI
products
• Blackboard Analytics is chosen
– June 2011 –
• Contract Agreement Sign-off
6
7. Implementation Schedule and Approach
• Step 3 – Division of Labour
7
BI Steering Group To develop plans & set directions;
chaired by AVP(AQA)
To lead the project, define data models,
coordinate with Blackboard Analytics &
receive training
AVP(AA) & Registrar
(Champion)
Registry/Faculty/
Support Units
(functional)
ITSC (technical)
BI Working Group
8. Implementation Schedule and Approach
• Step 4 – Server Installation
– July 2011
• Hardware & Software Installation
• Technical Training
• Step 5 – Project Planning & Management
– August 2011
• User training and customization by Blackboard consultants
• Data Cleansing from Banner, Business Rule Validation and GAP
Analysis
• Customization based on the Internationalization KPI
8
9. Implementation Schedule and Approach
• Step 6 – System Refinement & Deployment
– Data Warehouse reconciliation
– Develop Reports for Initial Deployment
• Step 7 - GO LIVE on Internationalization KPI in October 2011!!
– (4 months from acquisition of the BI product)
9
10. Implementation Approach
• Implementation starts from building localized KPIs
– Presume the Blackboard Analytics baseline model is valid as Lingnan
has followed very closely to the Banner baseline in inputting student
data
– Some essential reports are not covered in the baseline model
– Focus on customization instead of learning the baseline model
10
11. Benefit to the Institution
• Change on workflow – more efficient
• Use evidence to make decision – more effective
• More proactive bringing policy to deal with change
• Streamlining the collection of important information
11
19. Challenges Encountered
• Cultural Differences – U.S. vs Hong Kong
– Not all baseline models can be used (e.g. student attrition & retention
rates)
• Implementation starts from KPI but not Baseline
– Extensive customization works
• Data spread through everywhere
– Ellucian Banner ERP, Excel, paper records, etc
– Extensive data cleansing works
• Change of mindset
– Operational Reports vs Analytics Reports
19
20. Next Phase of Project
• Set up an Institutional Research Team to manage all the
planning and analytical tasks
• Implement other KPIs (draft) to measure
– Attraction to the Various Programme
– Quality of the Programme
– Student Engagement in the Programme
– Reflection on the Programme Experience
20
21. Conclusion
• Factors leading to the Success
– Get everybody involved – from AVPs to Clerical Staff
– Everyone goes for one goal – Phase I implementation goes live by
October 2011
– Have the right champion & working partners leading and working for
the BI project
21
