The document summarizes Lingnan University's implementation of Blackboard Analytics to establish a business intelligence system. It describes Lingnan University, the background and need for a BI solution, the implementation schedule and approach, benefits to the institution, challenges, and next steps. The implementation involved defining key performance indicators, acquiring Blackboard Analytics, customizing it to local needs, training users, and launching an initial set of reports focused on internationalization by October 2011, just 4 months after acquiring the BI product. The next phase will focus on additional KPIs and establishing an institutional research team to manage analytics.
1. Analytics to inform Continual
Improvement
The Experience of Lingnan University,
Hong Kong to implement Blackboard
Analytics
Terence Kwok
terence@LN.edu.hk
2. Agenda
• Who are we?
• Background of Business Intelligence Project
• Implementation Schedule and Approach
• Benefit to the Institution
• Challenges encountered
• Next phase of project
• Conclusion
3. Who are we?
• A Publicly-funded Liberal Arts University in Hong Kong
– 2,300 student
• Characteristics
– Small Class Teaching
– Multi-disciplinary Programmes
– Internationalization
– Close to Full Residence
3
4. Background of Business Intelligence Project
• Recommendation from Quality Assurance Council in July 2010
• No data warehouse
– Most data are captured in Banner but some essential data are spread
over Excel files and paper records
• A BI solution is therefore considered essential!!
4
5. Implementation Schedule and Approach
• Step 1 – Preparation Works
– September 2010
• Set up a Task Force on Evaluation Framework
• Define 5 University-wide KPIs
5
6. Implementation Schedule and Approach
• Step 2 - Acquisition of BI system
– September 2010 – February 2011
• sourcing of a suitable BI solution for higher education in Hong
Kong
– March 2011
• benchmarking with overseas institutions on using different BI
products
• Blackboard Analytics is chosen
– June 2011 –
• Contract Agreement Sign-off
6
7. Implementation Schedule and Approach
• Step 3 – Division of Labour
7
BI Steering Group To develop plans & set directions;
chaired by AVP(AQA)
To lead the project, define data models,
coordinate with Blackboard Analytics &
receive training
AVP(AA) & Registrar
(Champion)
Registry/Faculty/
Support Units
(functional)
ITSC (technical)
BI Working Group
8. Implementation Schedule and Approach
• Step 4 – Server Installation
– July 2011
• Hardware & Software Installation
• Technical Training
• Step 5 – Project Planning & Management
– August 2011
• User training and customization by Blackboard consultants
• Data Cleansing from Banner, Business Rule Validation and GAP
Analysis
• Customization based on the Internationalization KPI
8
9. Implementation Schedule and Approach
• Step 6 – System Refinement & Deployment
– Data Warehouse reconciliation
– Develop Reports for Initial Deployment
• Step 7 - GO LIVE on Internationalization KPI in October 2011!!
– (4 months from acquisition of the BI product)
9
10. Implementation Approach
• Implementation starts from building localized KPIs
– Presume the Blackboard Analytics baseline model is valid as Lingnan
has followed very closely to the Banner baseline in inputting student
data
– Some essential reports are not covered in the baseline model
– Focus on customization instead of learning the baseline model
10
11. Benefit to the Institution
• Change on workflow – more efficient
• Use evidence to make decision – more effective
• More proactive bringing policy to deal with change
• Streamlining the collection of important information
11
19. Challenges Encountered
• Cultural Differences – U.S. vs Hong Kong
– Not all baseline models can be used (e.g. student attrition & retention
rates)
• Implementation starts from KPI but not Baseline
– Extensive customization works
• Data spread through everywhere
– Ellucian Banner ERP, Excel, paper records, etc
– Extensive data cleansing works
• Change of mindset
– Operational Reports vs Analytics Reports
19
20. Next Phase of Project
• Set up an Institutional Research Team to manage all the
planning and analytical tasks
• Implement other KPIs (draft) to measure
– Attraction to the Various Programme
– Quality of the Programme
– Student Engagement in the Programme
– Reflection on the Programme Experience
20
21. Conclusion
• Factors leading to the Success
– Get everybody involved – from AVPs to Clerical Staff
– Everyone goes for one goal – Phase I implementation goes live by
October 2011
– Have the right champion & working partners leading and working for
the BI project
21