MID TERMS
MID TERMS
Hello!We are PlusMinus
LearnHubAng Mo Kio Thye Hua Kwan Hospital
AGENDA
○Team & Stakeholders Introduction
○Problem and Solution
○Market Research
○Demonstration
○Value to Sponsor
○Technical Complexities
○User Test & Quality Assurance
○Project Management
○Risk & Change Management
○X-Factor
○Learning Outcome
Team Introduction
PLUSMINUS Low Wen Jun (Belynda) PM
Rafid Aziz QA
Gwee Wei Ling FrontEnd
Mario YeremiahBusiness Analyst
Tan Ming Kwang BackEnd
Eugene Tan Database
Stakeholders
SUPERVISOR &
CLIENTSPROF PAUL
SUPERVISOR
EDY CHANDRA CLIENT
FRANK LEE CLIENT
LearnHub
Problem Statement
Motivation
Solution
PROBLEMSTATEMENT
MOTIVATION
Learn at
• Own pace
• Own convenience
• Available 24/7
LMS
AI Chatbot
ProgressReport
• Informational Chatbot
• Artificial Intelligence
• Automate enquiries
• Avoid HR holding on
line
• Reduce cost and
resources
• Natural Learning
Language
• Take Charge
• Reduce Reliance
AI Chatbot AnalyticsUpload/Download Materials
Progress ReportQuiz Management
How are we different from other COTS?
MARKET RESEARCH
LearnHub LearnDash Desire2Learn Litmos Blackboard
Price Free Moderate Expensive Expensive Expensive
AI Chat Bot
Courses
Track Progress
Download Materials
Upload Materials
Quiz
Analytics
Audit
Cloud Not Required
App Not Required
Value to Sponsor
Lighten HR’s workload with AI Chatbot
List new courses and learning opportunities on the portal
Insights to staff’s learning behaviour
Application DEMO
ALLIED HEALTH COURSE CREATOR ALLIED HEALTH SUPERVISOR
MEDICAL SERVICES STAFFMEDICAL SERVICE SUPERVISOR
LEON
PATRICK WENDY
GLADYS
LEONALLIED HEALTH SUPERVISOR
Problems:
Unable to distribute learning materials online
Solution:
Upload Course Function
GLADYSALLIED HEALTH COURSE CREATOR
GLADYS`ALLIED HEALTH COURSE CREATOR
Problems:
Unable to effectively keep track of personal learning progress
Solution:
Progress Report Function
LEONALLIED HEALTH SUPERVISOR
PATRICK WENDYMEDICAL SERVICE SUPERVISOR MEDICAL SERVICES STAFF
MEDICAL SERVICE SUPERVISOR
PATRICK
Problems:
Unable to effectively keep track of subordinate’s learning progress
Solution:
Progress Report Function
ALLIED HEALTH SUPERVISOR
LEON
Problems:
1. Overly reliant on HR for course information and HR policies
2. Unable to access learning materials online
Solution:
1. AI Chatbot
2. Download Course Function
GLADYS`ALLIED HEALTH COURSE CREATOR
LEONALLIED HEALTH SUPERVISOR
PATRICK WENDYMEDICAL SERVICE SUPERVISOR MEDICAL SERVICES STAFF
Architecture
Browser
Client Application
Server Application
Presentation Layer Data Access Layer
Database
HTTPS
ADO.NET
API
HTTPS
SOFTWARE ARCHITECTURE
Client
BrowserHTTPS
jQuery
Remote Desktop
Services
IIE Manager
Hosted on
VIA VPN
.NET
Triageuser
(AMK Server)
Window10
Development
Test
Live
IIE Manager
Liv
eLive
IIE Manager
TECHNICAL INTERACTION
Server ApplicationAPI
HTTPSLearny
LearnHub
HTTPS
HTTPS
RESTFUL Service
Returns
Intent/
Entity
Database
Send
Queries
3RD PARTY COMPONENT
Technical Complexities - AI Chatbot -
Controller Class
LUIS Dialog Class
Implementation Code
Microsoft Bot Framework
LUIS
Technical Complexities
-Web Hosting-
1
2
3
4
5
User Testing
70%
80%75%
78%
91% 90%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
UT1 UT2
UT Comparison
Satisfaction rate User Friendliness Passed Cases
Team’s Expectations
Filled feedback form
Filled feedback form
Filled feedback form
Staff UT 1 UT 2 Staff UT 1 UT 2 UT 1 UT 2
Sharinah - 7 Sharinah - 7 1 to 3 6 4
Sindy 7 7 Sindy 8 7 4 to 6 7 1
Edy 7 9 Edy 8 9 7 to 8 13 6
Javier - 9 Javier - 8 9 to 10 1 13
Frank 7 - Frank 6 -
Joel 7 - Joel 8 -
Total 28 32 Total 30 31
Grand Total 40 40 Grand Total 40 40 UT 1 UT 2
Percentage 70% 80% Percentage 75% 78% Validation 9 1
% Increase By: % Increase By: Function 10 12
AI Chatbot 5 9
Others 3 2
Sindy Edy Sharinah Javier Total
Failed Test Case 5 7 6 1 19
Passed Test Cases 61 63 31 17 172
Total Number of
Test Cases66 70 37 18 191
Passing % 92% 90% 84% 94% 90%
Edy Sharinah Javier
Quiz
Test Cases
Too Long but
acceptable.
Test case is
easy to follow
Too Long and not
really easy to
follow
Too Long but
easy to follow
3%
Count of Bugs by Issue Category
Count of Bugs by Criticality CategoryEase of Use (User Friendliness):Satisfaction Results
10%
Pass/Failed Test Case
Too Long but easy to follow
To include an optional email
feature to the quiz section.
Both supervisor and course
coordinator will be able to
receive the results of the
user
Sindy
Comments:
UT 2 Results
Staff UT 1 UT 2 Staff UT 1 UT 2 UT 1 UT 2
Sharinah - 7 Sharinah - 7 1 to 3 6 4
Sindy 7 7 Sindy 8 7 4 to 6 7 1
Edy 7 9 Edy 8 9 7 to 8 13 6
Javier - 9 Javier - 8 9 to 10 1 13
Frank 7 - Frank 6 -
Joel 7 - Joel 8 -
Total 28 32 Total 30 31
Grand Total 40 40 Grand Total 40 40 UT 1 UT 2
Percentage 70% 80% Percentage 75% 78% Validation 9 1
% Increase By: % Increase By: Function 10 12
AI Chatbot 5 9
Others 3 2
Sindy Edy Sharinah Javier Total
Failed Test Case 5 7 6 1 19
Passed Test Cases 61 63 31 17 172
Total Number of
Test Cases66 70 37 18 191
Passing % 92% 90% 84% 94% 90%
Edy Sharinah Javier
Quiz
Test Cases
Too Long but
acceptable.
Test case is
easy to follow
Too Long and not
really easy to
follow
Too Long but
easy to follow
3%
Count of Bugs by Issue Category
Count of Bugs by Criticality CategoryEase of Use (User Friendliness):Satisfaction Results
10%
Pass/Failed Test Case
Too Long but easy to follow
To include an optional email
feature to the quiz section.
Both supervisor and course
coordinator will be able to
receive the results of the
user
Sindy
Comments:
Staff UT 1 UT 2 Staff UT 1 UT 2 UT 1 UT 2
Sharinah - 7 Sharinah - 7 1 to 3 6 4
Sindy 7 7 Sindy 8 7 4 to 6 7 1
Edy 7 9 Edy 8 9 7 to 8 13 6
Javier - 9 Javier - 8 9 to 10 1 13
Total 14 32 Total 16 31
Grand Total 20 40 Grand Total 20 40 UT 1 UT 2
Percentage 70% 80% Percentage 80% 78% Validation 9 1
% Increase By: % Increase By: Function 10 12
AI Chatbot 5 9
Others 3 2
Sindy Edy Sharinah Javier Total
Failed Test Case 5 7 6 1 19
Passed Test Cases 61 63 31 17 172
Total Number of
Test Cases66 70 37 18 191
Passing % 92% 90% 84% 94% 90%
Edy Sharinah Javier
Quiz
Test Cases
Too Long but
acceptable.
Test case is
easy to follow
Too Long and not
really easy to
follow
Too Long but
easy to follow
-3%
Count of Bugs by Issue Category
Count of Bugs by Criticality CategoryEase of Use (User Friendliness):Satisfaction Results
10%
Pass/Failed Test Case
Too Long but easy to follow
To include an optional email
feature to the quiz section.
Both supervisor and course
coordinator will be able to
receive the results of the
user
Sindy
Comments:
Staff UT 1 UT 2 Staff UT 1 UT 2 UT 1 UT 2
Sharinah - 7 Sharinah - 7 1 to 3 6 4
Sindy 7 7 Sindy 8 7 4 to 6 7 1
Edy 7 9 Edy 8 9 7 to 8 13 6
Javier - 9 Javier - 8 9 to 10 1 13
Total 14 32 Total 16 31
Grand Total 20 40 Grand Total 20 40 UT 1 UT 2
Percentage 70% 80% Percentage 80% 78% Validation 9 1
% Increase By: % Increase By: Function 10 12
AI Chatbot 5 9
Others 3 2
Sindy Edy Sharinah Javier Total
Failed Test Case 5 7 6 1 19
Passed Test Cases 61 63 31 17 172
Total Number of
Test Cases66 70 37 18 191
Passing % 92% 90% 84% 94% 90%
Edy Sharinah Javier
Quiz
Test Cases
Too Long but
acceptable.
Test case is
easy to follow
Too Long and not
really easy to
follow
Too Long but
easy to follow
-3%
Count of Bugs by Issue Category
Count of Bugs by Criticality CategoryEase of Use (User Friendliness):Satisfaction Results
10%
Pass/Failed Test Case
Too Long but easy to follow
To include an optional email
feature to the quiz section.
Both supervisor and course
coordinator will be able to
receive the results of the
user
Sindy
Comments:
UT 2 Results
Staff UT 1 UT 2 Staff UT 1 UT 2 UT 1 UT 2
Sharinah - 7 Sharinah - 7 1 to 3 6 4
Sindy 7 7 Sindy 8 7 4 to 6 7 1
Edy 7 9 Edy 8 9 7 to 8 13 6
Javier - 9 Javier - 8 9 to 10 1 13
Total 14 32 Total 16 31
Grand Total 20 40 Grand Total 20 40 UT 1 UT 2
Percentage 70% 80% Percentage 80% 78% Validation 9 1
% Increase By: % Increase By: Function 10 12
AI Chatbot 5 9
Others 3 2
Sindy Edy Sharinah Javier Total
Failed Test Case 5 7 6 1 19
Passed Test Cases 61 63 31 17 172
Total Number of
Test Cases66 70 37 18 191
Passing % 92% 90% 84% 94% 90%
Edy Sharinah Javier
Quiz
Test Cases
Too Long but
acceptable.
Test case is
easy to follow
Too Long and not
really easy to
follow
Too Long but
easy to follow
-3%
Count of Bugs by Issue Category
Count of Bugs by Criticality CategoryEase of Use (User Friendliness):Satisfaction Results
10%
Pass/Failed Test Case
Too Long but easy to follow
To include an optional email
feature to the quiz section.
Both supervisor and course
coordinator will be able to
receive the results of the
user
Sindy
Comments:
UT 2 Results
Staff UT 1 UT 2 Staff UT 1 UT 2 UT 1 UT 2
Sharinah - 7 Sharinah - 7 1 to 3 6 4
Sindy 7 7 Sindy 8 7 4 to 6 7 1
Edy 7 9 Edy 8 9 7 to 8 13 6
Javier - 9 Javier - 8 9 to 10 1 13
Total 14 32 Total 16 31
Grand Total 20 40 Grand Total 20 40 UT 1 UT 2
Percentage 70% 80% Percentage 80% 78% Validation 9 1
% Increase By: % Increase By: Function 10 12
AI Chatbot 5 9
Others 3 2
Sindy Edy Sharinah Javier Total
Failed Test Case 5 7 6 1 19
Passed Test Cases 61 63 31 17 172
Total Number of
Test Cases66 70 37 18 191
Passing % 92% 90% 84% 94% 90%
Edy Sharinah Javier
Quiz
Test Cases
Too Long but
acceptable.
Test case is
easy to follow
Too Long and not
really easy to
follow
Too Long but
easy to follow
-3%
Count of Bugs by Issue Category
Count of Bugs by Criticality CategoryEase of Use (User Friendliness):Satisfaction Results
10%
Pass/Failed Test Case
Too Long but easy to follow
To include an optional email
feature to the quiz section.
Both supervisor and course
coordinator will be able to
receive the results of the
user
Sindy
Comments:
UT 2 Results
UAT
Usability Testing1
Study Task Instructions instead of Test Cases2
Goals
To complete the tasks assigned:• Within reasonable timing• Without assistance from SMU Team• Ensure bug-free application
Load Testing
Project Management
BUG METRICS
0
200
400
600
800
1000
1200
1400
1 2 3 4 5 6 7 8 9 10 11 12 13 14
Re
mai
nin
g H
ou
rs
Sprint
Target Burndown
Actual Burndown
BURNDOWN CHART
New to C# Logic Heavy for TNF Module
Re-scope to AI ChatbotRestart Preparation Phase
Buffer Sprint used for resolving bugs
RISK 1
Risk
Type
Risk Title Likelihood Impact Category Mitigation Plan Escalate
into issue?
Technical
Risk
The team is unfamiliar
with project
technologies such as
ASP.NET and LUIS,
and have limited
experience in
implementing certain
functionalities/logic
such as approval
workflow routing logic.
High High Red
We will consult professors with
expertise and look for alternative
options to go about resolving the
issues
Yes
Risk
Type
Risk Title Likelihood Impact Category Mitigation Plan Escalate
into issue?
Project
Managem
ent
Client might
not reply to the
team
questions on
the project
requirements
promptly
Medium High Dark
OrangeIf our main client(Cheryl) does
not reply promptly to the team's
question with regards to the
project scope, we will delegate
the authority to make decisions
to our second client(Edy).
However, Edy's decision is
subjected to HR's approval.
Yes
RISK 2
Change Request Description Feasibility Impact Status
Remove TNF
Functionality and Add in
AI Chat Bot Functionality
Explore into AI Chatbot so as to provide their
colleagues with the relevant HR information
they need at their fingertips …
Feasible High Completed
Add in a new course type
- Classroom.
Add in a new course type - Classroom, on top
of the existing e-learn course type. Classroom
course type will only purely be informational
purpose whereby there will be no
signup/awarding of learning hours…
Feasible High Completed
New Quiz Configurations Add a limit to the number of attempts someone
can attempt the quiz…
Feasible High Completed
New Quiz Configurations Add a configuration option in displaying quiz
answers. 3 options…
Feasible High Completed
New Main page - Event
Highlights
Request in automating this update process
whereby once there is a new piece of
information, the main page will automatically
update itself…
Infeasible High Rejected
CHANGE MANAGEMENT
x - Factor
10 Real Users 20 Completed Quizzes20 Courses
50 complex query hits per day
Chatbot capable of answering 250 complex queries
10 Real Users
20 Courses11
20 Completed Quizzes13
50 complex query hits per day
Chatbot capable of answering 250 complex queries
What’s after Mid Terms
Final’s X-Factor
20 Real Users 25 Completed Quizzes25 Courses
80 complex query hits per day
Chatbot capable of answering 600 complex queries
Group Reflection
Set up agreed name conventions for variables
1
2 Communication is key
Learning Outcome
LEARNING OUTCOME
• Difficult to manage expectations
between client and the team.
• Learnt the importance of
gathering clear project
requirements before actual
development of functions.
Low Wen Jun (Belynda) PM
LEARNING OUTCOME
•
Rafid Aziz QA
LEARNING OUTCOME
•
Tan Ming Kwang BackEnd
LEARNING OUTCOME
•
Eugene Tan Database
LEARNING OUTCOME
•
Gwee Wei Ling FrontEnd
LEARNING OUTCOME
•
Mario YeremiahBusiness Analyst
Thank You!Any questions?
- Brought to you by Team PlusMinus