MID TERMS - wiki.smu.edu.sg€¦ · 1. Overly reliant on HR for course information and HR policies 2. Unable to access learning materials online Solution: 1. AI Chatbot 2. Download

MID TERMS

Hello!We are PlusMinus

LearnHubAng Mo Kio Thye Hua Kwan Hospital

AGENDA

○Team & Stakeholders Introduction

○Problem and Solution

○Market Research

○Demonstration

○Value to Sponsor

○Technical Complexities

○User Test & Quality Assurance

○Project Management

○Risk & Change Management

○X-Factor

○Learning Outcome

Team Introduction

PLUSMINUS Low Wen Jun (Belynda) PM

Rafid Aziz QA

Gwee Wei Ling FrontEnd

Mario YeremiahBusiness Analyst

Tan Ming Kwang BackEnd

Eugene Tan Database

Stakeholders

SUPERVISOR &

CLIENTSPROF PAUL

SUPERVISOR

EDY CHANDRA CLIENT

FRANK LEE CLIENT

LearnHub

Problem Statement

Motivation

Solution

PROBLEMSTATEMENT

MOTIVATION

Learn at

• Own pace

• Own convenience

• Available 24/7

LMS

AI Chatbot

ProgressReport

• Informational Chatbot

• Artificial Intelligence

• Automate enquiries

• Avoid HR holding on

line

• Reduce cost and

resources

• Natural Learning

Language

• Take Charge

• Reduce Reliance

AI Chatbot AnalyticsUpload/Download Materials

Progress ReportQuiz Management

How are we different from other COTS?

MARKET RESEARCH

LearnHub LearnDash Desire2Learn Litmos Blackboard

Price Free Moderate Expensive Expensive Expensive

AI Chat Bot

Courses

Track Progress

Download Materials

Upload Materials

Quiz

Analytics

Email

Audit

Cloud Not Required

App Not Required

Value to Sponsor

Lighten HR’s workload with AI Chatbot

List new courses and learning opportunities on the portal

Insights to staff’s learning behaviour

Application DEMO

ALLIED HEALTH COURSE CREATOR ALLIED HEALTH SUPERVISOR

MEDICAL SERVICES STAFFMEDICAL SERVICE SUPERVISOR

LEON

PATRICK WENDY

GLADYS

LEONALLIED HEALTH SUPERVISOR

Problems:

Unable to distribute learning materials online

Solution:

Upload Course Function

GLADYSALLIED HEALTH COURSE CREATOR

GLADYS`ALLIED HEALTH COURSE CREATOR

Problems:

Unable to effectively keep track of personal learning progress

Solution:

Progress Report Function

LEONALLIED HEALTH SUPERVISOR

PATRICK WENDYMEDICAL SERVICE SUPERVISOR MEDICAL SERVICES STAFF

MEDICAL SERVICE SUPERVISOR

PATRICK

Problems:

Unable to effectively keep track of subordinate’s learning progress

Solution:

Progress Report Function

ALLIED HEALTH SUPERVISOR

LEON

Problems:

1. Overly reliant on HR for course information and HR policies

2. Unable to access learning materials online

Solution:

1. AI Chatbot

2. Download Course Function

GLADYS`ALLIED HEALTH COURSE CREATOR

LEONALLIED HEALTH SUPERVISOR

PATRICK WENDYMEDICAL SERVICE SUPERVISOR MEDICAL SERVICES STAFF

Architecture

Browser

Client Application

Server Application

Presentation Layer Data Access Layer

Database

HTTPS

ADO.NET

API

HTTPS

SOFTWARE ARCHITECTURE

Client

BrowserHTTPS

jQuery

Remote Desktop

Services

IIE Manager

Hosted on

VIA VPN

.NET

Triageuser

(AMK Server)

Window10

Development

Test

Live

IIE Manager

Liv

eLive

IIE Manager

TECHNICAL INTERACTION

Server ApplicationAPI

HTTPSLearny

LearnHub

HTTPS

HTTPS

RESTFUL Service

Returns

Intent/

Entity

Database

Send

Queries

3RD PARTY COMPONENT

Technical Complexities - AI Chatbot -

Controller Class

LUIS Dialog Class

Implementation Code

Microsoft Bot Framework

LUIS

Technical Complexities

-Web Hosting-

1

2

3

4

5

User Testing

70%

80%75%

78%

91% 90%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

UT1 UT2

UT Comparison

Satisfaction rate User Friendliness Passed Cases

Team’s Expectations

Filled feedback form

Filled feedback form

Filled feedback form

Staff UT 1 UT 2 Staff UT 1 UT 2 UT 1 UT 2

Sharinah - 7 Sharinah - 7 1 to 3 6 4

Sindy 7 7 Sindy 8 7 4 to 6 7 1

Edy 7 9 Edy 8 9 7 to 8 13 6

Javier - 9 Javier - 8 9 to 10 1 13

Frank 7 - Frank 6 -

Joel 7 - Joel 8 -

Total 28 32 Total 30 31

Grand Total 40 40 Grand Total 40 40 UT 1 UT 2

Percentage 70% 80% Percentage 75% 78% Validation 9 1

% Increase By: % Increase By: Function 10 12

AI Chatbot 5 9

Others 3 2

Sindy Edy Sharinah Javier Total

Failed Test Case 5 7 6 1 19

Passed Test Cases 61 63 31 17 172

Total Number of

Test Cases66 70 37 18 191

Passing % 92% 90% 84% 94% 90%

Edy Sharinah Javier

Quiz

Test Cases

Too Long but

acceptable.

Test case is

easy to follow

Too Long and not

really easy to

follow

Too Long but

easy to follow

3%

Count of Bugs by Issue Category

Count of Bugs by Criticality CategoryEase of Use (User Friendliness):Satisfaction Results

10%

Pass/Failed Test Case

Too Long but easy to follow

To include an optional email

feature to the quiz section.

Both supervisor and course

coordinator will be able to

receive the results of the

user

Sindy

Comments:

UT 2 Results

Staff UT 1 UT 2 Staff UT 1 UT 2 UT 1 UT 2

Sharinah - 7 Sharinah - 7 1 to 3 6 4

Sindy 7 7 Sindy 8 7 4 to 6 7 1

Edy 7 9 Edy 8 9 7 to 8 13 6

Javier - 9 Javier - 8 9 to 10 1 13

Frank 7 - Frank 6 -

Joel 7 - Joel 8 -

Total 28 32 Total 30 31

Grand Total 40 40 Grand Total 40 40 UT 1 UT 2

Percentage 70% 80% Percentage 75% 78% Validation 9 1

% Increase By: % Increase By: Function 10 12

AI Chatbot 5 9

Others 3 2

Sindy Edy Sharinah Javier Total

Failed Test Case 5 7 6 1 19

Passed Test Cases 61 63 31 17 172

Total Number of

Test Cases66 70 37 18 191

Passing % 92% 90% 84% 94% 90%

Edy Sharinah Javier

Quiz

Test Cases

Too Long but

acceptable.

Test case is

easy to follow

Too Long and not

really easy to

follow

Too Long but

easy to follow

3%

Count of Bugs by Issue Category

Count of Bugs by Criticality CategoryEase of Use (User Friendliness):Satisfaction Results

10%

Pass/Failed Test Case

Too Long but easy to follow

To include an optional email

feature to the quiz section.

Both supervisor and course

coordinator will be able to

receive the results of the

user

Sindy

Comments:

Staff UT 1 UT 2 Staff UT 1 UT 2 UT 1 UT 2

Sharinah - 7 Sharinah - 7 1 to 3 6 4

Sindy 7 7 Sindy 8 7 4 to 6 7 1

Edy 7 9 Edy 8 9 7 to 8 13 6

Javier - 9 Javier - 8 9 to 10 1 13

Total 14 32 Total 16 31

Grand Total 20 40 Grand Total 20 40 UT 1 UT 2

Percentage 70% 80% Percentage 80% 78% Validation 9 1

% Increase By: % Increase By: Function 10 12

AI Chatbot 5 9

Others 3 2

Sindy Edy Sharinah Javier Total

Failed Test Case 5 7 6 1 19

Passed Test Cases 61 63 31 17 172

Total Number of

Test Cases66 70 37 18 191

Passing % 92% 90% 84% 94% 90%

Edy Sharinah Javier

Quiz

Test Cases

Too Long but

acceptable.

Test case is

easy to follow

Too Long and not

really easy to

follow

Too Long but

easy to follow

-3%

Count of Bugs by Issue Category

Count of Bugs by Criticality CategoryEase of Use (User Friendliness):Satisfaction Results

10%

Pass/Failed Test Case

Too Long but easy to follow

To include an optional email

feature to the quiz section.

Both supervisor and course

coordinator will be able to

receive the results of the

user

Sindy

Comments:

Staff UT 1 UT 2 Staff UT 1 UT 2 UT 1 UT 2

Sharinah - 7 Sharinah - 7 1 to 3 6 4

Sindy 7 7 Sindy 8 7 4 to 6 7 1

Edy 7 9 Edy 8 9 7 to 8 13 6

Javier - 9 Javier - 8 9 to 10 1 13

Total 14 32 Total 16 31

Grand Total 20 40 Grand Total 20 40 UT 1 UT 2

Percentage 70% 80% Percentage 80% 78% Validation 9 1

% Increase By: % Increase By: Function 10 12

AI Chatbot 5 9

Others 3 2

Sindy Edy Sharinah Javier Total

Failed Test Case 5 7 6 1 19

Passed Test Cases 61 63 31 17 172

Total Number of

Test Cases66 70 37 18 191

Passing % 92% 90% 84% 94% 90%

Edy Sharinah Javier

Quiz

Test Cases

Too Long but

acceptable.

Test case is

easy to follow

Too Long and not

really easy to

follow

Too Long but

easy to follow

-3%

Count of Bugs by Issue Category

Count of Bugs by Criticality CategoryEase of Use (User Friendliness):Satisfaction Results

10%

Pass/Failed Test Case

Too Long but easy to follow

To include an optional email

feature to the quiz section.

Both supervisor and course

coordinator will be able to

receive the results of the

user

Sindy

Comments:

UT 2 Results

Staff UT 1 UT 2 Staff UT 1 UT 2 UT 1 UT 2

Sharinah - 7 Sharinah - 7 1 to 3 6 4

Sindy 7 7 Sindy 8 7 4 to 6 7 1

Edy 7 9 Edy 8 9 7 to 8 13 6

Javier - 9 Javier - 8 9 to 10 1 13

Total 14 32 Total 16 31

Grand Total 20 40 Grand Total 20 40 UT 1 UT 2

Percentage 70% 80% Percentage 80% 78% Validation 9 1

% Increase By: % Increase By: Function 10 12

AI Chatbot 5 9

Others 3 2

Sindy Edy Sharinah Javier Total

Failed Test Case 5 7 6 1 19

Passed Test Cases 61 63 31 17 172

Total Number of

Test Cases66 70 37 18 191

Passing % 92% 90% 84% 94% 90%

Edy Sharinah Javier

Quiz

Test Cases

Too Long but

acceptable.

Test case is

easy to follow

Too Long and not

really easy to

follow

Too Long but

easy to follow

-3%

Count of Bugs by Issue Category

Count of Bugs by Criticality CategoryEase of Use (User Friendliness):Satisfaction Results

10%

Pass/Failed Test Case

Too Long but easy to follow

To include an optional email

feature to the quiz section.

Both supervisor and course

coordinator will be able to

receive the results of the

user

Sindy

Comments:

UT 2 Results

Staff UT 1 UT 2 Staff UT 1 UT 2 UT 1 UT 2

Sharinah - 7 Sharinah - 7 1 to 3 6 4

Sindy 7 7 Sindy 8 7 4 to 6 7 1

Edy 7 9 Edy 8 9 7 to 8 13 6

Javier - 9 Javier - 8 9 to 10 1 13

Total 14 32 Total 16 31

Grand Total 20 40 Grand Total 20 40 UT 1 UT 2

Percentage 70% 80% Percentage 80% 78% Validation 9 1

% Increase By: % Increase By: Function 10 12

AI Chatbot 5 9

Others 3 2

Sindy Edy Sharinah Javier Total

Failed Test Case 5 7 6 1 19

Passed Test Cases 61 63 31 17 172

Total Number of

Test Cases66 70 37 18 191

Passing % 92% 90% 84% 94% 90%

Edy Sharinah Javier

Quiz

Test Cases

Too Long but

acceptable.

Test case is

easy to follow

Too Long and not

really easy to

follow

Too Long but

easy to follow

-3%

Count of Bugs by Issue Category

Count of Bugs by Criticality CategoryEase of Use (User Friendliness):Satisfaction Results

10%

Pass/Failed Test Case

Too Long but easy to follow

To include an optional email

feature to the quiz section.

Both supervisor and course

coordinator will be able to

receive the results of the

user

Sindy

Comments:

UT 2 Results

UAT

Usability Testing1

Study Task Instructions instead of Test Cases2

Goals

To complete the tasks assigned:• Within reasonable timing• Without assistance from SMU Team• Ensure bug-free application

Load Testing

Project Management

BUG METRICS

0

200

400

600

800

1000

1200

1400

1 2 3 4 5 6 7 8 9 10 11 12 13 14

Re

mai

nin

g H

ou

rs

Sprint

Target Burndown

Actual Burndown

BURNDOWN CHART

New to C# Logic Heavy for TNF Module

Re-scope to AI ChatbotRestart Preparation Phase

Buffer Sprint used for resolving bugs

RISK 1

Risk

Type

Risk Title Likelihood Impact Category Mitigation Plan Escalate

into issue?

Technical

Risk

The team is unfamiliar

with project

technologies such as

ASP.NET and LUIS,

and have limited

experience in

implementing certain

functionalities/logic

such as approval

workflow routing logic.

High High Red

We will consult professors with

expertise and look for alternative

options to go about resolving the

issues

Yes

Risk

Type

Risk Title Likelihood Impact Category Mitigation Plan Escalate

into issue?

Project

Managem

ent

Client might

not reply to the

team

questions on

the project

requirements

promptly

Medium High Dark

OrangeIf our main client(Cheryl) does

not reply promptly to the team's

question with regards to the

project scope, we will delegate

the authority to make decisions

to our second client(Edy).

However, Edy's decision is

subjected to HR's approval.

Yes

RISK 2

Change Request Description Feasibility Impact Status

Remove TNF

Functionality and Add in

AI Chat Bot Functionality

Explore into AI Chatbot so as to provide their

colleagues with the relevant HR information

they need at their fingertips …

Feasible High Completed

Add in a new course type

- Classroom.

Add in a new course type - Classroom, on top

of the existing e-learn course type. Classroom

course type will only purely be informational

purpose whereby there will be no

signup/awarding of learning hours…

Feasible High Completed

New Quiz Configurations Add a limit to the number of attempts someone

can attempt the quiz…

Feasible High Completed

New Quiz Configurations Add a configuration option in displaying quiz

answers. 3 options…

Feasible High Completed

New Main page - Event

Highlights

Request in automating this update process

whereby once there is a new piece of

information, the main page will automatically

update itself…

Infeasible High Rejected

CHANGE MANAGEMENT

x - Factor

10 Real Users 20 Completed Quizzes20 Courses

50 complex query hits per day

Chatbot capable of answering 250 complex queries

10 Real Users

20 Courses11

20 Completed Quizzes13

50 complex query hits per day

Chatbot capable of answering 250 complex queries

What’s after Mid Terms

Final’s X-Factor

20 Real Users 25 Completed Quizzes25 Courses

80 complex query hits per day

Chatbot capable of answering 600 complex queries

Group Reflection

Set up agreed name conventions for variables

1

2 Communication is key

Learning Outcome

LEARNING OUTCOME

• Difficult to manage expectations

between client and the team.

• Learnt the importance of

gathering clear project

requirements before actual

development of functions.

Low Wen Jun (Belynda) PM

LEARNING OUTCOME

•

Rafid Aziz QA

LEARNING OUTCOME

•

Tan Ming Kwang BackEnd

LEARNING OUTCOME

•

Eugene Tan Database

LEARNING OUTCOME

•

Gwee Wei Ling FrontEnd

LEARNING OUTCOME

•

Mario YeremiahBusiness Analyst

Thank You!Any questions?

- Brought to you by Team PlusMinus