The IRI-h Objectives 1
Platform Independent Services: using JAVA technology
Multi-participant Audio/Video: using Java’s JMF framework
Collaboration Engine with Multiple-Platform-Tool-Source:makes available the rich set of applications running on Windows/UNIX environments.
Delivery to the home/office: users can access the session over a regular Internet connection using the latest generation of high speed at home Internet connections.
Recording/Replay: indexed by session events
Support multiple learning modes: lecture, demonstration, collaborative learning, computer-based labs, student team project, study sessions
Virtual Rooms: the class can be divided into groups by assigning each group a virtual meeting room. Students can move from room to room and join in different on-going discussions.
The IRI-h Objectives 1
Platform Independent Services: using JAVA technology
Multi-participant Audio/Video: using Java’s JMF framework
Collaboration Engine with Multiple-Platform-Tool-Source:makes available the rich set of applications running on Windows/UNIX environments.
Delivery to the home/office: users can access the session over a regular Internet connection using the latest generation of high speed at home Internet connections.
Recording/Replay: indexed by session events
Support multiple learning modes: lecture, demonstration, collaborative learning, computer-based labs, student team project, study sessions
Virtual Rooms: the class can be divided into groups by assigning each group a virtual meeting room. Students can move from room to room and join in different on-going discussions.
IRI-h Network Layout
G
Multicast disabled site
UDP tunnel
Gateway
High SpeedNetwork (Multicast)
Gateway
High SpeedNetwork(Multicast)
S1 S2
S3P1
Low Bandwidth with multicast
Multicast
P3
High Delay without multicast
UDP tunnel
P2
Low Bandwidth without multicast
UDP tunnel
Intranet
Multicast
P4P5
P6P7 P8P9
IRI-h Network Layout
G
Multicast disabled site
UDP tunnel
Gateway
High SpeedNetwork (Multicast)
Gateway
High SpeedNetwork(Multicast)
S1 S2
S3P1
Low Bandwidth with multicast
Multicast
P3
High Delay without multicast
UDP tunnel
P2
Low Bandwidth without multicast
UDP tunnel
Intranet
Multicast
P4P5
P6P7 P8P9
IRI-h Software Architecture
SMLog Server
Group Communication server
Gateway
Token Managers
Observers
SP
Audio Video
Sharing Tool
Annotation
Pointer
RcvSnd
SndSnd
RcvRcv
Gateway servers
TCP connection
Thread relationship
Service manager
Main Thread
Snd: SenderRcv: ReceiverSP: Session ParticipantSM: Session Manager
IRI-h Software Architecture
SMLog Server
Group Communication server
Gateway
Token Managers
Observers
SP
Audio Video
Sharing Tool
Annotation
Pointer
RcvSnd
SndSnd
RcvRcv
Gateway servers
TCP connection
Thread relationship
Service manager
Main Thread
Snd: SenderRcv: ReceiverSP: Session ParticipantSM: Session Manager
IRI-h Startup Scenarios
E, F: Automated Startup by Java Server B: Manual Join by contacting the Directory Server
H: Session Manager manually invoked G: Manual Join by contacting H directly
SP Startup
B
SPStartup Applet
A
G
SP
E
SPHA
H
SM
F
HA SM
C
Java Server
D
Directory Server
SM: Session ManagerSP: Session ParticipantHA: Host AmbassadorX Y: X initiates protocol with YX Y: X spawn Y
server
IRI-h Startup Scenarios
E, F: Automated Startup by Java Server B: Manual Join by contacting the Directory Server
H: Session Manager manually invoked G: Manual Join by contacting H directly
SP Startup
B
SPStartup Applet
A
G
SP
E
SPHA
H
SM
F
HA SM
C
Java Server
D
Directory Server
SM: Session ManagerSP: Session ParticipantHA: Host AmbassadorX Y: X initiates protocol with YX Y: X spawn Y
server
Presentation ModePresentation Mode
Collaboration ModeCollaboration Mode
Future Tasks 1
• Gateway– Target bandwidth setup
• uplink (to gateway) 128-512 Kbps
• downlink (from gateway) 256-740Kbps
– Tunneling for lack of multicast
– Format transcoding and/or data rate limiting.
– Bandwidth management
• Inter-Stream Synchronization
• Quality of Session management
Future Tasks 1
• Gateway– Target bandwidth setup
• uplink (to gateway) 128-512 Kbps
• downlink (from gateway) 256-740Kbps
– Tunneling for lack of multicast
– Format transcoding and/or data rate limiting.
– Bandwidth management
• Inter-Stream Synchronization
• Quality of Session management
• Late-Join mechanisms (service state)
• Record/Replay
• Semi-reliable application access protocols
• Multiple Rooms
• Feedback: network monitor, “smiley face”
• Additional Features: classroom video, call on student, survey, PA channel for multiple rooms, exam tool, remote ipv
Future Tasks 2• Late-Join mechanisms (service state)
• Record/Replay
• Semi-reliable application access protocols
• Multiple Rooms
• Feedback: network monitor, “smiley face”
• Additional Features: classroom video, call on student, survey, PA channel for multiple rooms, exam tool, remote ipv
Future Tasks 2Performance
• IRI-h Scalability: scalability tests on 35 machines with no incremental degradation in performance (video/audio/IPV reception).
• Delay: Audio/Video 750ms, IPV 1800ms
• Bandwidth: 1.5 Mb/s with three video, audio, ipv, pointer and annotation
• StartUp: initial interface 1 minute, video 25s, audio (10s), ipv (5 s), pointer(30ms), private services (3 s), class creation (10s)
• Refresh rates: Video 15 frames/sec, IPV 5s for full screen
Performance
• IRI-h Scalability: scalability tests on 35 machines with no incremental degradation in performance (video/audio/IPV reception).
• Delay: Audio/Video 750ms, IPV 1800ms
• Bandwidth: 1.5 Mb/s with three video, audio, ipv, pointer and annotation
• StartUp: initial interface 1 minute, video 25s, audio (10s), ipv (5 s), pointer(30ms), private services (3 s), class creation (10s)
• Refresh rates: Video 15 frames/sec, IPV 5s for full screen
Platform/environment management including late join/early leave: A student can join an on-going session at any time and fully participate in that class.
Situational awareness: Students, instructors and technical engineers are made aware of the current operating environment and are notified about noteworthy changes or unusual situations.
Class Management: instructor handouts/student notes, call by name, polling, classroom video, attendance, auto session start, class monitoring, enrollment
Shared Common Experience: The position and focus of the windows displayed on the student’s workstation is coordinated with the instructor’s machine.
Scalable: 100 participants
Easy of Use: Ease of installation, Quick class join
The IRI-h Objectives 2 Platform/environment management including late
join/early leave: A student can join an on-going session at any time and fully participate in that class.
Situational awareness: Students, instructors and technical engineers are made aware of the current operating environment and are notified about noteworthy changes or unusual situations.
Class Management: instructor handouts/student notes, call by name, polling, classroom video, attendance, auto session start, class monitoring, enrollment
Shared Common Experience: The position and focus of the windows displayed on the student’s workstation is coordinated with the instructor’s machine.
Scalable: 100 participants
Easy of Use: Ease of installation, Quick class join
The IRI-h Objectives 2
Login/Discussion ModeToken controlled tools Private panel
Shared view
Room cards
Audio control
Annotation token holder utilitiesVideo control
Private panelLogin box
Class name and semester
Login/Discussion ModeToken controlled tools Private panel
Shared view
Room cards
Audio control
Annotation token holder utilitiesVideo control
Private panelLogin box
Class name and semester
Presentation ModePresentation Mode
The IRI-h Objectives 1
Platform Independent Services: using JAVA technology Multi-participant Audio/Video: using Java’s JMF framework Collaboration Engine with Multiple-Platform-Tool-Source: makes
available the rich set of applications running on Windows/UNIX environments.
Delivery to the home/office: users can access the session over a regular Internet connection using the latest generation of high speed at home Internet connections.
Recording/Replay: indexed by session events Support multiple learning modes: lecture, demonstration, collaborative
learning, computer-based labs, student team project, study sessions Virtual Rooms: the class can be divided into groups by assigning each
group a virtual meeting room. Students can move from room to room and join in different on-going discussions.
The IRI-h Objectives 1
Platform Independent Services: using JAVA technology Multi-participant Audio/Video: using Java’s JMF framework Collaboration Engine with Multiple-Platform-Tool-Source: makes
available the rich set of applications running on Windows/UNIX environments.
Delivery to the home/office: users can access the session over a regular Internet connection using the latest generation of high speed at home Internet connections.
Recording/Replay: indexed by session events Support multiple learning modes: lecture, demonstration, collaborative
learning, computer-based labs, student team project, study sessions Virtual Rooms: the class can be divided into groups by assigning each
group a virtual meeting room. Students can move from room to room and join in different on-going discussions.
IRI-h Network Layout
G
Multicast disabled site
UDP tunnel
Gateway
High SpeedNetwork (Multicast)
Gateway
High SpeedNetwork(Multicast)
S1 S2
S3P1
Low Bandwidth with multicast
Multicast
P3
High Delay without multicast
UDP tunnel
P2
Low Bandwidth without multicast
UDP tunnel
Intranet
Multicast
P4P5
P6P7 P8P9
IRI-h Network Layout
G
Multicast disabled site
UDP tunnel
Gateway
High SpeedNetwork (Multicast)
Gateway
High SpeedNetwork(Multicast)
S1 S2
S3P1
Low Bandwidth with multicast
Multicast
P3
High Delay without multicast
UDP tunnel
P2
Low Bandwidth without multicast
UDP tunnel
Intranet
Multicast
P4P5
P6P7 P8P9
IRI-h Software Architecture
SMLog Server
Group Communication server
Gateway
Token Managers
Observers
SP
Audio Video
Sharing Tool
Annotation
Pointer
RcvSnd
SndSnd
RcvRcv
Gateway servers
TCP connection
Thread relationship
Service manager
Main Thread
Snd: SenderRcv: ReceiverSP: Session ParticipantSM: Session Manager
IRI-h Software Architecture
SMLog Server
Group Communication server
Gateway
Token Managers
Observers
SP
Audio Video
Sharing Tool
Annotation
Pointer
RcvSnd
SndSnd
RcvRcv
Gateway servers
TCP connection
Thread relationship
Service manager
Main Thread
Snd: SenderRcv: ReceiverSP: Session ParticipantSM: Session Manager
IRI-h Startup Scenarios
E, F: Automated Startup by Java Server B: Manual Join by contacting the Directory Server
H: Session Manager manually invoked G: Manual Join by contacting H directly
SP Startup
B
SPStartup Applet
A
G
SP
E
SPHA
H
SM
F
HA SM
C
Java Server
D
Directory Server
SM: Session ManagerSP: Session ParticipantHA: Host AmbassadorX Y: X initiates protocol with YX Y: X spawn Y
server
IRI-h Startup Scenarios
E, F: Automated Startup by Java Server B: Manual Join by contacting the Directory Server
H: Session Manager manually invoked G: Manual Join by contacting H directly
SP Startup
B
SPStartup Applet
A
G
SP
E
SPHA
H
SM
F
HA SM
C
Java Server
D
Directory Server
SM: Session ManagerSP: Session ParticipantHA: Host AmbassadorX Y: X initiates protocol with YX Y: X spawn Y
server
Discussion ModeToken controlled tools Private panel
Shared view
Room cards
Audio control
Annotation token holder utilitiesVideo control
Private panelLogin box
Class name and semester
Discussion ModeToken controlled tools Private panel
Shared view
Room cards
Audio control
Annotation token holder utilitiesVideo control
Private panelLogin box
Class name and semester Presentation Mode
Token controlled tools Private panel
Shared view
Room cards
Audio control
Annotation token holder utilitiesVideo control
Private panelLogin box
Class name and semester
Presentation ModeToken controlled tools Private panel
Shared view
Room cards
Audio control
Annotation token holder utilitiesVideo control
Private panelLogin box
Class name and semester Collaboration Mode
Token controlled tools Private panel
Shared view
Room cards
Audio control
Annotation token holder utilitiesVideo control
Private panelLogin box
Class name and semester
Collaboration ModeToken controlled tools Private panel
Shared view
Room cards
Audio control
Annotation token holder utilitiesVideo control
Private panelLogin box
Class name and semester
Performance Results 1• Tool Sharing (IPV)
– The performance of IPV depends on the following activities.• Capture images of the windows in the application being shared,
• Compare these images with previous images to see if the image has changed (for removing temporal redundancy),
• Compress the image,
• Transfer,
• Decompress,
• Display images on client machine.
– Capture time is a function of the image size only (measured around 220 msec for a 700x700 image on a Unix machine).
– Comparison time is between 300-500 msec.
Performance Results 1• Tool Sharing (IPV)
– The performance of IPV depends on the following activities.• Capture images of the windows in the application being shared,
• Compare these images with previous images to see if the image has changed (for removing temporal redundancy),
• Compress the image,
• Transfer,
• Decompress,
• Display images on client machine.
– Capture time is a function of the image size only (measured around 220 msec for a 700x700 image on a Unix machine).
– Comparison time is between 300-500 msec.
• IPV (continued)– Compression time is a function of the compression algorithm and
ranges from 1000 to 3000 msec. since this is performed in software.
– Transmission time depends on image type and ranges from 20msec for text images to 350 msec. for picture images (using PNG).
– On the receiver's side, performance is dominated by the time to decompress which is around 500 msec.
• IRI-h Scalability– scalability tests have been performed by running IRI-h on all
Intranet machines (35) with no degradation in performance (video/audio/IPV reception).
Performance Results 2• IPV (continued)
– Compression time is a function of the compression algorithm and ranges from 1000 to 3000 msec. since this is performed in software.
– Transmission time depends on image type and ranges from 20msec for text images to 350 msec. for picture images (using PNG).
– On the receiver's side, performance is dominated by the time to decompress which is around 500 msec.
• IRI-h Scalability– scalability tests have been performed by running IRI-h on all
Intranet machines (35) with no degradation in performance (video/audio/IPV reception).
Performance Results 2Future Work
• Gateway– target bandwidth setup
• uplink (to gateway) 256Kbps• downlink (from gateway) 1 Mbps.
– Tunneling, and integration within current session/resource management framework.
– format transcoding and/or data rate limiting.
• Inter-Stream Synchronization• Late-Join mechanisms (service state)• Record/Replay• Quality of Session management• Semi-reliable application access protocols
Future Work
• Gateway– target bandwidth setup
• uplink (to gateway) 256Kbps• downlink (from gateway) 1 Mbps.
– Tunneling, and integration within current session/resource management framework.
– format transcoding and/or data rate limiting.
• Inter-Stream Synchronization• Late-Join mechanisms (service state)• Record/Replay• Quality of Session management• Semi-reliable application access protocols
Platform/environment management including late join/early leave: A student can join an on-going session at any time and fully participate in that class.
Situational awareness: Students, instructors and technical engineers are made aware of the current operating environment and are notified about noteworthy changes or unusual situations.
Class Management: instructor handouts/student notes, call by name, polling, classroom video, attendance
Shared Common Experience: The position and focus of the windows displayed on the student’s workstation is coordinated with the instructor’s machine.
Scalable: 100 participants
The IRI-h Objectives 2 Platform/environment management including late
join/early leave: A student can join an on-going session at any time and fully participate in that class.
Situational awareness: Students, instructors and technical engineers are made aware of the current operating environment and are notified about noteworthy changes or unusual situations.
Class Management: instructor handouts/student notes, call by name, polling, classroom video, attendance
Shared Common Experience: The position and focus of the windows displayed on the student’s workstation is coordinated with the instructor’s machine.
Scalable: 100 participants
The IRI-h Objectives 2
Poster on4x8 footposterboard
The IRI-h Objectives 1 Platform Independent Services: using JAVA technology Multi-participant Audio/Video: using Java’s JMF framework Collaboration Engine with Multiple-Platform-Tool-Source:
makes available the rich set of applications running on Windows/UNIX environments.
Delivery to the home/office: users can access the session over a regular Internet connection using the latest generation of high speed at home Internet connections.
Recording/Replay: indexed by session events Support multiple learning modes: lecture, demonstration,
collaborative learning, computer-based labs, student team project, study sessions
Virtual Rooms: the class can be divided into groups by assigning each group a virtual meeting room. Students can move from room to room and join in different on-going discussions.
Platform/environment management including late join/early leave: A student can join an on-going session at any time and fully participate in that class.
Situational awareness: Students, instructors and technical engineers are made aware of the current operating environment and are notified about noteworthy changes or unusual situations.
Class Management: instructor handouts/student notes, call by name, polling, classroom video, attendance, auto session start, class monitoring, enrollment
Shared Common Experience: The position and focus of the windows displayed on the student’s workstation is coordinated with the instructor’s machine.
Scalable: 100 participants Easy of Use: Ease of installation, Quick class join
The IRI-h Objectives 2
IRI-h Network Layout
G
Multicast disabled site
UDP tunnel
Gateway
High SpeedNetwork (Multicast)
Gateway
High SpeedNetwork(Multicast)
S1 S2
S3P1
Low Bandwidth with multicast
Multicast
P3
High Delay without multicast
UDP tunnel
P2
Low Bandwidth without multicast
UDP tunnel
Intranet
Multicast
P4P5
P6P7 P8P9
IRI-h Software Architecture
SMLog Server
Group Communication server
Gateway
Token Managers
Observers
SP
Audio Video
Sharing Tool
Annotation
Pointer
RcvSnd
SndSnd
RcvRcv
Gateway servers
TCP connection
Thread relationship
Service manager
Main Thread
Snd: SenderRcv: ReceiverSP: Session ParticipantSM: Session Manager
IRI-h Startup Scenarios
E, F: Automated Startup by Java Server B: Manual Join by contacting the Directory Server
H: Session Manager manually invoked G: Manual Join by contacting H directly
SP Startup
B
SPStartup Applet
A
G
SP
E
SPHA
H
SM
F
HA SM
C
Java Server
D
Directory Server
SM: Session ManagerSP: Session ParticipantHA: Host AmbassadorX Y: X initiates protocol with YX Y: X spawn Y server
Login/Discussion ModeToken controlled tools Private panel
Shared view
Room cards
Audio control
Annotation token holder utilitiesVideo control
Private panelLogin box
Class name and semester
Presentation Mode
Collaboration Mode
Future Tasks 1
• Gateway– Target bandwidth setup
• uplink (to gateway) 128-512 Kbps
• downlink (from gateway) 256-740Kbps
– Tunneling for lack of multicast
– Format transcoding and/or data rate limiting.
– Bandwidth management
• Inter-Stream Synchronization• Quality of Session management
Performance
• IRI-h Scalability: scalability tests on 35 machines with no incremental degradation in performance (video/audio/IPV reception).
• Delay: Audio/Video 750ms, IPV 1800ms
• Bandwidth: 1.5 Mb/s with three video, audio, ipv, pointer and annotation
• StartUp: initial interface 1 minute, video 25s, audio (10s), ipv (5 s), pointer(30ms), private services (3 s), class creation (10s)
• Refresh rates: Video 15 frames/sec, IPV 5s for full screen
• Late-Join mechanisms (service state)• Record/Replay• Semi-reliable application access protocols• Multiple Rooms• Feedback: network monitor, “smiley face”
• Additional Features: classroom video, call on student, survey, PA channel for multiple rooms, exam tool, remote ipv
Future Tasks 2