78
24th Workshop on Interactive Systems and Software (WISS
2016)
: AquaCAVE
(VR)
VR
VR VR
VR 3
VR
We propose an immersive virtual reality environment configured
in a swimming pool. This environment re-
alizes various forms of underwater entertainments and enhanced
swimming training environment. However,
we have to overcome some technical challenges caused by water
and surround-screen. In this research, we
focused on investigations on issues related to infrared (IR)
radiation absorption and reflection on the walls
of the swimming pool and proposed the solutions. The difficulty
on position tracking is that existing motion
capture systems using IR or blue lights are not feasible for an
underwater immersive projection environ-
ment. The reason is IR is absorbed, and visible lights are
unstable in complex backgrounds. Therefore, we
propose a circular-polarization-based technique for position
tracking using visible-light LED markers. In
addition, we also took investigations on an optical distortion
in the water, and reflections causing a decline
of immersion.
1
An Underwater Immersive Virtual Reality Environ-
ment for Enhancing the Swimming Experience: The
Design and Implimentation of AquaCAVE
Shogo Yamashita, Takashi Miyaki, Sunichi Suwa, Jun
Rekimoto, , Graduate school of
interdisciplinary information studies, the University
of Tokyo.
Sunichi Suwa, Jun Rekimoto,
, Sony Computer Science Laboratories.
, Vol.29, No.1(2012), pp.7884.
[ ] 2017 1 10 .
[8]
(CAVE)
ShogoYamashitaPre-print / Post-print version
Vol. 29 No. 1 Feb. 2012 79
1 AquaCAVE:
1 [5] VR
3D
VR AquaCAVE
AquaCAVE VR
VR
3
AquaCAVE
VR
LED
VR
2
2. 1
AquaCAVE VR
VR 3D
[3] [16]
AquaCAVE
VR
[20] Jain
VR [7]
2. 2
[25] [26]
HMD [1] [6]
Morales
AR [12]
HMD
AquaCAVE
3D
VR
80
HMD
CAVE
[18]
Dungeons swimmers [11]
AquaCAVE 3D
3 VR
VR
VR
VR
3. 1
3. 1. 1
OptiTrack [13]
3
[4]
3. 1. 2
Oqus Underwater [15]
CAVE
LED
CAVE
[19].
3. 1. 3
[14] VR
3. 2
( )
Vol. 29 No. 1 Feb. 2012 81
[29]
CAVE
VR
3. 3
(
) (
)
3
[22]
[27] 3
VR
VR
3. 4
[24]
3
[28]
VR
4 VR
4. 1
VR (AquaCAVE)
1 .
[ ]3m [ ]2m [ ]1.5m( 1m)
3cm
3D
LED
3
3
3
3
CAVE
3
4. 2 LED
LED 2
82
(A) ()
(B) ()
2
LED
2
LED
( 2)
2 A
LED 2
B A
4. 3
(B) (A)
3
[17]
3
[2]
3 (A)
3 (B)
TELESIN T03 Dome Port
(GoPro Hero 4)
3 (A)
3 (A)
3 (B)
[10]
3 (A)
Vol. 29 No. 1 Feb. 2012 83
Zhang
[21] GoPro
GoProStudio1
5
5. 1
CAVE
CAVE
CG
5. 2
( )
( )
3D
3D
3D
2
3D
1 GoProStudio:https://gopro.com/help/GoPro-Studio)
6
6. 1
3D 1/4
1/4
1/4 45
45
3D
3D
[23]
( 4)
6. 2
1/4 3D
5(A)
3D 5(B)
3D
3D (G15-DLP)
( ) 1/4
45
3D
84
7
7. 1
6 AquaCAVE
CAVE 3D
6 (RICOH PJ WX4141)
3D
MacPro
7. 2
2
LED
3
3
3
LED
3D 1/4
3D
CMOS
4
(A) 3D
(B) 1/43D
5
GoPro2
8
LED
3
VR
LED
2 DomePort
Vol. 29 No. 1 Feb. 2012 85
3D( 1/4)
LED LED
3D
Eye Position
x 6 display cables
3D ()
MacPro
()
()
6
8. 1
LED
LED
AquaCAVE
33
LED
1
BlobDetection
Processing 4
3 1: ( 10:20-0:40) 2:
( 1 8:50-9:10) 3:
( 2 5:00-5:10)
1 Tittle: Beauti-
ful Undersea World - Coral Reefs, Clownfish And
Colorful Underwater Animals, Creater: Serey V,
License: CC. 2 Tittle: Underwater - Jour-
ney to the Red Sea Coral Reef, Creater:Roberto
Lope Carrozza, License: CC.
4 BlobDetection library:
7 A LED
1 20
7
7 A B C
(C)
(C)
3
( 2) 3
3
LED
http://www.v3ga.net/processing/BlobDetection/
86
(B) 1 (0:070:09)
(C) 1 (0:130:20)
[] 1 2 30:00 0:01 0:02 0:03 0:04 0:05 0:06 0:07 0:08 0:09 0:10
0:11 0:12 0:13 0:14 0:15 0:16 0:17 0:18 0:19 0:20
[] 1 2 30:00 0:01 0:02 0:03 0:04 0:05 0:06 0:07 0:08 0:09 0:10
0:11 0:12 0:13 0:14 0:15 0:16 0:17 0:18 0:19 0:20
(B)
(C)
(A)
7
(A) (B)
8
8. 2
8
8 A)
B
GoPro Hero 6 5
TELESIN GP-DMP-T03-YL
25cm A4
8 B
3
5 GoPro hero 5Linear FOV
9
9. 1 3
LED
3
3
1 3
3
[9]
LED
3
OpenTrack 6.OpenTrack 3 (
)
3 Freetrack
3
UDP7 VR
(CAVE)
3
VR CAVE
3
CAVE VR
3
6 opentrack:https://github.com/opentrack/opentrack
7 FreeTrack:http://www.free-track.net/
Vol. 29 No. 1 Feb. 2012 87
3
CAVE
3
VR
9. 2
4
CAVE
9(A)
B
3D
( )
OpenGL
3D
(A) (B) CAVE
9
Libgls 8
10cm
( )
2
CAVE
CAVE
8 Libgls:http://libgls.sourceforge.net/
OpenGL:
http://libgls.sourceforge.net/
88
9. 3 VR
AquaCAVE
VR
10
VR (AquaCAVE)
VR
AquaCAVE
VR
LED
VR
VR
3
JST ACT-I
[ 1 ] Blum, L., Broll, W., and Muller, S.: Augmentedreality
under water, SIGGRAPH09: Posters,ACM, 2009, pp. 97.
[ 2 ] Bruno, F., Bianco, G., Muzzupappa, M.,Barone, S., and
Razionale, A.: Experimentation ofstructured light and stereo vision
for underwater 3Dreconstruction, ISPRS Journal of Photogrammetryand
Remote Sensing, Vol. 66, No. 4(2011), pp. 508518.
[ 3 ] Cheng, L.-P., Luhne, P., Lopes, P., Sterz, C.,and
Baudisch, P.: Haptic turk: a motion platformbased on people,
Proceedings of the 32nd annualACM conference on Human factors in
computingsystems, ACM, 2014, pp. 34633472.
[ 4 ] Coker, D., Reimers, J., and Watts, R.: Theinfrared
absorption spectrum of water, AustralianJournal of Physics, Vol.
35, No. 5(1982), pp. 623638.
[ 5 ] Cruz-Neira, C., Sandin, D. J., and DeFanti,T. A.:
Surround-screen projection-based virtual re-ality: the design and
implementation of the CAVE,Proceedings of the 20th annual
conference on Com-puter graphics and interactive techniques,
ACM,1993, pp. 135142.
[ 6 ] Gallagher, D. G.: Development of minia-ture, head-mounted,
virtual image displays fornavy divers, OCEANS99 MTS/IEEE. Riding
theCrest into the 21st Century, Vol. 3, IEEE, 1999,pp.
10981104.
[ 7 ] Jain, D., Sra, M., Guo, J., Marques, R., Wu, R.,Chiu, J.,
and Schmandt, C.: Immersive Scuba Div-ing Simulator Using Virtual
Reality, Proceedings ofthe 29th Annual Symposium on User Interface
Soft-ware and Technology, ACM, 2016, pp. 729739.
[ 8 ] Kirschenbaum, D. S., Ordman, A. M., Tomarken,A. J., and
Holtzbauer, R.: Effects of differentialself-monitoring and level of
mastery on sports per-formance: Brain power bowling, Cognitive
therapyand Research, Vol. 6, No. 3(1982), pp. 335341.
[ 9 ] Lavest, J.-M., Rives, G., and Lapreste, J.-T.:Underwater
camera calibration, European Confer-ence on Computer Vision,
Springer, 2000, pp. 654668.
[10] Lavest, J.-M., Rives, G., and Lapreste, J.-T.:Dry camera
calibration for underwater applica-tions, Machine Vision and
Applications, Vol. 13,No. 5(2003), pp. 245253.
[11] Lee, H., Moon, M., Park, T., Hwang, I., Lee, U.,and Song,
J.: Dungeons & swimmers: designing aninteractive exergame for
swimming, Proceedings ofthe 2013 ACM conference on Pervasive and
Ubiq-uitous Computing adjunct publication, ACM, 2013,pp.
287290.
[12] Morales, R., Keitler, P., Maier, P., and Klinker,G.: An
underwater augmented reality systemfor commercial diving
operations, OCEANS 2009,MTS/IEEE Biloxi-Marine Technology for Our
Fu-
Vol. 29 No. 1 Feb. 2012 89
ture: Global and Local Challenges, IEEE, 2009,pp. 18.
[13] OptiTrack: OptiTrack Motion Capture,
http://optitrack.com/.
[14] Pibyl, B., Chalmers, A., and Zemk, P.: Featurepoint
detection under extreme lighting conditions,Proceedings of the 28th
Spring Conference on Com-puter Graphics, ACM, 2012, pp. 143150.
[15] Qualisys: Qualisys underwater motion
capture,http://www.qualisys.com/.
[16] Rheiner, M.: Birdly an attempt to fly, ACMSIGGRAPH 2014
Emerging Technologies, ACM,2014, pp. 3.
[17] Treibitz, T., Schechner, Y., Kunz, C., and Singh,H.: Flat
refractive geometry, IEEE transactions onpattern analysis and
machine intelligence, Vol. 34,No. 1(2012), pp. 5165.
[18] Ukai, Y. and Rekimoto, J.: Swimoid: a swimsupport system
using an underwater buddy robot,Proceedings of the 4th Augmented
Human Interna-tional Conference, ACM, 2013, pp. 170177.
[19] Yamashita, S., Zhang, X., Miyaki, T., and Reki-moto, J.:
AquaCAVE: an underwater immersiveprojection system for enhancing
the swimming ex-perience, ICAT-EGVE, (2016).
[20] Yamashita, S., Zhang, X., and Rekimoto, J.:AquaCAVE:
Augmented Swimming Environmentwith Immersive Surround-Screen
Virtual Reality,Proceedings of the 29th Annual Symposium on
UserInterface Software and Technology, ACM, 2016,pp. 183184.
[21] Zhang, Z.: A flexible new technique for cameracalibration,
IEEE Transactions on pattern analy-sis and machine intelligence,
Vol. 22, No. 11(2000),pp. 13301334.
[22] , , :, , Vol. 42,
No. 4(2004), pp. 300306.[23] , , :
,(CVIM), Vol. 1, No. 1(2008), pp. 6472.
[24] : ,, Vol. 19, No. 3(1980), pp. 348356.
[25] :: ,
(2015).[26] : ME ,
BME, Vol. 2, No. 4(1988), pp. 252256.[27] , , , , ,
, , :3 ,
D, Vol. 83, No. 1(2000), pp. 396403.[28] , , , :
,B, Vol. 64, No. 2(2008), pp. 99114.
[29] , , : , ,
Vol. 9, No. 2(1999), pp. 243250.
2016
2014
28
28
( )
2008
2017
2002
2016
2017
1986
1994
. 1999
2007
(
) JST (2017-)
ShogoYamashita Notice for the use of this material: The
copyright of this material is retained by theJapan Society for
Software Science and Technology (JSSST). This material is
publishedon this web site with the agreement of the JSSST. Please
be complied with CopyrightLaw of Japan if any users wish to
reproduce, make derivative work, distribute or makeavailable to the
public any part or whole thereof.