hua vitae TenureReview - University of Arizona Vitae Hong Hua 2 Scholarships Beckman Fellowship, Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign,

CURRICULUM VITAE Hong Hua

Assistant Professor of Optical Sciences, University of Arizona (Updated on October 10th, 2008)

_______________________________________________________________________________ Contact Information Hong Hua Voice: (520) 626-8703 College of Optical Sciences Fax: (520) 621-3389 University of Arizona Email: [email protected] Tucson, AZ 85721 Web: http://3dvis.optics.arizona.edu _______________________________________________________________________________ Chronology of Education Universities Attended Department Degrees Dates Awarded Beijing Institute of Technology Opto-electronic Engineering Ph.D. with honors 1999 Beijing Institute of Technology Opto-electronic Engineering B.S.E. with honors 1994

Doctoral Dissertation Title: Techniques of Immersion Enhancement and Interaction for Virtual Reality Advisor: Dr. Yongtian Wang, Professor of Optical Engineering Major Field: Optical Engineering Subfields: 3D displays, augmented reality, virtual reality, human computer interface

_______________________________________________________________________________ Chronology of Employment Assistant Professor

College of Optical Sciences, University of Arizona, 12/2003-present Department of Electrical and Computer Engineering, University of Arizona, 2004-present Department of Computer Sciences, University of Arizona, 2004-present Department of Information and Computer Sciences, University of Hawaii at Mãnoa, 01/2003-12/2003

Beckman Research Fellow Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign,

12/1999-12/2002

Postdoctoral Research Associate ODAlab, School of Optics/CREOL, University of Central Florida, 02/1999-12/1999

_______________________________________________________________________________ Honors and Awards Honors

Best Student Paper Award (co-authored with students) at the 7th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’08) for the paper “An optical see-through head-mounted display with addressable focal planes” (Sheng Liu, Dewen Cheng, Hong Hua), 09/2008

Recipient of National Science Foundation (NSF) CAREER Award, 2007 Best Paper Award (Honorable Mention), IEEE Virtual Reality 2003 Excellent Ph.D. Dissertation, Beijing Institute of Technology, 07/1999 First Prize of Excellent Scientific Papers, Beijing Institute of Technology, 08/1998 Excellent B.S.E. Thesis, Beijing Institute of Technology, 07/1994

Curriculum Vitae Hong Hua

2

Scholarships Beckman Fellowship, Beckman Institute for Advanced Science and Technology, University of Illinois

at Urbana-Champaign, 12/1999-12/2002 China Instrument and Control Society Scholarship (~50 awardees selected nation wide), 12/1997 and

12/1994 Xu Teli Scholarship (~10 awardees selected at Beijing Institute of Technology), 01/1996 Aerospace Long-March Scholarship (~5 awardees selected at Beijing Institute of Technology),

11/1993 Ma Shixiu Optical Engineering Scholarship (1 awardee selected in the Department of Opto-electronic

Engineering, Beijing Institute of Technology), 12/1992 The People’s Scholarship of Beijing Institute of Technology (Fist prize, 7 times)

Awards Received by Students for Supervised Projects Craig Pansing, Optical Research Associates Student Optical Design Award, 07/2005

_______________________________________________________________________________ Service / Outreach Local/State Outreach

Optical Sciences Community Speaker, University of Arizona, 03/2004 and 04/2007 Lecturer/Demonstrator, the 2006 Arizona Youth University: Optical Sciences Camp, Tucson, Arizona,

06/2006 Participant, the Open House held by College of Optical Sciences (in coordination with the 2005

Optical Society of America Annual Meeting), 10/2005 Demonstrator, “UA Daughters on Campus” event, 04/2004 Lecturer, ICS Student Club, University of Hawaii at Mãnoa, 11/2003 Participant, the yearly Open House held by Beckman Institute for Advanced Science and Technology,

03/2002 and 03/2001

National/International Outreach and Services Ad-hoc Proposal Reviewer, Division of Information and Intelligent Systems, NSF, 2008 Proposal Review Panelist, Division of Information and Intelligent Systems, NSF, 2007 and 2003 Site-visit Review Committee Member, Science of Learning Center, NSF, 11/2005 Site-visit Review Committee Member, Science and Technology Center, NSF, 10/2004 Ad-hoc Proposal Reviewer, Indiana 21st Century Science and Technology Fund, 2004 Permanent Consulting Editor, McGraw-Hill Encyclopedia of Science and Technology,

10/2005-present Interim Consulting Editor, McGraw-Hill Encyclopedia of Science and Technology, 02/2005-10/2005 Topical Meeting Co-chair, 2008 Topical Meeting on Illumination Modeling: Simulation and

Perception of Lit and Unlit Objects (IM), Optical Society of America, Rochester, NY, 2008 Area Chair, the 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, 2007 Registration Chair, ACM International Symposium on User Interface Software and Technology

(UIST), 2004 and 2005 Meeting Session Co-chair, SPIE AeroSense 2002: Helmet Mounted Displays, Orlando, FL, 04/2002 Program Committee Member, IEEE and ACM International Symposium on Mixed and Augmented

Reality, 2003-present Program Committee Member, International Conference on Computer Vision and Pattern Recognition

(CVPR), 2008 Program Committee Member, International Conference on Computer Vision (ICCV), 2007 Referee, Optics Express, Optics Letter, Applied Optics, and Journal of Optical Society of America,

2002-present Referee, Optical Engineering and Journal of Electronic Imaging, 2001-present


3

Referee, IEEE Transactions on Systems, Man, and Cybernetics, 2000-present Referee, IEEE Computer Graphics and Applications, 2004-present Referee, IEEE Transactions on Visualization and Computer Graphics, 2006-present Referee, International Journal of Human Computer Interaction, 2003-present Referee, Journal of Presence: Teleoperators and Virtual Environments, 2003-present Referee, a variety of IEEE and ACM conferences such as IEEE Visualization 2004, ACM UIST 2005,

ACM Computer-Human Interaction (CHI) 2006, etc.

Departmental/College Committees and Services Optical Sciences Colloquium Committee, 2008-2009 Undergraduate Curriculum Committee, College of Optical Sciences, 2004-present Graduate Admission Committee, College of Optical Sciences, 2006-2007 Jack D. Gaskill Scholarship Committee, 2006 Optical Engineering Faculty Search Committee, 2005 Graduate Comprehensive Exam—Oral Examination Committee Participation

Spring 2008 (2 exams) Fall 2007 (3 exams) Spring 2007 (2 exams) Fall 2006 (2 exams) Spring 2006 (1 exam) Fall 2005 (2 exams)

University Committees and Services University Committee on Ethics and Commitment, elected in June 2008 for a three-year service Proposal Evaluation Committee for Spatially Immersive Environment Project, the Center for

Computing and Information Technology, University of Arizona, 2004 _______________________________________________________________________________ Publications (Published or Accepted)

An asterisk (*) indicates publications substantially based on work done as a graduate student Brief summary of results from selected articles is given at the end of the CV and also available at:

http://3dvis.optics.arizona.edu/publications/results.pdf PDF files of most of the following publications can be obtained at:

http://3dvis.optics.arizona.edu/publications/publications.html

Chapters in Scholarly Books and Monographs 1. J. P. Rolland and Hong Hua, “Head-mounted display systems,” in Encyclopedia of Optical Engineering

(Editors: R. Barry Johnson and Ronald G. Driggers), New York, NY: Marcel Dekker, pp.1-13, 2005. 2. J. P. Rolland, F. Biocca, C. Gao, Hong Hua, and O. Harrysson. “Design and prototyping of a teleportal

ultra-light weight large field of view head mounted display,” in Virtual Reality and Augmented Reality Applications in Manufacturing (Editors: Ong, S. K., and Nee, A. Y. C.), Publisher: Springer, pp.179-200, July 2004.

Referred Journal Articles 3. Ji-young Oh and Hong Hua, “Usability of multi-scale interfaces for 3D workbench displays,” in Journal of

Presence: Teleoperators and Virtual Environments, 17(5): 415-440, October, 2008. 4. Rui Zhang and Hong Hua, “Design of a polarized head-mounted projection display using ferroelectric

liquid-crystal-on-silicon microdisplays,” Applied Optics, 47(15): 2888-96, May 2008. 5. Xiaorui Wang and Hong Hua, “Theoretical analysis for integral imaging performance based on

microscanning of microlens array,” Optics Letter, 33(5): 449-451, February 2008. 6. Rui Zhang and Hong Hua, “Characterizing polarization management in a p-HMPD system,” Applied

Optics, 47(4):512-522, January 2008.


4

7. Hong Hua and Sheng Liu, “A dual-sensor foveated imaging system,” Applied Optics, 47(3): 317-27, January 2008. This article is also listed in Virtual Journal for Biomedical Optics, 3(2).

8. Hong Hua, Craig Pansing, and J. P. Rolland, “Modeling of an eye-imaging system for optimizing illumination schemes in an eye-tracked head-mounted display,” Applied Optics, 46(31): 7757-7770, October 2007 (cover story). This article is also listed in Virtual Journal for Biomedical Optics, 2(12).

9. Hong Hua and C. Gao, “Online calibration of a head-mounted projection display for augmented reality systems,” Journal of Society for Information Displays, 15(11):1-9, 2007.

10. Hong Hua, C. Gao, and N. Ahuja, “Calibration of an augmented reality system using head-mounted projective displays,” IEEE Transactions on Systems, Man, Cybernetics (Part A: Systems), 37(3): 416-30, 2007.

11. Hong Hua and C. Gao, “Design of a polarized head-mounted projection display,” Applied Optics, 46(14): 2600-10, April 2007. This article is also listed in Virtual Journal for Biomedical Optics, 2(6).

12. Hong Hua, N. Ahuja, and C. Gao. “Design analysis of a high resolution panoramic camera using conventional imagers and a mirror-pyramid,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(2): 356-61, February 2007.

13. Leonard Brown and Hong Hua, “Magic Lenses for augmented virtual environments,” IEEE Computer Graphics and Applications, 26(4): 64-73, July/August 2006.

14. Hong Hua, Prasana Krishnaswamy, and J. P. Rolland, “Video-based eyetracking methods and algorithms in head-mounted displays,” Optics Express, 14(10): 4328-50, May 2006.

15. K. Tan, Hong Hua, and N. Ahuja. “Multiview panoramic cameras using a mirror pyramid,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(7): 941-6, July 2004.

16. Hong Hua, Leonard Brown, and C. Gao, “System and interface framework for SCAPE as a collaborative infrastructure,” Presence: Teleoperators and Virtual Environments, 13(2): 234-250, April 2004 (cover story).

17. Hong Hua, Leonard Brown, and C. Gao, “SCAPE: Supporting Stereoscopic Collaboration in Augmented and Projective Environments,” IEEE Computer Graphics and Application, 24(1): 66-75, January/February 2004.

18. Hong Hua, Y. Ha, and J. P. Rolland. “Design and assessment of an ultra-light and compact projection lens using DOE and plastic components for head-mounted projective displays,” Applied Optics, 42(1): 97-107, January 2003.

19. *Hong Hua, Y. Wang, and D. Yan. “Low-cost dynamic rangefinding device based on amplitude-modulated continuous ultrasonic wave,” IEEE Transactions on Instrumentation and Measurements, 51(2): 362-7, April 2002.

20. Hong Hua, A. Girardot, C. Gao, and J. P. Rolland. “Engineering of head-mounted projective displays,” Applied Optics, 39 (22): 3814-3824, August 2000.

21. *Hong Hua, Y. Wang, X. Guo. “Design principle and error analysis of 6DOF ultrasonic position and orientation tracker,” Zidonghua Xuebao/Acta Automatica Sinica, 26 (6): 840-4, November 2000.

22. *Hong Hua, X. Guo, Y. Wang. “Design principle and error analysis of 3D ultrasonic position tracker,” Chinese Journal of Scientific Instruments, Vol. 21 (3): 326-330, June 2000 (in Chinese).

23. *Hong Hua, Y. Wang. “Design of position tracker using continuous ultrasonic wave and its application in virtual reality,” Acta Electronica Sinica, 27 (12): 98-101, December 1999 (in Chinese).

24. *Hong Hua, Y. Wang, T. Xu. “Dynamic rangefinding device using amplitude-modulated continuous ultrasonic wave,” Journal of Beijing Institute of Technology (English Edition), 7(1): 55-61, 1998.

25. *S. Zhang, Y. Wang, Hong Hua, “Diffraction efficiency calculation of planar grating using rigorous coupled-wave theory,” Optical Techniques, (1): 2-6, January 1998 (in Chinese).

26. *D. He, Y. Wang, X. Yuang, Hong Hua. “An optical viewing system for virtual reality,” Opto-Electronic Engineering, 24(5): 41-5, May 1997 (in Chinese).

27. *Y. Wang, Hong Hua, D. He etc. “Technical features of GOLD--software for general optical lens design,” Journal of Beijing Institute of Technology, 16(5): 483-9, May 1996.


5

Refereed Proceeding Articles (3~5 peer reviewers) (Only rigorously peer-reviewed conference articles listed in this category)

28. (Best Student Paper Award) Sheng Liu, Dewen Cheng, and Hong Hua, “An optical see-through head-mounted display with addressable focal planes,” Proceedings of 2008 IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’2008), pp. 33-42, September 2008 (<15% acceptance rate for full papers).

29. Sheng Liu and Hong Hua, “Spatialchromatic foveation for gaze contingent displays,” Proceedings of the 2008 ACM symposium on Eye Tracking Research and Applications (ETRA’08), pp. 139-142, March 2008.

30. C. Gao, N. Ahuja, and Hong Hua, “Active aperture control and sensor modulation for flexible imaging,” Proceedings of International Conference on Computer Vision and Pattern Recognition (CVPR’2007), pp.1-8, June 2007 (<28.2% acceptance rate).

31. Ji-Young Oh and Hong Hua, “User evaluations on form factors of tangible magic lenses,” Proceedings of 2006 IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’2006), pp.23-32, October 2006 (<26% acceptance rate for full papers).

32. Hong Hua and C. Gao, “A polarized head-mounted projective displays,” Proceedings of 2005 IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 32-35, October 2005 (<22% acceptance rate for short papers).

33. Leonard Brown, Hong Hua, and C. Gao, “A widget framework for augmented interaction in SCAPE,” Proceedings of 2003 ACM User Interface of Software and Technology (UIST 2003), also in Computer Human Interaction (CHI) Letters, 5(2), 1-10, October 2003 (<20% acceptance rate).

34. (Best Paper Award, Honorable Mention)Hong Hua, Leonard Brown, and C. Gao, “A new collaborative infrastructure: SCAPE,” Proceedings of IEEE Virtual Reality 2003 (VR’2003), pp. 171-179, March 2003 (<28% acceptance rate).

35. C. Gao, Hong Hua, and N. Ahuja, “Easy calibration of a head-mounted projective display for augmented reality systems,” Proceedings of IEEE Virtual Reality 2003 (VR’2003), pp. 53-60, March 2003 (<28% acceptance rate).

36. Hong Hua, C. Gao, and N. Ahuja, “Calibration of a head-mounted projective display for augmented reality systems,” Proceedings of 2002 IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’2002), pp.176-185, September 2002 (<28% acceptance rate).

37. K. Tan, Hong Hua, N. Ahuja, “Multi-view mirror pyramid panoramic camera,” Proceedings of 2002 IEEE Workshop on Omnidirectional Vision, pp. 87-93, June 2002.

38. Hong Hua, C. Gao, Leonard Brown, N. Ahuja, and J. P. Rolland, “A testbed for precise registration, natural occlusion and interaction in an augmented environment using a head-mounted projective display (HMPD),” Proceedings of IEEE Virtual Reality 2002 (VR’2002), pp. 81-89, March 2002 (<27% acceptance rate).

39. Hong Hua and N. Ahuja. “A high-resolution panoramic camera,” Proceedings of International Conference on Computer Vision and Pattern Recognition (CVPR’2001), pp. 960-67, December 2001 (<30.5% acceptance rate).

40. Hong Hua, C. Gao, Leonard Brown, N. Ahuja, and J. P. Rolland. “Using a head-mounted projective display in interactive augmented environments,” Proceedings of 2001 IEEE and ACM International Symposium on Augmented Reality (ISAR’2001), pp. 217-223, October 2001 (<32% acceptance rate).

41. M. Agrawal, Hong Hua, N. Ahuja. “On cosine-fourth and vignetting effects in lenses”, Proceedings of 2001 International Conference on Computer Vision (ICCV’2001), pp. 472-479, July 2001 (<34% acceptance rate).

42. Hong Hua, C. Gao, F. Biocca, and J. P. Rolland. “An ultra-light and compact design and implementation of head-mounted projective displays,” Proceedings of IEEE Virtual Reality 2001 (VR’2001), pp. 175-182, March 2001 (<30% acceptance rate).

Review Articles 43. Hong Hua, “Merging the worlds of atoms and bits: augmented virtual environments,” Optics and

Photonics News, 17(10): 26-33, October 2006 (cover story). 44. Hong Hua, “Stereoscopic displays,” McGraw-Hill 2005 Yearbook of Science & Technology, 339-342, 2005.


6

_______________________________________________________________________________ Work in Progress Articles Submitted to Refereed Journals 45. Prasad Gabbur, Hong Hua, and K. Barnard, “A fast connected components labeling algorithm for

real-time pupil detection,” submitted to Machine Vision and Applications Journal (Status: accepted for minor revision).

46. Rui Zhang and Hong Hua, “Imaging quality of a retroreflective screen in head-mounted projection displays,” submitted to Journal of Optical Society of America.

Articles to Be Submitted to Refereed Journals 47. Sheng Liu and Hong Hua, “Time-multiplexed dual-focal plane head-mounted display with a fast liquid

lens,” in preparation for a submission to Optics Letter. 48. Leonard Brown and Hong Hua, “The image of physical affordance on user interaction in an augmented

virtual environment,” in preparation for a submission to International Journal of Human-Computer Studies. _______________________________________________________________________________ Media 49. Hong Hua, Leonard Brown, and C. Gao. “SCAPE: A collaborative interface showcase,” Video Proceedings

of UIST 2003, Vancouver, CA, 2003. 50. Hong Hua, L. Brown, and C. Gao. “Head-mounted projective display technology showcase: augmented

‘GO’,” Video Proceedings of IEEE VR 2002, Orlando, FL, 2002. _______________________________________________________________________________ Scholarly Presentations Invited Papers and Talks 51. Hong Hua, “3D visualization techniques in multi-scale collaborative augmented virtual environments,”

Computer Science Colloquium, University of Arizona, November 16th, 2006. 52. (Invited Paper) Hong Hua, “Display technologies for collaborative work in 3D augmented and virtual

environments,” 2005 International Symposium on Optical Memory and Optical Data Storage, Paper MA2, Honolulu, Hawaii, July 10th, 2005.

53. (Invited Paper) Craig Pansing, Hong Hua, and J. P. Rolland, “Optimization of illumination schemes in a head-mounted display integrated with eye tracking capabilities,” Proceedings of the SPIE International Society for Optical Engineering, Vol. 5875, San Diego, USA, August 2005.

54. Hong Hua, “Stereoscopic display technology for collaborative augmented environments,” Visual Communication and Display Lab of Motorola Inc. (Schaumburg, IL), on June 4th 2003.

55. Hong Hua, “Stereoscopic display technology for collaborative augmented environments,” Department of Computer Science, George Mason University, Washington DC, on June 2nd, 2003.

56. Hong Hua, “Stereoscopic display research in augmented environments,” the Director’s Seminar Series, Beckman Institute, University of Illinois at Urbana-Champaign, September 2002.

57. Hong Hua, “Display and imaging methods in augmented reality”, the Department of Opto-Electronic Engineering, Beijing Institute of Technology, June 2002.

Submitted/Contributed Non-refereed Articles in Conference Proceedings 58. Rui Zhang and Hong Hua, “Design of a compact light engine for FLCOS microdisplays in a p-HMPD

system,” Proceedings of 2008 International Symposium of Society of Information Display (SID’2008). 59. Sheng Liu and Hong Hua, “Illumination design of a multi-touch sensing projection screen for augmented

virtual environments,” Proceedings of 2008 International Symposium of Society of Information Display (SID’2008).

60. Rui Zhang and Hong Hua, “Design of a polarized head-mounted projection display using FLCOS microdisplays,” Proceedings of the SPIE International Society for Optical Engineering (Photonic West 2007), Vol. 6489, 64890B, San Jose, USA, January 2007.


7

61. Sheng Liu, Craig Pansing, and Hong Hua, “Design of a foveated imaging system using a two-axis MEMS mirror,” Proceedings of 2006 International Optical Design Conference, Vol. 6342, 63422W-1-W-8, Vancouver, Canada, June 2006.

62. C. Curatu, J.P. Rolland, and Hong Hua, “Dual purpose lens for an eye-tracked projection head-mounted display,” Proceedings of International Optical Design Conference, Vancouver, Vol. 6342, 63420X, Canada, June 2006.

63. C. Curatu, Hong Hua, and J. P. Rolland, “Projection-based head-mounted display with eye-tracking capabilities,” Proceedings of the SPIE International Society for Optical Engineering, Vol. 5875, San Diego, USA, August 2005.

64. Hong Hua, “An ultra-bright polarized head-mounted projective display,” OSA 2005 Annual Meeting/Frontiers in Optics, Tucson, AZ, October 2005 (Oral presentation).

65. Leonard Brown, C. Gao, and Hong Hua, “Toward a tangible interface for multi-modal interior design using SCAPE,” 2004 IEEE Workshop on Beyond glove and wand based interaction, March 2004.

66. Y. Ha, Hong Hua, R. Martins, and J. P. Rolland, “Design of a wearable wide-angle projection color display,” Proceedings of 2002 International Optical Design Conference, pp. 67-73, June 2002.

67. Hong Hua, C. Gao, and J. P. Rolland, “Study of the imaging properties of retro-reflective materials used in head-mounted projective displays,” Proceedings of SPIE (Aerosense 2002), Vol. 4711, pp.194-201, April 2002.

68. J. P. Rolland, Hong Hua, and F. Biocca, “Head-mounted projective displays for creating remote collaborative environments,” Proceedings of SPIE (Aerosense 2002), Vol. 4711, April 2002.

69. Hong Hua, F. Biocca, and J. P. Rolland, “Design of an ultra-light head-mounted projective display and its applications in augmented collaborative environments,” Proceedings of SPIE (Electronic Imaging 2002), Vol. 4660, pp.492-497, January 2002.

70. Hong Hua, Leonard Brown, C. Gao, N. Ahuja, J. P. Rolland, F. Biocca. “A head-mounted projective display and its applications in interactive augmented environments,” SIGGRAPH 2001 Conference Abstracts and Applications--Sketches & Applications, August 2001.

71. (Invited Paper) J. P. Rolland, Y. Ha, L. Davis, Hong Hua, C. Gao, F. Biocca, “A new paradigm for head-mounted display technology: application to medical visualization and remote collaborative environments,” Proceedings of SPIE, Vol. 4442, August 2001.

72. J. P. Rolland, Hong Hua, C. Gao, and F. Biocca. “Innovative displays for augmented reality applications and remote collaborations”, Proceedings of 2001 Medicine Meets Virtual Reality (MMVR’2001), January 2001.

73. Hong Hua. “Integration of eye tracking capability into optical see-through head-mounted displays,” Proceedings of SPIE (Electronic Imaging 2001), pp. 496-503, January 2001.

74. Hong Hua, C. Gao, J. P. Rolland. “Ultra-light and compact design of head-mounted projective displays with diffractive optical element,” OSA 2000 Annual Meeting, October 2000 (Oral presentation).

75. Hong Hua, C. Gao, and J. P. Rolland. “Design and engineering implementation of head-mounted projective display,” Proceedings of 5th International Conference on Human Interaction with Complex Systems, April 30-May 2, 2000.

76. Hong Hua, A. Girardot, and J. P. Rolland. “Head-mounted projective display: design and engineering study,” OSA 1999 Annual Meeting, September 1999 (Oral presentation).

77. *Hong Hua, Y. Wang, D. He. “3-D sound techniques in virtual reality,” Transaction on Chinagraph’96, Publishing House of Electronic Industry, pp. 313-319, September 1996.

78. *D. He, Y. Wang, X. Yuan, Hong Hua. “Design of viewing lens used in head-mounted-display system,” Transaction on Chinagraph’96, Publishing House of Electronic Industry, pp. 308-312, September 1996.

79. *Y. Wang, X. Yuan, D. He, Hong Hua. “Design of viewing lens for virtual reality,” Proc. Of SPIE Vol. 2778, pp.71-72, 1996.

80. *D. He, T. Xu, Y. Wang, Hong Hua. “Head-mounted-display system for virtual reality,” Proc. Of SPIE Vol. 2892, pp.126-128, 1996.

81. *D. He, Y. Wang, Hong Hua. “Prototyping techniques: the application of virtual reality in manufacturing,” Proceedings of Ninth CAD & Computer Graphics of China, pp.561-567, 1996.


8

_______________________________________________________________________________ Patents and Patent Applications 1. Hong Hua and Sheng Liu, “Design of optical see-through head-mounted display with addressable focal

planes,” Provisional Patent Application, University of Arizona, September 2008. 2. Hong Hua and Rui Zhang, “Design of a polarized head-mounted projection display using FLCoS

microdisplay,” Provisional Patent Application, University of Arizona, January 2008. 3. Hong Hua, “Ultra-bright optical see-through head-mounted displays using polarization,” United States

Patent Application, University of Arizona, January 2008. 4. C. Gao, Hong Hua, and N. Ahuja, “Apparatus and method of acquiring uniform-resolution panoramic

images,” United States Patent 6,809,887 B1, October 2004. 5. Hong Hua and J. P. Rolland, “Compact lens-assembly for the teleportal augmented reality system,” US

Patent 6,731,734 B1, May 2004. _______________________________________________________________________________ Grants and Contracts Federal Grant Awards 1. National Science Foundation / Information and Intelligent Systems, “CAREER: Development of a

heterogeneous display environment to support complex data visualization” Award number: 06-44446 Funding period: 2007-2012 Funding amount: $500,001 Role: PI (Single PI award) Percent of effort: 100%

2. National Science Foundation / Information and Intelligent Systems, “Development and assessment of a polarized head mounted projective display technology”

Award number: 05-34777 Funding period: 2005-2008 Funding amount: $310,047 Role: PI (Single-PI award) Percent of effort: 100%

3. National Science Foundation / Information and Intelligent Systems, “IIS/HCI: Collaborative Research: Development and assessment of head-mounted fovea-contingent display technology”

Award number: 04-11578 Funding period: 2003-2007 Funding amount: $375,818 out of $750,000 total budget ($375,000 was awarded to University of

Central Florida) Role: PI Percent of effort: 50%

4. National Science Foundation / Information Technology Research (ITR), “IIS/HCI: Collaborative Research: Development of head-mounted projective display for distance collaborative environments”

Award number: 00-83037/04-17598 Funding period: 2000-2004 Funding amount: $294,857 out of $500,000 total budget ($200,000 was awarded to University of

Central Florida) Role: PI Percent of effort: 60%

5. Pending/Under Review, National Institute of Health, “A multi-focal plane 3D display platform with addressable focus cues for visual perception research,” submitted June 2008

Funding period: 2009-2011


9

Funding amount: $275,000 Role: PI (Co-Investigators: Elizabeth Krupinski and Jim Schwiegerling) Percent of effort: 85%

Private Foundations 6. Beckman Institute Research Grant, “Development of a head-mounted projective display for collaborative

environments” Founding source: Beckman Foundation Funding period: 2000-2002 Funding amount: $60,000 Role: PI Percent of effort: 100%

7. Beckman Institute Research Grant, “Design and integration of head-mounted display with eye tracking capability”

Founding source: Beckman Foundation Funding period: 2000-2001 Funding amount: $35,000 Role: PI Percent of effort: 100%

Other Grants 8. Faculty Travel Grant

Founding source: University of Arizona Funding period: October 2005 Funding amount: $750

_______________________________________________________________________________ Accuracy Statement This is a true and accurate statement of my activities and accomplishments. I understand that misrepresentation in securing promotion and tenure may lead to dismissal or suspension under ABOR Policy 6-201 J.1.b.

Candidate’s Signature: _______________________________ Date:_________________


10

_______________________________________________________________________________ Results from Selected Publications

Please refer to my CV for the publications cited in this section.

Vari-focal and Multi-focal Plane Head-Mounted Displays Existing stereoscopic display technologies commonly present a stereoscopic pair of perspective images at

a fixed focal distance to create 3D depth perception. Many psychophysical studies suggest that the fixed focal distance likely contributes to the perceived depth compression phenomena and visual fatigue when using stereoscopic displays. With my students, I recently explored an elegant method to design an HMD with addressable focal planes [28]. Figures 1 and 2 demonstrate the vari-focal capability in an optical-see through bench prototype. In Figure 1, a virtual torus was rendered at a 16cm distance from the viewer and the physical bar targets were placed at 16cm, 33cm, and 100cm, respectively. A camera was placed at the viewer’s eye position. The photos in Figures 1a through 1c were captured by focusing the camera on the three bar targets, respectively. In Figure 2, a virtual COKE can was rendered at a 40cm distance from the eye, mixing with two real cups placed at 40cm and 100cm away from the viewer, respectively. The photos in Figures 2a and 2b were captured by focusing the camera on the two real cups, respectively. The results on Figures 1 and 2 clearly demonstrated correct focus cues for the virtual objects.

Figure 1 A virtual torus was displayed at a 16cm depth in a vari-focal plane display prototype. The camera is

focused on the resolution targets placed at (a) 16cm; (b) 33cm; and (c) 100cm, respectively [28].

(a) (b)

Figure 2 A virtual COKE can is rendered at a 40cm depth in a vari-focal plane display prototype. It is realistically mixed with two real cups placed at a depth of 40cm and 100cm, respectively. The camera is

focused at the distance of (a) 40cm; and (b) 100cm, respectively [28].

We further investigated a time-multiplexed multi-focal plane approach to achieve the capability of rendering pseudo-correct focus cues for a volume of 3D objects [47]. Figure 3 demonstrates a dual-focal plane


11

implementation. Two virtual toruses, one at a depth of 100cm and the other at 16cm, were rendered in a time-multiplexed fashion in a 10ms time interval. The two photos were taken by focusing the camera at 16cm and 100cm, respectively. The results clearly demonstrated that the focus cues of the two virtual objects correctly match with those of the real objects.

(a) (b)

Figure 3 Two virtual toruses were at a depth of 16cm and 100cm, respectively, in a time-multiplexed dual-focal plane display prototype. The camera is focused at (a) 16cm; and (b) 100cm, respectively [47].

Head-Mounted Projection Display Head-mounted projection display (HMPD) offers the capabilities of designing wide field-of-view (FOV),

low distortion optical see-through HMDs and providing partially correct occlusion cues between computer-generated and real objects. I investigated a wide range of research topics to address the various challenges in designing compact display prototypes, including designing lightweight, high performance optical systems [4, 11, 18], developing compact helmet prototypes [4, 11, 42], investigating imaging characteristics and artifacts of retroreflective materials [6, 20, 46], assessing imaging quality of the display system, and addressing the issue of low luminous efficiency [4, 6, 11]. Figures 4 through 6 demonstrate three generations of prototype systems developed over the years. It is worth mentioning that the prototypes shown in Figures 5 and 6 [4, 11] demonstrated not only about three-times higher luminous efficiency than the first-generation prototype in Figure 4, but also significant improvements on image contrast and color reproduction[4]. The new designs open the door to the application of these information displays in scenarios where well-lit environments are required, such as in an operating room. Using these prototype systems, I have been developing 3D visualization systems (Figures 10 through 12 and Figure 14) to address the need for technologies capable of supporting complex data visualization tasks.


12

(a) (b) Figure 4 First-generation HMPD prototype: (a) optical system design [18] and (b) display prototype [42].

(a) (b)

Figure 5 Backlit AMLCD-based p-HMPD prototype: (a) optical system design and (b) display prototype [11].

(a) (b)

Figure 6 Reflective FLCoS-based p-HMPD prototype: (a) optical system design and (b) display prototype [4].

Eyetracking in Head-Mounted Displays The capability of accurately measuring the eye movements is one of the key enabling technologies for

achieving fovea-contingent information displays. To address the challenges of tracking eye movements in an HMD configuration, I have been developing methods and algorithms for accurate eye motion tracking in an HMD system. A comprehensive model was developed to simulate and optimize eye illumination schemes taking into account a range of human factors [8]. Figure 7 demonstrates a set of simulated eye images under two different illumination schemes, combining the effect of skin color difference and eye rotation angles. This

( )


13

model served as a foundation for the development of several eyetracking methods and algorithms [14, 45]. Figures 8 and 9 demonstrate two of the tracking methods I developed. In Figure 8, a dark pupil effect is created by four off-axis near infrared emitting diodes(IRED). The tracking algorithm extracts edge points from the pupil boundary and uses these points to fit an ellipse. The algorithm further extracts the four glint features formed through corneal reflection of the four illuminators and use them to compute a virtual glint. Combining the center of the fitted ellipse and the center of the virtual glint provides a more robust and accurate method of computing the gaze direction than other existing tracking method [14]. Figure 9 demonstrates a hybrid tracking method in which both the bright and dark pupil effects are utilized [45]. The eye is illuminated with two sets of IREDs —one on-axis and the other off-axis, which are synchronized separately with the even and odd fields of the camera (Figures 9a and 9b). The difference image (Figure. 9d) of the two fields is computed for pupil detection. This hybrid method offers the advantage of easy and robust pupil detection compared to methods using a bright or dark pupil image alone.

Input Illumination Caucasian Skin Color Black Skin Color

(a)

(b)

(c)

(d)

(e)

(f)

Figure 7 Example of simulated eye illuminations: (a) Simulated input illumination scheme; (b)-(c) Simulated eye images from input irradiance in (a), for zero eye rotation along with Caucasian skin (b), and 10o horizontal eye rotation combined with Black skin (c); (d) Simulated input illumination scheme; (e)-(f) Simulated eye images from input irradiance in (d), for 10o vertical eye rotation along with Caucasian skin

(e), and 10o diagonal eye rotation combined with Black skin (f).


14

(a) (b) Figure 8 Demonstration of a dark pupil tracking method: the dotted line is the fitted ellipse of the edge

points extracted from the pupil boundary; the white cross is the center of the fitted ellipse, and the red cross is the location of a virtual glint computed from the four real glints [14].

Figure 9 Demonstration of a hybrid tracking method: (a) even image field created by an on-axis IRED illuminator; (b) odd image field created by four off-axis IRED illuminators; (c) the entire image frame

combining the odd and even fields; (d) the difference image between the odd and even fields; (e) the tracked eye image with pupil and glint features extracted, in which the dotted line is the fitted ellipse of the edge

points extracted from the pupil boundary; the white cross is the center of the fitted ellipse, and the red cross is the location of a virtual glint computed from the four real glints [45].

SCAPE Visualization System and User Interfaces

Driven by the many technical challenges in effectively visualizing and interacting with heterogeneous datasets to support complex tasks, my group has developed an HMPD-based multi-scale, multi-perspective, collaborative augmented virtual environment—SCAPE [16, 17, 43]. The system is capable of visualizing a dataset simultaneously in multiple scales and perspectives. It further allows multiple users to concurrently view the environment from their individual perspectives. Figures 10a and 10b show the conceptual design and the physical construction of the SCAPE system. Figures 10c and 10d demonstrate sample views captured through the workbench and room displays, while Figure 11 demonstrate the tangible user interfaces [13, 31, 33]. Figure 12 shows an application of the SCAPE system for medical visualization.

(a)

(b) (c)

(d) (e)


15

Figure10 SCAPE: a multi-scale, multi-perspective collaborative augmented virtual environment: (a)

Conceptual simulation of SCAPE; (b) A prototype implementation; (c) A sample view through the workbench display; (d) A sample view through the surrounding wall display.

Figure 11 Tangible interaction techniques in SCAPE: (a)-(c) Physical props and interfaces; (d)-(f)

Augmented views of planar and cube-shape zoom lenses in 3D AVE; and (g) Sample views of an embedded planar lens with multi-functions (i.e. zoom, clip, and rendering-mode switch).


16

Figure 12 Application example of the SCAPE system in medical visualization

Foveated Imaging System

Conventional imaging techniques adopt a rectilinear sampling approach, where a finite number of pixels are spread evenly across an entire field of view (FOV). Consequently, their imaging capabilities are limited by an inherent tradeoff between the FOV and the resolving power. In contrast, a foveation technique, mimicking the human visual system, allocates the limited resources (e.g. a finite number of pixels or transmission bandwidth) as a function of foveal eccentricities, which can significantly simplify the optical and electronic designs and reduce the data throughput while the observer’s ability to see fine details is maintained over the whole FOV. My group developed a low-cost foveated imaging system [7] in which a wide visual field is captured with a dynamically embedded high-resolution fovea region. The peripheral sensor captures the context for target detection and tracking; the foveated sensor, with a resolution many magnitudes greater than the peripheral sensor, captures the fine details for target recognition and detail examination. Figure 13 shows an image captured by the system.

Figure 13 Example of a foveated imaging system [7]

_______________________________________________________________________________ Work in Progress Development of a Heterogeneous Display Environment to Support Complex Data Visualization

Under a recent NSF CAREER award (06-44446, Years 2007-2012), I have been developing a heterogeneous display environment that contains a large-scale immersive environment, a 2D/3D hybrid display in which a 3D display area is surrounded by a high resolution 2D tabletop display, and potentially various other 2D and 3D hand-held displays. The system is and will be integrated with an array of 2D and 3D user interaction techniques such as multi-touch sensing, hand gesture recognition, and TUI-based user interfaces. From the display perspective, this platform assists users in navigating and controlling their levels of immersion into the


17

digital realm. From the interaction perspective, the platform supports intuitive user interaction with both the physical and digital worlds through physical manipulation and gesture-based interaction metaphors. Furthermore, this platform provides a unique display environment for studying visualization and interaction techniques that are potentially capable of facilitating users’ ability to correlate and understand complex datasets as well as to support collaborative tasks. Figure 14 shows the conceptual design of the system (Fig. 14a), a prototype of the hybrid-WIM workbench display (Fig. 14b), the multi-touch 2D interface (Fig. 14c), and the application of the system for planetary science visualization (Fig. 14d). Working with my students, I am currently in the process of preparing a paper submission to IEEE Computer Graphics and Application to report the overall system design.

To support the design of the system interface, my student, Leonard Brown, recently completed a user study to evaluate the impact of physical affordance on user interaction in such display environment. We are in the process of preparing a paper submission to the International Journal of Human-Computer Studies to report our findings [48].

(a) (b)

(c) (d)

Figure14 Hybrid-SCAPE: a heterogeneous display environment: (a) Conceptual design; (b) Prototype implementation of a hybrid WIM display; (c) Multi-touch interface in the WIM display; (d) A sample view

through the WIM display for Mars exploration.

3D display 2D

HMPD

hua vitae TenureReview - University of Arizona Vitae Hong Hua 2 Scholarships Beckman Fellowship, Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign,

Documents