MAXIMUS FP7-ICT-2007-1-217039 Final Report MAXIMUS MAXimum fidelity Interactive Multi User display Systems Title: Final Report Version: 0.5 Deliverable type: Report Deliverable Number: D49 Workpackage: WP9 Contractual Date of Delivery: 31.08.2011 Actual Date of Delivery: 23.09.2011 Author(s): Thomas Gierlinger Reviewed by: Martin Ritz Approved by: Martin Ritz Date: 22.09.2011 Date: 23.09.2011 Date: 23.09.2011 Summary: This report presents the a publishable overview of the developments of the MAXIMUS project Responsible partner: Fraunhofer IGD File name: D49_Final_Report.doc Distribution list: Consortium and Project Officer Final Report
46
Embed
D49 Final Report 20110923 - CORDIScordis.europa.eu/docs/projects/cnect/9/217039/080/reports/001-D49... · fall-back to PRT only lighting or even OpenGL local lighting. This of course
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Contextual menus (see Figure 31) provide access to functionality that is specific to an
object or a light. A contextual menu is open by clicking on top of a object Figure 32
shows a change of color using the contextual menu, the user executed the following
steps:
1. Move the cursor to the chassis
2. Click on any button to open up the contextual menu. This will open the chassis
contextual menu
3. Click on the yellow color
The Contextual Menu provides the following functionality:
Reset. Reset the object to the original settings.
Lock / Unlock Prevents the user from making changes to the object. (it creates a lock
anchor)
Show/hide It shows/hides all objects in the scene. (it creates a show anchor)
Light Intensity Only available in lights, changes the light intensity.
Color Only available in objects, changes the object color.
2.5.2.4. Anchors
Whenever a object or light is locked or hidden the system creates a icon that gives the
user feedback on the state of that object. This is particularly relevant for hidden objects,
that are otherwise invisible when hidden. Figure 33 shows the icons for lock and hidden
objects. A user can click on the icon to remove the restrictions.
2.5.2.5. Interaction Modes
The prototype supports two interaction modes: navigation and manipulation(See Figure
34). User can change interaction modes by clicking on the top left button (see Figure
28).
Fig 32: The user changes the chassis color from red to yellow using contextual menu
MAXIMUS FP7-ICT-2007-1-217039 Final Report
26
Navigation
Navigation is the default interaction mode. It is used to visualize an object, zoom on
specific object parts and rotate the scene. The input device configuration for the
navigation interaction mode is as follows:
Right Button: hold the button and point to pan. Hold the right button and move the
device closer to the display to zoom. The zoom is focused on the cursor position. Thus,
if the cursor is position on top of a wheel and zoom is activated, the active scene will
focus on the wheel.
Left Button: hold the button and point to move the camera around the object
Click any button to open a contextual menu
Fig 34: Interaction Mode icons, the system shows the active mode on top left.
Manipulation
Manipulation is a secondary interaction mode that allows objects to be moved and
rotated. This mode can move specific object parts (if the model allows it). It is possible,
for example, to move the hood of a car to check the engine. The input device
configuration for the navigation interaction mode is as follows:
Right Button: hold the button and point, or hold and move the device closer to/away
from the display, to translate an object in the three axis.
Fig 33: Examples of Anchor. The tire is hidden and the chassis is locked. Right: Icons used for each anchor.
MAXIMUS FP7-ICT-2007-1-217039 Final Report
27
Left Button: hold the button and point to rotate the object
Click any button to open a contextual menu
Examine
Examine helps users inspect object details, by hiding every object except the target.
When this mode is activated rotation commands, revolve around the object instead of a
fixed scene point. Selecting another mode unhides all objects and rotates the target to
the original position.
The input device configuration for the navigation interaction mode is as follows:
Right Button: hold the button and point, or hold and move the device closer to/away
from the display, to zoom the object.
Left Button: hold the button and point to rotate the object (examine around a center
point)
Click any button to open a contextual menu
2.5.2.6. Alternative Views
According to user requirements, it should be possible to quickly change camera
position. As such, an after consulting with the users we provide a list of alternative
views on the bottom of the display. This list provides both orthogonal and perspective
views and allows users to jump from one view to another. Users can not configure
these views, but they are updated whenever there is a change in object (such as
translating an object or changing a color). Figure 35 shows the list of alternative views.
Fig 35: Alternative view list. The system provides five orthogonal views and three perspective views.
MAXIMUS FP7-ICT-2007-1-217039 Final Report
28
3. USE AND DISSEMINATION OF FOREGROUND
3.1. Public events
An entry in the table below indicates a presentation on a conference or other public event, with recordings or proceedings of this presentation,
open to the public.
Audience
(type + size) Event
Type of
dissemin
ation
action
Involved
partner Reference Result/outcome vs. purpose
Web Continuous Public
website
All, lead
by GCU
www.maximus-fp7.eu
A publically available website has been established,
containing information on the project, the objectives, the
consortium members, etc… It also includes latest news, i.e.
about realizations in the project.
RTT
Conference,
Milan, June
2008
Oral
presentati
on
Italdesign
Giugiaro
“Dal bozetto alla verifica
virtuale: stato dell’arte e
prospettive” Luca Jozzo
(“From the sketch to the virtual validation: state of the art and perspectives”)
Italdesign Giugiaro gave a presentation about the styling
process current procedures, limits, requirements and future
developments. During the presentation, a brief explanation
of the MAXIMUS project was given, highlighting the project
objectives and innovative approach
R&D Display
experts – (ca.
300 people in
room)
SID
International
Symposium
2008
June 2008
Oral
presentati
on +
technical
digest
BARCO Challenges and Technologies
for Multi-Channel Projection
Systems. P. Vandenberghe, B.
Maximus, SID International
Symposium, Digest of Technical
Papers, Volume XXXIX, Book I,
The Barco publication explains a.o. topics the concept of the
dimming systems to obtain a high dynamic range (HDR)
display. Such dimming systems have a higher potential to be
applied to higher brightness projectors than other systems.
The purpose of the paper and presentation was to inform the
display community and advertize this concept as an efficient
MAXIMUS FP7-ICT-2007-1-217039 Final Report
29
pp. 167-170
http://link.aip.org/link/?DTPSD
S/39/167/1
way to achieve HDR in projection without a light output
penalty, acknowledging the support of EC in this field
through the MAXIMUS project.
CHI’09, April,
Boston, USA,
2009, ACM.
Oral
presentati
on
INESC ID A Comparative Study of
Interaction Metaphors for
Large-Scale Displays. Ricardo
Jota, João M. Pereira and
Joaquim A. Jorge
Interaction with the squeezy ball requires us to research
human factors related to (1) the ergonomy of the device and
(2) interaction techniques that best fit the device. The paper
presented at CHI presents our first results on interaction
techniques for the squeezy ball. This paper corrabolates our
choices in the Maximus first prototype regarding interaction
techniques applied to the squeezy ball.
Light + Building
2008, April
2008 -
International
Trade Fair for
Architecture
and
Technology;
Presence
at trade
fair
IGD http://light-
building.messefrankfurt.com/fran
kfurt/en/home.html
An extended version of the IMPROVE renderer was
demonstrated and information on MAXIMUS was distributed.
This was the first time this fair was attended by Fraunhofer-
IGD and it became clear that the participants are relevant for
MAXIMUS (architects and lighting designers), so there will
also a visit to the next fair in 2010 (it's a 2 years cycle)
Computer
Graphics
Community
SIGGRAPH
2008 and
IPT/EDT 2008
Conferen
ce
exhibition
IGD Poster and short paper in the co-
located Immersive Projection
Technologies / Emerging Display
Technologies Workshop
Fraunhofer has been at SIGGRAPH 2008 where the results
of the IMPROVE project were shown as a poster and via a
short paper. Although the focus was on IMPROVE, also
information about the MAXIMUS project was provided
17th EPCG,
Portugal, 2009
INESC-IDDispositivo de Interacção para Ecrã de Grandes Dimensões, B. de Araújo, R. Jota, J. Fernandes, A. Ferreira e J.A.Madeiras Pereira, Actas do 17º Encontro Português de Computação Gráfica (17º EPCG), Covihã, Portugal, Outubro 2009
MAXIMUS FP7-ICT-2007-1-217039 Final Report
30
Computer
Graphics
Community
SIGGRAPH
Asia 2009
Conferen
ce,
dissemin
ation
IGD Santos, Pedro; Schmedt,
Hendrik; Hohmann, Sebastian;
Stork, André: The Hybrid
Outdoor Tracking Extension
for the Daylight Blocker
Display. In: Inakage, Masa
(Hrsg.); ACM SIGGRAPH:
Siggraph Asia 2009. Full
Conference DVD-ROM. New
York : ACM Press, 2009, 1 p.
Presentation of Daylight blocking HMD and marker-less
tracking plus sensor fusion. Dissemination of current
MAXIMUS project through flyer along poster presentation on
related technologies
Computer
Graphics
Community
Journal of Real-
Time Image
Processing,
Special Issue
IGD T. Gierlinger, D. Danch, A. Stork,
'Rendering techniques for
mixed reality', DOI
10.1007/s11554-009-0137-x
Invited by Mr. Carlsohn
R&D
institutes and
technology
companies
Innovation
Days 2009
Demo INESC-ID
Participation at “Innovation Days 2009”: a technology fair in
Lisbon which gathers R&D institutes and technology-based
companies. In this event INESC-ID showed the first
prototype of the multi-touch surface developed within the
MAXIMUS project.
Computer
Graphics
Community
IEEE VR2010 Conferen
ce,
Research
demo
IGD P. Santos, T. Gierlinger, H.
Schmedt, O.Machui, A. Stork,
'The ultimate display – yet
another try', Research Demo,
IEEE VR2010, March 20-24,
Boston, USA
Showing a combination of the IMPROVE Daylight blocker
display using the MAXIMUS rendering component and HDR
acquisition
Computer
Graphics
Community
SIMAUD 2010 Conferen
ce, Full
paper
IGD P. Santos, D. Acri, T. Gierlinger, H. Schmedt, 'Supporting Outdoor Mixed Reality Applications for Architecture and Cultural Heritage',
Showing the technological evolution along three European
research projects: IMPROVE, CINeSPACE and present
MAXIMUS project.
MAXIMUS FP7-ICT-2007-1-217039 Final Report
31
Symposium on Simulation for Architecture and Urban Design at the 2010 Spring Simulation Multiconference, SIMAUD 2010, Orlando, FL, USA
First contact to Autodesk RTD was established.
Computer
Graphics
Community
Symposium on
Virtual and
Augmented
Reality 2010,
Brasil, May 24-
27, 2010
IGD Open CL vs. CUDA for ray
tracing, R. Huff, T. Neves, T.
Gierlinger, A. Storck, A. Kuijper,
and D. Fellner, Symposium on
Virtual and Augmented Reality
2010 – SVR2010, 4p, 2010
Computer
Graphics
Community
CGI’10
Singapore,
June 8-11,
2010
IGD A general two-level
acceleration structure for
interactive ray tracing on the
gpu, R. Huff, T. Neves, T.
Gierlinger, A. Storck, A. Kuijper
and D. Fellner, Computer
Graphics International 2010 –
CGI 2010, SP19-1—SP19-4,
2010
Computer
Graphics
Community
SIGGRAPH
2010
July 2010
Poster IGD A Full HDR Pipeline from
Acquisistion to Projection, by
P. Santos, T. Gierlinger, R. Huff,
M. Ritz, and A. Stork, ACM
SIGGRAPH 2010, Los Angeles,
USA
MAXIMUS FP7-ICT-2007-1-217039 Final Report
32
Computer
Graphics
Community
Graphics
Interface 2010
INESC-IDA Comparison of Ray Pointing Techniques for Very Large Displays, Jota, R., Nacenta, M.A., Jorge, J.A., Carpendale, S. and Greenberg, S. To be published in Graphics Interface 2010, May 31 to June 2, Ottawa, Ontario, Canada
Cultural
Heritage
Community
VAST’10
France,
September
2010
IGD High Resolution Acquisition of Detailed Surfaces with Lens-Shifted Structured Light, M. Ritz, M. Scholz, M. Goesele, A. Storck, VAST10: The 11th International Symposium on Virtual Reality, Archaeology and Intelligent Cultural Heritage, 2010. Full papers: 1-8
Display R&D
community
(ca. 100
persons)
SID
International
Display
Workshops
2010
Dec. 2010
Oral
presentati
on and
proceedin
gs
BARCO High Resolutions Projection
Systems with High Dynamic
Range Capabilities, B.
Maximus, P. Candry and H.
Nakano, Proceedings of the 17th
International Display Workshops,
Vol. 2, pp. 1483-1486.
http://www.idw.ne.jp/10record.ht
ml
Barco presented a new method to determine the bitdepth
required to display and process HDR images, based on the
visibility of contouring artifacts. The objective was to
demonstrate the Barco knowledge on HDR image
processing and to indicate the quality of the HDR image
processing and reproduction in the Barco (LCOS) projector
platforms.
Symposium on
Virtual and
Augmented
Reailty
Brasil, 23-23
May 2011
IGD A comparison of xpu platforms
exemplified with ray tracing
algorithms, R. Huff, T.
Gierlinger, A. Kuijper, A. Storck,
and D. fellner, Symposium on
Virtual and Augmented Reality
2011 – SVR2011, pp. 1-8, IEEE,
MAXIMUS FP7-ICT-2007-1-217039 Final Report
33
2011
Simulation -
Training
community &
customers
Image
Conference
2011
June 2011
Oral
presentati
on and
proceedin
gs
BARCO Aspects of High Dynamic
Range Imaging on High
Resolution Projection
Systems, B. Maximus, Proceed-
ings of the Image 2011
Conference, Scottsdale USA, 6-9
June 2011
Barco presented the aspects of HDR imaging that has to be
taken into account in immersive systems to the Training
community (flight simulators, etc…). The requirements are
very similar to the V&AR applications where the MAXIMUS
project is more focused on. The aspects discussed are the
chosen HDR strategy via dimming, the impact of projector
and system contrast ratio, and the processing bitdepth
requirements.
Architects
and architect
students (ca.
30)
Showcase
event at Glas-
gow Caledo-
nian University
14 June, 2011
Project
presenta-
tion and
demo of
prototype
GCU,
INESC-
ID, and
other
partners
See also report on:
http://www.maximus-
fp7.eu/index.html#
The objective was to present the project in a first session,
and to collect feedback on the prototype from the demos in a
second session.
Computer
Graphics
Community
SIGGRAPH
2011
11 Aug, 2011
Talk Spheron Next-Generation Image Based
Lighting Using HDR Video, J.
Unger, S. Gustavson, J.
Kronander, G. Bonnet*, G.
Kaiser*. (* = Spheron)
http://www.siggraph.org/s2011/
for_attendees/talks/sessions/1
73
The figure above depicts a rendering-result based on a
spatially resolved HDR acquisition (more than only one
HDR-sphere has been acquired) which results in better
o Articles in Caledonian Outlook magazine, Scotsman newspaper.
MAXIMUS FP7-ICT-2007-1-217039 Final Report
39
4. REPORT ON SOCIETAL IMPLICATIONS
A General Information (completed automatically when Grant Agreement number is entered.
Grant Agreement Number:
Title of Project:
Name and Title of Coordinator:
B Ethics
1. Did your project undergo an Ethics Review (and/or Screening)?
If Yes: have you described the progress of compliance with the relevant Ethics Review/Screening Requirements in the frame of the periodic/final project reports?
Special Reminder: the progress of compliance with the Ethics Review/Screening Requirements
should be described in the Period/Final Project Reports under the Section 3.2.2 'Work Progress
and Achievements'
No
2. Please indicate whether your project involved any of the following issues
(tick box) :
YES
RESEARCH ON HUMANS
Did the project involve children?
Did the project involve patients?
Did the project involve persons not able to give consent?
Did the project involve adult healthy volunteers?
Did the project involve Human genetic material?
Did the project involve Human biological samples?
Did the project involve Human data collection?
RESEARCH ON HUMAN EMBRYO/FOETUS
Did the project involve Human Embryos?
Did the project involve Human Foetal Tissue / Cells?
Did the project involve Human Embryonic Stem Cells (hESCs)?
Did the project on human Embryonic Stem Cells involve cells in culture?
MAXIMUS FP7-ICT-2007-1-217039 Final Report
40
Did the project on human Embryonic Stem Cells involve the derivation of cells from Embryos?
PRIVACY
Did the project involve processing of genetic information or personal data (eg. health, sexual lifestyle, ethnicity, political opinion, religious or philosophical conviction)?
Did the project involve tracking the location or observation of people?
RESEARCH ON ANIMALS
Did the project involve research on animals?
Were those animals transgenic small laboratory animals?
Were those animals transgenic farm animals?
Were those animals cloned farm animals?
Were those animals non-human primates?
RESEARCH INVOLVING DEVELOPING COUNTRIES
Did the project involve the use of local resources (genetic, animal, plant etc)?
Was the project of benefit to local community (capacity building, access to healthcare, education etc)?
DUAL USE
Research having direct military use 0 Yes 0
No
Research having the potential for terrorist abuse
C Workforce Statistics
3. Workforce statistics for the project: Please indicate in the table below the number of people who worked on the project (on a headcount basis).
Type of Position Number of Women Number of Men
Scientific Coordinator
Work package leaders
Experienced researchers (i.e. PhD holders)
PhD Students
Other
4. How many additional researchers (in companies and universities) were recruited specifically for this project?
Of which, indicate the number of men:
MAXIMUS FP7-ICT-2007-1-217039 Final Report
41
D Gender Aspects 5. Did you carry out specific Gender Equality Actions under the project?
x
Yes No
6. Which of the following actions did you carry out and how effective were they? Not at all
effective Very
effective
Design and implement an equal opportunity policy Set targets to achieve a gender balance in the workforce Organise conferences and workshops on gender Actions to improve work-life balance Other:
7. Was there a gender dimension associated with the research content – i.e. wherever people were the focus of the research as, for example, consumers, users, patients or in trials, was the issue of gender considered and addressed?
Yes- please specify
No
E Synergies with Science Education
8. Did your project involve working with students and/or school pupils (e.g. open days, participation in science festivals and events, prizes/competitions or joint projects)?
Yes- please specify
x No
9. Did the project generate any science education material (e.g. kits, websites, explanatory booklets, DVDs)?
Yes- please specify
x No
F Interdisciplinarity
10. Which disciplines (see list below) are involved in your project? Main discipline1: Associated discipline1: Associated discipline1:
G Engaging with Civil society and policy makers
11a Did your project engage with societal actors beyond the research community? (if 'No', go to Question 14)
Yes No
1 Insert number from list below (Frascati Manual).
MAXIMUS FP7-ICT-2007-1-217039 Final Report
42
11b If yes, did you engage with citizens (citizens' panels / juries) or organised civil society (NGOs, patients' groups etc.)?
No Yes- in determining what research should be performed Yes - in implementing the research Yes, in communicating /disseminating / using the results of the project
11c In doing so, did your project involve actors whose role is mainly to organise the dialogue with citizens and organised civil society (e.g. professional mediator; communication company, science museums)?
Yes No
12. Did you engage with government / public bodies or policy makers (including international organisations)
No Yes- in framing the research agenda Yes - in implementing the research agenda
Yes, in communicating /disseminating / using the results of the project
13a Will the project generate outputs (expertise or scientific advice) which could be used by policy makers?
Yes – as a primary objective (please indicate areas below- multiple answers possible) Yes – as a secondary objective (please indicate areas below - multiple answer possible) No
13b If Yes, in which fields?
Agriculture
Audiovisual and Media
Budget
Competition
Consumers
Culture
Customs
Development Economic and
Monetary Affairs
Education, Training, Youth
Employment and Social Affairs
Energy
Enlargement
Enterprise
Environment
External Relations
External Trade
Fisheries and Maritime Affairs
Food Safety
Foreign and Security Policy
Fraud
Humanitarian aid
Human rights
Information Society
Institutional affairs
Internal Market
Justice, freedom and security
Public Health
Regional Policy
Research and Innovation
Space
Taxation
Transport
MAXIMUS FP7-ICT-2007-1-217039 Final Report
43
13c If Yes, at which level? Local / regional levels National level European level International level
H Use and dissemination
14. How many Articles were published/accepted for publication in peer-reviewed journals?
To how many of these is open access2 provided?
How many of these are published in open access journals?
How many of these are published in open repositories?
To how many of these is open access not provided?
Please check all applicable reasons for not providing open access:
publisher's licensing agreement would not permit publishing in a repository no suitable repository available no suitable open access journal available no funds available to publish in an open access journal lack of time and resources lack of information on open access other3: ……………
15. How many new patent applications (‘priority filings’) have been made? ("Technologically unique": multiple applications for the same invention in different jurisdictions should be counted as just one application of grant).
16. Indicate how many of the following Intellectual Property Rights were applied for (give number in each box).
Trademark
Registered design
Other
17. How many spin-off companies were created / are planned as a direct result of the project?
Indicate the approximate number of additional jobs in these companies:
18. Please indicate whether your project has a potential impact on employment, in comparison with the situation before your project:
Increase in employment, or In small & medium-sized enterprises Safeguard employment, or In large companies Decrease in employment, None of the above / not relevant to the project
2 Open Access is defined as free of charge access for anyone via Internet. 3 For instance: classification for security project.
MAXIMUS FP7-ICT-2007-1-217039 Final Report
44
Difficult to estimate / not possible to quantify
19. For your project partnership please estimate the employment effect
resulting directly from your participation in Full Time Equivalent (FTE = one person working fulltime for a year) jobs:
Difficult to estimate / not possible to quantify
Indicate figure:
I Media and Communication to the general public
20. As part of the project, were any of the beneficiaries professionals in communication or media relations?
Yes No
21. As part of the project, have any beneficiaries received professional media / communication training / advice to improve communication with the general public?
Yes No
22 Which of the following have been used to communicate information about your project to the general public, or have resulted from your project?
Press Release Coverage in specialist press Media briefing Coverage in general (non-specialist) press TV coverage / report Coverage in national press Radio coverage / report Coverage in international press Brochures /posters / flyers Website for the general public / internet DVD /Film /Multimedia Event targeting general public (festival, conference,
exhibition, science café)
23 In which languages are the information products for the general public produced?
Language of the coordinator English Other language(s)
Question F-10: Classification of Scientific Disciplines according to the Frascati Manual 2002
(Proposed Standard Practice for Surveys on Research and Experimental Development, OECD
2002):
FIELDS OF SCIENCE AND TECHNOLOGY
1. NATURAL SCIENCES
MAXIMUS FP7-ICT-2007-1-217039 Final Report
45
1.1 Mathematics and computer sciences [mathematics and other allied fields: computer
sciences and other allied subjects (software development only; hardware development
should be classified in the engineering fields)]
1.2 Physical sciences (astronomy and space sciences, physics and other allied subjects)
1.3 Chemical sciences (chemistry, other allied subjects)
1.4 Earth and related environmental sciences (geology, geophysics, mineralogy, physical
geography and other geosciences, meteorology and other atmospheric sciences
including climatic research, oceanography, vulcanology, palaeoecology, other allied