Final Evaluation of the ARTEMIS and ENIAC Joint ...Annex 1 References [1] James Manyika, Michael Chui, Peter Bisson, Jonathan Woetzel, Richard Dobbs, Jacques Bughin, Dan Aharon, ^The

FR

Digital

Single Market

Final Evaluation of the

ARTEMIS and ENIAC Joint Undertaking (2008-2013)

Operating under FP7

ANNEXES A report prepared for the European Commission

DG Communications Networks, Content & Technology by

Haydn Thompson, Rapporteur

Expert group Emilio Lora-Tamayo, Chairman

Werner Damm

Jean-Luc Dormoy Leonard Hobbs

Margriet Jansz Tomasz Kosmider

Wolfgang Pribyl

June 2017

2

DISCLAIMER

By the European Commission, Directorate-General of Communications Networks, Content & Technology.

The information and views set out in this publication are those of the author(s) and do not necessarily reflect the

official opinion of the Commission. The Commission does not guarantee the accuracy of the data included in this

study. Neither the Commission nor any person acting on the Commission’s behalf may be held responsible for

the use which may be made of the information contained therein.

ISBN 978-92-79-69635-0 doi:10.2759/540926

Copyright © 2017 – European Union. All rights reserved. Certain parts are licensed under conditions to the EU.

Reproduction is authorised provided the source is acknowledged.

3

4

Table of Contents

ANNEX 1 REFERENCES ................................................................................ 5

ANNEX 2 EXPERT PANEL COMPOSITION ..................................................... 8

ANNEX 3 ABBREVIATIONS ........................................................................ 12

ANNEX 4 INFORMATION SOURCES USED .................................................................. 14

ANNEX 5 INTERVIEWEES ................................................................................................. 15

5

ANNEXES

Annex 1 References

[1] James Manyika, Michael Chui, Peter Bisson, Jonathan Woetzel, Richard Dobbs, Jacques Bughin, Dan Aharon, “The Internet of Things: Mapping the value Beyond the Hype”, McKinsey Global Institute, June 2015.

[2] H. Thompson, “Market Opportunities for CPS”, THHINK, 2017.

[3] Peter Evans and Marco Annunziata, “Industrial Internet: Pushing the Boundaries of Minds and Machines”, GE, November 26, 2012.

[4] Henning Kagermann, Wolfgang Wahlster and Johannes Helbig, “Recommendations for implementing the strategic initiative INDUSTRIE 4.0”, ACATECH Report, National Academy of Science and Engineering, Germany, April 2013.

[5] https://ec.europa.eu/digital-single-market/en/digitising-european-industry

[6] http://www.semi.org/en/fab-investment-surge-china-0

[7]https://obamawhitehouse.archives.gov/sites/default/files/microsites/ostp/PCAST/pcast_ensuring_long-term_us_leadership_in_semiconductors.pdf

[8] https://www.artemis-ju.eu/

[9] http://www.eniac.eu/

[10] https://ec.europa.eu/research/fp7/index_en.cfm

[11] Report “First Interim Evaluation of the ARTEMIS and ENIAC Joint Technology Initiatives”, 30/7/2010 http://ec.europa.eu/dgs/information_society/evaluation/rtd/jti/

[12] Report “Second Interim Evaluation of the ARTEMIS and ENIAC Joint Technology Initiatives”, 30/5/2013 http://ec.europa.eu/dgs/information_society/evaluation/rtd/jti/

[13] http://ec.europa.eu/growth/industry/key-enabling-technologies/european-strategy/high-level-group/

[14] http://www.acatech.de/de/projekte/abgeschlossene-projekte/industrie-40.html

[15] http://www.theinternetofthings.eu/

[16] www.ecsel-ju.eu

[17] https://ec.europa.eu/programmes/horizon2020/

[18] http://ec.europa.eu/research/jti/

[19]http://www.lisbon-treaty.org/wcm/the-lisbon-treaty/treaty-on-the-functioning-of-the-european-union-and-comments/part-3-union-policies-and-internal-actions/title-xix-research-and-technological-development-and-space/475-article-187.html

[20] https://openlaws.com/detail/54897238-5d33-4796-88f1-428fed0cbc7c/en/SINGLE

[21] Council Regulation 74/2008

[22] Council Regulation 72/2008

[23] https://itea3.org/

6

[24] http://www.catrene.org/

[25] http://www.consilium.europa.eu/uedocs/cms_data/docs/pressdata/en/intm/142505.pdf

[26] https://publications.europa.eu/en/publication-detail/-/publication/d18360b6-5a8e-4c70-8692-cac0d3e5346e/language-en

[27] http://cordis.europa.eu/pub/ist/docs/artemis/june_sra.pdf

[28]http://ec.europa.eu/information_society/newsroom/image/document/2016-19/sra2016_15445.pdf

[29] http://www.eurekanetwork.org/

[30] Decision of the Governing Board of the ARTEMIS Joint Undertaking Approving the Multi-Annual Strategic Plan and Research Agenda for 2013, ARTEMIS-GB-2012-D.46, 2013.

[31] http://www.europarl.europa.eu/summits/lis1_en.htm

[32] https://ec.europa.eu/research/jti/pdf/councilreg_eniac.pdf

[33] http://www.aeneas-office.eu/web/documents/SRA.php

[34] http://www.eniac.eu/web/downloads/SRA2007.pdf

[35] https://www.autosar.org/

[36] Terms of Reference for an Expert Group on the Final Evaluation of the ENIAC and ARTEMIS Joint Undertaking (2008-2016) operating under the Seventh Framework Programme and the Interim Evaluation of the ECSEL Joint Undertaking (2014-2016) operating under Horizon 2020 [Ares(2016)4919318 - 01/09/2016]

[37] Support study for the Evaluation of ENIAC/ARTEMIS/ECSEL JU, CARSA, Feb. 2017, CARSA.

[38] ARTEMIS Annual Activity Report 2013

[39] ARTEMIS Annual Activity Report 2012

[40] ARTEMIS Business Impact 2015

[41] 2015 ECSEL Activity Report

[42] Second Interim Review of the ARTEMIS and ENIAC JTIs

[43] European Commission Report to European Parliament on ARTEMIS and ENIAC Evaluation, 2013, p.7.

[44] ENIAC Annual Activity Report 2013

[45] ENIAC MASP 2010

[46] ENIAC Annual Activity Report 2012

[47] ECSEL Programme Impact Document 2014

[48] ARTEMIS Business Impact, 2015

[49] https://artemis-ia.eu/project/9-sysmodel.html

[50] https://artemis-ia.eu/project/22-pshield.html

[51] https://artemis-ia.eu/project/17-chiron.html

[52] https://artemis-ia.eu/project/31-high-profile.html

[53] https://artemis-ia.eu/project/1-cesar.html

[54] https://ec.europa.eu/inea/en/ten-t/ten-t-projects

7

[55] https://artemis-ia.eu/project/56-emc2.html

[56] http://www.crystal-artemis.eu/

[57] http://www.arrowhead.eu/

[58] ECSEL JU Impact Analysis Study 2016

[59] https://cordis.europa.eu/pub/ist/docs/eniac/strategic_research_agenda_full.pdf

[60] Interim Evaluation of the ECSEL JU 2017

[61] http://www.euripides-eureka.eu/

[62]https://ec.europa.eu/programmes/horizon2020/en/h2020-section/smart-cyber-physical-systems

[63] http://www.silicon-europe.eu/home/

[64] http://www.silicon-saxony.de/en/home/

[65] http://www.minalogic.com/en

[66] http://www.dspvalley.com/

[67] https://nmi.org.uk/

[68] http://www.gaia.es/english.html

[69] http://www.hightechnl.nl/international

[70] http://www.semi.org/eu/

[71] http://www.penta-eureka.eu/

[72] https://ec.europa.eu/digital-single-market/en/digitising-european-industry

[73]http://ec.europa.eu/research/participants/data/ref/h2020/wp/2016_2017/main/h2020-wp1617-intro_en.pdf

[74] http://ertico.com/projects/c-its/

[75] https://www.fiware.org/

[76] https://ec.europa.eu/digital-single-market/en/big-data-value-public-private-partnership

[77] http://ec.europa.eu/research/industrial_technologies/factories-of-the-future_en.html

[78] http://www.spire2030.eu/

[79] http://www.cleansky.eu/

8

Annex 2 Expert Panel Composition

Emilio Lora-Tamayo, Chair

PhD degree in Physics by the UCM. He has been a researcher at different centers in France and visiting professor at UC Berkeley. Professor at the UAB. At CSIC he has been Director of the Centro Nacional de Microelectrónica, vicepresident and also President of CSIC between 1996-2002 and 2002-2004.

Emilio Lora-Tamayo (Madrid, 1950) has worked in CSIC since 1975. In 2003, being President, Emilio Lora-Tamayo initiated the change on the legal structure of CSIC, formerly a Public Research Organism, that ended on the creation of the Agencia Estatal de Investigación CSIC. On January 13th 2012 the Spanish Council of Ministers designated him once again as CSIC President, where he remains as for 2017.

After achieving his graduation in Physics in 1972, he was awarded the Diplôme d’Études Approfondies at the Université Paul Sabatier (Toulouse, 1973). He obtained the PhD degree in Physics by the Universidad Complutense (Madrid, 1977). Since 1989, he is Full Professor of Electronics at the Universidad Autónoma de Barcelona. He has been researcher at the Ècole Nationale Supérieure d’Aéronautique et de l’Espace (Toulouse, France), at the ENSAE and the Laboratoire d’Automatique et ses Aplications Spatiales (Toulouse, France) and at the Laboratoire d’Electronique et de l’Informatique (CEA-Grenoble, France). He has been visiting professor at the Electrical Engineering and Computer Sciences Department at UC Berkeley (United States).

He has been Director of the Instituto de Microelectrónica de Barcelona-Centro Nacional de Microelectrónica (IMB-CNM) and of the associated “Integrated Micro and Nanofabrication Clean Room”. He has also coordinated the Barcelona Nanocluster at Bellaterra (BCN-b).

His expertise is Microelectronics and Nanotechnology covering aspects of Physics and technology of semiconductors and microchips, simulation and design of silicon microdevices and chips, Micro and Nanosystems (MEMS & NEMS), nanofabrication and CNTs. He is the author of more than 100 research articles in peer reviewed scientific journals, and more than 150 communications at scientific meetings. He is coauthor of 7 patents and has written 12 books on this subject. He has been the coordinator or participated in more than 50 national or international research projects. He was the president of the scientific committee to assess and repair the damages caused by the “Prestige” oil spill (2002-2003).

He is a full member of the Real Academia de Ciencias y Artes de Barcelona, a corresponding member of the Real Academia de Medicina y Cirugía de Cádiz and of the Real Academia de San Dionisio de Artes y Ciencias de Jerez de la Frontera. He has been awarded with the Encomienda de número de la Orden del Mérito Civil and several CSIC awards.

Haydn Thompson, Rapporteur

Professor Haydn Thompson, BSc, PhD. CEng has over 30 years’ experience working in a mixture of senior industrial research and development roles in flight control systems, space programmes and signal processing applications for leading companies. For nearly 20 years he was the Programme Manager of the Rolls-Royce Control and Systems University Technology Centre. Currently he is CEO and Owner of the THHINK Group of Companies: THHINK Wireless Technologies Ltd. (UK), THHINK B.V. (NL), THHINK Autonomous Systems Pty. (Aus) and is a Director of THHINK Wireless Technologies Japan Ltd. as well as being Managing Director and Owner of Haydn Consulting Ltd. He is recognised and used by the European Commission and European Parliament as an expert in many fields and is a

9

consultant to a range of companies and government bodies including Rolls-Royce Aerospace, Rolls-Royce Marine, Rolls-Royce Nuclear Submarines, Rolls-Royce Civil Nuclear, the MoD, the TSB and Formula 1 Racing. He defines strategic technology roadmaps across Europe. He is Chair of a Working Group on Cyber Physical Systems of Systems for Transport and Logistics covering aerospace, automotive, rail, maritime and logistics. He has run many research programmes with Rolls-Royce (400+), was the co-ordinator of the EU FLEXICON project, led work on the More Electric Aircraft in the Airbus/EU MOET project, led consortia in the Airbus WICAS and SWIFT projects and has also run research programmes with Network Rail on remote infrastructure monitoring.

He has over 100 publications on applications of smart distributed systems, multi-disciplinary multi-objective optimisation, gas turbine engine control, fault diagnosis and health monitoring, wireless communications, smart sensors, energy harvesting, rapid prototyping and co-simulation. He has also written two books on gas turbine engine control. He is, or has been, a member of the International Federation of Automatic Control’s (IFAC) International Aerospace Control, Mechatronics and Real-Time Computing and Control Committees being chair of Embedded Systems, the Institution of Electronic and Electrical Engineers Aerospace Committee, and IET representative on the Learned Society Board of the Royal Aeronautical Society. He is a member of the American Institute of Aeronautics and Astronautics.

Werner Damm

Prof. Werner Damm holds the Chair for Safety Critical Embedded Systems at the Carl von Ossietzky University of Oldenburg. He is the Director of the Interdisciplinary Research Center on Critical Systems Engineering for Socio-Technical Systems. He is a member of acatech, the German National Academy of Science and Engineering. Currently he is engaged as a director in the working group “highly automated systems” and, in the framework of acatech pushing on autonomous driving. As a member of the steering board he contributed similarly to the Automotive Roadmap Embedded Systems and to the acatech-survey “New autoMobility – the future World of Automated Road Traffic” published by the end of 2015. Since the beginning of this year he is part of the EU Expert group carrying out the evaluation of the Public-Private-Partnerships funded by the European Union: the Joint Undertakings ECSEL, Artemis and ENIAC.

He is a member of the Board of Directors of the Applied Research Institute OFFIS – Institute for Information Technology and there in his function as a group executive manager responsible for the R&D Division Transportation. Furthermore he is the Chairman of the German competence cluster SafeTRANS, integrating leading companies and research institutes in the transportation domain, the co-founder and member of the steering board of the European Institute for Complex Safety Critical Engineering EICOSE, the Chairman of the Artemis Working Group Tool Platforms.

Werner Damm has been a member of various expert groups of the European Commission and the US National Science Foundation, notably on the topics of future strategies for Systems-of-Systems in Europe, and on Cyber-Physical Systems in the Transportation domain in the US.

His recent foundational research addresses mathematical models of embedded systems, systems-of-systems, and cyber physical systems, specification languages, hybrid systems, formal verification methods, formal synthesis, and real-time and safety analysis. This is complemented by applied research with industrial partners in avionics, automotive, space, and medical systems on system-and-safety development processes for safety related systems, where he pioneered contract-based systems engineering for functional requirements, safety and timeliness requirements, and stability requirements, the use of patterns for capturing such contracts, and tools for automatic test generation, consistency checking, and virtual integration testing based on formalized contracts.

10

Jean-Luc Dormoy

Jean-Luc Dormoy has worked in research institutions, large companies and startups. He is a co-founder of Kalray (http://www.kalrayinc.com), of VESTA-SYSTEM (http://www.vesta-system.fr/?lang=en), was director for “Smart Electric Systems” for the EDF Group in Europe, and was in charge of software programmes at CEA Tech. He is involved in initiatives for startups and cyber physical systems in the EU, worked with China, and spent some time at Stanford University.

Leonard Hobbs

Leonard graduated from University College Cork Ireland in 1986 with a 1st class honours degree in Electrical Engineering and was awarded the title of ‘graduate of the year’ by the college. He completed a Master's degree at the NMRC (now called Tyndall), at UCC in 1988.

He has been one of Ireland’s leading technologists in the ICT sector with close to 30 years of experience, mostly with Intel, spanning leading edge research to technology transfer to advanced manufacturing and high volume operations in the US, Europe and Ireland.

His last role at Intel was Director of Public Affairs with responsibility for driving Intel Ireland’s policy, communications, education and community agendas. He is currently at Trinity College Dublin where he is Director of Research and Innovation

Margriet Jansz

Margriet Jansz (NL) has over 30 years of experience in monitoring and evaluating research programmes, both in an academic setting and in industrial collaborations.

She is Program Director at the NWO Domain Applied and Technical Sciences (NWO-TTW), which funds technological research projects and programmes. Over the years she has been responsible for different fields of science, including mathematics, computer science, information technology, micro-electronics and civil engineering.

Margriet studied physics and mathematics at Leiden University to the Bachelor level. She then went to Bonn, Germany, where she obtained her Master degree in Astrophysics. After working for some years at the Max-Planck-Institute for Radio Astronomy, she returned to The Netherlands and joined Technology Foundation STW, now part of NWO-TTW, in 1985.

At STW she has been involved in monitoring and evaluating large-scale programmes in micro-electronics from the start and later also in information technology. When the first four Leading Technological Institutes were founded in The Netherlands, she was asked to monitor these during the first four years of their existence and then conduct a mid-term evaluation. In 2012-2013 she took part in both the evaluation of EUREKA porogramme CATRENE and the JTIs ARTEMIS and ENIAC.

Invited to represent STW in the Dutch ICT Research and Innovation Authority (ICTRegie) she was involved in creating a coherent ICT research and innovation ecosystem for The Netherlands.

As a result of her evaluation activities, Margriet has developed an interest in more fundamental science studies, in particular related to collaboration and to science and technology indicators. In this context she has coordinated two INTAS projects with Russian, British and French partners.

Tomasz Kosmider

President and Founder of Fundacja Partnerstwa Technologicznego TECHNOLOGY PARTNERS. Managing Director of the TECHNOLOGY PARTNERS Consortium and Centre of Advanced Technology.

11

His professional carrier (over 45 years) included management positions at large industrial and services companies. He had a deep experience in the organisation and management of multidisciplinary large scale RTD projects. He successfully managed RTD projects for industrial clients, within EU Framework Programmes, as well as within Polish Operational Programmes. The projects managed by Dr. Kosmider related mainly to such fields as aeronautics, transport, innovation and communication.

Leader and International Expert in EU-funded SCI TECH Reform Programme for Science & Technology Sector projects. Proposals Evaluator under the EU FP 5, 6 and 7, as well the H2020 Programme. Member of the European Research Advisory Board (EURAB 2), European Association of Research and Technology Organisations (EARTO) Board (Vice-President since 2014), and Knowledge 4 Innovation Board. Participant/speaker of many EU, OECD, EIRMA, ISPIM, RADMA and other international conferences on S&T co-operation and R&D management. Cofounder of an Insead Alumni Association.

Mr. Kosmider held an MA degree from Warsaw School of Economics in transport economics, a Ph.D. degree from Warsaw University, Poland, and an MBA diploma from INSEAD, Fontainebleau, France.

Wolfgang Pribyl

Professor Dipl.-Ing. Dr. Wolfgang Pribyl, MBA has over 35 years of experience in senior industrial research and academic positions working in the fields of electronics, microelectronics on chip and system level. For 12 years he was serving in leading positions within the Siemens Semiconductor Division in Austria, Germany and California (later spun-off as Infineon Technologies AG) and several years as CTO for austriamicrosystems AG (Austria). Besides his own consulting business he was 6 years full professor and head of the Institute of Electronics at the Graz University of Technology and since 2011 is part time professor at this institute. In 2011 he took over his current position as CEO of JOANNEUM RESEARCH, an independent RTO with a staff of 450, active in several fields, among those microelectronics, ICT, satellite communications, material science, robotics, health technology and aspects of IOT and I4.0.

He is serving the European Commission since the late 1990ies as expert in many related fields doing reviews and evaluations for the framework programs starting with FP4 and continuing till H2020, ENIAC and ECSEL. He was and is very active in IEEE conferences as ISSCC, ESSCIRC, Austrochip, PRIME and issued over 80 publications on semiconductor design and technology, microelectronics, electronics design and applications and contributed to three books. He has also been involved in the Austrian ENIAC activities from the beginning and has contributed to the opinion building process through a study on ENIAC’s potential for the Austrian industry. He was also active in setting up the new ECSEL Austria initiative after the merge of ENIAC and ARTEMIS and the recently established Silicon Alps Microelectronics Cluster in the southern region of Austria. He also serves as member of technical or advisory boards of a few, mostly start-up companies, mainly located in Austria.

12

Annex 3 Abbreviations

AAR Annual Activity Report AENEAS Association for European Nanoelectronics Activities AIPP ARTEMIS Innovation Pilot Projects ARTEMIS Advanced Research & Technology for EMbedded Intelligent Systems ARTEMIS-IA ARTEMIS Industry Association ASP ARTEMIS Sub-programme AWP Annual Work Program CA Clerical Assistant CATRENE Cluster for Application and Technology Research in Europe on NanoElectronics

(EUREKA Cluster) CEO Chief Executive Officer CoIE Centre of Innovation Excellence CP Collaborative Project CPS Cyber-Physical Systems CSA Co-ordination and Support Action DEI Digitising European Industry DG Directorate General (of the EC) DSP Digital Signal Processing EC European Commission ECS Electronic Components and Systems ECSEL Electronic Components and Systems for European Leadership ECU Electronic Control Units ED Executive Director EIP European Innovation Partnership ENIAC European Nanoelectronics Initiative Advisory Council EPoSS European Technology Platform on Smart Systems Integration ERA European Research Area ESIA European Semiconductor Industry Association ETP European Technology Platform EU European Union FDSOI Fully Depleted Silicon on Insulator FP7 Seventh Framework Programme (of the EC) FTE Full Time Equivalent GB Governing Board HEI Higher Education Institution IA Innovation Action (but also Industry Association) ICT Information and Communication Technology IoT Internet of Things IPCEI Important Projects of Common European Interest IT Information Technology ITEA Information Technology for European Advancement (EUREKA Cluster) JTI Joint Technology Initiative JU Joint Undertaking KEI Key European Industries KET Key Enabling Technologies KPI Key Performance Indicator LE Large Enterprise LEIT Leadership in Enabling and Industrial Technologies LSP Large-Scale Pilot MASP Multi-Annual Strategic Plan MASRIA Multi-Annual Strategic Research and Innovation Agenda

13

MM More Moore MS Member State MtM More than Moore NFA National Funding Authority PA Public Authority PAB Public Authorities Board PCAST Presidential Council Advisors on Science and Technology PENTA EUREKA Cluster to follow CATRENE PL Pilot Line PO Project Outline PPP Public Private Partnership R&D Research and Development R&I Research and Innovation RES Research Organisation RIA Research and Innovation Action RO Research Organisation RTO Research and Technology Organisation SMEs Small or Medium-sized Enterprises SoC System on Chip SOI Silicon on Insulator SR(I)A Strategic Research (and Innovation) Agenda TA Technical Administrator TEN Trans European Network TRL Technology Readiness Level TTP Time-Triggered Protocol VCSEL Vertical Cavity Surface Emitting Lasers WP Work Plan

14

Annex 4 Information Sources Used

Impact assessments on the establishment of the JUs under FP7 and H2020

Council regulations establishing the JUs

Council regulation establishing FP7 / Horizon 2020

1st and 2nd Interim Evaluations of ENIAC & ARTEMIS

Annual Activity Reports (AARs)

Fact-finding study report by CARSA et. al

Court of Auditors (CoA) and European Parliament recommendations

Other evaluation studies, such as FP7 ex-post evaluation, etc.

[Ca

talo

gu

e n

um

be

r]

15

Annex 5 Interviewees

Ben Ruck, ECSEL PAB Chair Khalil Rouhana, DG CNECT, Deputy Director-General Laila Gide, President ARTEMIS-IA Renzo Dal Molin, Vice Chair EPoSS Ina Sebastian, Chair of Management Committee AENEAS

16

European Commission Final Evaluation of the ARTEMIS and ENIAC Joint Undertaking (2008-2013) Operating

under FP7 – Annexes

Luxembourg, Publications Office of the European Union

2017 – 17 pages

ISBN 978-92-79-69635-0

doi:10.2759/540926

17

KK

-04

-17

-55

2-E

N-N

doi:10.2759/540926 ISBN 978-92-79-69635-0