ERCEA WEB EVALUATION TOOL Expert USER'S GUIDE · ERC Web Evaluation Tool V4.0-User's Guide Page 4 of 20 1. Introduction This document is the User’s Guide of ERC Web Evaluation Tool

ERCEA WEB EVALUATION TOOL

Expert USER'S GUIDE

European Research Council Executive Agency

ERC Web Evaluation Tool V4.0-User's Guide

Page 3 of 20

Contents

1. Introduction......................................................................................... 4 2. How to access Web Eva .................................................................... 4 3. How to access the panel meeting/panels comments ......................... 4 4. How to navigate in the main screen ................................................... 7 5. Actions on Proposal ........................................................................... 9

5.1 Downloading documents (arrow icon ): .................................... 9 5.2 Reviewing proposals (pencil icon ):............................................. 9

5.2.1. Proposal summary ............................................................... 10 5.2.2. Proposal reviews.................................................................. 11 5.2.3. Review’s comments ............................................................. 13 5.2.4. Criteria 2-over all score &sub criteria ................................... 14 5.2.5 Save and Submit reviews...................................................... 14

5.3 Signing and submitting proposal (lock icon ): .......................... 15 5.4 Declaring conflict of interest on proposal (Cross icon ) ............ 16 5.5 How to Suggest Remote Referees.............................................. 18

6. Reviews’ status ................................................................................ 21 7. Exporting Reviews............................................................................ 21


Page 4 of 20

1. Introduction This document is the User’s Guide of ERC Web Evaluation Tool version 3.0, intended to the expert’s evaluators (Panel member or Panel chair or External reviewers) working in ERC calls (Consolidators, starting, Advanced and Synergy) in step1 and/or step2. This User‘s Guide will explain to you how to use Web Evaluation Tool.

2. How to access Web Eva To access Web Evaluation tool, you have to authenticate yourself in the ECAS "European Commission Authentication Service" by clicking on the following link: https://webgate.ec.europa.eu/erc/webeva/login.htm -Once the ECAS screen opens, enter your ECAS email and password, - If you have no ECAS account, please click on the link below and follow the instructions to create a new one. http://erc.europa.eu/sites/default/files/content/ECAS-Account_Creation_Manual.pdf

3. How to access the panel meeting/panels comments If you are a panel chair or a panel member, you have the possibility to access the panel comments via the dedicated link in WEB Eva main screen. The link is only available in Webeva remote evaluation between the panel meeting starting date and ending date.

If the evaluation is closed in PMA-Excel, the link is removed and you are not able to access the panel’s comments screen.

-Click on the link “panel meeting” at the bottom of the main screen in Web Eva, an example below.

Below an example of panel meeting screen of LS4-ERC Starting call 6th call 2013


Page 5 of 20

-Select the proposal and click on the link:

-The proposals comments screen opens,

-At the bottom of the screen, if you click on “show” link,


Page 6 of 20

-The panel’s comments screen will be extended, an example below.


Page 7 of 20

4. How to navigate in the main screen After successful ECAS Login, the main screen shows you the proposal(s) assigned to you. The main screen is divided into 6 parts. Below and example of ERC-2013-StG, step 1

Part 1 –Online help

Panel Meeting link: If you click on the link in web Eva, the panel’s comments page is displayed.

User guide: if you click on the link, the user’s guide in PDF format is displayed Log out: if you click on the link, you will quit Web Eva Tool, you will be then redirected to ECAS Logout page.an example below.

Part 2-Expert ‘name In the top of this section, the experts ‘name is displayed.


Page 8 of 20

Part 3-Filter menu "Showing the evaluation" is a drop-down to allow you selecting the call (starting,

consolidators advanced, synergy or PoC -proof of concept), the steps (step1or step2).

If you are working in a Synergy call, the steps are the following:

Part 4-Statistics’table The table of statistics gives you an overview of your reviews (number of reviews not started, started, completed, signed and submitted, Coi declared). Below, an example.

Part 5-Download document The link allows you to download all the proposals in

the panel assigned to you. • All the panel’s proposals, only if you are a panel’s chair • All the assigned proposals to you • ERC Work Program • Guide for peer reviews

Part 6-Proposals ‘data A table shows information about the proposals assigned to you, by default; the proposals are assigned by panel.an example below

The table can be sorted out in ascending or descending order by using any column as criterion. The column used for sorting the proposals will have its header highlighted.


Page 9 of 20

5. Actions on Proposal The last column in the proposals’ table of the main screen shows the actions that you might execute on each proposal.

5.1 Downloading documents (arrow icon ): If you click on this icon, the application opens a new browser window to download a proposal’s document or the whole proposal. Below an example.

5.2 Reviewing proposals (pencil icon ): Note: If you have not yet signed your AOT’s and you click this icon, you will see this message and you cannot access the proposals.

This section is described for 2013 evaluations only. If you click on the icon, you will access the proposals' review page.


Page 10 of 20

Below an example of review 'screen of ERC starting grant 6th call 2013.

The content of this page is different for 2013 evaluations in comparison with the previous evaluations. The score is in descendent order, the content of the criterion 1 is new and the criterion 2 has new layout. The page is divided into 4 sections:

5.2.1. Proposal summary This section consists of the proposal summary, the review status and the reminder message. The availability of the actions on this page depends on the review status. Here is the mapping between the available actions and the status: Review Status/ Available actions

Not started Started Signed and submitted

Deadline passed

Edit reviews X X

Suggest Remote Referee

X X X(*) X(*)

Sign and submit reviews

X X

(*) Except for Synergy, this action is only available in step1. When the panel is finalized this action is not available.


Page 11 of 20

Below is the screenshot of the proposal summary with "Not started" status and the available reminder to regularly save the work.

5.2.2. Proposal reviews This section contains evaluation criteria and expert's reviews. There are 2 criteria for 2013 evaluations. Each criteria contains an overall score and sub criteria.

• Criteria1- Overall score Score radio buttons are shown in descendant order (from 4.0 to 1.0 with 0.5 intervals).

For each criterion, you should select only one score from the table. If you select a score between 4.0 and 2.0, a red message "above threshold" is displayed on the left side of the selected radio button (below, an example).


Page 12 of 20

If you select a score between 2.0 and 1.0, a red message "below threshold" is displayed on the left side of the selected radio button. Below an example.

Normally the reviews in the sub criteria should be coherent with the overall score of the criteria. If the reviews are very negative then the overall score should be below threshold and vice versa.

• Criteria 1 - Sub criteria Each sub criteria of criterion 1 contains a set of questions that your reviews should answer. By default they are displayed, but it is possible to hide them by clicking on "Hide full criteria descriptions" link. Below an example of sub criteria of criterion 1.


Page 13 of 20

5.2.3. Review’s comments You can write your reviews in the textboxes (white boxes). The length of your reviews is shown below each textbox. This length cannot be lower than the minimum characters and cannot be higher than the maximum characters defined on the top of the textbox. If you do not respect the minimum length, you are allowed to save your reviews, but not to submit them. If you do not respect the maximum length then your reviews will be truncated. Below an example.


Page 14 of 20

5.2.4. Criteria 2-over all score &sub criteria Sub criteria of criterion 2 are presented in table where you can express if you "Fully agree", "Agree partially", "Disagree partially", "Strongly disagree" with each sub criteria. You should select one radio button per sub criteria. Otherwise, your review is considered to be incomplete. Below an example of criterion 2 in step 1.

5.2.5 Save and Submit reviews At the bottom of the review 'screen, there are three buttons:

Save – Save the review and maintains the window open. Save & Exit - Save the review and close the window.


Page 15 of 20

If you click on “save” button and the review is completed (all the comments are entered With minimum of 50 characters' and the scores selected), the "sign and submit review" window is displayed.

If you click on “save” button and the review is not completed, the application shows you a warning message.an example below.

Cancel – cancels all changes and closes the window.

5.3 Signing and submitting proposal (lock icon ): Once you have sign and submit the review, the review can be processed for the panel meeting. The” lock” icon in the column “action” in the main screen is inactive and no further changes will be allowed. "Save" and "Save & Exit" buttons are automatically disabled in the review ‘screen.


Page 16 of 20

5.4 Declaring conflict of interest on proposal (Cross icon ) This icon allows you to declare a potential Conflict of Interest (CoI) with a specific proposal, if the review is 'signed and submitted ' you can declare a Coi but before the review deadline is passed. How to declare a CoI:

• select the proposal in the main screen and click button in “Actions” column ,

• The application will display the following window,


Page 17 of 20

• Select the "reason" in the drop down tag, this field is mandatory and the application

will not allow declaring a CoI unless a value is provided, • Write a comment on the reason using the text area tagged as "Specify the reason",

• Its optional, but mandatory if the reason you have selected is "6 Other",

• Click on "Declare CoI ", • A warning message is displayed

• If you click on “OK “button, a notification e-mail is automatically sent to the Panel coordinator.

How de system behaves The proposal with "CoI declared" has an orange background, and the Cross icon is disabled.

The only action available on a proposal with a "CoI declared" status is "Download proposal".


Page 18 of 20

5.5 How to Suggest Remote Referees

You have the possibility to suggest, during the remote evaluation in step 1, new remote referees by searching in ERC database, or by adding new ones.

If you are working on the Synergy call, you can suggest a new RR in both steps

"1A" & "1B". If the review is closed, you can suggest the remote referee's names during the panels meeting. The maximum number of suggested remote is 5, and the minimum number is zero, you can "Sign and submit" a proposal without any suggested RR. At the bottom of the review 'screen, just above the “save" button, you have the button "add" to suggest new remote referee.

Below an example of the “Suggested Remote Referees for step 2” screen.


Page 19 of 20

How to search for Remote referees in the ERC Database.

• Click on 'add' button1 in the bottom of the review screen, • The 'add a remote referee' window opens, see example below, • Enters a last name or the Keywords and click on search , • The application shows the result , • Tick the button to select the expert and click 'Add' button,

• The RR is added in the list at the bottom of the review screen.


Page 20 of 20

How to add new Remote referees

• Encode, at any order, the last name, the first name the Email and the institution in the 'add a remote referee' window, see example,

• Click on 'Add new' button,

• The result(s) are displayed at the bottom of the review screen; the “Add” button is inactive.

You can remove the RR from the list by clicking on in the “actions” column.


Page 21 of 20

6. Reviews’ status There are six possible statuses for each review:

Not a single comment or score has been introduced in the review

The review has started but scores and/or comments are missing

Review is ready to be finalised

Review finished and blocked and field in white colour

The deadline for sign and submit the proposal has been passed. The proposal cannot be submitted

The Coi has been declared by the expert on the proposal

7. Exporting Reviews At the bottom of the main screen, you can download and save the expert's reviews in RTF and PDF format.

ERCEA WEB EVALUATION TOOL Expert USER'S GUIDE · ERC Web Evaluation Tool V4.0-User's Guide Page 4 of 20 1. Introduction This document is the User’s Guide of ERC Web Evaluation Tool

Documents