NSS Additional Bank of Questions Derek Young Senior Adviser, Evidence Informed Practice.

NSS Additional Bank of Questions

Derek Young

Senior Adviser, Evidence Informed Practice

Additional/Optional Questions

• For 2008 the NSS bank of questions (and methodology) was the same as in 2007. The same process of opting-in and choosing the scales/questions were applied.

• A total of 87 institutions (including 15 FECs) opted-in the bank of questions. Most institutions chose the maximum number of additional questions allowed (five scales) - 65 institutions participated the 2007 pilot.

• The most popular scales are:

Feedback from Students

Careers

Course Delivery

• This is consistent with 2007.

Change for 2008

• 2007 – 65 institutions in total

• 2008 – 87 institutions in total

• 2008 – 15 FECs

• 2008 – 72 HEIs

o 3 totally different

o 16 totally same

o 27 partial change

o 30 new for 2008

o 25 not returning for 2008

Totally different

• Three institutions chose totally different groups

2007 2008 2007 2008 2007 2008

Careers 1 1

Course content & structure 2 2 2

Work placements 3

Social opportunities 4 4

Course delivery 5 5 5

Feedback from students 6 6 6

The physical environment 7

Welfare resources & facilities 8 8 8

Workload 9 9 9

Assessment 10 10 10

Learning community 11 11 11

Intellectual motivation 12 12 12

Additional group take-up 2007 - 2008

2007 2008

Careers 38 (25359) 56 (46228)

Feedback from students 36 (23366) 43 (44315)

Course delivery 28 (16368) 38 (31596)

Learning community 28 (15171) 38 (35693)

Welfare resources & facilities 24 (13190) 24 (17499)

Intellectual motivation 19 (14122) 18 (18837)

Social opportunities 19 (11786) 21 (15206)

Assessment 19 (10561) 23 (19453)

Workload 17 (9155) 26 (18794)

Work placements 19 (3641) 25 (9151)

Course content & structure 16 (8667) 20 (13882)

The physical environment 9 (3786) 1 (832)

Insert Caveat Here

Devils Advocate

Devils AdvocateCareers

Feedback from

Students

Course Delivery

Learning Community

Welfare Resources and FacilitiesIntellectual Motivation

Social Opportunities

Assessment

Workload

Work Placements

Course Content and Structure

The Physical Environment

Careers

Item % disagree2007 2008

% neutral2007 2008

% agree2007 2008

As a result of my course I believe that I have improved my career prospects

5.3 4.5 11.7 10.5 83.0 84.1

Good advice is available for making career choices

12.9 12.3 24.5 23.0 62.6 62.7

Good advice is available for further study options

12.5 12.9 24.7 23.2 62.9 62.2

Course Content and Structure

Item % disagree2007 2008

% neutral2007 2008

% agree2007 2008

All of the compulsory modules are relevant to my course

8.7 10.2 9.4 10.3 82.0 78.6

There is an appropriate range of options to choose from on my course

19.0 19.9 16.1 16.1 64.9 60.1

The modules of my course form a coherent integrated whole

8.3 8.5 16.1 17.4 75.6 73.7

Work PlacementsItem % disagree

2007 2008% neutral2007 2008

% agree2007 2008

I received sufficient support and advice from my institution about the organisation of my placements

18.0 16.5 14.4 12.7 67.7 68.4

My placements were valuable in helping my learning

4.6 5.0 5.5 5.8 89.8 86.5

My placements have helped me to develop my skills in relation to my course

6.2 6.8 7.9 8.3 85.8 81.8

My placements have helped me to develop my general life skills

3.9 3.9 9.3 8.3 86.8 84.9

The taught part of my course was good preparation for my placements

18.7 17.6 19.7 20.4 61.7 59.3

Social Opportunities

Item % disagree2007 2008

% neutral2007 2008

% agree2007 2008

I have had plenty of opportunities to interact socially with other students

10.4 8.3 12.2 10.1 77.3 80.7

I am satisfied with the range of clubs and societies on offer

14.9 11.6 23.9 19.2 61.2 65.0

I am satisfied with the range of entertainment and social events on offer

20.9 16.9 25.1 21.2 54.0 58.0

Course Delivery

Item % disagree2007 2008

% neutral2007 2008

% agree2007 2008

Learning materials made available on my course have enhanced my learning

6.2 5.2 13.9 12.7 79.6 81.7

The range and balance of approaches to teaching has helped me to learn

8.4 7.9 16.7 16.8 74.8 75.2

The delivery of my course has been stimulating

11.0 10.2 17.4 17.2 71.6 72.5

My learning has benefited from modules that are informed by current research

5.8 5.6 17.7 17.0 76.5 76.2

Practical activities on my course have helped me to learn

8.5 8.6 16.6 16.0 75.0 69.8

Feedback from Students

Item % disagree2007 2008

% neutral2007 2008

% agree2007 2008

I have had adequate opportunities to provide feedback on all elements of my course

9.7 8.9 13.9 13.4 76.3 77.6

My feedback on the course is listened to and valued

18.2 16.3 36.0 33.0 45.8 49.6

It is clear to me how students’ comments on the course have been acted upon

29.3 25.8 34.3 33.3 36.4 40.2

The physical Environment

Item % disagree2007 2008

% neutral2007 2008

% agree2007 2008

Security has been satisfactory when attending classes

3.1 3.1 13.0 9.9 83.8 85.5

My institution provides an appropriate environment in which to learn

4.6 2.9 7.2 5.6 88.3 91.4

Welfare Resources and Facilities

Item % disagree2007 2008

% neutral2007 2008

% agree2007 2008

There is sufficient provision of welfare and student services to meet my needs

6.9 7.2 22.3 18.5 70.8 68.3

When needed, the information and advice offered by welfare and student services has been helpful

6.3 6.2 26.7 21.2 67.0 60.1

Workload

Item % disagree2007 2008

% neutral2007 2008

% agree2007 2008

The workload on my course is manageable

11.3 12.2 11.6 12.4 77.1 74.5

This course does not apply unnecessary pressure on me as a student

19.6 19.9 18.4 18.1 62.0 61.1

The volume of work on my course means I can always complete it to my satisfaction

23.1 24.9 22.1 21.4 54.7 52.8

I am generally given enough time to understand the things I have to learn

15.7 17.2 18.6 18.5 65.7 63.4

Assessment

Item % disagree2007 2008

% neutral2007 2008

% agree2007 2008

Teaching staff test what I have understood rather than what I have memorised

11.7 12.1 18.5 18.5 69.9 68.5

Assessment methods employed on my course require an in-depth understanding of the course content

6.2 6.2 11.2 11.7 82.6 82.1

Learning Community

Item % disagree2007 2008

% neutral2007 2008

% agree2007 2008

I feel part of a group of students committed to learning

11.1 10.5 14.8 15.0 74.1 74.3

I have been able to explore academic interest with other students

12.3 12.4 19.3 19.0 68.4 67.5

I have learned to explore ideas confidently

6.0 5.2 15.0 15.0 79.0 79.5

Within my course I feel my suggestions and ideas are valued

13.2 11.4 24.8 24.3 62.0 63.3

I feel part of an academic community in my college or university

15.8 14.3 18.5 17.3 65.7 67.8

Intellectual Motivation

Item % disagree2007 2008

% neutral2007 2008

% agree2007 2008

I have found the course motivating

9.4 9.0 11.1 10.2 79.4 80.8

The course has stimulated my interest in the field of study

8.0 7.4 9.4 8.4 82.6 84.2

The course has stimulated my enthusiasm for further learning

13.8 13.6 15.1 14.4 71.1 71.7

Institution-specific questions pilot 2008

Institutions’ own questions are related to the student experience and within the NSS spirit/scope.

HEFCE provided guidelines for institutions when writing/choosing their questions.

Institutions were able to choose either a five-point scale agree/disagree statement (same as the NSS core questions) or an open-ended question.

Ipsos MORI checked/reworded the questions as necessary. No questions were rejected as all were in line with HEFCE’s guidance. The final list of questions was submitted to HEFCE for final approval. The own institutions’ questions are programmed into the online survey.

83 institutions supplied their own institutional questions.

HEIs own 5-point scale questions/statements

• My experiences at ####### have prepared me for life and work beyond the College.

• My time at University has helped me develop my employability and enterprise skills.

• My programme has prepared me for work in a global environment.

• The University has prepared me well for the world of work.

• As a result of completing my degree, I believe that I have improved my career prospects.

• My course of study has prepared me for life and work in an increasingly international environment.

HEIs own 5-point scale questions/statements

• I would recommend ####### University to a friend.

• Overall I would recommend this course to others.

• I would recommend my University to other students.

• I would recommend the University as a place to study to a friend or relative.

• Overall, I am satisfied with my experience as a student.

• Taking into account my overall experience, I would recommend ####### to potential students as a place to study.

• I would recommend the University to other people who were thinking of applying to #######.

HEIs own open-ended questions

• What is the best thing about being a student at ####### University?

• What have been the best and worst feature of your student experience at the University of #######?

• If there is one thing you could change about the delivery or content of your course, what would it be ?

• What do you think the University could have done differently to improve the quality of your course?

• In your view, what is the single most important thing the University should do to improve the educational experience for undergraduates?

• If you could have changed one thing about the University of ####### to improve your learning experience, what would it be?

HEIs own open-ended questions

• If you could have changed anything about the University, what would it have been and why?

• Giving reasons for your answer, please say whether you would recommend your degree programme at ####### to someone you know?

• Please tell us (a) what has been the best thing about your experience at the University of #######, and (b) if you could change one thing in order to make the experience better for future students, what would it be?

• Please state one main factor that influenced your experience at ####### in a positive way that you would like to see maintained and strengthened and also one main factor that influenced your experience in a negative way that you would like to see addressed. The information that you provide will be used to help us to continue to improve the experience of our students.

HEIs own open-ended questions

• How could we improve the usefulness of feedback we give you on your work?

• The University of ####### is keen to improve the feedback its students receive on their work. Based on the experience on your course, do you have any suggestions for how this might be done?

• Does ####### provide an appropriate environment in which to learn?

• Please describe your expectations on starting at ####### and tell us whether these have been met.

• What did you find to be surprising in your experience at University?

Not so useful

• Could you please comment on the freedom, facilities and support you were given at ####### to experiment, explore, and fulfil your creative potential

Now this is not the end. It is not even the beginning of the end. but it is, perhaps, the end of the beginning. (Winston Churchill)

• Institutional perception

• League table

• End point or beginning?