ITEST Management Information System (MIS) - Baseline ...stelar.edc.org/sites/stelar.edc.org/files/MIS_Baseline_Survey_Fall... · NSF ITEST Management Information System (MIS) - Baseline

NSF ITEST Management Information System (MIS) - Baseline Survey (Fall 2014)

1

Welcome to the Management Information System (MIS) – Baseline Survey.

The MIS collects information from ITEST projects to inform the state of the ITEST program: who participates, how often, in what kinds of activities, with what objectives and targeted outcomes. As required by the NSF ITEST Program, the MIS is administered by the STELAR Center to ITEST projects shortly after their award is granted, to provide baseline data, and annually thereafter in the fall.

How the MIS benefits you:

The results of the survey are used extensively by NSF program officers to meet reporting requirements on their portfolios.

MIS data gathered in previous years have provided the basis for information-rich research products and other publications developed by STELAR and used to promote your project work to the national community of stakeholders. Past MIS reports are available on the STELAR website.

Completing the MIS provides you an opportunity to collect and synthesize data about your project. You will have the opportunity to save your responses when you submit your MIS.

Consistent data collection efforts across NSF program areas are the critical building blocks that allow programs like ITEST to articulate collective outcomes and share models being generated by the community of practice.

Instructions:

Questions in this Baseline MIS will ask for project information regarding expected activities for the life of your project.

While you may progress through the MIS without answering all questions, we strongly encourage you to respond to each item before final submission of the MIS; if not, we may need to follow up with you by phone later.

There are a total of 38 items, but not every project will be prompted to answer every item.

Completion of the questionnaire typically takes 45-60 minutes.

For Collaborative Projects:

Collaborative projects may complete the MIS in one of two ways. [Please contact us at [email protected] to tell us which option your project has chosen.]

o Option 1: Complete one MIS together with the other PI(s). Select this option if the project has just one set of target participants. To complete the MIS contact the other PI(s) and decide whose unique MIS link you will use to submit your project’s MIS.

http://stelar.edc.org/stelar-materials

mailto:[email protected]


2

o Option 2: Each PI completes his/her own MIS for the project. Select this option if the PIs are responsible for different target participants at different sites.

If you have any questions as you complete the MIS, please feel free to contact us at [email protected]. Thank you very much for your participation! Type in your NSF award number here to enter the MIS:

PROJECT STAFF

1 Please complete the staffing chart below for your ITEST project.

If you would like to list more than ten people, please contact [email protected].

Contact Information Role (choose from list)

Principal Investigator (1)

Co-Principal Investigator (2)

Evaluator (3)

First Name Last Name Email Organization Project Staff (4)

1

2

3

4

5

6

7

8

9

10

2 Who is the primary contact person for this project?

Name (1)

Phone Number (2)

mailto:[email protected]


3

NEEDS ASSESSMENT

3 Please indicate the topics for which you, or a member of your project team, would like to share

expertise with the community or learn more about. This information will help STELAR to develop

relevant and timely peer technical support activities.

I can share expertise

I would like to learn more

I am not interested

Incorporating workforce development in ITEST project work (1)

Broadening participation in the ITEST context (2)

STEM learning environments in the ITEST context (3)

Utilizing the Common Guidelines for Education Research and Development (4)

Developing and implementing project evaluations (5)

Developing and sustaining partnerships with organizations, industries and/or businesses (6)

Using social media effectively (in project work and/or for dissemination) (7)

Developing and implementing dissemination strategies (8)

Recruiting and retaining project participants (9)

Engaging similar communities across and outside of ITEST and NSF (10)

Other, please specify (11)


4

PROJECT DESCRIPTION

4 Create a one-sentence brief description of your project (examples are included below).

Be sure to include project location(s), numbers of teacher, numbers of students, and

numbers of others (parents, guidance counselors) as applicable, and indicate the project

setting (urban, suburban, rural) in an action-oriented sentence similar to the examples.

Note: 255 character limit

Sample Project Descriptions

- More than 175 rural and suburban Latino youth, grades 5-12, are engaged in structured,

hands-on, out-of-school information technology (IT) education programs in conjunction with out-

of-session “bridging activities.”

- One hundred and seventy five grade 7-12 students in Boston and Lowell, Massachusetts use

an online learning system to participate in IT-intensive engineering design programs at schools

and community centers.


5

5a Indicate your project's PRIMARY discipline. You may choose only one PRIMARY discipline,

but in the next item you will have an opportunity to identify as many secondary disciplines as are

relevant.

Bioscience - general (1)

Bioscience - bioinformatics (2)

Bioscience - biomedicine (3)

Bioscience - biotechnology (4)

Bioscience - DNA analysis/sequencing (5)

Bioscience - neuroscience (6)

Computer Science - general (7)

Computer Science - computer hardware (8)

Computer Science - gaming and simulations (9)

Computer Science - general skills and mathematics (10)

Computer Science - multimedia - audio, video, and animation (11)

Computer Science - programming (12)

Computer Science - web development (13)

Engineering - general (14)

Engineering - aerospace (15)

Engineering - astronomy (16)

Engineering - design (17)

Engineering - nanotechnology (18)

Engineering - robotics (19)

Environmental Science - general (20)

Environmental Science - climate modeling (21)

Environmental Science - ecological research and analysis (22)

Environmental Science - GIS/GPS (23)

Environmental Science - remote sensing technology (24)

Mathematics - general (25)

Other (please specify) (26) ____________________


6

5b Indicate your project's SECONDARY discipline(s). (check all that apply)

Bioscience - general (1)

Bioscience - bioinformatics (2)

Bioscience - biomedicine (3)

Bioscience - biotechnology (4)

Bioscience - DNA analysis/sequencing (5)

Bioscience - neuroscience (6)

Computer Science - general (7)

Computer Science - computer hardware (8)

Computer Science - gaming and simulations (9)

Computer Science - general skills and mathematics (10)

Computer Science - multimedia - audio, video, and animation (11)

Computer Science - programming (12)

Computer Science - web development (13)

Engineering - general (14)

Engineering - aerospace (15)

Engineering - astronomy (16)

Engineering - design (17)

Engineering - nanotechnology (18)

Engineering - robotics (19)

Environmental Science - general (20)

Environmental Science - climate modeling (21)

Environmental Science - ecological research and analysis (22)

Environmental Science - GIS/GPS (23)

Environmental Science - remote sensing technology (24)

Mathematics - general (25)



7

6 Indicate where in the US your project work will take place. (check all that apply)

Project will take place nationally (1)

Alabama (2)

Alaska (3)

Arizona (4)

Arkansas (5)

California (6)

Colorado (7)

Connecticut (8)

Delaware (9)

District of Columbia (10)

Florida (11)

Georgia (12)

Hawaii (13)

Idaho (14)

Illinois (15)

Indiana (16)

Iowa (17)

Kansas (18)

Kentucky (19)

Louisiana (20)

Maine (21)

Maryland (22)

Massachusetts (23)

Michigan (24)

Minnesota (25)

Mississippi (26)

Missouri (27)

Montana (28)

Nebraska (29)

Nevada (30)

New Hampshire (31)

New Jersey (32)

New Mexico (33)

New York (34)

North Carolina (35)

North Dakota (36)

Ohio (37)

Oklahoma (38)

Oregon (39)

Pennsylvania (40)

Rhode Island (41)

South Carolina (42)


8

South Dakota (43)

Tennessee (44)

Texas (45)

Utah (46)

Vermont (47)

Virginia (48)

Washington (49)

West Virginia (50)

Wisconsin (51)

Wyoming (52)

7 Indicate in which geographic area(s) your project will work. (check all that apply)

Rural (1)

Suburban (2)

Urban (3)

8 Indicate which grade span(s) your project will focus on. (check all that apply)

Early childhood (PK) (1)

Elementary (K-5) (3)

Middle (6-8) (4)

High (9-12) (5)

9 Indicate in what type of school(s) your project will work. (check all that apply)

Charter (1)

Magnet (2)

Private (3)

Public (4)


YOUTH PARTICIPANTS

10 Indicate whether or not the following groups of youth will participate in your project.

[NOTE: Please respond to this question carefully. The MIS will display questions based on your

response. Once saved, you will not be able to change your response to this question.]

Yes No

Youth in informal settings out of school (direct project work in either summer or after school settings) (1)

Youth in formal school settings (only include youth who will participate directly in project work in school settings; later in the survey you will be asked about youth in classrooms of your teacher participants) (2)


9

11 Indicate in what way(s) your project work with youth will be structured. (check all that apply)

After school program (1)

Distance learning (2)

In-school program (3)

Online/social networking (4)

Summer program: 1-2 week sessions (5)

Summer program: more than 2 weeks per session (6)

Weekend program (7)

Youth employment/internship component (8)


12 On average, how many contact hours will each individual youth participate in your project? If

youth will have different levels of participation, check all that apply.

Less than 25 hours (1)

25-49 hours (2)

50-74 hours (3)

75-99 hours (4)

More than 100 hours (5)

13 On average, how long will individual youth participate in your project? If youth will have

different lengths of participation, check all that apply.

Less than one year (1)

One year (2)

More than one year (3)

The length of the project (4)


10

14 List each of your projected project outcomes for youth. Your project may have fewer than six

outcomes for youth. If your project has more than six outcomes for youth, please contact

STELAR at [email protected] to complete the table.

Outcome (choose from list) Provide a brief description of this

outcome.

changes in self efficacy in STEM (1)

changes in participation in STEM-related activities (2)

changes in interest in STEM (3)

changes in engagement in STEM (4)

changes in STEM content knowledge (5)

changes in skills using technology tools (6)

changes in skills applying STEM concepts (7)

changes in ways of thinking and problem-solving (8)

changes in knowledge of STEM careers, workplace demands (9)

changes interest in STEM careers (10)

changes in preparation for STEM careers (11)

documentation of youth entry into STEM career paths (12)

Other youth-related outcomes (13)

Youth Outcome 1

Youth Outcome 2

Youth Outcome 3

Youth Outcome 4

Youth Outcome 5

Youth Outcome 6

15 Indicate the data collection method(s) your project will use with youth. (check all that apply)

Embedded assessments (1)

ITEST project observations (summer institutes, youth activities) (2)

Performance-based assessments (3)

Pre and/or Post Assessments (4)

Youth interviews (5)

Youth focus groups (6)

Youth self-reports (journals) (7)

Youth web-based data (blogging, emails, posts) (8)



11

15b Indicate the type of Pre- and/or Post-Assessments (content and mode of administration)

your project will use with youth. (check all that apply)

Pre-Assessment Post-Assessment

Written Survey

Other than Written Survey

Written Survey


Attitudes toward STEM and/or STEM careers (1)

STEM content (2)

Technology skills (3)

Other (please specify) (4)

16 Indicate what additional youth outcome metric(s) will be collected. [that is, indicate what

existing data you gathered, but not data you collected through project-administered instruments]

College major (1)

Competency/skills progress reports (2)

Examples of student academic work (3)

High school grades (4)

Participation in additional extracurricular activities (5)

Participation in advanced STEM classes (6)

Participation in college courses (7)

Participation in high school courses (8)

Participation in science fair or other STEM competitions (9)

Participation in STEM-related work experience (10)

Selection of post-high school career/school pathway (11)

Standardized test scores (12)

Videos of students and/or educators (13)

Other(please specify) (14) ____________________

17 Were any of the instruments to be used with youth externally developed and validated?

Yes (1)

No (2)

17b Please list the names of the externally developed and validated instruments your project will

use with youth.


12

EDUCATOR PARTICIPANTS

18 Will your project work directly with educators?

[NOTE: Please respond to this question carefully. The MIS will display questions based on your

response. Once saved, you will not be able to change your response to this question.]

Yes (1)

No (2)

19 Will any youth be taught by participating educators as part of your project's work?

Yes (1)

No (2)

20 Indicate in what way(s) your project work with educators will be structured. (check all that

apply)

Professional development day(s) during the academic year – after school (1)

Professional development day(s) during the academic year – during school hours (2)

Professional development day(s) during the academic year – weekends (3)

Virtual/ Distance Learning (online training or courses, webinars, online community,

conference calls) (4)

Summer Institute and/or Training (5)

Summer Institute and/or Training with youth participants (6)


21 On average, how many contact hours will each individual educator participate in your

project? If educators will have different levels of participation, check all that apply.

Less than 25 hours (1)

25-49 hours (2)

50-74 hours (3)

75-99 hours (4)

More than 100 hours (5)

22 On average, how long will individual educators participate in your project? If educators will

have different lengths of participation, check all that apply.

Less than one year (1)

One year (2)

More than one year (3)

The length of the project (4)


13

23 List each of your project outcomes for educators. Your project may have fewer than six

outcomes for educators. If your project has more than six outcomes for educators, please

contact STELAR at [email protected] to complete the table.

Outcome (choose from list) Provide a brief

description of this

outcome.

changes in self-efficacy in teaching STEM content (1)

changes in implementation of ITEST materials (2)

changes in knowledge for using technology tools in STEM teaching (3)

changes in knowledge of STEM career information (4)

changes in perception of STEM (5)

changes in practice/pedagogy (6)

changes in STEM content knowledge (7)

changes in use of technology tools (8)

Other educator-related outcomes (9)

Educator Outcome 1

Educator Outcome 2

Educator Outcome 3

Educator Outcome 4

Educator Outcome 5

Educator Outcome 6

24 Indicate the data collection method(s) your project will use with educators. (check all that

apply)

Classroom observations (1)

Educator focus groups (2)

Educator interviews (3)

Educator self-reports (journals) (4)

Educator web-based data (blogging, emails, posts) (5)

Embedded assessments (6)

Examples of educator class plans (7)

ITEST project observations (summer institutes, youth activities) (8)

Pre and/or Post Assessments (9)

Videos of students and/or educators (10)



14

24b Indicate the type of Pre- and/or Post-Assessments (content and mode of administration)

your project will use with educators. (check all that apply)

Pre-Assessment Post-Assessment

Written Survey


Written Survey


Attitudes toward STEM and/or STEM careers (1)

STEM content (2)

Technology skills (3)

Other (please specify) (4)

25 Were any of the instruments to be used with educators externally developed and validated?

Yes (1)

No (2)

25b Please list the names of the externally developed and validated instruments your project will

use with educators.

OTHER PARTICIPANTS AND PROJECT ACTIVITIES

26 Indicate which activity or activities will be included in your project. (check all that apply)

Career development (creating a career plan, providing information about career pathways)

(1)

Career skills development (laboratory work, engineering or science lab, using tools,

equipment and instruments found in STEM careers) (2)

Classroom work (academic content learning, in-class projects, guest speakers) (3)

Curriculum development (4)

Field experiences for educators (5)

Field experiences for youth/students (6)

Hands-on activities using technologies common in the STEM workplace (7)

Mentoring of educator participants (8)

Mentoring of youth/student participants (9)

Participation of visiting scientists or STEM professionals (10)

Place-based learning (11)

Problem-based learning (12)



15

27 Many ITEST projects involve participants in addition to youth and/or educators. Indicate who

will work with your project, whether as paid or unpaid staff, volunteers, participants, or who will

provide any kind of formal support. (check all that apply)

Community members (1)

Education professionals (2)

Graduate students (3)

IT/STEM professionals (4)

Parents/families (5)

Professional association staff or volunteers (6)

Tribal elders (7)

Undergraduate students (8)

University faculty or staff (9)


The project will not involve additional participants (11)

28 Indicate what type of partner institution(s) will work with your project. (check all that apply)

Business/Industry (1)

College/University (2)

Community-based organization (3)

Government laboratory (4)

Hispanic serving institution (5)

Historically Black college/university (6)

Other minority serving institution (7)

Informal science education organization (8)

PK-12 school (9)

Not-for-profit organization (10)

Researcher, Research institution (11)


The project will not work with partner institutions (13)


16

RESEARCH AND EVALUATION

29 Indicate what study design(s) will be used to answer your project’s research and/or

evaluation questions. If mixed methods will be used, or different methods will be used to answer

different questions, select all methods that will be used.

Experimental (1)

Quasi-Experimental (with comparison group) (2)

Quantitative, with comparison group (3)

Quantitative with pre/post design (4)

Quantitative, no comparison group (5)

Qualitative, with comparison group (6)

Qualitative, no comparison group (7)


30 Use the space below to add more details about your evaluation and/or research design, as

relevant.

31 How often will the PI/project staff and the evaluator interact?

Once a week (1)

A few times a month (2)

Once a month (3)

Once a quarter (4)

Once a year (5)

DISSEMINATION

32 Do you plan to present your project’s work at conferences?

Yes (1)

No (2)


17

32b Indicate at which conference(s) you plan to present your project’s work. (check all that

apply)

ACM Special Interest Group on Computer Science Education (SIGCSE) (1)

American Educational Research Association (AERA) (2)

American Evaluation Association (AEA) (3)

American Indian Science and Engineering Society (AISES) (4)

American Society for Engineering Education (ASEE) (5)

Association for Science Teacher Education (ASTE) (6)

Association of Science-Technology Centers (ASTC) (7)

Computer Science Teachers' Association (CSTA) (8)

International Conference on Computer-Supported Collaborative Learning (CSCL) (9)

International Council of the Learning Sciences (ICLS) (10)

International Society for Technology in Education (ISTE) (11)

International Technology and Engineering Educators Association (ITEEA) (12)

League for Innovation Science, Technology, Engineering and Math (STEMtech) (13)

National Afterschool Association (NAA) (14)

National Association for Research in Teaching (NARST) (15)

National Education Association (NEA) (16)

National Science Teachers Association (NSTA) (17)

SACNAS: Advancing Hispanics/Chicanos & Native Americans in Science (18)

Serious Games (19)

Society for Information Technology and Teacher Education (SITE) (20)


32c Will one or more of the conference presentations involve collaboration with other ITEST

projects in some way?

Yes (1)

No (2)


18

33 Indicate in what dissemination activity or activities your project will engage. (check all that

apply)

Blogs (1)

Book chapters (2)

Books (3)

Conference presentations (4)

Invited presentations (5)

Media (newspaper, TV, video, radio) (6)

Meetings/topical convenings (7)

Newsletters (8)

Peer-reviewed journal articles (9)

Podcasts or webinars (10)

Social networking (11)

Website (12)

Workshops (13)

Other, please specify (14) ____________________

34 Indicate what product(s) will be developed for your project. (check all that apply)

Apps for phone or tablet (1)

Curriculum/instructional materials (2)

Evaluation strategies (3)

Games (4)

Implementation models (5)

Instruments (e.g., to assess interest, engagement, persistence, motivation, skills, knowledge

of dispositions, etc.) (6)

Professional development materials/teacher training (7)

Program models (8)

Research findings (9)

Software (10)

Technology designs/Prototypes (11)

Textbooks (12)

Theoretical constructs (13)

Videos/Multimedia (14)

Virtual environments (15)

Website (16)

Other, please specify (17) ____________________

The project will not develop any products (18)

35 Please enter the citation for articles, conference or journal papers, or curriculum materials

produced by your project (if any). Please also include accompanying URLs (if any).


19

ADDITIONAL INFORMATION

In this section we ask that you place your project work in the context of NSF’s current goals that

are applicable to the ITEST program, specifically looking at Workforce Development and

Broadening Participation. For each question, providing 1-2 sentences is sufficient.

36 In your project, what specific strategies will be used to broaden participation in your activities

to traditionally underrepresented populations?

37 In your project, what specific strategies will be used to contribute to STEM workforce

development?

38 If there is anything else you would like us to know about your project that you have not had

the opportunity to note, please use this box to do so.

Before you submit your MIS, please be sure that you have answered all questions in each

section. Even if sections have a check mark, there may be remaining unanswered questions.

Once you have checked your responses to all questions, please click the "Submit MIS" below.

Upon submission you will receive an email with all of your responses and a link to a url from

which you can save the responses as a pdf file. To save the responses, click on the link to open

the web page, and then click on the red pdf icon in the upper right corner and follow the

instructions. Once again, thank you for completing this year's MIS. Your participation contributes

to a broader understanding of the value of the ITEST program for the youth and educators it

serves.

ITEST Management Information System (MIS) - Baseline ...stelar.edc.org/sites/stelar.edc.org/files/MIS_Baseline_Survey_Fall... · NSF ITEST Management Information System (MIS) - Baseline

Documents