Mathematics and Science Partnership (MSP) Programs U.S. Department of Education: Baltimore Regional Meeting February 14-16, 2011.

Mathematics and Mathematics and Science Partnership Science Partnership

(MSP) Programs(MSP) Programs

Mathematics and Mathematics and Science Partnership Science Partnership

(MSP) Programs(MSP) Programs

U.S. Department of U.S. Department of Education: Education:

Baltimore Regional Baltimore Regional MeetingMeeting

February 14-16, 2011February 14-16, 2011

MSP Grant and Funding Cycle

States have 15 months to award funds on

a competitive basis to partnerships consisting of STEM faculty at an IHE and

a “high-need” local education agency.

Funds are released to the states through a formula

grant (number of students at poverty level) each July.

Congress appropriates funds for the program.

Projects submit annual/final reports to U.S. Department of Education within 60 days at the end of each 12-month

reporting cycle. U.S. Department of Education

Program Cycle

States fund winning project proposals. States submit a

copy of each funded proposal to U.S. Department of

Education 30 days after award date.

The Annual Progress Report (APR)

• SEC. 2202.(f): Each eligible partnership receiving a grant or sub-grant shall report to the Secretary…

• Partnerships/projects must send their APRs to their State Educational Agency (SEA), the SEA must review and approve the APR, and submit it to the U.S. Department of Education (USED) within 60 days from the end of the performance period.

Overview of the APR Submission Process

(Norm)SEA creates an APR for the project to complete

The project completes the APR and submits it to the SEA by the indicated date.

The SEA reviews the APR and determines if the APR is acceptable OR if revisions are needed.

SEA sends the APR to the USED. The USED reports MSP results to Congress.

OR…Partial Submission (extraordinary)

SEA creates an APR for the project to complete

The project completes the APR and performs a partial submission and informs the SEA of when the APR will be completed by the indicated date. (Only with SEA approval).

The SEA reviews the partially submitted APR and determines if the APR is acceptable OR if revisions are needed & accepts or negotiates the final submission date with USED input.

SEA sends the APR to the USED. The USED reports MSP results to Congress.

APR Example• Typical Example:

– Project Achieve is awarded a 3 year MSP sub-grant that has a start date of 10/1/2009 and an end date of 9/30/2012; with “performance period 1” starting on 10/1/2009 to 9/30/2010.

– The project has 12 months to complete their activities for that first year (as indicated in their application to the state).

– During the first 12 months the project would have completed their first year’s activities, collected student data, collected teacher data and would be ready to enter the findings into the report by 9/30/2010. Much of the basic project information can be entered earlier.

APR Example (continued…)

– The project finishes the APR and sends it to their SEA (at a time determined by the SEA; before 60 days).

– The SEA will review the APR and determine if • The APR is complete and accurate; or• The APR needs revision.

– If the APR is complete and accurate the SEA will submit the report to USED by 11/30/2010 (60 days after the performance period).

– If the SEA has determined that the APR needs revisions, the SEA will comment on the report, the project will make the needed changes, resubmit to the SEA, the SEA will review again, and still submit to USED by 11/30/2010 (60 days after the performance period).

APR Example (continued…)

– This process will continue until…• The project has completed a full cycle (in this

case 3 years) and submits their final APR (projects are encouraged to also submit their Final Evaluation Report that summarizes all 3 years of activities); or

• The project is discontinued (a decision made by the SEA).

– At the end of the full performance cycle projects must re-compete to receive an additional cycle of funding. (Note: not all states have 3 year cycles)

Ed-MSP.NET

APR Due Dates

Accessing your APR• Post-award, your SEA coordinator should

create a new APR for newly funded projects and continuing projects.

• You should receive an email from Ed-MSP.net (check your spam box).

• If you have forgotten your login or password please access the forgotten password option on the login page located on http://apr.ed-msp.net.

Logging In

After accessing this link, it will ask you for your email (contact your SEA if you are not sure which email is listed).

The system will send you an email to re-establish your new login and password.

If that does not work contact [email protected] or your state’s contact at USED

Levels of AccessThere are three levels of access for projects

1. Project Directors can read, write, and submit reports to their state coordinators. (2 Max)

2. Other Contacts can read and edit reports. (5 Max)

3. Read-only access. (5 Max)*It is the project’s responsibility to tell the SEA

which individuals require access and their levels.

Completing the APR

Most of your answers can be found in the User's Guide…please refer to this document.

User’s Guide

A copy of the User’s Guide can be found as a part of your handouts!

User’s Guide Overview• Step-by-step instructions on how to

complete the report.• Includes definitions that describe what

each section should include.• Includes FAQ’s • Includes technical information on the

Mathematics and Science PartnershipsTeacher Content Knowledge (MSPTCK)

• User’s Guide for the MSPTCK

Completing the APR (cont…)

Edit New APR…allows the project to enter data into the APR

Change APR Status…allows the PD (only) to submit the report to the SEA coordinator.

Completing the APR (cont…)

The Status column indicates where the project is in the APR submission process.

-Incomplete…not submitted to SEA

-Approval Pending…sent to SEA; SEA has yet to review.

-Revisions Needed…reviewed by the SEA; project must re-submit to the SEA after changes have been made.

-Partial Approval…project is missing core data (teacher, student, and/or evaluation); project must re-submit when data is complete by the approved date.

-Approval Granted…SEA has approved the APR and submitted to USED.

APR Contents

APR Section I- MSP Project Information

This section provides a summary of basic project information:

a) Project: Name, APR Performance Period, funding amount, etc.

b) Lead Organization: the fiscal agent.c) Partner Organizations: includes the fiscal

agent, the High-Need Local Education Agency (LEA), the Institute of Higher Education (IHE), partner schools (public and private), other LEAs (charters, etc.), businesses, non-profits, or other.

Section II- AbstractThis section asks the project to briefly

describe their project. The abstract should include a description of:-the participants (teachers, student, etc);-the professional development models and/or interventions;-any other information the project would like to share.

*The abstract will be viewed as a public document on the ed-The abstract will be viewed as a public document on the ed-msp web-site and msp web-site and must be cut & pasted into this sectionmust be cut & pasted into this section. It . It may notmay not be saved as an attachment. be saved as an attachment.

Section II- Abstract

You must either copy and paste or type into the text box below.

Section III- ResponsibilitiesThis section is designed to identify the various

partners’ roles and responsibilities.a) Administer the Overall Partnership: (logistical

management, budgeting, recruitment, etc).b) Designing Professional Development: (Creating PD

curriculum, designing learning tools, assessments, etc).

c) Deliver Professional Development: (Leading the PD sessions, technical assistance, etc).

d) Evaluate MSP: (Collecting and/or analyzing data, designing the evaluation plan, etc.).

Section III- Responsibilities

Projects should make their best estimate in this matter; however it should be noted that the percentages should add up to 100%

Section IV- PD Participants

This section asks about information on participants in professional development activities

a) Number of Higher Ed Faculty involved in the MSP Project (math, science, engineering, education, and other)

b) 1. Primary Goal (improving teachers’ content knowledge, training teachers leaders, both, or other)

Section IV- PD Participants

b) 2. Primary Target (individual teacher or schools)

If you select schools, you will then enter information on each school and tell whether the selection of schools focused on high-need schools.

Section IV- PD Participants

The remaining sections identify the number of participants in an MSP project.

c) Total teachers receiving MSP PD in Math or Science (don’t double-count!)

d) Elementary School Teacherse) Middle School Teachersf) High School Teachersg) Administrators*h) Participant Students

*The focus of PD must be on training teachers, and teachers must make

up the majority of participants. Administrators may attend PD, but can

not receive a stand-alone offering.

Section IV- PD Participants

If a teacher teaches multiple groups of students (e.g. general education and AP) count the teacher only once – under the teacher’s primary/dominant role.

If a teacher teaches multiple groups of students (e.g. general education and AP) count the teacher only once – under the teacher’s primary/dominant role.

Section V- PD ModelsThis section asks the project to identify the

number of contact hours, the structural model, and a detailed account of activities in the professional development models.

a) Contact Hours: the average number of PD hours provided to each teacher (e.g. summer institute hours, on-line follow-up, etc…not independent study, etc.)

b) Type of PD Activities: this section asks the project to identify the structural model and primary focus of PD:

1. Summer institute: PD that is conducted for at least 2 weeks and 60 hours

2. Summer institute with follow-up: a summer institute plus at least 3 days of follow-up training conducted in the classroom during the academic year.

3. Other: Any structure that is not listed above.c) Description of Professional Development Model

-Provide a description about the person that provided the PD and a more detailed account of the activities.

Section V- PD Models

Choosing a PD type will open a specific series of windows that allow the project to provide further detail.

Section VI- Professional Development Content

This section identifies the Professional Development Content.

• Mathematics Content• Science Content • Both

Section VI- Professional Development Content

Section VII- Program EvaluationA) Type of Evaluator B) Evaluation Design: Identify the primary design

(Random Assignment, Matched Comparison, Non-matched comparison, One-group, Qualitative/descriptive, or other) and provide a brief description

• Did your project administer pre/post tests? When did the tests take place (immediately before the PD, immediately after, 3 weeks after, etc.) & how often?

• Did you assess student content knowledge?• Did the project use other measures of success, if so please

describe?• Include any relevant information about sampling, data

collection procedures, and analysis .

C) Phase of Implementation

Section VII- Program Evaluation

Choose the Phase of Implementation

Section VII- Program Evaluation

D) Assessment Measures:• Provide information on eacheach assessment

used to evaluate teachers & information on each each assessment used to evaluate students.

• Indicate whether each assessment has been tested for validity and reliability and (if applicable) whether it is used for GPRA.

Section VII- Program Evaluation

If the project uses multiple assessments (as many projects do)…the project must access this page and option multiple times to report on each assessment or evaluation tool.

Section VII- Program EvaluationE) Analysis of Changes in Teacher Practice:

- How did your project measure success in the classroom?

F) Teacher FindingsG) Student FindingsH) Impact on the PartnershipI) Other Impacts*In these narrative sections, please describe

anecdotes or describe evidence of the program’s effectiveness.

Section VII- Program EvaluationJ) Upload Report: Evaluation report

In the Evaluation Report, we are looking for specific information on how the evaluation was designed and implemented. • How did the project determine if teachers experienced

statistically significant gains in content knowledge?• Were there any threats of contamination? If so, how

were they handled?• Provide a timeline and description of each of the

evaluation activities.• The Final reports should address the Data Quality

Initiative (DQI) rubric criteria (if projects are reporting experimental or quasi-experimental designs).

Section VII- Program Evaluation

If projects do not have the evaluation report ready by the date of submission, projects may (in consultation with the SEA and USED) partially submit the APR until the evaluation report is completed.

Section VII- Program Evaluation

Please note…if this is your project’s final year (and will have to re-compete to acquire additional funds), please check this box & attach an evaluation that evaluated the project across its entire performance cycle.

This should include (among other things) the aggregate student and teacher information and evaluation across the life of the project.

Section VIII- Government Performance & Results Act

A) Teachers:• Use the MSPTCK spreadsheet to indicate the

number of teachers who have made statistically significant gains in all professional development opportunities.

*Remember to save the spreadsheet to your personal computer as it will not save on the site.

B) Students:• Include student data using only the most important

assessment for mathematics or science.

*For Both Sections:-If the results are unavailable, projects may (with consultation of SEA and the USED) perform a partial submission.

Section VIII- Government Performance & Results Act

Section VIII- Government Performance & Results Act

Click the spreadsheet…

Note: if the project has administered more than one content knowledge assessment to different groups of teachers, run the MSPTCK for each group and aggregate the results.

If you have difficulty please access the users guide.

Section VIII- Government Performance & Results Act

Select Enable Macros

Section VIII- Government Performance & Results Act

Section VIII- Government Performance & Results Act

If you need detailed instructions please access this link for step by step directions.

Section VIII- Government Performance & Results Act

States may have changed their assessment structure, but the concept of application remains the same

Section IX- Lessons Learned

In this section we are asking the project to provide an overview of the challenges and successes encountered in the project over the past 12 months.A) MSP ImplementationB) MSP Evaluation

Section X- State Review

This section is to be filled out by the state coordinator.

A) 1. MSP initial award date2. Length of MSP award3. Current year of implementation4. Indicate if it is a final report

Section XI- Supplementary Docs.

Questions?• Pat O’Connell Johnson at

[email protected] Or

• [email protected]

Mathematics and Mathematics and Science Partnership Science Partnership

(MSP) Programs(MSP) Programs

Mathematics and Mathematics and Science Partnership Science Partnership

(MSP) Programs(MSP) Programs

U.S. Department of U.S. Department of Education: Education:

Baltimore Regional Baltimore Regional MeetingMeeting

February 14-16, 2010February 14-16, 2010