Assignment #3 - Evaluation Assessment

Engage Stakeholders

Who should be involved?

Grade 9 Program teachers, resource teacher, students, parents, school board

How might they be engaged?

By determining if the goals are being met and if the program is more beneficial than detrimental.

          Focus the Evaluation

What are you going to evaluate?  Describe program (logic model).

The Grade Nine Learning Community at Mount Royal Collegiate

What is the purpose of the evaluation?

To determine whether the program is allowing for a smooth transition from grade eight, and helping to retain students.

Who will use the evaluation? How will they use it?

Who/users	How will they use the information?
Program Teachers	They can make changes to the program depending on the results.
School Administrators	Determine whether the program should continue or not.

What questions will the evaluation seek to answer?

Does the program actually help to transition kids from grade eight to grade nine?

How does it prepare them for grade ten if the program is similar to grade eight groupings?

Does it help retain students more effectively than without the program? Are the relationships authentic – do they continue past grade 9 and consequently lead to success in later years.

What information do you need to answer the questions?

What I wish to know	Indicators – How will I know it?
Attendance data before and after the program was in place	If attendance improved, then the program has some benefit.
Reading and math scores before and after program	If better after, benefit to the program.
Failure rates before and after program.	If students are not failing as many classes as before the program was implemented, then it would indicate merit.
Grade 9 attendance data compared to grade 10 attendance data	If attendance is good in grade 9 and changes significantly in grade 10 it would indicate several things about the program.

When is the evaluation needed?

By the end of the 2012-2013 school year to determine if changes need to be made for next year.

What evaluation design will you use?

A mix of Stake’s Countenance Model, and Scriven’s Summative Model

          Collect the information

What sources of information will you use?

Existing information:	Attendance reports, test results
People:	Teachers in the program, resource teacher, administration,
Pictorial records and observations:	None

What data collection method(s) will you use?

*	Survey		Document review
*	Interview	*	Testimonials
	Observation		Expert panel
	Group techniques		Simulated problems or situations
	Case study		Journal, log, diary
*	Tests		Unobtrusive measures
	Photos, videos	Attendance Reports	Other (list)

Instrumentation: What is needed to record the information?

A program to compile the attendance reports to determine if change has occurred.

When will you collect data for each method you’ve chosen?

Method	Before program	During program	Immediately after	Later
Interview/survey past students of the program		*
Interview/survey teachers in the program		*
Attendance reports		*	*

Will a sample be used? 

No
Yes	*	If yes, describe the procedure you will use.
Students in grades 9, 10 and 12 will be used to gain information about their take on the program.

          Analyze and Interpret

How will the data be analyzed?

Data analysis methods:

Analyze the surveys to determine if students find benefit to the program –interview grade 9, 10 and 12 students – students who are in the program, recently out of the program, and students who have had time to reflect on the program. Teacher responses will also be analyzed to determine how they believe the program is running. Analyze grade 9 attendance and test results and compare them to the same students in grade ten

Who responsible:

Me

How will the information be interpreted—by whom?

I will interpret the information by compiling answers and looking for consistency

What did you learn? What are the limitations?

Some of the responses could be subjective, from both the teachers in the program, and from the students. There are many variables that can determine a response; grade 9 students may not be the most reflective when it comes to their learning and motivations.

Teachers of the program may be biased because they started it and are so close to it.

               Use the Information

How will the evaluation be communicated and shared?

To whom	When/where/how to present
Teachers of the program	Present reports on data and how students perceive the program and what is happening in reality.
Administration	Present reports on data and how students perceive the program and what is happening in reality.

Next steps?

Show this to the teachers of the Grade 9 Learning Community to determine where the gaps are

          Manage the evaluation                 Standards

Reports will be anonymous	Human subject’s protection		Utility
	Management chart		Feasibility
	Timeline		Propriety
*	Responsibilities		Accuracy
None Needed	Budget