-
National Education Research and Evaluation Centre (NEREC)
Faculty of Education, University of Colombo.
National Report National Assessment of Achievement of
Grade 08 Students in Sri Lanka - 2012
World Bank and Ministry of Education Assisted Publication
May 2013
World Bank Ministry of
Education Faculty of Education
University of Colombo
-
National Assessment of Achievement of Grade 08 Students in Sri
Lanka - 2012
National Report
National Education Research and Evaluation Centre (NEREC)
Faculty of Education
University of Colombo
Colombo 03.
World Bank and Ministry of Education Assisted Publication
May 2013
-
ii
© National Education Research and Evaluation Centre (NEREC)
Faculty of Education, University of Colombo.
ISBN 978-955-1187-24-8
First Published May 2013
Principal Writer: Marie Perera
Data Analysis: P.K.J.E. Nonis
R.D.C. Niroshinie
Gayathri Abeygunasekara (Department of Examinations)
Data Processing: Nayanie Gamaethige
M.H.S.F. Mahsanie
Nadee Gamaethige
K.P. Ganga Udeshika
Anuradha S. Seneviratne
Chathuri Weerasinghe
Varuni Gurugamage
K.M. Kanishka Karunanayake
Jayathu Amarasinghe
Dinupa Thennakoon
Kanthi Amarasinghe
W.C. Gamlath
-
iii
Acknowledgements
It gives me pleasure as the Director of NEREC to express my
thanks to all those who
contributed to make the research study on “National Assessment
of Achievement of
Students Completing Grade 08 in Year 2012 in Sri Lanka” a
success.
• Professor (Mrs.) Kshanika Hirimburegama, Former Vice
Chancellor,
University of Colombo for her encouragement.
• Professor Marie Perera, Dean, Faculty of Education, University
of Colombo
for her guidance in initiating the activities of the project and
writing the
research report.
• Prof. W. Chandradasa, Mr. P.K.J.E Nonis, Ms. R.D.C. Niroshini,
Ms. Jeevani
Herath, Ms. Kumudu Seneviratne, Ms. Lalitha Kumari, Ms.
Sulochana
Neranjani, Mr. Kapila Bandara for their immense contribution to
accomplish
their task as the members of the team.
• Late Ms. P. Jasinghe, Ms. Nilimini Peiris, Ms. Mala Irangani,
Ms. P.M. Walpita,
Mr. L.K. Waduge, Mr. A.W.A. Siriwardana, Ms. D.S. Gamage and
Ms. N.D. Karunarachchi for their services in construction of
test items.
• Ms. Gayathri Abeygunasekara, Commissioner of Examinations
(Research &
Development), Department of Examinations National Evaluation and
Testing
Services, for helping in selecting items from pre-tested items
and item
analysis.
• Dr. Harsha Aturupana (Lead Education Specialist), MS. Deepa
Shankar and
Prof. Upul Sonnadara of the World Bank, for their guidance and
support.
• Mr. S.U. Wijeratne, Additional Secretary, (Planning), Ms.
Madura Wehella
(Director of Education) and Dr. Jayantha Balasuriya (Deputy
Director of
Education), of the Ministry of Education Planning Division for
their unstinted
support in developing and launching the project.
• Mr. Ariyadasa Edirisinghe for the services rendered in
coordinating test
administration and conducting training workshops.
• Ms. Sulochana Neranjani for proof reading the research
report.
• All members of NEREC, for their contribution.
• All members of the Research Management Unit of the University
of Colombo
for the cooperation extended.
-
iv
• All who participated in test administration and gather
background
information from school principals, students, teachers and
parents.
• All other professionals from the provincial, zonal and school
levels who
contributed in numerous ways in carrying out this project.
• All others who assisted me in their respective capacities in
making this
venture a success.
Let me thank all of them, once again.
Prof. M. Karunanithy
Director
National Education Research and Evaluation Centre (NEREC)
-
v
Research Team
M. Karunanithy
Marie Perera
W. Chandradasa
P.K. J.E. Nonis
Kapila Bandara
R.D.C. Niroshini
Jeevani Herath
Lalitha Kumari
Sulochana Neranjani
-
vi
Test Construction Team Overall coordination - W. Chandradasa
Mathematics
Prasadi Jasinghe - University of Colombo
M.N.P. Peiris - Dept. of Mathematics, National Institute of
Education
N.W.P. Mala Irangani - St. Pauls Grils School, Milagiriya
P.M. Walpita - Sirimavo Bandaranaike Vidyalaya, Colombo 07
Science
Kumudu Seneviratne - University of Colombo
L.K. Waduge - Dept. of Science, National Institute of
Education
A.W.A. Siriwardana - Retired ISA
D.S. Gamage - Ananda Balika Vidyalaya, Pitakotte
English
Marie Perara - University of Colombo
E. Sulochana Neranjani - University of Colombo
N.D. Karunaarachchi - RESC, Bolawalana
-
vii
Contents
Acknowledgements iii
Research Team v
Test Construction Team vi
Contents vii
List of Tables x
List of Figures xii
Executive Summary xv
Chapter 1 – Introduction to the Study
1.1 Background 1
1.2 National Assessment Studies conducted in Sri Lanka 3
1.3 Rationale for the present study 3
1.4 National Assessment of Learning Outcomes- 2012 4
1.5 Summary 5
Chapter 2 – Methodology
2.1 Introduction 7
2.2 Objectives of the study 7
2.2.1 Specific objectives of the study 7
2.3 Sampling methodology 8
2.3.1 Desired target population 8
2.3.2 Sampling frame and elements of the sampling frame 9
2.3.3 School level exclusions 9
2.3.4 Defined target population 10
2.3.5 Sample design – procedure 11
2.4 Framework for the National Assessment 13
2.5 Achievement tests 14
2.6 Procedures in Administration of the National Assessment 2012
14
2.7 Analysis of data 16
2.8 Summary 16
Introduction to chapters 3-5 19
-
viii
Chapter 3 - Patterns in Achievement - Mathematics 2012
3.1 Introduction 21
3.2 Patterns of achievement at National Level 21
3.3 Provincial wise student achievement 24
3.3.1 Variation among students 26
3.4 Achievement levels by type of school 29
3.5 Achievement levels by gender 34
3.6 Achievement levels by medium of instruction 38
3.7 Analysis of achievement by competency levels 42
3.8 Summary 50
Chapter 4 - Patterns in Achievement - Science 2012
4.1 Introduction 51
4.2 Patterns of achievement at National Level 51
4.3 Provincial wise student achievement 54
4.3.1 Variation among students 55
4.4 Achievement levels by type of school 58
4.5 Achievement levels by gender 62
4.6 Achievement levels by medium of instruction 66
4.7 Analysis of achievement by competency levels 70
4.8 Summary 79
Chapter 5 - Patterns in Achievement – English Language 2012
5.1 Introduction 81
5.2 Patterns of achievement at National Level 81
5.3 Provincial wise student achievement 84
5.4 Achievement levels by type of school 88
5.5 Achievement levels by gender 93
5.6 Achievement levels by medium of instruction 97
5.7 Analysis of achievement by competency levels 101
5.8 Summary 107
-
ix
Chapter 6 - Conclusions and the Way Forward
6.1 Introduction 109
6.2 Patterns identified in the achievement of learning outcomes
-
2012
109
6.2.1 All island performance 109
6.2.2 Provincial wise performance and trends 110
6.2.3 Achievement according to school types 111
6.2.4 Achievement according to gender 112
6.2.5 Achievement according to medium of instruction 112
6.2.6 Achievement of competency levels 113
6.3 What the findings reveal 114
6.3.1 Impact of the curriculum reforms 114
6.3.2 Opportunities for equity 115
6.4 The way forward 116
References 121
-
x
List of Tables
Chapter 2
Table 2.1: School level exclusions by provinces 10
Table 2.2: Illustrates the defined target population by
provinces 10
Table 2.3: Calculated student sample and school sample per
province 12
Table 2.4: Calculated, allocated and achieved student sample per
each
province
12
Table 2.5: The Content of Achievement Tests and their
distribution in the
papers
13
Chapter 3
Table 3.1: All island achievement in mathematics 2012 –
cumulative
percentages 23
Table 3.2: Provincial achievement in mathematics 2012 –
Summary
Statistics
24
Table 3.3: Mathematics marks achievement according to the school
type 29
Table 3.4: Cumulative student percentages according to the
school type-
Mathematics
32
Table 3.5: Mathematics achievement in summary statistics table
34
Table 3.6: Gender wise mathematics analysis cumulative table
36
Table 3.7: Achievement level by medium of instruction -
Mathematics 38
Table 3.8: Medium wise cumulative percentage Table - Mathematics
40
Table 3.9: Achievement of competency level related to knowledge
and
skills
43
Table 3.10: Achievement of competency levels related to
communication 45
Table 3.11: Achievement of competency levels related to
relationships,
reasoning and problem solving
46
Chapter 4
Table 4.1: All island achievement in science 2012 – cumulative
percentages 53
Table 4.2: Provincial achievement in science 2012 – Summary
statistics 54
Table 4.3: Science marks achievement according to the school
type 58
Table 4.4: Cumulative student percentages according to the
school type -
Science
60
Table 4.5: Science Achievement in summary statistics table
62
-
xi
Table 4.6: Gender wise Science analysis cumulative table 65
Table 4.7: Achievement level by medium of instruction - science
66
Table 4.8: Medium wise cumulative percentage table - Science
68
Table 4.9: Competency levels in relation to Biology 71
Table 4.10: Achievement of Competency levels related to
Chemistry 72
Table 4.11: Achievement of competency levels related to earth
science 73
Table 4.12: Achievement of competency levels related to physics
74
Chapter 5
Table 5.1: All island achievement in English 2012 –
cumulative
percentages
83
Table 5.2: Provincial achievement in English 2012 – Summary
Statistics 84
Table 5.3: English marks achievement according to the school
type 88
Table 5.4: Cumulative student percentages according to the
School Type-
English
91
Table 5.5: English Achievement in summary statistics table
93
Table 5.6: Gender wise English analysis cumulative table 95
Table 5.7: Achievement level by medium of instruction – English
language 97
Table 5.8: Medium wise cumulative percentage table – English
language 99
Table 5.9: Competencies and competency levels in English 101
-
xii
List of Figures
Chapter 3
Figure 3.1: All island achievement in Mathematics 2012 –
dispersion of marks 21
Figure 3.2: All island achievement in mathematics 2012 – boxplot
23
Figure 3.3: Bar chart to represent mean among the provinces -
Mathematics 25
Figure 3.4: Box plot chart representing all island mathematics
achievement 28
Figure 3.5: Bar chart representing the mean values according to
school types
- Mathematics
30
Figure 3.6: Dispersion of marks by school type - Mathematics
31
Figure 3.7: Mathematics marks according to the school types
using Box plot and
whiksper plot
33
Figure 3.8: Bar chart representing mean values according to
gender 34
Figure 3.9: Dispersion of marks by gender 35
Figure 3.10: Box plot and whiksper plot representing gender
wise
mathematics marks
37
Figure 3.11: Bar chart representing mean values according to
medium of
instruction - Mathematics
38
Figure 3.12: Dispersion of marks by medium of instruction -
Mathematics 39
Figure 3.13: Box plot for medium wise achievement - Mathematics
41
Figure 3.14: Achievement of competency levels related to
knowledge and skills 44
Figure 3.15: Achievement of competency levels related to
communication 46
Figure 3.16: Achievement of competency levels related to
Connections,
Reasoning and problem solving
47
Figure 3.17: Facility index value for mathematics 48
Chapter 4
Figure 4.1: All island achievement in science 2012 – dispersion
of marks 51
Figure 4.2: All island achievement in science 2012 – box plot
52
Figure 4.3: Bar Chart to represent Mean among the provinces -
Science 55
Figure 4.4: Provincial wise achievement in science 2012 – box
plot 57
Figure 4.5: Bar chart representing the mean values according to
school types
- Science
58
Figure 4.6: Dispersion of marks by school type - Science 59
-
xiii
Figure 4.7: Science marks according to the school types using
box plot and
whiksper plot
61
Figure 4.8: Bar chart representing mean values according to
gender 63
Figure 4.9: Dispersion of marks by gender 64
Figure 4.10: Box plot and whiksper plot representing gender wise
Science marks 65
Figure 4.11: Bar chart representing mean values according to
medium of
instruction - Science
67
Figure 4.12: Dispersion of marks by medium of instruction -
Science 67
Figure 4.13: Box plot for medium wise achievement - Science
69
Figure 4.14: Achievement of competency levels related to Biology
72
Figure 4.15: Achievement of competency levels related to
chemistry 73
Figure 4.16: Achievement of competency levels related to earth
science 74
Figure 4.17: Achievement of competency levels related to physics
75
Figure 4.18: Facility index value for science part I 76
Figure 4.19: Facility index value for science part II 76
Figure 4.20: Facility index value for science part III 77
Chapter 5
Figure 5.1: All island achievement in English 2012 – dispersion
of marks 81
Figure 5.2: Box plot chart representing all island English
achievement 82
Figure 5.3: Bar chart to represent mean among the provinces-
English
language
85
Figure 5.4: Box plot chart representing all island English
achievement 87
Figure 5.5: Bar chart representing the mean among the school
types- English 89
Figure 5.6: Dispersion of marks by school type – English
language 90
Figure 5.7: English marks according to the school types using
Box plot and
whiksper plot
92
Figure 5.8: Bar chart representing mean values according to
gender - English 94
Figure 5.9: Dispersion of marks by gender - English 94
Figure 5.10: Box plot and whiksper plot representing gender wise
English
marks
96
Figure 5.11: Bar chart representing mean values according to
medium of
instruction – English language
97
Figure 5.12: Dispersion of marks by medium of instruction –
English language 98
-
xiv
Figure 5.13: Box plot for medium wise achievement – English
language 100
Figure 5.14: Competency related to grammar 102
Figure 5.15: Achievement levels in writing brief notes and
mechanics of
writing
102
Figure 5.16: Achievement levels in creative writing 103
Figure 5.17: Facility values in the competency levels related to
vocabulary and
reading
104
Figure 5.18: Facility values for the different test items
–English Language 105
-
xv
Executive Summary
National Assessment of learning outcomes has become an important
component of
education policy analysis and programme monitoring in Sri Lanka.
The National
Education Research and Evaluation Centre (NEREC) of the Faculty
of Education,
University of Colombo has been the forerunner in conducting
these assessments.
NEREC has conducted National Assessment of Learning Outcomes
both at primary
as well as at secondary level. At secondary level National
Assessment of learning
outcomes were conducted at Grade 8 in 2005 and 2008. This report
presents the
findings of a National assessment conducted in grade 8 for
English, mathematics
and science in the year 2012.
The national assessment of learning outcomes of 2012 used new
instruments to test
cognitive skills in English, mathematics and science in keeping
with the new
competency based curriculum which was introduced in 2009 in
grade 8. Therefore,
there is a need to find out whether the introduction of the new
curriculum had an
impact on the learning outcomes.
However, it is not possible to compare the findings of this
assessment with the
previous assessments as new test items have been constructed.
Instead, the 2012
national assessment will serve as the baseline for monitoring
the level and
distribution of learning outcomes overtime.
The national assessment covered the entire country and the
sample was drawn to
enable analysis by province, type of schools, gender and medium
of instruction. It
also collected information pertaining to correlates of
achievement through
administering questionnaires to students, teachers, principals
and parents.
However, this report will be restricted only to the analysis of
the achievement of
learning outcomes related to cognitive skills. The background
information would be
discussed in a separate report.
Patterns in learning achievement was discussed using measures of
central tendency
-Mean and median, Skewness values of the distribution,
cumulative percentages
-
xvi
and percentile ranks. In addition, graphs – frequency polygon
and box plots were
also used
Data gathered through the achievement tests were analyzed on a
national and
provincial basis in relation to medium of instruction, school
type, and gender.
The findings revealed that there is disparity in achievement in
all three subjects in
relation to provincial performance, school type, gender and
medium of instruction.
It was also revealed that the competency based curriculum needs
to be revisited.
-
1
Introduction to the Study
1.1 Background
A world wide emphasize on the need for timely and credible data
on student learning,
that may inform the design of effective mechanisms to improve
educational outcomes,
rather than only on education inputs could be seen. Consequently
there is a dramatic
and global growth in the use of learning assessments (Kamens
& McNeely, 2010).
This shift from an emphasis on education inputs to assessment of
quality was influenced
by the Jomtien Declaration (World Declaration on Education for
All 1990). Article 4 of
the Jomtien Declaration states that the focus of basic education
should be “on actual
learning acquisition and outcome, rather than exclusively upon
enrolment, continued
participation in organized programs and completion of
certification requirements”
(World Declaration on Education for All 1990,p. 5). Another
reason for this shift in focus
was the Dakar Framework for Action (UNESCO 2000), which also
highlighted the
importance of learning outcomes. One of its goals was, by 2015,
to improve “all aspects
of the quality of education . . .especially in literacy,
numeracy, and essential life skills”
(UNESCO 2000, iv, 7).
As a member country agreed on the World Declaration on Education
for All, Sri Lanka
strived to enhance the quality of education by implementing
procedures that will
provide information on students’ learning. One such measure
adopted was monitoring
student achievement through national assessments at different
Grade levels conducted
by the National Education Research and Evaluation Centre
(NEREC). A national
assessment “is designed to describe the achievement of students
in a curriculum area
aggregated to provide an estimate of the achievement level in
the education system as a
whole at a particular age or grade level” (Kellaghan, Greaney
and Murray. 2009, p.xi).
Chapter One
-
Chapter One – Introduction to the study
2
The purpose of a national assessment is not only to provide
information on the state of
education, but also that information should lead to improvement
in student
achievement by systematically feeding into decision making.
Promoting “Equity” and “excellence” and reducing disparities in
the education system is
one of the main focuses of the Government of Sri Lanka. In this
regard a comprehensive
medium term Education Sector Development Framework and Programme
(ESDFP)
from 2006–2010 was developed. This “framework incorporates a
blend of bottom - up
and top – down supportive planning process for the development
of the primary and
secondary education system” (Pg.2) One of the Major areas
identified in this Framework
is “improving the quality of basic and secondary education” and
“increasing equitable
access to basic and secondary education” (p.2) This Framework
further emphasizes
that equitable access means that “each child can access an
education appropriate to his
/her individual learning potential and needs” (Pg.4). The plan
for the second stage of the
ESDFP for the period 2012 -2016. The ESDFP (2013 -2017) is an
extension of the
second stage policy framework and comprises three policy themes
as follows.
Theme 1: Increase equitable access to basic and secondary
Education
Theme 2: Improve the quality of primary and secondary
education
Theme 3: Strengthen governance and service delivery of
education
In addition it provides a foundation theme and a crosscutting
activity to ensure the
achievement of policy themes related results and outcomes.
The foundation : Overarching education sector development
rolling plan : and
Crosscutting activity : Results – based monitoring and
evaluation. (p.1)
Under theme 2 – Improving Quality of primary and secondary
Education, National
Assessment of Learning Outcomes are expected to be utilized for
program
development.
-
Chapter One – Introduction to the study
3
1.2 National Assessment Studies conducted in Sri Lanka
National Assessment of Learning Outcomes has become an important
component of
education policy analysis and programe monitoring in Sri Lanka.
The National
Education Research and Evaluation Centre (NEREC) of the Faculty
of Education,
University of Colombo has been the forerunner in conducting
these assessments.
NEREC has conducted National Assessment of Learning Outcomes
both at primary as
well as at secondary level. At primary level, assessments were
conducted at Grade 4 in
2003, 2007 and 2009 respectively. At secondary level National
Assessment of Learning
Outcomes were conducted at Grade 8 in 2005 and 2008. The results
from these studies,
it is claimed provide “useful information for analysis of policy
and the monitoring of the
progress of the education system” (Aturupana, 2009, p.31).
1.3 Rationale for the present study
This report presents the findings of a National Assessment
conducted in grade 8 for
English, Mathematics and Science.
A national assessment has multiple purposes. According to
Kellaghan and Greaney
2000), all national assessments seek answers to one or more of
the following questions:
• How well are students learning in the education system (with
reference to
general expectations, aims of the curriculum, preparation for
further learning, or
preparation for life)?
• Does evidence indicate particular strengths and weaknesses in
students’
knowledge and skills?
• Do particular subgroups in the population perform poorly? Do
disparities exist,
for example, between the achievements of (a) boys and girls, (b)
students in
urban and rural locations, (c) students from different language
or ethnic groups,
or (d) students in different regions of the country?
• What factors are associated with student achievement? To what
extent does
achievement vary with characteristics of the learning
environment (for example,
school resources, teacher preparation and competence, and type
of school) or
with students’ home and community circumstances?
-
Chapter One – Introduction to the study
4
• Are government standards being met in the provision of
resources (for example,
textbooks, teacher qualifications, and other quality
inputs)?
• Do the achievements of students change over time? This
question may be of
particular interest if reforms of the education system are being
undertaken.
Answering the question requires carrying out assessments that
yield comparable
data at different points in time
(Kellaghan and Greaney, 2008, p.9).
The national assessments conducted in grade 8 in 2005 and 2008
reveal that on average
there is an improvement in achievement levels of Grade 8
students in Science and
Mathematics. The achievement of the English language, which is
the second language of
the students was not assessed. While there was an improvement in
the achievement of
learning outcomes it was also revealed that there are
inequalities in provision of
education in relation to provinces, gender, medium of
instruction and locality (NEREC,
2008).
Although there is a substantial increase in achievement over the
period, the need “for
these findings to be supported by further national assessments
in the future, in order to
reach a reliable and robust conclusion about the magnitude of
improvement”
(Aturupane, 2009, p.33) has been stressed.
On the other hand, in 2007, a new competency based curriculum
was introduced at
grade 6 and in 2009 in grade 8. Therefore, there is a need to
find out whether the
introduction of the new curriculum had an impact on the learning
outcomes.
1.4 National Assessment of Learning Outcomes- 2012
The National Assessment of Learning Outcomes of 2012 used new
instruments to test
cognitive skills in English, Mathematics and Science in keeping
with the new curriculum.
Therefore, it is not possible to compare with the previous
assessments. Instead, the
2012 National Assessment will serve as the baseline for
monitoring the level and
distribution of learning outcomes overtime.
-
Chapter One – Introduction to the study
5
The national assessment covered the entire country and the
sample was drawn to
enable analysis by province, type of schools, gender and medium
of instruction. It also
collected information pertaining to correlates of achievement
through administering
questionnaires to students, teachers, principals and parents.
However, this report will
be restricted only to the analysis of the achievement of
learning outcomes related to
cognitive skills. The background information would be discussed
in a separate report.
Chapter 2 of this report will discuss the methodology of the
study. Chapters 3-5 will
present the findings pertaining to the achievement of cognitive
skills in Mathematics,
Science and English respectively. The final chapter will discuss
the lessons to be learnt
and the way forward.
1.5 Summary
A worldwide concern regarding the need to achieve “Education for
All” is evident. The
challenge before all nations is to ensure that increased access
to education is delivered
in association with improvements in the conditions of schooling
and student
achievement levels.
Sri Lanka being a member country that has agreed to the World
Declaration on
Education for All, has conducted two national assessments of
achievement of learning
outcomes of grade 8 students with the aim of monitoring and
evaluating the quality of
its education systems.
Results of the second study show substantial improvements in
achievement, while there
are still disparities in achievement inter and intra wise
provincial level. A new
competency based curriculum had been introduced in 2009.
Therefore, it is necessary
to assess student achievement in order to find out the impact of
the new curriculum
reforms as well as to provide a baseline for future studies.
-
Chapter One – Introduction to the study
6
-
7
Methodology
2.1 Introduction
As mentioned in chapter 1, the National Assessment of
Achievement of Grade 08 Pupils
in Sri Lanka was conducted in 2012.
This chapter elaborates the methodology adopted in the 2012
study which was slightly
different to the two previous studies conducted in 2005 and
2008.
2.2 Objectives of the study
In accordance with the Education Sector Development Framework
Programme (ESDFP)
and the Development of Education plan through sector wide
approach, two main
objectives were identified.
• Assess the performance of students completing Grade 08 in the
year 2012 in Sri
Lanka.
• Identify the background information which correlates with
students’
performance.
2.2.1 Specific objectives of the study
I. Assess the extent to which the expected learning outcomes
have been
achieved by students.
II. Identify the areas of strengths and weaknesses of students’
achievement in
relation to subject content and related skills.
III. Examine whether disparities prevail in achievement in
relation to provinces,
school type, medium of instruction, and gender.
IV. Investigate background factors that correlate with
achievement levels of
students.
Chapter Two
-
Chapter Two - Methodology
8
In section 2.3, the sampling methodology will be discussed.
2.3 Sampling methodology
The sampling methodology used for this study, was based on an
instructional manual
designed by the Statistical Consultation Group, Statistics
Canada in Ottawa. It has been
recommended by the World Bank in its series, Assessment of
Educational Achievement in
Developing Countries and has been used for evaluation purposes
since 2007 in
international studies such as the IEA Study of Reading Literacy,
the IEA Progress in
International Reading Study (PIRLS), and Trends in International
Mathematics and
Science Study (TIMSS).
In the previous grade 08 studies the sampling methodology was
based on SAMDEM
(Sample Design Manager), designed by the UNESCO International
Institute for
Educational Planning. However, in this methodology the
demarcation between implicit
and explicit strata was not very clear.
Further, in using SAMDEM the cluster size was 20 per school.
When the number of
students in a class was less than twenty, pseudo schools were
used in the sample.
Pseudo schools were formed by joining two schools where number
of students was
greater than 10 but less than 20 and geographically closed to
each other. In the 2012
study, after excluding the extremely small schools (as explained
in 2.3.3) intact classes
have been used irrespective of the number of students in the
class.
Selection of the sample of schools and the sample of students
will be discussed next.
2.3.1 Desired target population
The target population of the study has grade-based definition.
Therefore, students who
have completed eighth grade in the education system of Sri Lanka
in the year 2012 were
considered as the desired target population of this study.
-
Chapter Two - Methodology
9
2.3.2 Sampling frame and elements of the sampling frame
Sampling frame is the list of ultimate sampling entities. Latest
updated school database
available at the Ministry of Education-Sri Lanka (the school
database for the year 2010
June) was the sampling frame used for the study.
Although private schools also provide primary and secondary
education they are not
controlled by the government. In addition, there are a few
international schools which
also provide primary and secondary education. However, these two
categories of
schools are not included in the sampling frame. Accordingly, as
Table 2.1 indicates the
desired target population of the study was 308498 pupils who
completed grade eight in
2012 from 5766 government schools that were listed in the
sampling frame.
However, in selecting the final sample certain schools and
consequently number of
students had to be excluded from the population.
2.3.3 School level exclusions
Extremely small size :
The schools that consist of less than 10 students in grade 06 of
the available MOE
database (2010 June) was considered as extremely small size
schools. Such schools had
been excluded from sample in the previous study as well. Most of
these schools
belonged to Type 3 and even if there were classes up to grade 8
in these schools multi
grade teaching took place. Table 2.1 illustrates school level
exclusions by provinces.
As a result of the exclusion of 3.4% of extremely small schools
from the desired target
all island school population, 1.4% of the desired target all
island student population was
also excluded.
-
Chapter Two - Methodology
10
Table 2.1: School level exclusions by Provinces
Province
Number of Schools Number of Students
Desired
target
Population
excluded %
excluded
Desired
Target
Population
excluded %
excluded
1. Western 935 17 1.82 73704 594 0.81
2. Central 814 36 4.42 39424 619 1.57
3. Southern 695 13 1.87 38872 388 1.00
4. Northern 437 15 3.43 19940 401 2.01
5. Eastern 618 38 6.15 32023 993 3.10
6. North Western 738 9 1.22 36806 170 0.46
7. North Central 433 15 3.46 18816 204 1.08
8. Uva 511 28 5.48 21169 493 2.33
9. Sabaragamuwa 585 25 4.27 27744 526 1.90
All island 5766 196 3.40 308498 4388 1.42
2.3.4 Defined target population
After excluding schools from the desired target population,
remaining schools can be
defined as the "Defined Target Population".
Table 2.2: Illustrates the defined target population by
provinces
Province Defined Target
School Population
Defined Target
Student Population
1. Western 918 73110
2. Central 778 38805
3. Southern 682 38484
4. Northern 422 19539
5. Eastern 580 31030
6. North Western 729 36636
7. North Central 418 18612
8. Uva 483 20676
9. Sabaragamuwa 560 27218
5570 304110
-
Chapter Two - Methodology
11
2.3.5 Sample design – procedure
The sample procedure has a multi stage approach. Multi stage
sampling is a strategy
whereby the final sample is derived through a series of
stages.
In the first stage, schools were selected for the sample.
Schools were selected within
strata with Probability Proportional to Size, without
replacements. Probability
Proportional to Size Sampling (PPS) is a sampling technique,
commonly used in
multistage cluster sampling, in which the probability that a
particular sampling unit will
be selected in the sample is proportional to some known variable
(Ross, K.,2004). Then
in the second stage a group of students was selected from the
sampled schools. Cluster
sampling approach was the strategy used for selection of
students from the grade 08
classes. This means that an entire grade 04 class from each
sampled school was
selected.
In selection of the sample, the present study as in the two
previous studies, the province
was taken as the main stratum (explicit stratum). The rationale
for selecting the
province as the explicit stratum is that in the Sri Lankan
context education being a
devolved subject the Provincial Education Ministries have a key
role in planning,
implementing and monitoring educational plans. Medium of
instruction (Sinhala and
Tamil) and type of school have been considered as implicit
strata, because in Sri Lanka
it is used to report students' achievement by medium of
instructions and type of school.
Accordingly results will be reported for provinces.
Table 2.3 illustrates student sample and school sample per
province with other
important values which decide the size of sampling error, such
as roh and ESS and
design effect. Design Effect is the ratio of the variance of the
sample mean for a complex
sample design to the variance of a simple random sample.
-
Chapter Two - Methodology
12
Table-2.3: Calculated student sample and school sample per
province
PROV
Data
Total
MOS
(average
class size)
roh
Design
effect
ESS=178
school
sample
student
sample
calculated
Western students 73110 34.89 0.25 9.47 1686 49
classes 2095
Central students 38805 28.85 0.25 7.96 1417 49
classes 1345
Southern students 38484 30.64 0.25 8.41 1497 49
classes 1256
Northern students 19539 27.79 0.25 7.69 1370 49
classes 703
Eastern students 31030 29.58 0.25 8.14 1450 49
classes 1049
North Western students 36636 30.05 0.25 8.26 1471 49
classes 1219
North Central students 18612 28.28 0.25 7.82 1392 49
classes 658
Uva students 20676 27.56 0.25 7.64 1360 49
classes 750
Sabaragamuwa students 27218 29.71 0.25 8.17 1456 49
classes 916
Total 13099 441
Table-2.4 illustrates calculated student sample, allocated
student sample and achieved
student sample by provinces.
Table 2.4: Calculated, allocated and achieved student sample per
each province
Province
Calculated
Student
Sample
Allocated Student
Sample as MOE
Student Database
Achieved Student Sample
TIMSS Science Mathem
atics English
Western 1686 1849 1488 1496 1491 1491
Central 1417 1643 1414 1413 1367 1361
Southern 1497 1812 1504 1515 1504 1503
Northern 1370 1384 1281 1269 1288 1291
Eastern 1450 1584 1343 1344 1344 1344
North Western 1471 1663 1465 1471 1434 1437
North Central 1392 1659 1425 1426 1452 1454
Uva 1360 1613 1355 1352 1361 1364
Sabaragamuwa 1456 1778 1580 1588 1573 1572
13099 14985 12864 12874 12814 12817
-
Chapter Two - Methodology
13
The sampling frame was explicitly stratified by province. With
stratification, sample
student size can be calculated in advance of sampling procedure
so that it will meet the
desired level of precision, by each stratum. This ensures that
the target population is
represented adequately in the sample. Study team was satisfied
with 178 as Effective
Sample Size (ESS). This would be an accuracy of plus or minus
7.5% at the error limit at
the province level. Rate of homogeneity, (roh) 0.25 was
calculated from the previous
grade 4 assessment study data. Maximum value of roh at the
province level was taken
for the calculation of the student sample for each province.
Assigning a weight to each
sampled unit was calculated within the explicit strata.
2.4 Framework for the National Assessment
Four achievement tests were used in this study, as instruments
to assess student
achievement.
The construct assessed in these studies were the competency
levels that were expected
to be achieved by grade eight students. Based on these
competency levels Table of
specifications, similar to Table 2.5 was prepared for each
subject to maintain content
validity.
Table 2.5: The Content of Achievement Tests and their
distribution in the papers
Competency Competency
Level
Content domain Cognitive
domain
Question
numbers
-
Chapter Two - Methodology
14
In addition to mathematics, science and English language an
additional paper was
constructed using 40 items selected from the 2011 version of the
Third International
Mathematics and Science Study (TIMSS) framework. However, the
construction and
analysis of student performance in the Sri Lankan version of
TIMSS would be included
in a separate report.
2.5 Achievement tests
The tests in mathematics, science and English Language were
designed based on the
framework for each subject.
Originally three papers were designed for each subject. These
three papers were pre
tested in 10 schools.
After the item analysis, one paper for each subject was designed
selecting items within
the facility values ranging from .4-6.5.
Structure and the number of test items for each paper depended
on the subject. While
the Mathematics paper consisted only selective type questions,
the English language
and science papers consisted of both selective and supply type
items.
Mathematics test consisted of 40 multiple choice questions with
four options. The
English Language paper consisted of 40 items of different types
such as multiple choice,
matching activities, completion of sentences and writing simple
sentences.
The Sri Lankan version of TIMSS consisted of 40 items of
multiple choice questions and
short answer response questions.
2.6 Procedures in administration of the National Assessment
2012
National Assessment of Grade 08 students were administered
island wide on 4th and 5th
of December, 2012. However in some schools because of the
principals’ strike,
examination scheduled on 4th was conducted on 06th of December.
Out of 441 schools,
-
Chapter Two - Methodology
15
two schools in Uva Province and one school in Eastern Province
did not participate in
the test.
Test coordinators
Coordinators to administer the test and collect background
information from sample
schools were appointed from among Lecturers of the Faculty of
Education and students
who follow Master of Philosophy, Master of Education and Post
Graduate Diploma in
Education courses, lecturers and trainee teachers from Colleges
of Education and
Project officers from National Institute of Education. To assist
them, experienced
teachers from the same schools were appointed with the consent
of principals.
Coordinators’ contribution in the process of test administration
and other activities
involved were very much appreciated.
Training workshop for coordinators
Training workshop for coordinators was organized in two phases.
A team representing
NEREC visited the provinces such as North Central, Northern and
Eastern and
conducted workshops at Anuradhapura Polonnaruwa, Vavuniya,
Killinochchi and
Trincomalee zonal offices and Colleges of Education Jaffna and
Batticaloa. Test papers
and other relevant documents were handed over to all
coordinators with necessary
instructions.
The second phase of the training workshops was organized at the
NEREC on 28th, 29th
and 30th of November, 2012. Coordinators from Central, Southern,
Western, North
Western, Subragamuwa and Uva Provinces participated in these
sessions. Test papers
and other relevant documents with necessary instructions were
handed over to them.
All coordinators were advised to meet the principals and the
school coordinators of
sample schools on 3rd of December to do necessary prior
arrangements with regard to
test administration and to distribute parents’ questionnaires.
Background information
in relation to teachers, students and parents were collected on
4th and 5th.
-
Chapter Two - Methodology
16
Given below are some of the measures that were adopted in the
2012 study which were
expected to increase the reliability of the assessment.
• The tests were administered on two week days.
• In order to better monitor the administering of the tests, in
the 2012 study
438 independent coordinators were appointed to the 438
examination
centers.
• As mentioned above, the coordinators had to complete a journal
in which
they had to provide information regarding the conduct of the
examination
and the collection of other relevant background information.
Return of answer scripts and other documents
Coordinators from Central, Southern, Western, North Western,
Subragamuwa and Uva
Provinces handed over the answer scripts and other documents at
the NEREC from 08th
to 20th December. A team from NEREC visited the North Central,
Northern and Eastern
provinces to collect answer scripts and other documents from
18th to 23rd December.
2.7 Analysis of data
Data gathered through the achievement tests were analyzed on a
national and
provincial basis. In order to minimize the effect of the
discrepancy between the
expected and the achieved sample, data was weighted.
Patterns in learning achievement was discussed using Measures of
central tendency
(Mean, Standard Deviation and median) error of mean, Skewness,
cumulative
percentages and percentile ranks. In addition, graphs –
frequency polygon and box plots
were also used.
2.8 Summary
The National Assessment of Achievement of grade 08 pupils of Sri
Lanka in the year
2012 was conducted with the main objective of examining how far
equity is promoted
in the country by enabling all children to access and complete
basic education.
-
Chapter Two - Methodology
17
This chapter elaborated the specific objectives of the study,
sampling procedures and
the frame work of the assessment.
The next three chapters will present the data pertaining to
student achievement in
relation to the three subjects – mathematics, science and
English language.
-
Chapter Two - Methodology
18
-
19
Introduction to Chapters 3 – 5
In chapters 3-5 data pertaining to achievement of learning
outcomes in relation to
mathematics, science and English language would be presented. In
each chapter
the main objective would be to identify patterns in achievement
in relation to
providing equal opportunities in Education.
The patterns in achievement will first be presented at all
island level to get an
overview of the students’ achievement in the relevant subject.
As discussed in
Chapter 2, the explicit strata in the 2012 study is the
province. The implicit
stratum are the gender, school type and medium of instruction.
Thus, Student
achievement will next be presented in relation to province. This
would be
followed by achievement in relation to gender, school type and
medium of
instruction.
In order to discuss the distribution of achievement at National
level, three
indicators are used. They are:
• Measures of central tendency -mean and median
• Skewness values of the distribution
• Measures of relative position -cumulative percentages and
percentile
ranks,
• Graphs – frequency polygons and box plots
The nature of the distribution of scores provincial wise reveals
certain patterns.
These patterns are discussed using the following indicators,
• Measures of central tendency -mean and median
• Skewness values of the distribution
• Measures of relative position - cumulative percentages and
percentile
ranks,
• Measures of variability – range and standard deviation
• Graphs – frequency polygons, box plots and whiksper chart
In the final section of each chapter student achievement would
be presented in
relation to the competency levels identified for the particular
subject would be
analyzed.
-
Introduction to chapters 3-5
20
-
21
Patterns in Achievement –
Mathematics 2012
3.1 Introduction
In 2007, a competency based curriculum was introduced in Sri
Lanka. The present
National Assessment is the first study conducted on the Grade 8
mathematics
curriculum since the new curriculum was introduced.
This chapter presents the patterns in achievement of the
students in mathematics.
3.2 Patterns of achievement at National Level
National Level student achievement would be discussed in
relation to student
performance pertaining to mathematics.
Fig. 3.1: All island achievement in Mathematics 2012 –
dispersion of marks
Chapter Three
Skewness = 0.268
Mean = 51.439
Median = 47.50
-
Chapter Three– Patterns in Achievement: Mathematics 2012
22
The frequency polygon shown in Fig. 3.1 outlines the total
picture of the distribution of
marks of grade 08 students in mathematics.
Fig. 3.1 depicts a skewed distribution of marks. A distribution
is skewed “when one tail
of the distribution is longer than the other tail, making the
distribution
asymmetrical” (Burks and Christerson, 2012, p.461). In this
distribution the tail to the
right is longer, however the numbers even though increasing in
numerical value is less
frequent than towards the left tail. Hence it is positively
skewed.
Even though the mark distribution indicates a positive skewness
it is not very high. A
perfectly symmetrical distribution has a skewness of 0. All
Island mathematics
skewness is 0.268. This indicates that there is a higher
percentage of students with low
marks. Similarly, the distributions are said to be skewed
positively when there are more
individuals in a group who score less than the average score for
heir group.
Fig. 3.2 illustrates student achievement patterns further.
As Fig. 3.2 displays all island mathematics scores range from
zero to approximately
97%.
The all island median which is is the mid point value of the
marks distribution when it is
arranged according to ascending order is 47.5. This means that
50% of the students in
the sample has scored higher than or equal to 47.5 mark points.
On the other hand the
mean of the distribution which is the arithmetic average of the
scores is 51.4.
A positively skewed distribution of marks can be observed. That
is the higher number of
low achievers compared to the high achievers has impacted on the
median value. Hence
there is a difference between the mean and the median.
-
Chapter Three – Patterns in Achievement: Mathematics 2012
23
Fig. 3.2: All island achievement in mathematics 2012 –
boxplot
Table 3.1: All island achievement in mathematics 2012 –
cumulative percentages
Marks
Interval
Student
Percentage
cumulative
Percentage
90 to 100 4.02 100.00
80 to 89 9.35 95.98
70 to 79 11.56 86.64
60 to 69 11.83 75.08
50 to 59 12.79 63.25
40 to 49 16.25 50.46
30 to 39 19.36 34.21
20 to 29 12.42 14.86
10 to 19 2.22 2.43
0 to 9 0.21 0.21
All island mathematics marks corresponding to the class
intervals indicate that 34.21 of
students score less than the pass mark. On the other hand,
another 24.39 of students
have scored above 70, while 50.46% has scored below 50
marks.
-
Chapter Three– Patterns in Achievement: Mathematics 2012
24
These differences emphasize the disparity that prevails in
achievement of learning
outcomes, even though the mean score is relatively
satisfactory.
Although no comparison is possible with previous grade 8 studies
due to the
instruments being different, it is interesting to note that the
mean value in the 2008
study had been 50.4.
Summary of National Level achievement
• The national level mean score is 51.4, while the median is
47.5.
• Disparity in achievement prevails with 34.2 of the national
sample scoring less
than 40 and 24.93 scoring above 70.
Provincial wise student achievement will be discussed next.
3.3 Provincial wise student achievement
Table 3.2: Provincial achievement in mathematics 2012 – Summary
Statistics
Province
Name
Me
an
Ra
nk
Sta
nd
ard
De
via
tio
n
Sta
nd
ard
Err
or
of
Me
an
Pe
rce
nti
le
(p2
5)=
Q1
Me
dia
n
(p5
0)=
Q2
Pe
rce
nti
le
(p7
5)=
Q3
Sk
ew
ne
ss
Western 54.765 1 21.1161 0.2073 37.5 55.00 72.5 0.065
Southern 54.739 2 21.4272 0.2234 37.5 52.50 72.5 0.111
North Western 52.802 3 21.6044 0.2483 35 50.00 72.5 0.233
Sabaragamuwa 52.619 4 20.5242 0.2261 35 50.00 70 0.209
Central 51.203 5 20.6198 0.2448 35 47.50 67.5 0.325
Northern 50.792 6 21.0793 0.3000 32.5 47.50 67.5 0.327
Eastern 48.482 7 21.7137 0.2757 30 42.500 67.5 0.416
North Central 47.160 8 18.7199 0.2162 32.5 42.50 60 0.433
Uva 46.288 9 19.6501 0.2591 30 42.50 60 0.455
All Island 51.439 20.9757 0.0811 35.0 47.50 67.5 0.268
F=170.164, Significance = 0.000
-
Chapter Three – Patterns in Achievement: Mathematics 2012
25
As Table 3.2 indicates based on Provincial wise mean
achievements Western Province
ranks first. Although Western Province is ranked first, the
Southern Province is ranked
second with only a slightly decimal value.
Achievement wise the provinces fall into three categories.
Western, Southern, North
Western and Sabaragamuwa with mean scores above the national
mean, fall into the
higher category. Northern and Central Provinces cluster in the
middle while Eastern,
North Central and Uva fall into the lowest category. Between the
Western and Uva
Provinces there is more than 8 point difference in mean values
indicating the disparity
in achievement among the Provinces.
These disparities are further highlighted through the bar chart
given in Fig, 3.3.
Fig. 3.3: Bar chart to represent mean among the provinces -
Mathematics
Although superficially there appears to be similarity in mean
achievement among
Western and Southern Provinces differences can be observed by
using other statistics.
Median difference between Western and Southern reveals more
information than the
mean difference. Western Province median being 55 indicates that
out of 50% of the
students in the Western Province sample has scored higher than
or equal to 55 mark
-
Chapter Three– Patterns in Achievement: Mathematics 2012
26
points. In the Sothern Province 50% of the students have scored
higher or equal only to
52.5, mark points.
Similarities in achievement among the other provinces can be
seen when the median
value is analysed. It is interesting to note that three distinct
groups can be seen.
Western, Southern, North Western and Sabaragamuwa fall into
category 1 with 50% of
the students scoring higher than or equal to 50 marks. Central
and Northern fall into
category 2 with 50% of the students scoring higher than or equal
to 47.5 marks.
Eastern, North Central and Uva fall into category 3 with 50% of
the students scoring
higher than or equal to 42.5 marks. In these provinces the
median value is below the all
island median.
3.3.1 Variation among students
Standard deviation (SD) indicates the deviation of student marks
from the mean
(average) value of the marks distribution. According to Table
3.2, all the standard
deviation values lie between 18 to 21 ranges. Therefore, in most
of the provinces the
deviation of marks from the mean is similar. As already
discussed, the mean difference
between Western and Southern provinces is very little. However,
the deviation of marks
from the mean in the Southern province is higher compared to the
Western Province.
Therefore, it could be claimed that the achievement differences
among the students in
the Sothern province is higher than in the Western Province.
Highest standard deviation is seen in the Eastern Province. This
means that student
marks deviation from the mean value is higher. This indicates
that there is lot of
variation among student achievement in this province.
North Central and Uva Provinces obtained lower standard
deviations compared to
other provinces and below the National standard deviation.
Therefore, in these
provinces deviation of student achievement from the mean value
is less, compared to
other provinces. Lower SD value indicates homogeneous
performance among these
-
Chapter Three – Patterns in Achievement: Mathematics 2012
27
provinces. However, these provinces have obtained lower mean
than the other
provinces. Therefore, the homogeneity is among low
achievers.
Disparity in achievement
In all the provinces skewness values are positive. Western
Province skewness value
being 0.065 indicates that value is near to zero than the values
in other provinces. This
means majority of the students’ achievement lies closer to
higher values than the lower
values.
On the other hand, in provinces like Eastern, North Central and
Uva the skewness is
higher due to majority of student marks falling among low scores
and they are further
away from the zero value.
Use of Box plot and whisker plot to present provincial wise
mathematics
marks
“A percentile may be defined as a point on the score scale below
which a given percent
of the cases lie”. Defined in this way, 1st percentile (written
as P1) will mean “a point in
the given series or distribution below which one percent cases
lie and above which 99%
cases lie”. Going further, the 25th percentile (p25) will
indicate that score point below
which 25% of the cases lie. Similarly, 75th percentile (p75)
will reveal a score point in a
given series or distribution below which the scores of 75% and
above which 30 %
students of the group fall.
The Percentile index calculated can be used to identify further
characteristics of the
marks distribution.
Western Province first Quartile (Q1) mark 37.5 indicates that
25% of students from the
Western Province sample are below this mark. On the other hand,
Q3 denotes that 75%
of the students from the Western Province sample has scored
below 72.5 Although inter
quartiles are similar between Western and Sothern Province, as
already discussed the
median is higher in Western Province. First Quartile in all
provinces lies between 30 to
-
Chapter Three– Patterns in Achievement: Mathematics 2012
28
37.5. This shows that there is some similarity in this mark
range among provinces.
However, the third Quartile ranges from 60 to 72.5 marks,
indicate greater differences
among provinces.
“A boxplot shows the five statistics (minimum, first quartile,
median, third quartile, and
maximum). It is useful for displaying the distribution of a
scale variable and pinpointing
outliers”. The length of the box is the interquartile range
based on Tukey’s hinges.
That is, IQR=Q3−Q1
Fig. 3.4: Box plot chart representing all island mathematics
achievement
Western and Southern provinces show similar characteristics in
relation to the mark
range between P25 and P75. North Western p75 is equal to Western
and Southern, but
p25 is lower, indicating that while there are high achievers
there are also low achievers.
Sabaragamuwa achievement mark range is better than the Central,
North, Eastern
North Central and Uva. It is interesting to note that Eastern
and Uva are similar with
respect to p25. However, in the Eastern province P75 is very
much higher equaling
Central and Northern Provinces.
North Central Northern
-
Chapter Three – Patterns in Achievement: Mathematics 2012
29
Therefore, the box plot confirms the disparity of achievement
that exists among the
provinces and especially in the Eastern province.
Summary of Provincial Level analysis
• Achievement wise the provinces fall into three categories.
Category 1 – Western, Southern, North Western and Sabaragamuwa
with mean
scores above the national mean ( >51.439)
Category 2 –Northern and Central provinces cluster in the
middle.
Category 3 – Eastern, North Central and Uva.
• Disparity of marks within a province is highest in the Eastern
province.
• In North Central and Uva provinces the disparity of marks is
less , but the marks
are low. Therefore, in these provinces achievement is more
homogeneous but
low.
3.4 Achievement levels by type of school
Table 3.3: Mathematics marks achievement according to the school
type
School
Type
Mean Standard
Deviation
Standard
Error of Mean
Skewness Percentile
(p25)
Median
(p50)
Percentile
(p75)
1AB 61.121 20.1235 0.1070 -0.260 45.0 62.500 77.5
1C 41.719 16.4140 0.1144 0.693 30.0 37.500 52.5
Type 2 38.335 14.8774 0.1427 0.796 27.5 35.000 47.5
All Island 51.439 20.9757 0.0811 0.268 35.0 45.500 67.35
As Table 3.3 indicates there is a considerable gap between the
mean scores of 1AB
schools and type 1C and type 2 schools. While the mean
difference between 1AB and 1C
is 19.402, the difference between 1AB and Type2 is 22.786. These
differences are very
high between school types. 1AB students’ performance appears to
very strongly affect
to increase the all island mathematics mean statistics. 1AB
schools and all island mean
difference is closer to 10 marks, whereas 1C type schools mean
value is 10 marks below
that of the all island mean value. Type 2 performance is even
worse, but more closer to
Type 1C. The need to improve the performance of 1C and Type 2
schools have been
repeatedly stressed in the previous studies and analysis (World
Bank, 2011). However,
-
Chapter Three– Patterns in Achievement: Mathematics 2012
30
in spite of the curriculum revision the gap seems to continue.
This is highlighted in
Fig. 3.5.
The difference in mean scores is graphically shown in Fig.
5.5.
Fig. 3.5: Bar chart representing the mean values according to
school types - Mathematics
The gap between the school types is further highlighted when the
median scores are
considered. The median value of the 1AB schools is considerably
higher than the 1C and
Type 2 Schools. This reveals that 50% of student achievement is
above or equal to 62.50
mark value in the 1AB schools. On the other hand, in 1C and Type
2 schools 50% of
students are scoring below the pass mark. In fact, in 1AB
schools even the bottom 25%
is scoring above the median of 1C and Type 2 schools.
Variation among students
Although achievement is higher in 1AB schools, variation among
student achievements
can also be seen. As shown in Table 3.3 standard deviation of
the 1AB schools is quite
high and second only to the all island value. All Island
standard deviation had become so
high due to the disparity between the high performance of the1AB
schools and the low
performance of the other two types of schools. Type 2 and 1C
schools’ standard
deviations have become more than one third of the mean
statistics. On the other hand,
-
Chapter Three – Patterns in Achievement: Mathematics 2012
31
1AB schools’ standard deviation is only less than one third of
the mean value. Therefore,
even though SD of the 1AB schools is higher than the other two
type of schools,
relatively achievement differences among students in1AB schools
is less than 1C and
Type2 schools.
Fig. 3.6: Dispersion of marks by school type - Mathematics
Disparity in achievement
As Fig. 3.6 depicts, two distinct types of curves. The
negatively skewed curve for the
1AB schools indicate a larger percentage of students with high
scores and lower
percentage of students with low performance. On the other hand,
1C and Type 2
schools’ marks distribution shows a positively skewed curve. As
can be seen from
Fig. 3.6 the negative skewness of the 1AB curve had contributed
to lower the skewness
of the all island curve even though it is still positive.
Contribution of the different types
of schools to the all island mathematics performance can be
further explained through
Table 3.4 giving the cumulative percentage of students’
performance.
-
Chapter Three– Patterns in Achievement: Mathematics 2012
32
Table 3.4: Cumulative student percentages according to the
school type- Mathematics
Class
Interval
1AB
Student
(%)
Cumulative
(%)
1C
Student
(%)
Cumulative
(%)
Type 2
Student
(%)
Cumulative
(%)
90 to 100 7.30 100.00 0.50 100.00 0.10 100.00
80 to 89 15.90 92.70 2.40 99.50 1.20 99.90
70 to 79 17.90 76.80 5.10 97.10 3.20 98.70
60 to 69 15.70 58.90 8.20 92.00 6.00 95.50
50 to 59 13.30 43.20 12.70 83.80 11.40 89.50
40 to 49 12.40 29.90 21.10 71.10 19.50 78.10
30 to 39 11.56 17.50 27.10 50.00 30.10 58.60
20 to 29 4.96 5.94 19.40 22.90 23.40 28.50
10 to 19 0.88 0.98 3.20 3.50 4.80 5.10
0 to 9 0.10 0.10 0.30 0.30 0.30 0.30
Fig. 3.6 displays that 1AB school curve peaked at the 70-79
class interval. Table 3.4,
indicates that 76.80% of the students’ have scored up to this
level. On the other hand,
when the pass mark is considered as 40, in Type 2 and 1C schools
58.60% and 50% of
students are below this mark.
-
Chapter Three – Patterns in Achievement: Mathematics 2012
33
Fig. 3.7: Mathematics marks according to the school types using
Box plot and
whiksper plot
Box plot and whiksper chart graphically shows that Type 2
schools’ achievements are
very low compared to 1C and 1AB school types. More than 75
percent of the students
are below the all island mean statistics indicated by the
horizontal line. However, there
are also a few students who have scored exceptionally high marks
in the Type 2 schools.
1C schools’ achievement indicated by the interquartile is
slightly higher than the Type 2,
but the 3rd Quartile is just below the all island mean Value
line. There are also students
who have done exceptionally well in 1C schools as well. However,
the numbers are less
compared to Type 2 schools. 1AB schools’ interquartile range is
also higher than the
other two school types. However there are no exceptional cases
indicated in the boxplot.
The reasons for exceptional performance by a few students in the
1C and Type 2 schools
need further investigation.
-
Chapter Three– Patterns in Achievement: Mathematics 2012
34
Summary
• The gap between the achievement of students in 1AB schools and
1C and type 2
is wide.
• Majority of the students in 1C and type2 schools, 50% and
58.6% respectively
have scored below 40 marks. On the other hand, only 17.5% have
scored below
40 marks in 1AB schools.
3.5 Achievement levels by gender
Table 3.5: Mathematics achievement in summary statistics
table
Student
Gender
Mean Standard
Deviation
Standard
Error of Mean
Skewness Percentile
(p25)
Median
(p50)
Percentile
(p75)
Female 52.518 20.5271 0.1100 0.228 35.0 50.000 70.0
Male 50.263 21.3916 0.1196 0.332 32.5 47.500 67.5
All Island 51.439 20.9757 0.0811 0.268 35.0 47.500 67.5
There is a slight difference in the achievement of females over
males. As Table 3.5
indicates, male performance is also lower than the all island
mean score.
These differences could also be seen in Fig. 3.8
Fig. 3.8: Bar chart representing mean values according to
gender
-
Chapter Three – Patterns in Achievement: Mathematics 2012
35
Although the mean score of the male students is below the all
island mean, when
considering the median the score for males is equal to the all
island score. According to
Table 3.5, 50% of the male students score is equal or above 47.5
which is also the all
island score. On the other hand, the female students outperform
both the male
performance and the all island performance.
Although male students’ mean achievement is lower than the
female students, they have
obtained a higher standard deviation value. Therefore, the
deviation from the mean is
higher among the male students indicating greater variation
among their performance.
Fig. 3.9: Dispersion of marks by gender
Fig. 3.9 displays two curves which are both positively skewed.
However, as Table 3.5
indicates the male curve has a higher positive value than the
female, as well as the all
island value.
Pattern of the two curves are similar at the beginning, then
peaks become different up
to the 8th class interval (70 to 79). Finally, both curves
become similar again.
-
Chapter Three– Patterns in Achievement: Mathematics 2012
36
The disparity in the male students’ achievement can be
elaborated better through the
cumulative percentages. As can be seen in Table 3.6, the
differences between male and
female performances can be seen mainly up to the 8th class
interval (70 to 79). There on
the cumulative percentages become almost similar.
Table 3.6: Gender wise mathematics analysis cumulative table
Class Interval Female
(%)
Cumulative
Percentage
Male
(%)
Cumulative
Percentage
90 to 100 4.00 100.00 4.00 100.00
80 to 89 9.70 96.00 9.00 96.00
70 to 79 11.70 86.30 11.40 87.00
60 to 69 13.14 74.60 10.40 75.60
50 to 59 13.40 61.46 12.10 65.20
40 to 49 17.10 48.06 15.30 53.10
30 to 39 18.14 30.96 20.70 37.80
20 to 29 11.00 12.82 14.00 17.10
10 to 19 1.71 1.82 2.80 3.10
0 to 9 0.11 0.11 0.30 0.30
According to Table 3.6 and Fig.3.9 it could be concluded that
among both females and
males, there are high performing students. On the other hand,
among both groups there
are low performing students as well. The highest percentage of
students in both groups
fall into the class interval 30-39, which means they are below
the pass mark. However,
the percentage of males falling into this group is higher than
the females. This is a
matter of concern with respect to equity. Therefore, attention
should be paid to improve
the performance of nearly 30-38% of low achievers and especial
attention should be
paid to the low performing males.
-
Chapter Three – Patterns in Achievement: Mathematics 2012
37
Fig. 3.10: Box plot and whiksper plot representing gender wise
mathematics marks
Box plot and whiksper for gender wise mathematics achievement
shows similarities
that has been discussed already. Both student groups start at a
similar base and reach
higher mark ranges at a similar mark points. Median of the
female students is very close
to all island mean achievement.
Summary
• Female performance is slightly better than all island and male
performance.
• While 18.14% of girls have scored below 40, the male is
20.7%
• Equal percentage of males and females have reached the higher
mark range -
70-100.
-
Chapter Three– Patterns in Achievement: Mathematics 2012
38
3.6 Achievement levels by medium of instruction
Table 3.7: Achievement level by medium of instruction -
Mathematics
Medium of
the
Student
Mean Standard
Deviation
Standard
Error of
Mean
Skewness Percentile
(p25)
Median
(p50)
Percentile
(p75)
Bilingual 69.173 16.6879 0.1797 -0.564 57.5 72.500 82.5
Sinhala 50.118 20.3762 0.0984 0.354 32.5 47.500 65.0
Tamil 45.160 19.4672 0.1571 0.596 30.0 40.000 57.5
All Island 51.439 20.9757 0.0811 0.268 35.0 47.500 67.5
There is a wide disparity between the students belonging to the
different medium of
instruction. While the Sinhala medium students’ mean achievement
is closer to the all
island mean value, bilingual students’ mean achievement is
exceptionally high. On the
other hand, the Tamil medium students’ mean achievement is below
the national mean
average and is the lowest.
These disparities are further highlighted through the bar chart
given in Fig. 3.11.
Fig. 3.11: Bar chart representing mean values according to
medium of instruction -
Mathematics
-
Chapter Three – Patterns in Achievement: Mathematics 2012
39
Sinhala medium students’ performance is equal to all island
performance with respect
to the median value. This means that 50% of Sinhala medium
students as well as all
island students score equal or above 47.5%. Comparison using
median value also reveal
same exceptional pattern observed in the bilingual students
achievement. Their median
value being 72.5, the gap between the Sinhala medium as well as
all island performance
is 25. On the other hand, the differences between bilingual and
Tamil Medium is 32.50.
Bilingual medium students’ 25th percentile is equal to Tamil
medium students’ 75th
percentile value. Sinhala Medium students’ 75th percentile is
less than the bilingual
students’ 50th percentile value.
The diversity in achievement scores among the students taught
through the different
medium of instruction, is further highlighted through the
frequency distribution graphs.
Fig. 3.12: Dispersion of marks by medium of instruction -
Mathematics
The disparity discussed using the mean and the median is also
visible through the
frequency distribution graph. While the bilingual students’
curve is negatively skewed
the other two curves are positively skewed.
Bilingual
-
Chapter Three– Patterns in Achievement: Mathematics 2012
40
Bilingual medium students’ curve peaks at the higher mark
ranges, Tamil and Sinhala
medium students’ curves peak at the lower mark intervals.
This medium wise disparity in students’ achievement can be
elaborated better through
the cumulative percentages.
Table 3.8: Medium wise cumulative percentage table -
Mathematics
Marks
Interval Bilingual Cumulative
Percentage Sinhala Cumulative
Percentage Tamil Cumulative
Percentage
90 to 100 11.10 100.00 3.40 100.00 1.80 100.00
80 to 89 21.30 88.90 8.40 96.60 5.20 98.20
70 to 79 23.70 67.60 10.20 88.20 8.50 93.00
60 to 69 18.40 43.90 11.40 78.00 9.40 84.50
50 to 59 11.70 25.50 13.30 66.60 11.90 75.10
40 to 49 7.80 13.80 17.30 53.30 18.00 63.20
30 to 39 5.00 6.00 21.10 36.00 22.90 45.20
20 to 29 0.90 1.00 12.40 14.90 19.00 22.30
10 to 19 0.10 0.10 2.30 2.50 3.10 3.30
0 to 9 0.00 0.00 0.20 0.20 0.20 0.20
With respect to the performance of bilingual students, among the
first class interval
there is no single student, but Sinhala and Tamil medium there
is 0.20 percent of
students. When 5th class interval (40 to 49) is considered, only
13.80 percent of
bilingual students are below this level,
Considering the pass mark as 40, only 6.0% of bilingual students
are below that range.
On the other hand, 36% of Sinhala medium and 45.20% of Tamil
medium students have
scored below the pass mark.
-
Chapter Three – Patterns in Achievement: Mathematics 2012
41
Fig. 3.13: Box plot for medium wise achievement -
Mathematics
Box plot for medium wise achievement graphically shows the
differences that has been
discussed already .
A remarkable feature of this box plot is that even though the
bilingual students’
achievement is exceptionally high there is one outlier. That is,
this student’s marks fall
outside the box plot indicating s/he had scored very low
marks.
There are several co relates which could contribute to the
exceptionally good
performance of the bilingual students. It is claimed that
usually the bilingual students
are a selected group based on their academic proficiency.
Therefore, it is not possible to
draw conclusions regarding the bilingual students’ achievement,
only considering the
test scores. A more in depth analysis may be possible when the
background information
is analyzed.
Bilingual
-
Chapter Three– Patterns in Achievement: Mathematics 2012
42
Summary
• There is wide disparity among students belonging to different
medium of
instruction.
• The Sinhala medium students’ mean score is equal to the
national mean.
Bilingual students mean is higher than the national mean, while
the Tamil
medium students’ mean is lower.
Achievement patterns observed in relation to the achievement in
mathematics, revealed
that there were variations among provinces, school type, gender
and medium wise.
Students’ achievement in relation to subject content will be
discussed next.
3.7 Analysis of achievement by competency levels
In constructing the achievement tests, the test items were
designed in relation to the
competencies and competency levels identified for grade eight.
As discussed in chapter
2, the construct assessed in these studies were the competency
levels. Based on the
competencies and competency levels table of specification was
prepared.
The mathematics paper was based on five main process standards–
knowledge and
skills, communications, relationships, reasoning and problem
solving.
Achievement of competencies related to knowledge and skills
The percentage of students who has answered correctly the
questions related to each
competency level under knowledge and skills is given in Table
3.9
-
Chapter Three – Patterns in Achievement: Mathematics 2012
43
Table3.9: Achievement of competency level related to knowledge
and skills
Competency Level Question
numbers
percen
tage
1.1 Inquires into the relationships between the whole numbers. 2
53.1%
1.2 Manipulates directed numbers under the basic
mathematical
operations 1 36.9%
2.1 Builds relationships between the terms of number patterns
by
investigating various properties 7 39.1%
3.1 Manipulates units and parts under multiplication 3 63.2%
5.1 Develops the relationship between fractions, ratios and
percentages 8 35.9%
7.1 Satisfies various requirements by investigating the
perimeter of
rectilinear plane figures 20 38%
9.1 Facilitates daily work by investigating large masses 18
51%
10.1 Determines for daily needs, the space that is taken up by
various
solids 15 54.9%
11.1 Facilitates daily work by investigating the capacity of
liquid
containers 21 23.7%
12.1 Investigates the rotation of earth and inquires into its
results 19 56.1%
12.2 Investigates the difference in time between countries and
finds
their relative positions 23 34.4%
13.1 Indicates the direction of a location using angles 24
31.8%
15.1 Factorizes algebraic expressions 26 34.6%
20.2 Illustrates the behavior of a variable pictorially 31
32.4%
20.3 Represents location on a Cartesian Plane 30 44.1%
21.1 Examines the angles made by various straight lines 35
43.7%
21.2 Performs calculations using the relationships between
various
angles 36 37.4%
22.1 Created solids and confirms the relationships between
properties
related circles 34 58.3%
23.1 Inquires into the relationships between the various angles
of
rectilinear plane figure 33 33.6%
24.1 Inquiries into the special properties related to circles 32
67.7%
25.1 Inquires into the results of a rotation that are based on
symmetry 37 47%
27.1 Compares varies movements with the basic foci 11 70.6%
29.1 Inquires into numerical representative values of a group of
data 12 68.2%
31.1 Determines the likelihood of an event occurring by
investigating
the various methods of finding a suitable value 13 64.4%
-
Chapter Three– Patterns in Achievement: Mathematics 2012
44
As Table 3.9 indicates the highest percentage of students has
achieved competency level
24.1. On the other hand, the lowest percentage of students has
achieved competency
level 11.1.
The achievement of different competency levels is also
graphically shown in Figure 3.14
Competency levels related to knowledge and skills
Fig. 3.14: Achievement of competency levels related to knowledge
and skills
Achievement of Competency levels related to communication
The percentage of students who has answered correctly the
questions related to each
competency level under communication is given in Table 3.10
Table 3.10 indicates the achievement of competency levels
related to communication.
-
Chapter Three – Patterns in Achievement: Mathematics 2012
45
Table 3.10: Achievement of competency levels related to
communication
Competency level Question
no. Percentage
3.2 Manipulates units and parts of units under division 9
26.7
3.3 Manipulates decimal numbers under the mathematical
operations of multiplication and division. 4 70.4
6.2 Expands a power of a negative integer and finds the value 5
60.1
8.2 Fulfils daily needs by investigating the surface area of
various solids. 16 18.7
13.2 Describes various locations in the environment using
scale
drawings 22 62.4
14.1 Simplifies algebraic expressions by removing brackets
and
finds the value by substitution. 25 45.8
18.1 Uses the relationships between two quantities that can
be
used to enhance beauty. 28 51.6
20.1 Uses a number line to represent fractions and decimal
numbers 29 38.2
26.1 Studies shapes by creating various patterns that can be
used
to enhance beauty. 39 53.4
30.1 Analyze the various relationships related to sets. 40
53.9
As Table 3.10 indicates that the lowest achievement relates to
competency level 8.2. On
the other hand, the highest percentage can be seen in relation
to competency level 3.3.
However, students have been able to perform better in the
competency level 30.1 which
is higher than the lowest performing competency. Therefore, this
analysis implies that
the reordering of the competency levels may be necessary.
-
Chapter Three– Patterns in Achievement: Mathematics 2012
46
Fig. 3.15: Achievement of competency levels related to
communication
Achievement of competency levels related to relationships,
reasoning and
problem solving
Table 3.11 indicates achievement of competency levels related to
Connections,
Reasoning and problem solving
Table 3.11: Achievement of competency levels related to
relationships, reasoning
and problem solving
Standard Competency Level Q. No %
Relationships
4.1 Uses ratios in day to day activities 6 56.3
4.2 Solves problems constructing relationships between
two ratios 10 41.5
Problem
solving
8.1 Finds the area of a compound plane figure in the
environment and has an awareness of the space
allocated for them.
17 52.9
17.1 Uses linear equations to solve problems 27 38.4
Reasoning 27.2 Constructs triangles 38 59
28.1 Represents data such that comparison is facilitated 14
64.8
-
Chapter Three – Patterns in Achievement: Mathematics 2012
47
As Table 3.11 indicates students’ performance in all three
standards are similar. The
test papers were constructed based on the weightage given to
different competency
levels in the curriculum. Therefore, it could be seen that the
weightage given to
relationships, problem solving and reasoning is less compared to
knowledge and skills.
Fig. 3.16: Achievement of competency levels related to
connections, reasoning and
problem solving
As Fig. 3.16 displays that students’ performance in these
standards is average. On the
other hand these are skills essential to be developed in a
knowledge society. However,
the curriculum does not provide adequate opportunities to
develop these skills.
Facility index values for the mathematics paper
The mathematics paper consisted of forty supply type
questions.
Fig. 3.17 di