TIMSS 2010/11: New Zealand Year 9 students' strengths and weaknesses in mathematics Publications
Publication Details
This booklet contains a selection of TIMSS 2010/11 test questions from the four mathematics content domains. It includes examples of questions where New Zealand Year 9 students did better than the international average and examples where they did worse. For those questions where New Zealand students struggled, suggested resources are provided for use in the classroom for teaching the topics these questions relate to. This booklet is intended as a resource for Year 9 mathematics teachers.
Author(s): Research, Ministry of Education
Date Published: April 2014
This report is available as a download (please refer to the 'Downloads' inset box). For links to related publications/ information that may be of interest please refer to the 'Where to Find Out More' inset box.
Summary
Along with students from over 60 countries, New Zealand’s Year 9 students took part in the 2010/11 cycle of the Trends in International Mathematics and Science Study (TIMSS 2010/11). This study measures trends in mathematics and science achievement in Years 5 and 9 and identifies effective instructional practices from around the world. After every cycle of TIMSS, some of the test questions are released to the public while some are kept confidential to help measure trends from one cycle to the next.
This booklet contains a selection of TIMSS 2010/11 test questions from the four mathematics content domains. It includes examples of questions where New Zealand Year 9 students did better than the international average and examples where they did worse. For those questions where New Zealand students struggled, suggested resources are provided for use in the classroom for teaching the topics these questions relate to. This booklet is intended as a resource for Year 9 mathematics teachers.
The TIMSS content and cognitive domains
The assessment in TIMSS is organised around a content domain and a cognitive domain. Details of these domains are published in the TIMSS 2011 assessment frameworks (Mullis et al., 2009). The content domain for Year 9 (Grade 8) mathematics has four areas: number, algebra, geometry, and data and chance. These content areas relate to the strands of the New Zealand Mathematics and Statistics Curriculum: number and algebra, geometry and measurement, and statistics. These strands are themselves combinations of five strands from the previous Mathematics Curriculum (number, algebra, measurement, geometry, and statistics).
The cognitive domain for mathematics is made up of three areas that describe the thinking processes students must use as they engage with the content: knowing, applying, and reasoning.
In the content domain, New Zealand Year 9 students did better at data and chance questions and worse at algebra questions in 2010/11. In the cognitive areas, our students did better at tasks that required them to apply their knowledge and use their reasoning and worse at questions that required them to demonstrate their knowledge of mathematical concepts, procedures, and facts.
The questions (and accompanying score points) in the TIMSS test were not evenly distributed across all content and cognitive areas. The distribution reflects the content and cognitive emphasis of the curricula of the participating countries. In the mathematics content areas at Year 9, the most emphasis was on algebra, followed by number. Note also that the content area in which New Zealand Year 9 students showed the greatest strength, data and chance, had the least number of questions (along with geometry).
Time spent on content and cognitive areas in New Zealand classrooms.
On average, New Zealand Year 9 teachers indicated that they spent almost one-third of their mathematics teaching time (32%) in the school year on number (including whole numbers, fractions, decimals, ratio, proportion and percent). Twenty-four percent of mathematics teaching time was spent on algebra (including patterns, equations, formulas and relationships) and 25 percent on geometry (including lines and angles, shapes, congruence and similarity, spatial relationships, symmetry and transformations). On average, 17 percent of teachers’ time was spent on data and chance (including reading, organising and representing data, data interpretation and chance), and 2 percent on general topics other than those four.
According to teachers, the cognitive emphasis in their lessons was on getting students to work problems (individually or with peers) with teacher guidance (68% in every or almost every lesson), explain answers (52% in every or almost every lesson) and apply facts, concepts and procedures to solve routine problems (50%), rather than on memorising rules, procedures and facts (19% in every or almost every lesson).
Test curriculum matching analysis
When developing TIMSS 2010/11, every effort was made to ensure the widest possible coverage of the mathematics and science curricula in each country. However, inevitably the TIMSS 2010/11 tests were not a perfect match for every curriculum, and so some questions fell outside the scope of what the children had covered in class. To address this issue, each country was asked to indicate which questions on the tests were inappropriate for their curriculum. Those questions in which New Zealand students did worse than the international average and were mismatches for the New Zealand curriculum have not been included in this booklet.
How is the information in this booklet presented?
Each question in the four mathematics content areas gives the question, identification label and item number, the content and cognitive domain it relates to, the expected answer (and in some cases typical wrong answers), and a table with a selection of countries’ results for comparison. This table shows the percentage of students who correctly answered the question and achieved the maximum number of points. The number/s of released booklets in which the questions can be found are also mentioned in the table.
Benchmarks
In the body of the test above each set of questions, the benchmarks to which the questions are anchored are included. These benchmarks link student performance on the TIMSS mathematics scale to performance on mathematics questions and describe what students can typically do at set points on the mathematics achievement scale. More information about the benchmarks can be found in Mullis et al. (2012).
Navigation
Where to find out more
Contact Us
Education Data Requests
If you have any questions about education data please contact us:
Email: Requests Data and Insights
Phone: +64 4 463 8065