TIMSS 2010/11: New Zealand Year 9 students' strengths and weaknesses in science Publications
Publication Details
This booklet contains a selection of TIMSS 2010/11 test questions from the four science content domains. It includes examples of questions where New Zealand Year 9 students did better than the international average and examples where they did worse. For those questions where New Zealand students struggled, suggested resources are provided for use in the classroom for teaching the topics these questions relate to. This booklet is intended as a resource for Year 9 science teachers.
Author(s): Research, Ministry of Education.
Date Published: April 2014
This report is available as a download (please refer to the 'Downloads' inset box). For links to related publications/ information that may be of interest please refer to the 'Where to Find Out More' inset box.
Summary
Along with students from over 60 countries, New Zealand’s Year 9 students took part in the 2010/11 cycle of the Trends in International Mathematics and Science Study (TIMSS 2010/11). This study measures trends in mathematics and science achievement in Years 5 and 9 and identifies effective instructional practices from around the world. After every cycle of TIMSS some of the test questions are released to the public, while some are kept confidential to help measure trends from one cycle to the next.
This booklet contains a selection of TIMSS 2010/11 test questions from the four science content domains. It includes examples of questions where New Zealand Year 9 students did better than the international average and examples where they did worse. For those questions where New Zealand students struggled, suggested resources are provided for use in the classroom for teaching the topics these questions relate to. This booklet is intended as a resource for Year 9 science teachers.
The TIMSS content and cognitive domains
The assessment in TIMSS is organised around a content domain and a cognitive domain. Details of these domains are published in the TIMSS 2011 assessment frameworks (Mullis et al., 2009). The content domain for Year 9 (Grade 8) science has four areas: biology, chemistry, physics, and Earth science. The biology content area is similar to the living world strand in the New Zealand Science Curriculum, and the Earth science area is similar to the planet Earth and beyond strand. The physics area corresponds to the physical world strand of the New Zealand Curriculum and chemistry the material world strand.
The cognitive domain for science is made up of three areas that describe the thinking processes students must use as they engage with the content: knowing, applying, and reasoning.
In the content domain, New Zealand Year 9 students did relatively better on Earth science questions and worse on chemistry questions in 2010/11. In the cognitive areas, our students scored relatively worse on applying and relatively better on reasoning when compared to our overall science score.
The questions (and accompanying score points) in the TIMSS test were not evenly distributed across all content and cognitive areas. The distribution reflects the content and cognitive emphasis of the curricula of the participating countries. In the science content areas at Year 9, the most emphasis was on biology, followed by physics and chemistry, then Earth science.
Time spent on content and cognitive areas in New Zealand classrooms
On average, New Zealand Year 9 teachers indicated that they spent 27 percent of their science teaching time in the school year on biology (e.g., structure/function; life processes, reproduction/heredity, natural selection; ecosystems, human health). Twenty-eight percent was spent on chemistry (e.g., classification, composition and properties of matter; chemical change) and 27 percent was spent on physics (e.g., physical states/changes in matter; energy; light; sound; electricity and magnetism; forces and motion). An average of 14 percent of teachers’ science teaching time was spent on Earth science (e.g., Earth’s structure, processes, and resources; the solar system and universe) and four percent of teachers’ time was spent on general topics other than those four.
According to teachers, the cognitive emphasis in their lessons was on getting students to give explanations about something they are studying (58% in every or almost every lesson) and relating what they are learning in science to their daily lives (45% in every or almost every lesson), rather than on memorising facts and principles (6% in every or almost every lesson).
Test curriculum matching analysis
When developing TIMSS 2010/11, every effort was made to ensure the widest possible coverage of the mathematics and science curricula in each country. However, inevitably the TIMSS 2010/11 tests were not a perfect match for every curriculum, and so some questions fell outside the scope of what the children had covered in class. To address this issue, each country was asked to indicate which questions on the tests were inappropriate for their curriculum. Those questions in which New Zealand students did worse than the international average and were mismatches for the New Zealand curriculum have not been included in this booklet.
How is the information in this booklet presented?
Each question in the four science contents areas gives the question, identification label and item number, the content and cognitive domain it relates to, the expected answer (and in some cases typical wrong answers), and a table with a selection of countries’ results for comparison. This table shows the percentage of students who correctly answered the question and achieved the maximum number of points. The number/s of released booklets in which the questions can be found are also mentioned in the table.
Benchmarks
The TIMSS benchmarks describe what students can typically do at set points on the science scale: low (400), intermediate (475), high (550), and advanced (625). Each test question is categorised as being ‘anchored’ at one of these benchmarks. This benchmark anchor level is given in the text above each question and gives an indication of the difficulty of the question. More information about the benchmarks can be found in Martin et al. (2012).
Navigation
Where to find out more
Contact Us
Education Data Requests
If you have any questions about education data please contact us:
Email: Requests Data and Insights
Phone: +64 4 463 8065