Education Counts

Page navigation links

  • Education Counts Logo
  • Skip to Primary Navigation Menu
  • Skip to Secondary Navigation Menu
  • Skip to search
  • Skip to content

Site Search

Site Search

Site navigation menus

  • Know your region
  • Find your nearest school
  • Early learning services
  • Directories
  • Publications
  • Statistics
  • Topics
  • Data Services

Search the education counts website

Find pages with

Narrow results by:

Measuring the worth of e-Learner support systems: Developing a possible benchmarking method for evaluation effectiveness Publications

Publication Details

This report was commissioned by the Ministry and undertaken by the Aotearoa Tertiary Students’ Association. It tested a survey-based method for assessing learner perceptions of the effectiveness of e-Learning support systems.

The report also surveyed the beliefs of e-Learning professional staff (tutors and support personnel) about the effectiveness of those systems. The findings of the two surveys were tested for any correlation between the learners’ judgments and staff assessments.

Author(s): Jane Renwick and Stephen Owen, Aotearoa Tertiary Students' Association. Report prepared for the Ministry of Education.

Date Published: May 2005

Executive Summary

The findings in this research (and those from overseas projects) indicate that student support services provide levels of assistance across a range of factors which contribute to the ability of e-learners to complete their study programme. Overall, the relative standard error of the quantitative findings in this report is 8.51% at a 95% confidence interval. The research confirms the factors identified in the ‘E-Learners Support Project’ are aspects of students support services which are likely to mitigate the attrition of e-learners from their study programme

Despite the fact that the population list used for this research was a year out of date at the time when the survey was undertaken, the methodology and research technique produced useful results. It is reasonable to assume that researchers could use a similar technique in the future to measure the worth of student support services, especially those provided to e-learners. It is also reasonable to assume that a similar survey to the ‘E learners Support Project’ would produce a significantly smaller standard error if it were implemented in a timely manner across common e-learning platforms to New Zealand tertiary students.

Currently, the New Zealand tertiary sector is implementing initiatives recommended in the Performance Review of the Performance Element to Tertiary Funding. As part of that review there is a proposal to undertake a survey of students’ tertiary experience. The findings of this report underline the importance of measuring the components of student support services and assessing their effectiveness. Furthermore, this research suggests that the introduction of a generic framework for a performance assessment would need to weight the responses from e-learners across components of student support services to take account of the greater reliance e-learners place on particular aspects of those services.

The findings from the research population indicate that overall the tertiary organisations are providing good student support services that approach the level of performance e-learners expect. They provide a useful bench mark that other providers could use to gauge their own performance across a range of factors which support the e-learner.

The research has highlighted areas where provision of services could be improved to meet the e-learners needs: a trial e-learning programme for potential students, easy navigation of web sites and learning platforms, improved access to generic information, for example, time management, provision of personalised communication with staff, social integration with their cohort and peers and help desk support that is readily understood. The recommendations in this report identify seven aspects of support services that providers with e-learners should measure and assess.  Tertiary providers should now be encouraged to assess and monitor their performance as deliverers of those services.

Of particular interest to providers delivering these services will be the level of importance these e-learners place on the technical assistance they are given and the email communication they receive from staff. The research suggests providers are likely not to be reaching the performance level the e-learners declare optimum.

It appears from the findings that Technical Assistance is above all the most important aspect of support to e-learners. Currently tertiary providers are aware of the need to improve the delivery of this service by extending the hours that help is available.

The e-learners in this research are predominantly a female population with care giving responsibilities to a dependent person. They are clearly a population likely to do their e-learning activities outside the ‘normal’ operating hours of their provider. The recommendations of this report include a suggestion that a one place provision of technical assistance help desk support with extended operating hours is a feasible option for delivery of services to e-learners. The report suggests that the introduction of that service is advantageous as part of our national learning infrastructure.

Navigation

  • All Schooling

Downloads

  • Full Report (PDF, 965.3 KB)
  • Full Report (DOC, 1.3 MB)
  • Full Report (PDF, 1.8 MB)
  • Exec Summary (PDF, 166.4 KB)
  • Full Report (DOC, 2.0 MB)
  • Exec Summary (DOC, 160.5 KB)
  • Appendices (PDF, 866.5 KB)
  • Appendices (DOC, 1.3 MB)

Contact us

Education data requests
If you have any questions about education data please email us at Requests Data and Insights

Home Close Menu
  • Know your Region Show submenu
  • Find your nearest school Show submenu
  • Early Learning Services Show submenu
  • Directories Show submenu
    • Early Childhood Services Directory – APIShow submenu
    • Early Childhood ServicesShow submenu
    • School Directory – APIShow submenu
    • New Zealand SchoolsShow submenu
    • Māori Schools DirectoryShow submenu
      • Māori Schools DirectoryShow submenu
    • Pacific Schools DirectoryShow submenu
    • Tertiary ProvidersShow submenu
    • School Mergers, Closures & NewShow submenu
  • Publications Show submenu
    • Early Childhood EducationShow submenu
    • MāoriShow submenu
      • KME & MMEShow submenu
      • English-medium EducationShow submenu
      • KME or MME, & English-mediumShow submenu
    • SchoolingShow submenu
      • LearnersShow submenu
        • Learners in GeneralShow submenu
        • Education | Learning OutcomesShow submenu
        • Student Engagement | BehaviourShow submenu
      • Learning Support & WellbeingShow submenu
      • WorkforceShow submenu
      • Parents & WhānauShow submenu
      • School Networks | SystemShow submenu
      • CurriculumShow submenu
      • Digital TechnologyShow submenu
      • Large Scale International StudiesShow submenu
    • PacificShow submenu
    • Tertiary EducationShow submenu
      • COVID-19Show submenu
      • LearnersShow submenu
      • Beyond StudyShow submenu
        • DestinationsShow submenu
          • The mobility patterns of New Zealand's doctoral graduatesShow submenu
        • EmploymentShow submenu
        • Income & EarningsShow submenu
        • Other Economic OutcomesShow submenu
        • Social OutcomesShow submenu
      • MonitoringShow submenu
      • Literacy & NumeracyShow submenu
      • Research Performance/FundingShow submenu
      • SystemShow submenu
      • Annual ReportsShow submenu
      • Occasional PapersShow submenu
      • NZ University RankingsShow submenu
      • e-learningShow submenu
    • Learning SupportShow submenu
    • InternationalShow submenu
    • Publication SeriesShow submenu
  • Statistics Show submenu
    • Action Plan for Pacific Education measurement framework dataShow submenu
    • Annual monitoring reading recoveryShow submenu
    • Apprenticeship boostShow submenu
    • Attainment of 18-year-oldsShow submenu
    • AttendanceShow submenu
    • Beyond studyShow submenu
    • Daily attendance dashboardShow submenu
    • ECE financesShow submenu
    • ECE servicesShow submenu
    • ECE staffingShow submenu
    • Early learning participationShow submenu
    • Early leaving exemptionsShow submenu
    • Entering & leaving teachingShow submenu
    • Financial resourcingShow submenu
    • Financial support for tertiary studentsShow submenu
    • First Year Fees Free tertiary educationShow submenu
    • Funding to schoolsShow submenu
    • HomeschoolingShow submenu
    • StaffingShow submenu
      • How does New Zealand’s tertiary education staffing compare internationally?Show submenu
    • Initial teacher education statisticsShow submenu
    • International students in NZShow submenu
    • Language use in ECEShow submenu
    • Micro-credentials & training schemesShow submenu
    • Māori language in schoolingShow submenu
    • NZ's workplace-based learnersShow submenu
    • National school roll projectionsShow submenu
    • Number of schoolsShow submenu
    • Ongoing resourcing schemeShow submenu
    • Pacific language in schoolingShow submenu
    • Per student funding for schoolsShow submenu
    • School board representationShow submenu
    • School boardsShow submenu
    • School donationsShow submenu
    • School leaver pathwaysShow submenu
    • School leaver's attainmentShow submenu
    • School rollsShow submenu
    • School subject enrolmentShow submenu
    • Stand-downs, suspensions, exclusions & expulsionsShow submenu
    • Teacher numbersShow submenu
      • 2021Show submenu
      • 2020Show submenu
    • Teacher turnoverShow submenu
    • Tertiary achievement & attainmentShow submenu
    • Tertiary enrolments in language courses, including Te Reo Māori coursesShow submenu
    • Tertiary participationShow submenu
    • Tertiary population dataShow submenu
    • Tertiary researchShow submenu
    • Tertiary summary tablesShow submenu
    • Pathways from Year 11Show submenu
    • Transient studentsShow submenu
    • Traumatic incidentsShow submenu
    • University rankings fact sheetsShow submenu
    • Vocational education & trainingShow submenu
  • Topics Show submenu
    • He Whakaaro: Education InsightsShow submenu
  • Data Services Show submenu

Site information

  • Site map
  • Contact us
  • About this site
  • Glossary
  • Copyright, Legal & Privacy
  • Links
  • © Education Counts 2026
  • Ministry of Education logo.
  • New Zealand Government logo.
Scroll to top of page