MANAGING NATIONAL ASSESSMENT REPORT. Southland Boys High School

Transcription

1 MANAGING NATIONAL ASSESSMENT REPORT Suthland Bys High Schl September 2016

2 Managing Natinal Assessment Review The purpse f reviewing the management f natinal assessment is: t help schls achieve valid, fair, accurate and cnsistent internal assessment accrding t the requirements f the Assessment (including Examinatin) Rules fr Schls with Cnsent t Assess 2016 (Assessment Rules); and t cnfirm that schls are meeting the requirements f the Cnsent t Assess Against Standards n the Directry f Assessment Standards Rules 2011 (CAAS) and its Guidelines (CAAS Guidelines) in rder t maintain their cnsent t assess, in cmbinatin with the mst recent Educatin Review Office reprt. The review has three cmpnents: The annual external mderatin f assessment materials and f teacher grade judgements fr student wrk selected by the schl s randm-selectin prcess. A randm sampling f aspects f assessment systems and data fr review r audit n an annual basis. A visit t review each schl s assessment systems at least nce every fur years. Managing Natinal Assessment Reprt This reprt summarises NZQA s evaluatin f hw effectively the schl: has addressed issues identified thrugh the three cmpnents f NZQA s managing natinal assessment review and thrugh the schl s wn internal review manages assessment practice fr natinal qualificatins manages internal and external mderatin manages and makes use f assessment-related data maintains the currency f assessment plicy and prcedures, and cmmunicates them t staff, students and families. In preparing this reprt, the Schl Relatinship Manager met with the Assistant Principal, Principal s Nminee, Heads f Department fr Digital Technlgy, Mathematics, Science and Scial Science and three students. The schl als prvided pre-review infrmatin and the fllwing dcuments: Suthland Bys High Schl, NQF Internal Assessment, Staff Prcedures Suthland Bys High Schl, NQF Internal Assessment, Student Guidelines sample f curse utlines. There was a reprt-back sessin with the Rectr, Assistant Principal and Principal s Nminee at the end f the review visit t highlight gd practice and areas fr imprvement, with suggested strategies and next steps and t agree n any actin required. Suthland Bys High Schl MNA Reprt

3 OVERVIEW Suthland Bys High Schl 14 September 2016 Suthland Bys High Schl has prcesses in place which meet the academic and vcatinal needs f individual students and help in ensuring credible assessment fr natinal qualificatins. A cherent and cmprehensive methd f mnitring the cmpletin f all mderatin and recrding the utcmes wuld allw the schl t evaluate the effectiveness f their internal mderatin prcesses. Areas f strength Internal mderatin is becming embedded practice acrss the schl and departments are respnding t external mderatin feedback. This has led t an increase in external mderatin agreement rates, prviding evidence that assessment is credible. Schl self-review demnstrates an imprving capacity t undertake its wn evaluatin f the effectiveness f the schl s assessment practices and prcedures. It has led t identifying issues f cncern, changes in the schl examinatin prcess and alteratins t curse design and the curses ffered t better supprt student achievement. Assessment prcesses are effectively managed. T meet individual student need, assessment differentiatin is being catered fr by a range f practices. Students achievement is clsely tracked t supprt their prgress. These all cntribute in assisting students t imprve their assessment utcmes. Assessment data is managed effectively t ensure results reprted t NZQA are timely and accurate. Achievement data is analysed t review schl curses and prcesses and t set strategic directin. The schl has cmmunicatins that allw staff, students and caregivers t understand NCEA and schl assessment prcedures. The schl has fully addressed the agreed actin items frm the 2014 Managing Natinal Assessment review. Areas fr imprvement The schl has nt fully addressed the significant issue frm the 2014 Managing Natinal Assessment review. The schl must have a systematic methd f mnitring the cmpletin f all mderatin and recrding the utcmes s there is less reliance n using external mderatin t prvide quality assurance. The Head f Learning Supprt has put in place prcesses t effectively cllect evidence frm teacher recrds and schl-based testing. This evidence needs t be used t supprt future apprpriate special assessment cnditins applicatins. The schl currently has a relatively lw number f students with special assessment cnditins. Suthland Bys High Schl MNA Reprt

4 Requiring all departments t use a cmmn template fr curse utlines wuld enable students and parents t easily access the necessary curse-related infrmatin in a cnsistent frmat acrss all curses. Schl dcumentatin has been reviewed, but a minr additin required is infrmatin n derived grades in the staff quick reference guide. The schl publicises the prcess t apply fr financial assistance fr NZQA fees but the number f cmpleted applicatins is relatively lw. Nn-payment f fees thrugh financial hardship culd prevent students frm being awarded the qualificatins they have gained. The schl culd cnsider the pssible reasns fr this and, if they can, increase the number f applicatins made. Next Steps Fllw-up check planned t cnfirm required actin reslved The need t adequately address a required actin is a significant issue that prevents the schl frm meeting the requirements f the Cnsent t Assess Against Standards n the Directry f Assessment Standards Rules NZQA will return in 12 mnths time t check that this required actin has been reslved. The details f the issue are nted n page 5 f this reprt. Required actin In rder t maintain its cnsent t assess, the schl must: adequately address Actin Items frm the previus MNA review (CAAS Guidelines 3v). Agreed actin NZQA and senir management agree n the fllwing actin t further refine assessment practices. Senir management undertakes t: update the staff quick reference guide t include infrmatin n derived grades. Next Managing Natinal Assessment review Based n the utcme f this assessment systems check and the planned fllw-up check next year n the required actin, it is anticipated that the next Managing Natinal Assessment review will be cnducted within three years. Kay Wilsn Manager Schl Quality Assurance and Liaisn 24 Nvember 2016 NZQA Suthland Bys High Schl MNA Reprt

5 FINDINGS OF THIS REVIEW Respnse t External and Internal Reviews Previus external reviews Evidence was sught that external review recmmendatins and findings have been apprpriately and effectively addressed. (CAAS Guidelines 3v) Agreed actin items frm 3 July 2014 MNA Reprt The review identified three agreed actins. Senir management undertk t: clarify the purpse and prcess f internal mderatin fr teachers have teachers check entries and results data against that received by NZQA t best identify where data has nt been sent r is incrrect review the teacher and staff guidebks as detailed in the reprt. All three agreed actins have been cmpleted. In particular, the schl has wrked t ensure that staff are aware f, and meet, the required expectatins f mderatin s that results reprted are quality assured. Required actin item frm the 3 July 2014 MNA Reprt The review als identified a significant issue. In rder t maintain its cnsent t assess, the schl was required t: ensure internal mderatin is adequately mnitred by senir management and dcument the prcess by which this will happen (CAAS Guidelines 2.6iii). The schl has nt fully cmpleted this actin. Evidence was prvided that, in 2015, cmpleted internal mderatin cver sheets were submitted as paper cpies r thrugh Ggle Drive t the Principal s Nminee. This prcess has nt been rigrusly fllwed this year. The Principal s Nminee regularly makes infrmal checks n department practice but des nt keep a recrd f the utcme f the visits. Heads f Department mnitr mderatin within their departments, but d nt attest t its cmpletin. These current practices help t mnitr mderatin but a cmprehensive and systematic mnitring prcess is required t prvide feedback n the cmpletin and effectiveness f all mderatin, and recrd the utcmes. Mnitring shuld enable the Principal s Nminee and senir management t evaluate hw effective internal mderatin is at prviding quality assurance, mre systematically infrm self-review, and mitigate pssible issues arising frm any persnnel changes. The required actin n page 4 f this reprt is in respnse t the failure t fully address this required actin frm the previus MNA reprt. External Mderatin Heads f Department cmplete a written respnse t the reprts fr all standards that are externally mderated. The Assistant Principal and Principal s Nminee read the reprts and respnses and discuss any issues that arise with the Heads f Department. Where required, an actin plan is agreed and implemented, with the Assistant Principal r Principal s Nminee checking cmpletin where needed. There was an increase in the agreement rate with assessr judgements frm 2014 t Suthland Bys High Schl MNA Reprt

6 Internal review Evidence was sught that the schl was effectively using its self-review and evaluatin prcesses t identify areas fr n-ging imprvement in assessment practice and prcedures, which are then actined. (CAAS Guidelines 3iv) Recent areas f internal review have resulted in the fllwing utcmes: remving a schlwide examinatin perid s that departments have the flexibility t cnduct practice assessments in a manner that best suits their teaching and assessment prgramme creating new curses such as Agriculture and Hrticulture, Mechatrnics and a cmbined Media and Gegraphy curse, t meet student need mdular science curses that allw assessing f tw standards frm ne mdule f wrk. The schl s self-review demnstrates an imprving capacity t undertake its wn review f its NZQA-related assessment practice. The senir management understands the need fr cnsistency f assessment practice acrss the whle schl. They identified that ne subject area, whilst shwing innvative practice in areas f assessment, needs t understand where their practice is nt in line with schl plicy and NZQA rules and guidelines. Particular cncerns that are in the prcess f being reslved are; practices arund resubmissin, and the need t verify grades fr student wrk even if the standard is having assessr judgements checked thrugh external mderatin. Required actin In rder t maintain its cnsent t assess the schl must: fllw-up external review recmmendatins and findings. (CAAS Guidelines 3v) Suthland Bys High Schl MNA Reprt

7 Assessment Practice Hw des the schl s assessment practice allw fr the effective management f assessment fr natinal qualificatins? (CAAS Guidelines 2.5v-vii, 2.6, 3) Suthland Bys High Schl has effective prcesses and prcedures fr: mnitring, during the assessment and marking prcess, the authenticity f student wrk managing missed and late assessments, appeals and breaches f the assessment rules using resubmissin and further assessment pprtunities apprpriately cllecting credible evidence f student achievement fr derived grade applicatins. Suthland Bys High Schl has effective prcesses t meet the assessment needs f all students by: ensuring staff are well infrmed f student special assessment cnditin entitlements, and apprpriate assistance is readily available extending assessment pprtunities using external prviders. Tailring curses t meet student needs Assessment differentiatin is catered fr by a range f practices. At Year 11 and 12, cre subject areas ffer different curses within a level. Teachers review student attainment t advise which curse is the mst apprpriate. Sme departments persnalise assessment prgrammes within curses by allwing students, in cnsultatin with parents, t withdraw frm standards where apprpriate. Sme departments ffer extra r alternative standards t differentiate assessment. These appraches assist students t maximise their assessment pprtunities. Student achievement is effectively tracked Achievement is tracked and interventins put in place s that barriers t student achievement are minimised. Staff regularly update an estimate f the number f credits a student will achieve in their subject. Academic tutrs track the students in their hrizntal tutr grups. Senir management use the estimated credits t create a list f targeted learners wh are at risk f nt achieving a qualificatin. Students are referred t the member f the senir management team with respnsibility fr their year grup, and in discussin with the student and caregivers, a range f interventins can be put in place t help imprve achievement. These can be discussins with the subject teacher, tutrials, a hliday prgramme between terms three and fur, r cmpleting internals during study leave. Increase the number f special assessment cnditins applicatins The schl has a relatively lw number f students prvided with special assessment cnditins. The wrk the Head f Learning Supprt has dne nw allws the schl t use schl-based evidence frm teacher recrds and testing at Year 9 and 10 t supprt future applicatins. This wuld help meet the needs f mre students. N actin required N issues with the schl s management f assessment fr natinal qualificatins were identified during this review. Suthland Bys High Schl MNA Reprt

8 Mderatin Hw effectively des schl internal and external mderatin assure assessment quality? (CAAS Guidelines 2.6, 3) Suthland Bys High Schl has effective prcesses and prcedures fr managing: internal mderatin, including: ensuring all new r mdified assessment materials are critiqued prir t use verifying grades fr a sample f student wrk, with a fcus n grade bundaries, t ensure assessment judgements are cnsistent with the standard using external subject experts t verify grades where necessary using a cmmn Internal Mderatin Cver Sheet as a wrking dcument t recrd the mderatin prcess external mderatin, including: the use f a respnse frm t prvide senir management with staff feedback and any necessary actins fr bth NZQA and industry training rganisatin mderatin. Apprpriate material is available fr external mderatin All assessment material, including digital cntent, is securely stred. The Principal s Nminee is aware f where material is stred, and has access t it. Staff fllw a prcess that meets NZQA requirements fr randm selectin f student wrk, but the schl will investigate using the student management system t make the chsing and sharing f names easier. Cmprehensive and systematic mnitring prcess required This will prvide feedback n the cmpletin and effectiveness f all mderatin, and recrd the utcmes. Mnitring shuld enable the Principal s Nminee and senir management t: evaluate hw effective internal mderatin is at prviding quality assurance mre systematically infrm self-review mitigate pssible issues arising frm any persnnel changes. Agreed Actin NZQA and senir management agree n the fllwing actin t imprve the schl s internal and external mderatin t assure assessment quality. Senir management undertakes t: cmprehensively and systematically mnitr internal mderatin prcesses. Suthland Bys High Schl MNA Reprt

9 Data Quality and Use Hw effectively des the schl manage and make use f assessment-related data? (CAAS Guidelines 2.6, 2.7, 3) Suthland Bys High Schl effectively: manages assessment-related data by: reprting results t NZQA n a timely and regular basis reprting Nt Achieved results apprpriately withdrawing entries where apprpriate having apprpriate student and teacher checks t ensure reprted results are accurate hlding current memranda f understanding with external prviders using the NZQA Key Indicatrs t identify and reslve data issues makes use f assessment-related data t: ensure detailed annual reprting and review by all Heads f Department t the Rectr and Bard f Trustees set strategic directin and infrm decisin making track and mnitr students prgress and achievement. Use f assessment data t facilitate self-review The data manager prvides results data fr departments t analyse internal results at the end f the year and external results after results are released. This is used t review achievement in standards, infrm changing curse design and review teaching and assessment practice t reflect the needs f their current chrt. Schl-wide data is analysed by senir management t review verall perfrmance and set strategic directin, such as a literacy fcus. Lw number f financial assistance applicatins Nt applying fr financial assistance may be preventing students frm paying fees, s they are unable t be awarded the qualificatins they have gained. Althugh the schl publicises the prcess t apply fr financial assistance fr NZQA fees, the number f applicatins received is relatively lw. In 2015, ten percent f students did nt pay their NZQA fees. The schl shuld cnsider the pssible reasns fr this and, if they can, increase the number f applicatins made. N actin required N issues with the schl s management and use f assessment-related data were identified during this review. Suthland Bys High Schl MNA Reprt

10 Cmmunicatin Hw effectively des the schl maintain the currency f assessment plicy and prcedures, and cmmunicate them t staff, and students and their families? (CAAS Guidelines 2.4i(f), 2.4v, 2.6, 2.7ii, 3) Suthland Bys High Schl has effective prcesses and prcedures fr: cmmunicating assessment plicy and prcedures t staff, students and their families prviding infrmatin t students and parents t supprt their understanding f NCEA encuraging use f the NZQA Learner lgin and the student management system prtal fr students and parents t mnitr prgress. Cmprehensive and timely infrmatin is prvided t staff Staff are clearly infrmed f NCEA and schl prcesses and prvided with updates and timely reminders abut prcesses. The staff handbk has been fully reviewed, resulting in the creatin f a cncise quick reference guide linked t a cmprehensive dcument. The quick reference guide shuld have infrmatin n derived grades added t prvide full cverage f key prcesses. The Principal s Nminee circulates a weekly t staff t highlight updates and prvide reminders f schl prcesses. Use f a cmmn template fr curse utlines shuld be expanded Requiring all departments t use a cmmn template fr curse utlines wuld enable students and parents t easily access the necessary curse-related infrmatin in a clear and cnsistent frmat acrss all curses. All departments prvide students with curse utlines, with sme already fllwing a cmmn template available frm the schl management system. This shuld be adapted t include infrmatin n whether a curse is endrseable and/r assesses standards n the University Entrance apprved list. The schl als agreed t explre nline access thrugh their website r student management system s students and parents culd easily refer t the infrmatin as needed. Agreed actin NZQA and senir management agree n the fllwing actin t maintain the currency f assessment plicy and prcedures, and cmmunicate them t staff, students and families. Senir management undertakes t: update the staff quick reference guide t include infrmatin n derived grades. Suthland Bys High Schl MNA Reprt