Assessment Validation and Moderation Policy and Procedure

Transcription

1 Assessment Validatin and Mderatin Plicy and Prcedure

2 Assessment Validatin and Mderatin Plicy and Prcedure Mdificatin histry Date Mdificatin Persn respnsible 28/11/11 Additin f sectin t meet CAP cnditins Dr Ian Whyte 29/11/2012 Additin f the Changes t the Plicy sectin apprved by Academic Bard meeting 29/11/12 Academic Bard apprval IW edit 22/2/2018 Majr revisin t plicy t reflect revised prcesses Apprved by AB 19/3/2018 Dr Gerge Brwn edit Definitins Threshld Learning Outcmes Natinally agreed threshld learning utcmes fr Turism, Hspitality and Events fr Higher Educatin Cursewrk Prgrams at AQF Level 7 and 9. Current versin maintained at Peer Review Prtal A central lcatin where de-identified assessment tasks may be externally mderated by bth Australian and verseas higher educatin institutins. Current prtal lcatin at Peer Review f Assessment A prcess f assuring expected learning utcmes are infrmed by natinal and internatinal cmparatrs. Further infrmatin may be fund at data/assets/pdf_file/0006/986118/guidelines-for-peer-review-of- ASSESSMENT.pdf ICHM Assessment Validatin and Mderatin Plicy and Prcedure March 2018 Page 2

3 Preamble Assessment validatin and mderatin is an integral part f assessment prcedures, designed t ensure cmmn interpretatins f criteria and standards are established as they relate t student perfrmance, cntributing t reliability in assessment grades whilst acknwledging that human judgement is a significant element in the prcess. The purpse f this plicy is t ensure that assessment briefs, assessment tasks and marking rubrics are valid and reliable. Internal and external mderatin are critical t assure validly and reliability f assessment practices including the awarding f grades. The validatin and mderatin prcess is cnducted each semester n a cntinual basis and imprvement actins are recrded. Plicy Validating and mderating the relevance and cnsistency f assessment briefs and assessment judgements is critical t ensuring the assessments meet the accredited prgram Learning Outcmes and natinally agreed Threshld Learning Outcmes. ICHM will validate its assessment strategies by: Reviewing, cmparing and evaluating the assessment prcedures, tls and evidence cntributing t judgements made by a range f assessrs against assessment pieces, including the infrmatin prvided in Learner and Lecturer guides, and Dcumenting actin taken t imprve the quality and cnsistency f assessment A minimum f three subjects frm each year f the prgram must underg assessment validatin and mderatin in each semester f a year. All ICHM prgrams must have had all subjects underg assessment validatin and mderatin ver a tw-year perid Validatin and mderatin methds may include: Validatin f assessment briefs Internal and external mderatin f assessment tls and activities An assessment review panel An independent external validatr Benchmarking against evidence frm ther prviders f subjects at the same level Students acknwledge that by agreeing t the enrlment cnditins f ICHM, that a sample f their deidentified wrk may be used fr assessment validatin and mderatin purpses and may be prvided t external parties fr this purpse. Where any student assessment is sent externally t ICHM, the Directr Academic will advise the receiving institutin that ICHM is bund by its Privacy Plicy and the assessments cannt be used fr any ther purpse. Prcedure ICHMs Assessment Validatin and Mderatin prcess cnsists f three main stages planning, implementing and reprting. Planning The ICHM Directr Academic in cnjunctin with Discipline Stream Crdinatrs will develp a tw-year Assessment Validatin and Mderatin Review Plan (AVMRP) t determine subjects chsen, the type(s) f validatin and mderatin methds and frequency f the assessment validatin and mderatin meetings. This plan may include the use f the Peer Review Prtal and any ther external benchmarking resurces available The AVMRP will be published and available t all Lecturing staff, utlining the timing f assessment reviews and the dates f the Academic Cmmittee (AC) meetings where results f validatin and mderatins are t be presented fr discussin. Implementatin ICHM s Validatin and Mderatin prcess is implemented via tw main stages: Pre-assessment Validatin f assessment tls Validatin f Assessment Briefs fr all subjects* by the Discipline Crdinatrs. This prcess includes verifying the fllwing: Assessment methds and tasks ensure cverage f all subject and threshld learning utcmes Graduate qualities are mapped apprpriately ICHM Assessment Validatin and Mderatin Plicy and Prcedure March 2018 Page 3

4 Timing f assessment in accrdance with Assessment Grid Assessment methds and tasks are cnsistent and gather sufficient evidence Assessment tasks have clear instructins fr bth the assessr and students Assessment methds and tasks meet the requirements f ICHM Assessment Principles Marking criteria and rubrics meet the subject and threshld learning utcme requirements Validatin f all Final Examinatins by a peer academic. This prcess includes verifying the fllwing: Validity f questins psed Crrect weighting applied Apprpriate variety f questining techniques used Cntent being assessed links t subject and threshld learning utcmes *Where, at the Discipline Stream Crdinatrs discretin, it is deemed that the Assessment Brief has met ICHM requirements fr tw cnsecutive semesters, then specific Assessment Briefs may be exempt frm systematic review. T ensure maintenance f standards, a randm assessment will ccur in future semesters. Pst Assessment Mderatin f assessment utcmes Once assessments have been marked by the respective Lecturer, three pst assessment marking activities are undertaken each semester: Review f individual assessment pints Prir t the publicatin f individual assessment pints, Lecturers are required t prvide the Directr Academic with a de-identified graph f the spread f results fr each assessment item. Where the results appear t be incngruent with prir and/ r expected trends, the Directr Academic will cnsult with the individual Lecturer t review their interpretatin f the marking criteria fr the assessment item. If, in the pinin f the Directr Academic, the results need further review, then the Directr Academic will cnvene an Academic Cmmittee Meeting. Review f end f semester prvisinal results Immediately fllwing the finalisatin f all prvisinal results fr each semester, and prir t review and apprval f results by the Academic Cmmittee, the Directr Academic (in cnjunctin with the Discipline Stream Crdinatrs) will review the prvisinal results fr all subjects. This review will: Assess the spread f results, cmparing prir semester results, and identify any trends that appear t be incngruent with prir and/ r expected trends Cnsider feedback frm the Lecturer prvided in the End f Semester Curse Reprt Where any results appear t be incngruent with prir and/ r expected trends then a reprt will be prepared by the Directr Academic and prvided t the Academic Cmmittee fr its cnsideratin. The reprt will cntain: examples f assessment prcesses and tls used feedback n assessments gained thrugh individual debriefs f Lecturers and students samples f graded assessments cpies f reprts frm the Peer Review Prtal (where applicable) The Academic Cmmittee will assess this reprt and determine if further investigatin is required. Scheduled pst assessment mderatin In accrdance with the AVMRP, a series f pst assessment mderatin activities will be undertaken t randmly verify the rigur f assessment prcesses undertaken during a given semester f study. Several scheduled activities are undertaken, and include (but are nt limited t) the fllwing: Mderatin at the margins Final results centred arund the specific mark levels (eg. 50%, 55%, 65% etc). A representative sample f assessments arund these marks are reviewed fr the apprpriateness f the given mark and, therefre, the final grade. Multiple markers in the same subject - The distributin f the marks awarded by the varius markers is assessed (and if there are multiple questins, then fr each questin) t ascertain if there are markers wh might lie utside f the average r a general trend. ICHM Assessment Validatin and Mderatin Plicy and Prcedure March 2018 Page 4

5 Nte, where multiple markers are utilised within a subject, the markers are required t meet n a regular basis during the semester with the purpse f calibrating and mderatin assessment utcmes Randm sampling - An entire subject is chsen, and a sufficient number f randmly chsen assessments is selected t meet the particular cnfidence level. Use f the Peer Review Prtal, t ensure external natinal and internatinal cmparatrs are btained using the afrementined mderatin methds Where the Discipline Stream Crdinatrs identify any situatin where pst assessment utcmes have the ptential t adversely impact the grade distributin in any subject then they may request the Directr Academic t invke a mderatin prcess. Details f the mderatin prcess are t be develped by the Directr Academic and presented t the Academic Cmmittee fr apprval Reprting A summary f the assessment validatin and mderatin activities cnducted in accrdance with the AVMRP is prvided in the AVMRP Reprt by the Directr Academic. Imprvement activities are dcumented in a central register alng with the assigned activities t specific peple r grups f peple and indicates required cmpletin dates. The AVMRP is prvided t the Academic Cmmittee, with a summary reprt prvided by the Directr Academic t the Academic Bard. Changes t the Plicy The Academic Bard must apprve any change t this Assessment Validatin and Mderatin Plicy and Prcedure. ICHM Assessment Validatin and Mderatin Plicy and Prcedure March 2018 Page 5