Guidance for Completing the Program Performance Report

Transcription

1 Guidance fr Cmpleting the Prgram Perfrmance Reprt Infrmatin t assist staff f State/Territry Cuncils n Develpmental Disabilities ADMINISTERED BY THE NATIONAL ASSOCIATION OF COUNCILS ON DEVELOPMENTAL DISABILITIES CONTRACT #HHSP C

2 Cntents Sectin I: Identificatin... 2 Sectin II: Cmprehensive Review and Analysis Update... 2 Sectin III: State Plan Implementatin... 3 A. Intrductin... 3 Cultural Diversity... 3 B. Evaluatin f State Plan Implementatin... 4 B1. Evaluatin Activities... 4 B2. Evaluatin Results... 4 B3. Lessns Learned and Future wrk f the Cuncil... 5 C. Input n Natinal Pririties... 5 Sectin IV: State Plan Implementatin... 6 Sectin IV.A. Detailed Prgress Reprt n Gals... 6 Backgrund/Cntext... 6 Prgress Reprt... 7 Gal # Narrative Year Overview (FY 2020) Year Overview (FY2021) Sectin IV.B. Individual and Family Advcacy Perfrmance Measure (by GOAL) Individual Respnses Demgraphic Data I. Output Measures II. Outcme Measures Sectin IV.C. System Change Perfrmance Measures (by Gal) Sectin V. Cuncil Financial Infrmatin Sectin VI. Measures f Cllabratin

3 Overview: There are five majr areas f the reprt Sectin Area I. Identificatin II. Cmprehensive Review and Analysis (CRA) III. State Plan Implementatin IV. Prgress Reprt V. Cuncil Financial Infrmatin VI. Measures f Cllabratin Sectin I: Identificatin Prvide the requested infrmatin. Sectin II: Cmprehensive Review and Analysis Update AIDD Instructin: PURPOSE: T prvide an update t the Cmprehensive Review and Analysis The DD Act requires the fllwing annual descriptins: adequacy f health care and ther services, supprts and assistance that individuals with develpmental disabilities in Intermediate Care Facilities (ICF) receive; adequacy f health care and ther services, supprts, and assistance that individuals with develpmental disabilities served thrugh hme and cmmunity based waivers receive; AIDD interprets this as annual updates t: adequacy f health care and ther services, supprts and assistance that individuals with develpmental disabilities in Intermediate Care Facilities receive (ICF updates); adequacy f health care and ther services, supprts, and assistance that individuals with develpmental disabilities served thrugh hme and cmmunity based waivers (HCBW) receive (HCBW updates); And ther sectins that apply (e.g.: state infrmatin, prtrait f state services, analysis f state issues and challenges, ratinal fr gal selectin, cllabratin); Federal and state initiatives impacting peple with DD and their families in the State/Territry. Nte: (*) Adequacy may be described in terms f quality and/r ppulatins served versus need. ITACC Guidance: It is nt necessary t repeat the exact infrmatin frm the State plan but nly thse factrs that changed and influenced prgrams and services fr individuals with develpmental disabilities and/r influenced the Cuncil s gals and bjectives. 2

4 Sectin III: State Plan Implementatin PURPOSE: T prvide the cntext f what will be reprted in the PPR. Sectin III is cmprised f 3 reprting areas: (A) Intrductin; (B) evaluatin f state plan implementatin; (C) Input n Natinal Pririties. A. Intrductin AIDD Instructin: In this sectin prvide an executive summary with chesive infrmatin that prvides an verview f the reprt including, but nt limited t the fllwing: (1) targeted areas f emphasis (2) strategies used t implement activities (3) significant accmplishments and/r barriers t state plan implementatin (4) needs requiring state plan amendments (5) a descriptin f hw the Cuncil will disseminate the annual reprt t stakehlders and the general public and hw the Cuncil will address availability in accessible frmats. Nte: detailed infrmatin will be prvided belw in Sectin IV ITACC Guidance: This shuld be a much brader mre abbreviated versin f yur larger PPR reprt. It shuld hit n larger highlights f the entire year and reprt, nt specifics fr bjectives. Think aggregate large picture verview. We recmmend writing this sectin last! Be mstly brad Include a few details (Ex. Aggregate # s) D nt duplicate ther sectins Cultural Diversity AIDD Instructin: Describe the Cuncil s verall effrts t address the needs f individuals with develpmental disabilities and their families f a diverse culture thrugh its state plan supprted activities. ITACC Guidance: This descriptin shuld bradly address the verall effrts specific t state plan supprted activities during the reprting perid. The descriptin f effrts can include (but is nt limited t) infrmatin abut hw activities supprted and educated limited English prficiency (LEP) husehlds, frntier r gegraphically islated ppulatins, lw literacy ppulatins, and thers; cllabratin and crdinatin effrts with public and private rganizatins t advance cultural and linguistic cmpetent (CLC) services and supprts, utreach and engagement activities t diverse cmmunities, supprting and educating cmmunities, and technical assistance effrts. This sectin shuld nt include the targeted disparity gal/bjective infrmatin. The infrmatin fr the targeted disparity gal/bjective shuld be reprted in Sectin IV. 3

5 Evaluatin f State Plan Implementatin In this sectin reprt n the evaluatin activities cnducted and results. The reprt shuld include: B1. Evaluatin Activities AIDD Instructin: Describe the evaluatin activities undertaken during the fiscal year being reprted, including evaluatin activities cnducted t strategically assess the verall prgress and directin f the state plan implementatin. ITACC Guidance: Review the evaluatin sectin f the 5 year State Plan as a tl t frame the develpment f the descriptin. Develp the descriptin specific t the reprting perid and include activities that were cnducted during the reprting perid. It may be helpful t review the annual wrk plan dcuments that indicated the data evaluatin and measurement fr bjective activities. B2. Evaluatin Results AIDD Instructin: Reprt the brad results f the evaluatin activities described abve (B1), including a brad assessment f the verall prgress f Cuncil supprted activities. ITACC Guidance When reprting the brad results, review the AIDD perfrmance measures in the reprting year wrk plan, and the reprting year utputs and utcmes generated frm grant r cntract and staff reprts. Types f data can include qualitative, r quantitative data n utputs frm bjectives/activities, utcmes frm bjectives/activities, and data n custmer satisfactin. Summarize the fllwing infrmatin TIPS: Infrmatin cllected frm all evaluatin activities Prgress made in achieving the utputs and utcmes f yur state plan gals and bjectives, remember t describe the results n self advcacy separately frm all ther activities. Effectiveness f the strategies used t achieve the gals/bjectives f the State Plan Summarize results f custmer satisfactin data cllected Determinatin f whether the prjected Cuncil results are being achieved Findings regarding prgress made tward achieving State Plan gals FAQ Questin If I reprt the results here, d I have t reprt any results in the prgress narratives? Answer Yes. All bjective narratives must include a summary f evaluatin activities t mnitr prgress and impact f cuncil supprted activities; data cllected during the year, data surces (where yu gt the data), and data cllectin methds (hw yu gt the data). And all narratives must include the AIDD perfrmance measures fr the activities being reprted in the narrative. Review the data cllected and decide n hw best t summarize. Fr example, summarizing by gal may assist the reviewer/reader t see the prgress made. Make sure the data cllected reflects the data indicated n the reprting year Annual Wrk Plan. 4

6 If data is missing, explain what happened, and if any changes will be made fr data cllectin in the fllwing year; If additinal data was cllected beynd what was included in the Data Evaluatin and Measurement sectins f the reprting year Annual Wrk Plan, summarize it as well. B3. Lessns Learned and Future wrk f the Cuncil AIDD Instructin: Reprt n hw the Cuncil will use lessns learned frm state plan implementatin and the data gathered frm the evaluatin activities t mve frward the wrk f the Cuncil. ITACC Guidance: Lessns learned are typically insights frm a prject r activity that can be usefully applied t future prjects and activities. Lessns learned can include infrmatin abut adjustments t future annual wrk plans, amendments t the State plan, updates t bjectives and activities, and pssibly a shift f prject fcus r strategies. B. Input n Natinal Pririties Purpse t prvide AIDD input n pssible natinal pririties and areas f ptential cllabratin at the federal level. ITACC Guidance: In this sectin, prvide AIDD with infrmatin abut ptential natinal pririties n disability related areas as well as ther recmmendatins fr AIDD t pursue with ther federal agencies (example: Department f Educatin, Department f Labr, Hmeland Security, FEMA). FAQ s FAQ Where des this infrmatin cme frm? Answer A few suggestins t generate input are: Results frm Cuncil prjects, plicy wrk/cllabratins with ther grups, need assessment data, brainstrming with the Cuncil Executive Directr, staff and members, survey, r discussins with the DD Netwrk Partners. The key is t generate ideas t share with AIDD based n quantitative and/r qualitative surces. FAQ D we have t fill ut this sectin? Answer Yes. This sectin prvides Cuncil s the pprtunity t prvide input int a natinal disability pririty agenda. AIDD des nt require the data be cllected in a certain manner but des want pririty areas identified that can be pursued with ther federal agencies. 5

7 Sectin IV: State Plan Implementatin Sectin IV.A. Detailed Prgress Reprt n Gals ITACC Guidance: The infrmatin n areas f emphasis, strategies, and cllabratrs shuld be reprted by gal. Areas f emphasis annually, the Cuncil will reprt the areas f emphasis addressed during the reprting perid. Strategies annually, the Cuncil will reprt the strategies addressed during the reprting perid. Cllabratrs annually, the Cuncil will reprt the cllabratrs wh participated r adds names f cllabratrs nt previusly planned. ITACC guidance: Fr each gal and bjective that was active during the reprting perid, the Cuncil will prvide infrmatin abut activities that were cnducted by Objective. A series f check ff bxes will appear fr each bjective. Each questin must have at least ne respnse. Check ff bxes: #3 Select the fcus f the bjective. Individual/Family Advcacy, System Change, r Capacity Building. #4 Select whether the bjective is new (started during the reprting perid); nging (bjective was active in a prir reprting perid) r cmpleted (the bjective and crrespnding activities were cmpleted during the reprting perid). #5 Select if the bjective addresses the fllwing: Self Advcacy DD Act Requirement Targeted Disparity DD Netwrk Cllabratin Demnstratin Prject f new appraches t services and supprts The name f the prject, the mnth and year the prject riginated must be included Demnstratin f Prjects r Activities The name f the prject, the mnth and year the prject riginated must be included #6 Select the stage f Implementatin fr systems change activities: planning, implementatin r utcme/full integrated. ITACC Guidance: Planning infrmatin gathering, research, meetings with cllabratrs Implementatin demnstratin activities, prjects and activities, advcacy training and effrts, Outcme/Fully Integrated result f activities and effrts Backgrund/Cntext AIDD Instructin: Prvide an verall descriptin f this bjective: The descriptin shuld at a minimum prvide backgrund infrmatin n the bjective t establish a cntext fr the activities. 6

8 ITACC Guidance: Prvide a clear and thrugh intrductin and backgrund infrmatin fr the bjective activities. The statement shuld be designed t prvide the reader with a better understanding f the details prvided in the bjective prgress reprt. Infrmatin can include brad activities, targeted ppulatin, brad utput infrmatin, brad utcme infrmatin, and gegraphic infrmatin. Example: New and cntinuing activities that were fcused n emplyment issues were implemented Statewide and in the Nrtheast Regin. Activities included training, plicy advcacy, and capacity building activities and were targeted twards peple with DD, their families, and prviders f emplyment services. Output numbers demnstrated high interest in the tpic and utcmes resulted in peple with DD and their families understanding and accessing the emplyment system and prviders using best practice methds t prvide emplyment services. Expected Outputs list the expected utputs frm the annual wrk plan fr the bjective Outputs Achieved Reprt the utputs achieved. Prgress Reprt AIDD Instructin: The reprt shuld include the fllwing: A narrative prgress reprt that chesively describes the activities that were implemented tward achieving the bjective, including hw the identified strategy was used, hw the activity was implemented, challenges t achieving the bjective and unexpected benefits. Fr system change activities, include a descriptin f the stage f implementatin (planning, initiatin, implementatin, utcme/fully integrated) f the system change initiative. All narratives must describe what numbers make up the perfrmance measures number fr the activities being reprted in the narrative. A summary f evaluatin activities t mnitr prgress and impact f cuncil supprted activities fr the bjective; data cllected during the year, data surces, and data cllectin methds; Expected Outcmes Outcmes (matches the expected utcmes frm the annual wrk plan as it relates t the bjective) List the expected utcmes fr the activities described fr the bjective frm the annual wrk plan. Outcmes achieved reprt the utcmes achieved. Prgress twards achieving utcmes fr verall bjective. The annual reprt shuld include an assessment as t the extent t which prgress was made n the intended utcmes fr the bjective. Additinally, include stries f culturally diverse peple with develpmental disabilities whse lives are better because f Cuncil wrk n this activity (e.g., became better advcates fr themselves and thers, became mre cnnected t the cmmunity). Stries f plicy r legislative changes that happened as a result f Cuncil individual advcacy wrk that are likely t psitively impact the lives f peple with develpmental disabilities r that will prevent a ptential negative impact (e.g., created deleted, refined prgrams and/r legislatin, reallcated use f funds, rganizatinal systems change as a result f evidence based practices). 7

9 ITACC Guidance: Reprted by bjective. Cuncil staff will prvide infrmatin n activities within an bjective that were cnducted during the reprting perid (this may r may nt include the planned cllabratin item, and/r the targeted disparity item). Guidance fr drafting a rbust narrative: Nte: If there are numerus activities under an bjective and a lt that culd be reprted, chse the cmbinatin f infrmatin that best describes the Cuncil s wrk and related prgress. Describe each activity that that the timeline shws wuld be cnducted that year. Sme Cuncils plan multiple activities t accmplish an bjective. If this is the case, clearly identify each activity and the planned timeline fr the activity and prvide quantitative data within the narrative fr the specific activity s reviewers have a clear picture f actual impact f each activity. Clarify if the activity began in the fiscal year being reprted r was a cntinuatin activity frm previus fiscal year(s). Indicate gegraphic area (statewide, reginal, and lcal) r number f cities/cunties cvered. Describe hw the perfrmance measures fr each bjective were achieved. State which measures crrespnd t which activity r prject and include a written descriptin explaining the numbers reprted. Fr example, if three activities resulted in peple receiving training in an area related t the gal/bjective, prvide enugh detail t ensure that the reader understands what the three activities were and hw many peple were trained thrugh each activity. Describe dllars leveraged similarly. Describe deliverables (# f wrkshps/training events, prducts created and disseminated, training curriculum develped, plicies changed/created/imprved, etc.) Review hw the results and utcmes fit int the evaluatin plan submitted with the 5 year State plan in the narrative. The submitted evaluatin plan shuld serve as guidance fr the Cuncil. If the Cuncil needs t adjust the evaluatin plan, it shuld be updated with the State plan amendments and/r updates (as applicable). When relevant fr specific activities, describe the evaluatin methd used fr the activity (survey, fcus grup, fllw up survey, tracking, etc.). Include: Data surces (peple, dcuments, prducts, activities, events and recrds frm which data are btained). Results f the evaluatin (Example: 57% f peple surveyed reprted they were mre cmfrtable in public places because f the activity). Any barriers r cncerns nted If pssible, include stries t demnstrate the impact f the activity/activities 8

10 FAQ What are utputs? Outcmes? Answer: Outputs refer t sme f the tangible prducts, numbers, and data that are gained frm Cuncil effrts. Fr example: the number f peple trained, the number f websites created, the number f trainings implemented, the number f new plicies created. Outputs can be calculated and shwn numerically. They prvide a quick snapsht f smething the cuncil has dne. Outcmes are a lnger term lk at the benefits r the s what f the utputs. Fr example. The Cuncil trained 100 peple, but s what? What is the larger impact, value, r results f training thse 100 peple? Outcmes fr that utput culd be 100 peple are nw mre knwledgeable abut supprted decisin making, r 100 peple are nw participating in advcacy events because f their participatin in the training. Outcmes can be reprted numerically t, but Gal # Narrative AIDD Instructin: In this sectin, fr each gal reprted fr the reprting perid, prvide an verall chesive descriptin f: the extent t which prgress is being made in achieving the intended utcmes f the Gal fr the reprting year; the extent t which each gal was r was nt achieved fr the reprting year; where applicable, factrs that impeded gal achievement fr the reprting year needs that require substantive state plan amendment (gal nly) ITACC Guidance: This is a new reprting item t describe the prgress a Cuncil has made (r nt made) twards EACH 5 Year gal in the State Plan fr each reprting year. Belw are sme tips fr develping the descriptin. Review the 5 Year Lgic Mdel, determine if the Cuncil is clser t r further frm the lngterm utcmes and impact statements fr the gal under review. Cnsider the impact f majr activities fr the bjectives under the gal cllectively, did the wrk mve the Cuncil clser t accmplishing the 5 year gal? Review the evaluatin data (utputs and utcmes, AIDD perfrmance measures) fr each bjective did the results indicate prgress was made tward reaching the 5 year gal? 4 Year Overview (FY 2020) AIDD Instructin: [Prvide] a descriptin f hw the Cuncil will use and build frm knwledge gained and prgress made t mve frward in the next state plan cycle (FY ). ITACC Guidance: This is a new reprting item and nly applies t the PPR fr the Federal Fiscal Year 2020 (the PPR is due January 1, 2021). The reasn this item is included crrelates t the next 5 year 9

11 State plan that will be due August 15, 2021 mst likely, planning effrts will be underway in This verview shuld include infrmatin abut what the Cuncil learned frm the current State plan activities and include infrmatin abut what prjects/activities are likely t be carried frward int a new 5 year plan and/r infrmatin abut systems change effrts that will be nging. We recmmend reviewing the previusly submitted PPR sectin(s) that described the prgress made twards each 5 year gal t identify areas where Cuncil investments may be cntinued and any infrmatin that may be available t infrm the fcus f the next 5 year State plan. 5 Year Overview (FY 2021) AIDD Instructin: Fr the final PPR (FY2021) f this state plan cycle, prvide an verall analysis f the utcmes achieved during the five year state plan cycle. The descriptin shuld include the extent t which diverse stakehlders are satisfied with cuncil activities that prmte self determinatin and cmmunity participatin fr individuals with disabilities and families, results f ther types f infrmatin gathering such as fcus grups, surveys, r ther feedback r input methds with individuals with develpmental disabilities and families and majr accmplishments and factrs impeding gal achievement (if applicable). ITACC Guidance: This is a new reprting item and nly applies t the PPR fr the Federal Fiscal Year This sectin shuld present the analysis f the utcmes achieved thrughut the 5 years. We recmmend reviewing the 5 year Lgic Mdel that was created fr the State plan and fcus t help assess the verall utcmes achieved during the life f the plan. An verall descriptin f satisfactin with cuncil activities shuld be included in this sectin t accmpany the discussin n utcmes achieved. We recmmend reviewing previus PPR s t gather and rganize infrmatin t identify imprtant themes, key cncepts, patterns, and trends. After rganizing the infrmatin take nte f similarities and cntrasts, relate pieces f infrmatin t establish relatinships between and amng them, determine if there are emerging themes, identify gaps in the infrmatin and determine what assumptins can be made. Analyzing the satisfactin f stakehlders can be accmplished by using the same prcess fcusing n the data cllected that crrelates t the perfrmance measures n satisfactin f peple with develpmental disabilities and their families with cuncil supprted activities. Sectin IV.B. Individual and Family Advcacy Perfrmance Measure (by GOAL) Individual Respnses Demgraphic Data Aggregate number frm all individual respnses (individuals with develpmental disabilities and family members f individuals with develpmental disabilities) cllected fr the reprting federal fiscal year. ITACC Guidance: The demgraphic data page n the PPR template indicates Cuncil staff shuld reprt the number f individuals with DD and the number f family members (IFA 1.1 and IFA 1.2). These numbers shuld be the ttal number f peple wh participated in a Cuncil activity and nt the respndent number that will be used fr the denminatr. 10

12 PPR Nte: The PPR sectin calls fr staff t als reprt the ttal number f peple with develpmental disabilities wh respnded t an evaluatin/survey abut the prject r activity they participated in as the IFA 1.1 denminatr. Nte: This number may be different (lwer) than the ttal number f peple wh participated in the prject r activity and is based n the number f peple wh respnded t an evaluatin/survey abut the prject. PPR Nte: The PPR sectin calls fr staff t als reprt the ttal number f family members wh respnded t an evaluatin/survey abut the prject r activity they participated in as the IFA 1.2 denminatr. Nte: This number may be different (lwer) than the ttal number f peple wh participated in the prject r activity and is based n the number f peple wh respnded t an evaluatin/survey abut the prject Perfrmance Measures Infrmatin see Guidance Dcument fr Cuncil Staff I. Output Measures ITACC Guidance: We created a Guidance Dcument fr Cuncil Staff: AIDD DD Cuncil Perfrmance Measures that is a tl and guide fr Cuncil staff t use in data cllectin and reprting activities. II. Outcme Measures ITACC Guidance: We created a Guidance Dcument fr Cuncil Staff: AIDD DD Cuncil Perfrmance Measures that is a tl and guide fr Cuncil staff t use in data cllectin and reprting activities. Sectin IV.C. System Change Perfrmance Measures (by Gal) ITACC Guidance: We created a Guidance Dcument fr Cuncil Staff: AIDD DD Cuncil Perfrmance Measures that is a tl and guide fr Cuncil staff t use in data cllectin and reprting activities. Sectin V. Cuncil Financial Infrmatin Purpse: In this sectin, Cuncils are t identify the bligatin and liquidatin status fr the 3 FFY f funds. AIDD Instructin: Fiscal Infrmatin is fr prgrammatic purpses nly. ITACC Guidance: Reprt each Federal Fiscal Year (FFY) Grant Award year separately. The reprting perids shuld include the current reprting year, and the tw previus reprting years. Three fields are prvided, ne fr each FY. Fr each line, reprt the requested infrmatin. Additinal infrmatin is prvided fr individual lines: Guidance is prvided fr specific line items as indicated belw: Line 4 State funds cntributing t Cuncil State Plan Activities shuld reflect all real dllars (nt inkind) that the State/Territry prvided t the Cuncil and used fr State plan activities. 11

13 Line 5 Additinal Cuncil Funds Used fr Other Activities culd be grants r cntracts r ther state funds the Cuncil receives that are used fr activities ther than State plan activities. The match required shuld reflect the variety f match the Cuncil calculated fr prjects and activities that is cnsistent with the DD Act Sectin 126 (a) (1 3). Line 10 Match Met shuld be the ttal amunt f match that is met fr the FY grant award. Because Cuncils have tw years t bligate and a final year t liquidate a grant award, match may be accumulated during the life f the grant award. Calculate match that is generated fr the grant award year and prvide the amunt. Line 11 Match Unmet line 9 subtracted frm line 8. Prvide the amunt f dllars leveraged fr the reprting year. Itacc Guidance: Dllars leveraged refers t the results f an initial investment f Cuncil funds (including time and ther resurces) t gain a dllar return frm ther surces. Funds can be either public r private. Dllars leveraged shuld nt include the match required fr prjects/activities. Sectin VI. Measures f Cllabratin Purpse: In this sectin, Cuncils are t discuss cllabrative effrts with specific DD Netwrk partners and ther cllabratrs separate frm the planned DD Netwrk Cllabratin gal/bjective. 1. Identify the critical issues/barriers affecting individuals with develpmental disabilities and their families in yur State that the Cuncil and the P&A, the Cuncil and the UCEDD, the Cuncil and ther cllabratrs may have wrked n during the reprting perid 2. Identify the Area f Emphasis cllabratively addressed by the DD Cuncil and Cllabratrs. AIDD Instructins: The reprt shuld include a narrative prgress reprt that chesively describes the activities that were implemented by the Cuncil and the P&A, the Cuncil and the UCEDD, the Cuncil and ther cllabratrs. Fr at least ne f the issues/barriers identified abve describe: (a) the issue/barrier; (b) cllabrative strategies t address issue/barrier and expected utcme(s); (c) the DDC s specific rle and respnsibilities in this cllabrative effrt. Include any technical assistance expertise DD Cuncil staff can prvide t ther States in this area; (d) briefly identify prblems encuntered as a result f this cllabratin, and technical assistance, if any, desired; and (e) any unexpected benefits f this cllabrative effrt. ITACC Guidance: This sectin shuld include infrmatin ther than the required planned gal/bjective specific t the DD Netwrk (the planned cllabrative activities will be reprted in the prgress reprt narrative fr the bjective). We recmmend reviewing the 5 Year State plan sectin n Cllabratin (the sectin is lcated under the Cmprehensive Review and Analysis; Ratinale fr Gal Selectin buttn, then select Cllabratin). After reviewing the planned cllabratin activities, determine the cllabrative activities that ccurred during the reprting perid and prepare a narrative prgress 12

14 reprt that describes the cllabratin activities as a whle; then select ne f the issues/barriers the Cuncil and the cllabratr(s) wrked n and prepare a descriptin t include the items b thrugh e (abve). 13