NGO Social Accountability Practitioner Survey October 11, 2007 Final Report Prepared by Fusion Analytics
Table Contents Research objectives Framework and survey methodology Executive summary Respondent prile Programs/polices and media/communications Social accountability tools Access to information Communications process Public Opinion and Future state 2
Survey Objectives Research objectives 1. Gather evidence for the proposition that social accountability mechanisms depend for their effectiveness on communication structures and processes, and particularly the power public opinion 2. Demonstrate how these tools could work better if more attention is paid to both the communication environment in which they are applied the media system, the quality the public sphere, etc. and the processes shaping public opinion and provoking public action 3. Create a set (1) analytical/diagnostic and (2) implementation tools to support development practitioners in using these tools more effectively 3
Framework and Survey Methodology Framework This deck presents the findings from the NGO social accountability practitioner survey research. The analysis is structured by key green topics around accountability practices: 1. Program and polices 2. Existing practitioner tools 3. The role public opinion Methodology Online study among NGO social accountability practitioners Surveys were taken in 4 languages: English, French, Spanish and Russian Total Interviews conducted: 45 Survey timeframe: June 30 August 31, 2007 4
Survey Sample Sample Composition The web-based survey was sent to those social accountability practitioners who participated in the World Bank Institute s stocktakings social accountability practices in Africa, Asia, Europe and Central Asia, and Latin America (Peru and Ecuador). Survey Sample The survey sample reflects a population social accountability practitioners across four regions (South Africa, Eastern Europe, Latin America, and Asia) and provides qualitative insight into social accountability programs, tools and role public opinion. Although the survey provides a quantitative context due to the nonrepresentative sampling and small samples sizes the results the survey should be interpreted directionally. 5
Executive Summary - Overview Support social accountability is strong among NGOs and donors but low among government stakeholders Lack government support and funding are key drivers behind the lack effectiveness existing social accountability tools Receiving support from local community groups and the government are most important to practitioner social accountability work Overall, practitioners are generally up-beat about their past work and are even more enthusiastic about the potential for social accountability programs in the future 6
Respondent Prile 7
Respondents work across multiple Social Accountability function areas Social Social accountability accountability capacity capacity Policies 60% Implementation 56% Project management 53% Project evaluation 38% Other 20% Q. In what capacity have you worked on social accountability projects and/or polices in your organization? (Select all that apply) 8
The majority respondents receive social accountability reports on both a national and local level local reports have been available longer Social Social accountability accountability reports reports Length time receiving reports on SA programs National level Local level Currently receive reports 87% 96% Less than one year 8% 1 to 2 years 40% 22% 3 to 4 years 24% 48% 5+ years 20% 22% Q. How long have you been receiving reports/data/evaluations from social accountability programs in the country that you work? Note SC =social accountability 9
Respondents are primarily general managers or project managers SA programs Respondent Respondent Position Position Director/General manager 34% Other 4% Specialist Project leader/manager 24% Project implementer, project monitor, project advisor, coord 27% Q. Which the following best describes your position (please select one): 10
Respondents have worked on social accountability programs primarily in Latin America, Africa, Eastern Europe, and Asia Peru South Africa Kazakhstan Zambia Uganda Ghana Ecuador Tanzania Mozambique Macedonia, FYR Kenya Senegal Nigeria Niger Malawi Kyrgyz Republic Georgia Ethiopia Egypt, Arab Rep. Bosnia-Herzegovina Azerbaijan Other 5% 5% 5% 5% 2% 2% 2% 2% 2% 2% 2% 2% 2% 2% 2% Q. In what country have you most recently worked on Social Accountability Programs? 9% 9% 7% 7% 7% 7% Country Country most most recently recently worked worked on on social-accountability social-accountability programs programs 11
Programs, Polices and Media 12
Summary: Programs/polices and media/communications Social accountability programs enjoy significantly more recognition/support from NGOs and donors than from the government and the private sector Social accountability programs are most affected by usage and accessibility - however practitioners rate both these dimensions low Practitioners have access to multiple (an average 9.6) traditional or alternative systems communications However, few these communications systems are seen as affective 13
Commercial media systems and an open political culture exist in most settings. Social accountability programs enjoy significantly more recognition/support from NGOs and Donors than from the government and private sector Existing Existing communication communication programs programs and/or and/or policies policies 84% 24% 76% 36% 49% 9% 56% 69% 33% 40% 35% 60% 40% 40% 40% 36% 18% 22% 24% 18% 7% A commercial media system (e.g. commercial radio, new spapers, etc) A constitution and the political culture that allow s freedom speech, association and assembly Social accountability programs that are recognized/supported by local NGOs Social accountability programs that are recognized/supported by Donors Free elections A Freedom Information Act Social accountability programs that are recognized/supported by the government Social accountability programs that are recognized and supported by the private sector Strongly agree (5) Agree (4) Q. In your opinion, to what extent does the country you work have the following programs and/or policies in place (5=strongly agree). 14
Although a majority have commercial media systems accessibility (especially in rural areas) and use are a concern 84% Media Media or or communications communications processes processes 24% 65% 29% 60% 36% 31% 29% 20% 13% A commercial media system (e.g. commercial radio, new spapers, etc) A media system accessible to ordinary citizens/general population A media system that is w ell used by the population A media system accessible to ordinary citizens/general population in rural areas Strongly agree (5) Agree (4) Q. In your opinion, to what extent does the country you work have the following media or communications processes in place (5=strongly agree). 15
Social accountability programs are most affected by media systems that are used and accessible Affect Affect media media or or communications communications outlets outlets Currently Have A media system that is w ell used by the population 29% 31% A media system accessible to ordinary citizens/general population 27% 22% 29% A media system accessible to ordinary citizens/general population in rural areas 22% 20% 65% A commercial media system 18% 33% 84% Strongly agree (5) Agree (4) Q. In your opinion, to what extent do the following media or communications outlets affect your social accountability work (5=strongly agree). 16
Practitioners have access to multiple (an average 9.6) traditional or alternative systems communications Traditional Traditional or or alternative alternative systems systems communication communication Internet 98% Cellular telephones/mobile telephony 98% Commercial broadcast radio/television 96% State-ow ned TV/radio 91% Billboards and posters 91% Satelite television new s (i.e., BBC World, CNN, etc) 89% Call-in radio/tv programs 87% Community radio 82% Village assemblies/meetings 80% Theater 78% Tow n halls 62% Respondents use an average 9.6 (out a total 11 options] alternative systems communication Q. Which the following traditional or alternative systems communication exist within the country you work? (Select all that apply) 17
However, few these communications systems are seen as affective local community systems, in general, are rated the most affective Affect Affect traditional traditional or or alternative alternative systems systems communication communication 50% 56% 22% 36% 49% 51% 51% 47% 43% 18% 20% 22% 20% 37% 51% 40% 13% 20% 20% 31% 31% 29% 27% 27% 24% 22% 20% 18% 29% 38% 15% 18% 4% 9% 9% Village State-ow ned assemblies/meetings TV/radio Call-in radio/tv programs Commercial broadcast radio/television Cellular telephones/mobile telephony Internet Tow n halls Community radiobillboards and posters Documentaries Theater Satellite television new s (i.e., BBC World, CNN, Voice America, etc) top two box Strongly agree (5) Agree (4) Q. In your opinion, to what extent do the following traditional or alternative systems communication affect your social accountability work? (5=strongly agree) 18
Social Accountability Tools 19
Summary: Social Accountability Tools In general, participation in social accountability tools is low Right to information, public expenditure tracking surveys, and participatory monitoring and budgeting have been in use among practitioners the longest while social audits, community score cards, and citizen report cards are used less frequently and for shorter periods Lack government support and funding are key drivers behind the lack effectiveness existing social accountability tools 20
Summary: Social Accountability Tools (cont.) Think tanks and NGO s have the most access to social accountability tools (albeit only a slight majority) while less than half rate government access high and access for the general population is essentially non-existent Despite their low access ratings, the government, media and the general population are considered to be the most important stakeholders to receive information on social accountability programs Local media are rated as the most helpful communications channels for disseminating the results social accountability programs 21
Use social accountability tools is low Use Use Social Social accountability accountability tools tools Public expenditure tracking surveys 13% 31% 31% 22% 2% Right to information and information disclosure 40% 36% 13% 0% Participatory monitoring 2% 29% 47% 9% 2% Participatory budgeting 2% 36% 36% Social Audits 7% 24% 47% 22% 0% Community score card 7% 40% 40% 2% Citizen report cards 7% 40% 33% 4% In all w ays possible To a large extent To a moderate extent To a minimal extent Not at all Don t know Q. Based on your knowledge, please indicate the level to which the country you work participates in the following social accountability tools/programs (see below for definitions each program): 22
Right to information, public expenditure tracking surveys, and participatory monitoring/budgeting have been in use among practitioners the longest while social audits, community score cards, and citizen report cards are used less frequently and for shorter periods Active Active use use social social accountability accountability programs programs Right to information and information disclosure 29% 24% 9% Public expenditure tracking surveys 24% 20% 4% 22% 13% Participatory monitoring 20% 33% 22% 2% 7% Participatory budgeting 20% 38% 2% 9% Social Audits 13% 20% 13% 22% Community score card 18% 29% Citizen report cards 9% 18% 20% 9% 29% 5 years or more 3 to 4 years 1 to 2 years Less than one year Don t use Don t know Q. To the best your knowledge, how long has the country you work in been actively carrying out each the following social accountability programs? 23
Overall the effectiveness social accountability programs are rated low by practitioners Affect Affect traditional traditional or or alternative alternative systems systems communication communication 13% 13% 22% 8% 8% 32% 32% 21% 32% 29% 32% 27% 25% 26% 42% 12% 12% 27% 39% 38% 22% 26% 25% 30% 34% 22% 8% 29% 3% 27% 18% 21% 19% 32% 22% Social Audits Participatory monitoring Public expenditure tracking surveys Participatory budgeting Right to information and information disclosure Community score card Citizen report cards top two box Very effective (5) 4 Neutral (3) 2 Not at all effective (1) Q. Please rate the effectiveness each the social accountability programs the country you work currently participates in (5=very effective): 24
A Lack government and funding support appear to be drivers behind lack Social Accountability program effectiveness Reason Reason behind behind lack lack participation participation Right to information and information disclosure 68% 21% 5% 6% Participatory budgeting 64% 18% 14% 4% Citizen report cards 54% 29% 14% 3% Community score card 48% 30% 17% 5% Social Audits 42% 29% 29% Participatory monitoring 36% 44% 8% 12% Public expenditure tracking surveys 35% 26% 35% 4% Lack support from government Lack funding Lack NGO support Past programs were not successful Q. In your opinion, why has the country you work not participated in the following social accountability programs? 25
Despite practitioner low rating effectiveness a majority can cite a particular social accountability program that helped improve governance Recall Recall a a social social accountability accountability program program that that helped helped improve improve governance governance No 18% Yes 82% Q. In your experience, can you recall a particular social accountability program that helped improve governance over the past five years? 26
Think tanks and NGOs have the most access to social accountability tools (albeit only a slight majority) while less than half rate government access high and access for the general population is essentially non-existent Extent Extent access access to to information information on on social social accountability accountability tools tools Think tanks, research institutions/ libraries, universities 27% 31% 58% NGOs 24% 27% 51% Government 18% 27% 45% Media 22% 33% General population/citizens 2% 7% 9% top two box Strongly agree (5) Agree (4) Q. In your opinion, to what extent does each the following stakeholders have access to information on social accountability tools? (5=strongly agree) 27
Despite their low access ratings, the government, media and general populations are considered to be the most important stakeholders to receive information on SA programs Importance Importance stakeholders stakeholders to to receive receive information information on on social social account account ability ability tools tools Government 93% Media 91% General population/citizens 91% NGOs 89% Think tanks, research institutions/ libraries, universities 84% Most important (5) Q. In your opinion, how important is it that each the following stakeholders receives information on social accountability tools? (5=most important) 28
Local media are rated as the most helpful communications channels for disseminating the results SA programs Disseminating Disseminating social social accountability accountability information information 76% Village assemblies/meetings 82% 24% 20% 60% 58% 58% Community meetings Community radio 78% Media Interviews 73% 33% 40% 60% Commercial broadcast radio/tv 27% 20% 18% 27% 24% 36% 33% 33% 31% 31% 29% 29% Internet 53% 49% 58% Town halls Call-in radio/tv programs Press conferences 53% Publications 65% State-owned TV/radio 40% 13% 22% 24% 24% 22% Theater 39% Billboards and posters 44% Satellite television news 31% 27% 20% Cellular/mobile telephony top two box Very helpful (5) Helpful (4) Q. Please rate the extent to which each communication medium listed below helps in disseminating information about the results social accountability tools (5=very helpful). 29
Access to Information 30
Summary: Access to Information Consistent with other measures access, the general population s access to ficial government information (e.g., budget allocations, etc) is low National government fices, websites, and the media are the most accessed sources government information Specific websites and NGOs are rated the most useful sources information on social accountability programs The internet and colleagues are by far the most frequently used communications channels to access government information Multiple stakeholders are accessed to provide feedback on development or progress on social accountability projects Q. What are the most important programs or polices to ensure that access to information remains open? 31
Consistent with other measures access, the general population s access to ficial government information (e.g., budget allocations, etc) is low General General population population access access to to ficial ficial government government information information Very accessible 5 7% 18% 4 3 38% 2 Not accessible at all 1 38% 7% top two box Accessible Government information to the general public Q. Please rate the extent to which ficial government information (such as budget allocations, budget transfers, budget reports, etc.) is accessible to the general public in the country you work. 32
National government fices, websites, and the media are the most accessed sources government information Practitioner Practitioner sources sources ficial ficial government government information information National Government fices/ministries 87% Specific internet sites 71% The media 67% Local Government Offices 60% NGOs 58% Donors 38% Social accountability tools 33% Libraries 27% Local community groups Other 4% Q. What sources do you access to obtain ficial government information (such as budget allocations, budget transfers, etc.)? (Select all that apply) 33
Specific websites and NGOs are rated the most useful sources information on SA programs Usefulness Usefulness ficial ficial sources sources information information Specific internet sites 53% 21% 74% Social accountability tools used by NGOs 43% 30% 73% NGOs 41% 27% 68% Local Government 39% 20% 59% National Government fices/ministries 36% 29% 65% The media 30% 32% 62% Donors 24% 24% 48% Libraries 20% 15% 35% top two box Very useful (5) Useful (4) Q. How useful are the following ficial sources information on social accountability programs/tools: 34
The media and specific websites are used most ten to access information on SA programs Frequency Frequency use use ficial ficial sources sources information information The media 57% 14% 29% Specific internet sites 55% 26% 19% NGOs 31% 21% 48% National Government fices/ministries 30% 21% 49% Local community groups 20% 17% 63% Social accountability tools 17% 67% Local Government 15% 28% 56% Libraries 10% 17% 72% Donors 9% 29% 62% Daily Once a month Once every few months Q. How ten do you use ficial information from the following sources? 35
The internet and colleagues are by far the most frequently used communications channels to access government information Communication Communication channels channels Internet 62% 13% 18% 7% Co-w orkers/colleagues 53% 22% 9% Publications 38% 20% 42% National Government 22% 24% 44% 10% Local Government 27% 51% Press conferences 24% 42% 23% Rural community groups 7% 13% 40% 40% Local community groups 7% 47% 35% Daily Once a month Once every few months Have not used Q. What communication channels (e.g. publications, internet, etc) do you access to obtain ficial government information? 36
Multiple stakeholders are accessed to provide feedback on development or progress on SA programs Stakeholder Stakeholder feedback feedback NGOs 82% Community 78% Local government 71% National Government 67% Other 22% Q. What stakeholders do you access to provide feedback on development or progress on your social accountability projects? 37
Communication processes 38
Summary: Communication Processes Receiving support from local community groups and the government are most important to practitioner social accountability work Despite the importance receiving support from the local community and the government the ability these two key groups to use program results is lacking also concern is the high level resistance among government stakeholders Across stakeholder groups face-to-face and direct advocacy are viewed as the most effective influence tactics Q. What are the most important programs or polices to ensure that access to information remains open? 39
Receiving support from local community groups and the government are most important to practitioner social accountability work Support Support from from Stakeholders Stakeholders Local community groups 76% 13% 89% Government 76% 92% NGO 60% 22% 82% Media (e.g., Journalists) 51% 29% 80% Very important (5) Important (4) Q. Please rate the importance receiving support from the following stakeholders in order for your social accountability work to be effective? top two box 40
Despite the importance receiving support from the local community and the government the ability these two key groups to use program results is lacking. Also concern is the high level resistance government Communication Communication Channels Channels Local Community 4% 51% 20% 4% 20% Government 44% 42% 2% 7% 4% NGO 18% 42% 36% 4% Donors 33% 40% Resistance to programs General awareness programs Know how to use program results effectively Know how to obtain support for programs Don t know Q. For each stakeholder group below, please select the option that best characterizes their reaction/relationship to social accountability programs? 41
In obtaining support among government stakeholders practitioners found the face to face meetings and direct advocacy most successful Government Government support support tactics tactics and and strategies strategies Direct advocacy w ith community groups 34% 23% 20% Third party intervention/ spokesperson/champion 21% 28% 21% Advocacy through the media 30% 23% Face to face meetings 42% 14% 12% Very effective (5) Effective (4) Did not use Q. In situations where support from important stakeholders was not forthcoming what tactics or strategies did you employ for each stake holder group? 42
In obtaining support among NGO stakeholders practitioners found the face-to-face meetings, advocacy through the media, and direct advocacy most successful NGO NGO support support tactics tactics and and strategies strategies Direct advocacy w ith community groups 32% 30% 18% Third party intervention/ spokesperson/champion 14% 25% 32% Advocacy through the media 34% 32% 18% Face to face meetings 44% 21% 12% Very effective (5) Effective (4) Did not use Q. In situations where support from important stakeholders was not forthcoming what tactics or strategies did you employ for each stake holder group? 43
In obtaining support among local community stakeholders practitioners found the face-to-face meetings and direct advocacy most successful Local Local community community support support tactics tactics and and strategies strategies Direct advocacy w ith community groups 36% 30% 14% Third party intervention/ spokesperson/champion 32% 20% Advocacy through the media 26% 23% Face to face meetings 43% 20% Very effective (5) Effective (4) Did not use Q. In situations where support from important stakeholders was not forthcoming what tactics or strategies did you employ for each stake holder group? 44
In obtaining support donors practitioners found the face-to-face meetings by far the most successful Donor Donor support support tactics tactics and and strategies strategies Direct advocacy w ith community groups 7% 34% Third party intervention/ spokesperson/champion 9% 34% Advocacy through the media 23% 27% Face to face meetings 35% 12% 19% Very effective (5) Effective (4) Did not use Q. In situations where support from important stakeholders was not forthcoming what tactics or strategies did you employ for each stake holder group? 45
Practitioners spend most their time with stakeholders on program awareness, use results, and obtaining program support not surprisingly among government stakeholders practitioners spend more their time addressing program resistance Stakeholder Stakeholder Influences Influences Donors 29% 40% 13% 7% Local Community 2% 42% 24% 13% 13% 6% NGO 24% 40% 22% 3% Government 18% 33% 27% 7% 4% Resistance to programs General awareness programs How to use program results effectively How to obtain support for programs Don t know NA Q. For each stakeholder group below, please select the ways in which you have tried to influence their response/relationship to social accountability programs? (Select all that apply) 46
Public Opinion & Future Social Accountability Programs 47
Summary: Public Opinion Practitioners universally agree that public opinion is key to effective social accountability mechanisms and achieving program goals A majority practitioners have experienced a media program and/or intervention that has improved social accountability in their country Overall, practitioners are generally up-beat about their past work and are even more enthusiastic about the potential for social accountability programs in the future Q. What are the most important programs or polices to ensure that access to information remains open? 48
Practitioners universally agree that public opinion is key to effective social accountability mechanisms and achieving program goals Importance Importance Public Public Opinion Opinion 95% 96% Important (4) Very important 5 84% 80% The role public opinion in the effectiveness social accountability mechanisms? The role public opinion in achieving the goals your social accountability work? Q. In your opinion, how important is the role public opinion in the effectiveness social accountability mechanisms?/in your opinion, how important are the media in achieving the goals your social accountability work? 49
A majority practitioners have experienced a media program and/or intervention that has improved social accountability in their country Media Media program program and/or and/or intervention intervention No 31% Yes 69% Q. Can you recall an example a media program and/or intervention over your pressional career that you consider to have improved social accountability in the country you work? 50
Media program and/or intervention highlights Respondent verbatims The use community radio to sensitize local communities and local governments and to call for people's participation in participatory budget forums Programs like 3rd Degree and Carte Blanche tend to carry [occasionally] scandalous exposes on inadequacies in public sector delivery. There does appear to be some level impact in terms putting fire under the respective departments Anti-corruption TV footages have helped create considerable awareness The production a quarterly community newsletter by a group NGOs that evaluates local government budgets and their implementation in the whole country. It has really enlightened local people and made them ask very important questions about the local goverment Publication financial flows to local governments on a monthly basis in national newspapers Q. Can you recall an example a media program and/or intervention over your pressional career that you consider to have improved social accountability in your country?/if yes, please describe the media program and/or intervention. 51
Increased citizen involvement with the government and effective and efficient use budgets were ranked most important to practitioners in improving social accountability programs in the future Importance Importance social social accountability accountability components components Increase citizen involvement w ith government 24% 42% Effective and efficient use budgets 22% 22% Improved service delivery 9% 13% Training programs (e.g., effective advocacy Improved communications program results 7% 7% 7% 13% Improved planning Increased local Government involvement 4% 4% 4% 7% Increased national Government involvement Increased Donor involvement 0% 2% 2% 2% Better advocacy 0% 7% Ranked second Ranked first Q. Please rank the top 2 program components in order importance (1=most important) to improving social accountability programs in the future. 52
Practitioners are generally up-beat about their past work and are even more enthusiastic about the potential for social accountability programs in the future Past Past and and future future 84% 68% Better 44% 64% Significantly better 24% 20% In the PAST 2 years would you say that social accountability programs in the country you work have gotten In the NEXT 2 years do you believe that social accountability programs in the country you work will get... Q. In the past 2 years would you say that social accountability programs in the country you work have gotten/in the next 2 years do you believe that social accountability programs in the country you work will get 53