Monitoring and Evaluation

 

 

  “True genius resides in the capacity for evaluation of uncertain, hazardous, and conflicting information”  Winston Churchill

Whether it is setting up the monitoring and evaluation for a project, identifying indicators, designing a logframe, conducting a baseline, mid-line or rapid needs assessment or providing monitoring for an ongoing project, i-APS works with you to ensure that the systems designed and put in place provide you the information you need.

Our M&E work includes the following services:

  •  Assessments and Research
  • Performance and Impact Evaluations
  • Data Quality Assessments, Collection and Monitoring
  • Theory of Change, Design And Performance Monitoring Systems
  • Results Framework and Tool Development
  • Risk Analysis and Due Diligence
  • Sector and Stakeholder Analysis Cash Transfer Programming 

i-APS team members have extensive, varied experiences in conducting monitoring and evaluation work, including work in both slow- and rapid-onset natural disasters and in situations of ongoing conflict and refugee populations. 

The most relevant recent projects related to monitoring and evaluation work highlighted below:

MONITORING AND EVALUATIONS

Client

Project

Location

GOAL/MDM/IMC

Independent Learning Evaluation of DFID-funded Ebola Treatment Centres

Sierra Leone

CARE International

Impact of Multi-purpose Cash Assistance on Gender Dynamics in Refugee Households and Communities

Lebanon

GOAL

Evaluation of emergency food security, NFI & shelter project

Syria

GOAL

Evaluation of Emergency Food Support for Conflict Affected Syrians, Food and Livelihoods

Syria

Save the Children Middle East Program

Evaluation of Humanitarian Relief for Children and Their Families Affected by the Conflict in Syria

Lebanon, Iraq Turkey, Syria,

UNICEF, UNFPA

External Review of the Gender-based Violence AoR Leadership and Coordination Structures

Global, MENA

    Third Party Monitoring

    Through Third Party Monitoring work,  i-APS provides an independent assessment of programs and projects.

     i-APS team employs a methodological approach that prioritizes both qualitative and quantitative methods, using four core data collection processes:

    • Literature review and analysis of secondary data.
    • Beneficiary verification, accountability to and transparency with  affected populations.
    • Beneficiary surveys, case studies.
    • Process monitoring.
    • KIIs and FGDs.
    • Monitoring checklist, service delivery verification and post-distribution/post-implementation monitoring.
    • Direct observation and on-site verification of the implementation of programs, and
    • Situational analysis of population and operational environment

    The data are always gathered in a sensitive way and disaggregated by key qualifiers including age, gender, and location.

    Through a collaborative and transparent process, our team works with our clients and stakeholders to develop customized solutions that are sensitive to local context and that are practical. i-APS understands how to develop implementation plans and tools that will translate our clients projects’ goals into field-level realities and provide feedback to inform client’s decisions about their program quality and the impact on the communities they serve.

    Data collection and analysis occurs on ongoing (monthly basis), a consolidated draft monthly report from the monitoring activities are then submitted to our clients for review and comments. Monthly reports serve as a base for next month training, capacity building and program quality improvement actions.

    Quarterly reports provide a summary on key findings, corrective actions and provide operational suggestions focusing on program adjustments and contribute towards organizational wide learning and knowledge management. Six months and annual report serve as a base for midterm or final program review.   

    THIRD PARTY MONITORING

    Client

    Project

    Location

    Plan International

    Real Time Institutional Assessment and Evaluation of Plan’s Response To Typhoon Haiyan

    Philippines

    Relief International

    Third Party Monitoring, Multi Sector Assistance for Conflict-Affected Communities

    Syria

    Global Communities

    Field Third Party Monitoring, Syrian Relief and Resiliency Program

    Syria

    International Organization for Migration

    Third Party monitoring of emergency shelter, livelihoods, sanitation projects implemented by three partners

    Syria

    ACTED

    Third Party Monitoring of agriculture and food security program

    Syria

     

     

    SPOTLIGHT PRACTICE AREA: Institutional Strengthening and Development

    i-APS works with organizations in the public and private sector to identify opportunities for organizational strengthening and growth. Our aim is to make global development more effective by ensuring that actors are operating to their maximum potential.

    Institutional Strengthening and Development Approach

    i-APS begins Institutional Strengthening and Development engagements by performing an organizational assessment. This assessment allows us to develop a shared understanding of existing organizational strengths and weaknesses, identify system-level challenges to be addressed, pinpoint clear competitive advantages to leverage, and foster consensus on priorities for action.  At the end of the assessment phase, i-APS will have answered the following questions: 

    • What are the immediate and long-range steps necessary to achieve the client’s objectives?
    • What are the processes that need to be put in place?
    • What are the tools that need to be created?

    Based on the answers to these questions, i-APS will design individualized and team-based action plans, define key milestones for the engagement, and identify key performance indicators (KPIs) for target initiatives. While this is the typical formula for structuring Institutional Strengthening and Development engagements, i-APS’ remains flexible to the specific objectives, timelines, and needs.

    Strategic and Operational Planning

    i-APS can help you design or update your organization’s overall direction and then lay out the key actions, initiatives, and resources necessary to achieve your vision.

    Balanced Scorecard

    i-APS works with clients to expand their frame of reference beyond traditional financial and project related metrics to focus attention across critical areas of their organization.

    System Design and Process Improvement

    i-APS can help remove internal bottlenecks and roadblocks by performing quick internal assessments and offering bespoke products and systems to create efficiency.

    Training and Capacity Building

    By focusing on strengthening human capacity we can help ensure that your project, program, organization, or partnership works to its maximum potential and has a sustainable future.

    Value Proposition Development

    i-APS can help you to build a compelling value proposition that will let your funders, beneficiaries, customers, or investors know how your organization stands out from the rest.

    Illustrative LIst of Projects

    INSTITUTIONAL DEVELOPMENT

    Client

    Project

    Location

    Catholic Relief Services

    National Cost Share and Private Sector Development Strategy

    Nigeria

    ACORD International

    Institutional Strengthening

    Africa (13 counties)

    IMA World Health

    Institutional Business Processes Planning and Development

    Washington, D.C., Global

    Iraqi Red Cross/Red Crescent

    Communication study: brand image and perceptions

    Iraq

    American Red Cross

    Institutional Assessment and Business Plan Development

    Haiti

    FOCUS 1000

    The Social Mobilisation Action Consortium, Digital Data Collection and Community-based Surveillance System of Ebola Virus Disease

    Sierra Leone

    IFRC, Saudi Red Crescent Authority,

    Communication and advocacy strategy

    Saudi Arabia

    Syrian American Medical Society

    Institutional strengthening, capacity building, program development

    Syria, Turkey, Jordan, USA

    World Vision International

    Design & delivery of multiple trainings in the areas of project cycle management, leadership, development and M & E

    MENA

    MENA Region Red Cross/Red Crescent National Societies

    Disaster management strategy and institutional management strategy development (17 organizations)

    MENA

    IFRC and Red Crescent Societies

    Regional organizational leadership and management strategy

    MENA

    Iraqi Red Crescent Society

    Five-year strategic plan, branding and marketing, investment strategy, public/private sector partnership development

    Iraq

    Knowledge Management 

    The challenge faced by organization is how, in a lean, fast-paced environment can they capture or consolidate the critical
     knowledge being developed through programming in the field, channel that into programming innovations and the
    development of best practice, all the while feeding critical insights back into the organization to improve and strengthen
    its operations, and channeling the appropriate information to key stakeholders to inform future programming, policy, and
    strategy.

    The objective of i-APS Knowledge Management Practice is to enable organizations responding to humanitarian disasters to capture, understand, and translate lessons learned into best practice across operations

    i-APS will work together with your organization to build upon the existing, consolidate or develop a customized Knowledge
    Management and Learning Process or Portal to address the way that this universal issue manifests itself uniquely within
    the each organizational structure. The KM creates an online “brain center” for country, regional and global programs to
    deposit critical program level information – such as context assessments, third party monitoring reports, and evaluations.
    However, unlike the shelf where these types of reports normally end up, i-APS works together with organizations to build
    capacity around ensuring that the portal because a resource for institutionalizing learning and managing knowledge.

    i-APS’ experience in the conflict and post conflict context includes projects at every stage of the organizational learning cycle in all major sectors.

    We have performed rapid needs assessments; health facility and capacity utilization assessments; an economic evaluation of a food assistance program, jobs, vocational training centers and livelihoods; a final evaluation ; a Cash Based Response Feasibility study, and third-party monitoring of DFID, ECHO, UN, USAID and OFDA funded programs. As a learning organization i-APS employs its capacity to improve the implementation of the learning cycle in
    promoting and refining best practices and sharing that information to help organizations achieve their effectiveness and efficiency.
    In total, i-APS has implemented over twenty five learning projects globally.

    Client

    Project

    Location

    Plan International USA

    Study on Social Mobilization and Behavioral Change Communication Response to Ebola Crisis

    Republic of Guinea

    Global Communities

    Market and Needs Assessment for agriculture & shelter programming

    Iraq, Turkey and Syria

    ACTED

    Market Value Chain Assessment

    Syria

    ACTED

    Labor Market Assessment for vocational training, jobs and livelihoods programming

    Syria

    Global Communities

    Labor Market Assessment

    Turkey

    World Vision International (WVI)

    Rapid Needs Assessment in Syria

    Syria

    GOAL

    Economic Analysis to Measure Impact of Cash-Based Programs on the Local and Household Economy

    Syria

    Cash-Based Working Group, Global Communities, UNHCR, DFID

    Cash Based Response Feasibility Assessment

    Northern Syria

    Cash Based Working Group, WFP, FAO

    Cash Based Response Feasibility Assessment

    Southern Syria

    WHO, Jordanian Ministry of Health

    Health Facility and Capacity Utilization of Government of Jordan Health Care Facilities

    Jordan

    Disaster Management 

     i-APS advisors can network effectively and work across a range of humanitarian disciplines.  i-APS advisors provide specialist advice, analysis to assist humanitarian and recovery strategy development, programme funding and contribute to response plans.  Our team of experts are on stand-by to deploy to emergency situations.  At i-APS we offer support with:

    •  Humanitarian risks assessment and analysis
    • Planning and managing humanitarian response
    • Humanitarian theory, practice and architecture
    • Disaster resilience theory, practice and architecture
    • Disaster Training: training based on practical experience of running humanitarian operations

     All our Advisors have knowledge of the development effectiveness agenda, the international development system, and come with institutional and organisational knowledge.

    ‘’People of different religions and cultures live side by side in almost every part of the world, and most of us have overlapping identities which unite us with very different groups. We can love what we are, without hating what – and who – we are not. We can thrive in our own tradition, even as we learn from others, and come to respect their teachings.”

    ― Kofi Annan

    Humanitarian risks assessment and analysis

    A coordinated approach to the assessment of an emergency and to the prioritization of the needs of affected people lays the foundation for a coherent and efficient humanitarian response.  For protracted crises, the depth and volume of information needed for an effective response increases as it evolves. This often translates into a requirement for in-depth cluster/sector, thematic or agency-specific assessments to inform planning and operations, which in turn necessitates a harmonized assessment approach with joint needs analysis.

    At i-APS we utilize and build on existing and tried and tested tools and guidelines; enabling i-APS client’s to receive bespoke toolboxes that improve knowledge on existing humanitarian information and  support existing architecture. Our pool of seasoned emergency response personnel are able to provide timely analysis and can assist clients with recommendations for service provision.

    Disaster Management Training

    Training based on practical experience of running humanitarian operations. The aim of disaster management training is to build the capacity of staff and volunteers, and that of local Government service providers to improve preparedness and response at all levels before during and after disasters and to give the means to work together in a coordinated manner. The focus of i-APS’s disaster management training is generally on improving the technical skills of the participants, but also on personnel and team management. It aims to encourage an exchange of experience and knowledge and the creation of networks amongst the disaster managers. It also aims to improve coordination of disaster response and the quality and availability of disaster management tools.

    i-APS can assist and guide organizations and Governments on standardizing training curricula, train trainers, facilitate and support training in disaster management at national, regional and international level.

    This training will reflect the mandate of the client in disaster management in its country and vary but will generally include:

    •  Volunteer induction
    • Volunteer management
    • Community based first aid (CBFA)
    • Community based disaster management (CBDM) Participatory hygiene and sanitation transformation (PHAST)
    • Water and sanitation
    • Vulnerability and capacity assessment needs assessment training Relief and distribution Logistics management National disaster response team (NDRT)
    • Public health in emergencies
    • Food security and nutrition
    • IT/Telecommunications

    i-APS expertise goes beyond institutional strengthening and support; our team is fully equipped to handle project
    implementation as well. Whether it’s a rapid needs assessment or impact analysis, i-APS will deploy a team of experts to
    meet your needs.

    •  Humanitarian Response and Disaster Management, Civil Society Engagement and Sectors of Interventions
    • Jobs and Livelihoods
    • Leadership Development, Management and Organizational Change
    • Inclusive Development
    • Labor Market Assessments and Value Chain Assessments

      HOW CAN i-APS HELP YOU ON YOUR ORGANIZATIONS JOURNEY? 

      9

      STARTING UP

      Just getting started?

      i-APS can provide the road map to your next five years of growth. A good foundation and the appropriate systems are the keys to sustainability. From strategic and operational planning to capacity-building, systems development, and program design, we’ll help you make sure that your organization is on the right track.

      9

      GROWING

      Ready to take it to the next level?

      i-APS can help you break down internal and external barriers to growth. Whether it’s a refresh of your strategic plan, support in the development of multi-million dollar proposals, facilitation of new strategic partnerships, systems stress tests, process review and reform, or staff capacity building – we’ll make sure that you and your team can achieve meaningful impact.

      9

      WELL-ESTABLISHED

      Need an injection of third-party expertise?

      i-APS is a network of substantive and technical experts who can provide the surge capacity your organization needs. With seamless capacity to scale-up and back, i-APS can quickly provide your organization with the expertise its looking for across a variety of domains. Whether its baseline and benchmark analysis, rapid needs assessment in hard to reach areas, third-party monitoring, evaluation, learning, market analysis or developing your local partners’ capacity – our team can get you the data you need to ensure your operations are targeted.

      PROJECT IMPLEMENTATION

      i-APS : expertise goes beyond institutional strengthening and support; our team is fully equipped to handle project  implementation as well. Whether it’s a rapid needs assessment or impact analysis, i-APS will deploy a team of experts to meet your needs.

      Technical Capabilities 

      • Organizational Development, Training and Capacity Building
      • Monitoring and Evaluation
      • Research, Learning and Adaptability
      • Communications and Advocacy
      • Strategic Planning, Business Modeling and Market Development

      Substantive Expertise

      • Value Proposition
      • Emergency Management, Disaster Relief and Humanitarian Assistance
      • Civil Society Engagement
      • Healthcare Services
      • Leadership Development, Management and Organizational Change
      • Inclusive Development