Challenges and solutions for data collection in humanitarian research projects: an example from South Sudan

Written by Gerbrand Alkema, MEAL Advisor, World Vision

In 2019 John Hopkins University together with World Vision embarked upon a quasi-experimental research project to learn more about cash transfers in humanitarian settings and how cash transfers might impact on family relationships and intimate partner violence (IPV). The research was designed based on anecdotal reports of increased association of IPV following cash distributions in humanitarian settings. Especially in settings where women have little say in finances.  Although the relationship between cash and IPV has been researched in development settings (Roy et al, 2021), this study was one of the first to look at the relationship in humanitarian settings.

The research used a mixed method data approach with quantitative and qualitative data collection. This was done with the help of students who were well-trained in qualitative and quantitative data collection. Specific attention was paid to the training for the qualitative cohort, ensuring data collectors were comfortable with when to ask what follow up questions, given the potentially sensitive nature of the data.

Four key data collection challenges were overcome during this research project:

1. Working in a non-written language:

The data collection cohort were intensively trained in translation on the spot. Dinka, the majority language spoken in West Gogrial, is not a written language and one English word may have several translations, depending on dialect and where a Dinka speaker comes from. Before data collection data collectors discussed the most used words in the area and agreed the same use of language.

2. Working with team members remotely:

The team was split across South Sudan, UK and USA, and team members needed to be able to work together in real time. The data collectors used Kobo to collect data with near instant data transfer to servers, where an internet connection is available or were uploaded on return to the office in South Sudan. Data could be reviewed for quality by researchers in the US and feedback provided before the enumerators went out again the next day. The speed of the exchange between field and back-office, and responsive management, enabled support to the data collection team and ensured that locations were not over-sampled or under-sampled. This was particularly important when it came to the follow-up surveys and understanding whether thresholds had been met for quantitative sampling by location, ensuring that sufficient respondents were surveyed at follow-up to maintain power.

3. The COVID-19 pandemic:

The COVID-19 pandemic posed an additional challenge for data collection which was halted until the government allowed non-essential services to resume. At this point, the risk of infection with COVID-19 was still present and with limited availability to testing, the data collection was adapted. Enumerators were instructed not to attend data collection days when not feeling well and a rudimentary triage was carried out to assess the risk of respondents having COVID-19. Any suspected positive cases were then provided with information on management of COVID-19 and the survey re-scheduled. Enumerators were also required to find locations for the survey to be administered that allowed for social distancing, while ensuring the privacy of the respondent. Focus Group Discussions were cancelled and replaced with Key Informant Interviews and In-Depth Interviews.

4. Sensitivity of the topic:

Intimate partner violence is a sensitive topic to discuss given the associated stigma and risks. This is especially true in the context of South Sudan where rates of IPV are reportedly high and blame is often placed on the women who experience violence. Enumerators found that some surveyed women were hesitant to answer questions around their experiences of violence, while others had commented that given that enumerators were too young, it was inappropriate for them to talk about such issues. The short communication lines between the teams in the field and the back office and the diversity of the study team meant that quick solutions were found and implemented. These included revising the interview respondents and adjusting the wording of questions to make them more relatable to local context. Moreover, we also employed a consultant who was Dinka, female, and a similar age-bracket as the interviewees to conduct later interviews. As a result, women were able to more openly share their experiences of IPV.

While the data collection process encountered its fair share of complications, through adaptive management, solutions were found to the challenges we identified, and robustness and rigour of data was maintained. Researchers would do well to plan for and find a balance of flexibility in data collection, which responds to unforeseen challenges but maintains confidence in the data collected; a critical ingredient in this process is enabling rapid communication between the research team members to facilitate fast decision-making.

The research findings have now been shared with key stakeholders within World Vision and beyond and have provided insights into the complex relationship between cash assistance and IPV in South Sudan.