HDX data check (quality and sensitivity control and data freshness checks)
All data publicly or privately shared through HDX is reviewed by a Centre for Humanitarian Data team member to ensure it follows the Terms of Service. This initial check is always performed by a member of the Centre's Data Partnerships team. A dataset will immediately be deleted from the HDX platform in case the data is found to contain personally identifiable information or other data that the Data Partnership Team member considered likely to be sensitive.
- In case the potentially sensitive data is microdata, the following steps will be taken:
- A copy of the microdata resource is obtained by Nafi in Dakar
- Nafi applies the risk assessment tool which is part of the SDCmicro package developed by the World Bank
- Nafi shares back the risk assessment with Javier and Jos
- Javier, Jos and Nafi reach out to the contributor to inform them of the risk of reidentification of individual respondents, and explain the SDC process
- Nafi applies the SDC tool to the data concerned, and conducts another risk assessment and estimates information loss, results are shared with Javier and Jos
- Javier, Jos and Nafi determine next steps (either publication of the perturbed dataset or sharing of the original dataset through HDX connect) together with contributor
- Lessons learned are recorded in an overview of the incident, drafted by Nafi and reviewed by Jos