1. Selection
INSERT PARTNER ABBREVIATION selects the data they will share on the HDX platform, within the limitations set by the Terms of Service.
2. Preparation
INSERT PARTNER ABBREVIATION prepares the selected data for publication. This may include cleaning the data and putting it into one of the supported formats. HDX encourages INSERT PARTNER ABBREVIATION to add HXL tags to the data.
3. Transmission
The data can be uploaded directly to the HDX platform as a resource or through a link to a remote URL such as Google Drive or DropBox or an API.
4. Storage and hosting
Data that is uploaded to HDX is stored on a third party’s servers, which are currently hosted in the United States but may be moved to a different location in the future. Data shared through a URL link is stored in the cloud or servers belonging to INSERT PARTNER ABBREVIATION.
5. HDX data check (quality and sensitivity control and data freshness checks)
All data publicly or privately shared through HDX is reviewed by a Centre for Humanitarian Data team member to ensure it follows the Terms of Service. This initial check is always performed by a member of the Centre's Data Partnerships team. A dataset will immediately be deleted from the HDX platform in case the data is found to contain personally identifiable information or other data that the Data Partnership Team member considered likely to be sensitive.
- Who to call?
- In any case, the Data Policy Officer (Jos) is notified - in case the Data Policy Officer (Jos) is not available, this notification will be forwarded to the Data Partnerships Team lead (Javier) and to the Centre Lead (Sarah).
- In case the potentially sensitive data is microdata (row-level survey data), Mike will also be notified.
- These team members, together with the Data Partnership Team member, review and document the case. After internal discussion, the contributor of the dataset will be notified and invited to jointly discuss the issue and to determine next steps.
Further, a dataset will be made private by the Centre for Humanitarian Data team member and the contributor will be notified immediately in case the Data Partnerships Team members finds that:
● The dataset is found to contain gaps that render the quality of the dataset insufficient for use by a humanitarian audience, or;
● There are no resources (files or links) or broken links are found, or;
● The dataset contains data that is not relevant to a humanitarian audience, or;
● Data was not shared in one of the suggested formats.
After the dataset has been uploaded, the Centre for Humanitarian Data team will conduct regular checks to verify that data on the platform is being maintained. If the dataset is found to be out of date, the Centre for Humanitarian Data team will contact the contributor to suggest that the data be updated or that the dataset update frequency indication be changed. If metadata is found to be incorrect, the Centre for Humanitarian Data team will notify the contributor, after which the Centre for Humanitarian Data team might correct the metadata.
6. Retention and deletion
i) Data shared through HDX will be accessible until such a time when:
a. INSERT PARTNER ABBREVIATION delete the data by clicking “Delete dataset”, in which case the data is purged from the HDX database, or;
b. a request for removal is made by a stakeholder with a legitimate interest in removing the data from the platform, in which case the HDX team will make the dataset private. The data is then either purged from the database or republished after further investigation by HDX, in consultation with INSERT PARTNER ABBREVIATION.