Internal testing draft plan below:
next step:
- dev+design to align on which server to conduct a test
- slimmed down version of file store on one of the non-production server
- description of test for each feature - with help from CJ + nalae - with more randomness to test
A list of HDX features for periodic test:
*please check with yumi/dan which server is appropriate for test any of the feature below.
- HDX Connect
a. (Login with your HDX org admin account) Upload a (temp) HDX connect dataset
b. (Logout from your HDX admin account) Find the HDX Connect dataset you created and(if you're not logged in - it should ask you to login. Login as HDX org editor or member) request access from "Data" view on main nav as well as from the (HDX Connect) dataset page. Make 2 requests (1 you will approve, 2 you will decline as a maintainer).
c. Check your email associated with HDX admin and make sure you received the 2 requests with messages you had entered. (if the test was not performed on production - these emails are caught in mailhog and actually not sent. so check the mailhog inbox + click on link to request page)
d. Login again as a HDX admin + approve one of the requests (with attachment - use dummy xls or csv) and decline the other request.
e. Check your email (one should be approved with attachment and the other should be declined). *if the test is not on production - check mailhog
f. Finally, delete the HDX connect dataset (you can leave it if not on production)
+++ end of test +++ - Add data flow
a. (Login with your HDX org admin account) Upload several datasets (1. with a local file from your desktop 2. with remote resource - get it from existing dataset)
b. - Edit data flow (A. overwrite old resource with new B. change resource from external URL <> local resource)
- Contact contributor/group message (either to everyone, all admin, all editors)
- New account registration + request to join + request a new organization
- Data Check (A. validate a local file + remote resource on Tools + B. validate a hxl-tagged resource on HDX)
- Quick Charts (A. test making quick charts on Tools + B. After testing 2(add data with hxlated data), turn on
- Make a dashboard/event page / Edit existing dashboard/event page
- Add/Change carousel item on homepage
- Add a new member from org page 'members' tab + login as admin to confirm the request&approve/decline the membership
- Send a question via "contact us" in FAQ page
a. (without logging in) send a question *if the test is not on production - check mailhog
b. (while logged in to one of the account - admin/editor/member - your email should be pre-populated in the form) send a question *if the test is not on production - check mailhog
Note: if you experienced any bug/issue, make a Jira ticket and tag Yumi/Dan.
Week of / Features | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | |
(example) Week of 1/1/2019 | x (no issue) | x (Jira link) | x (no issue) | ||||||||||
Week of 6/10/2019 | |||||||||||||
Volunteer testing draft plan below
Dear Volunteer,
HDX runs on the open-source CKAN platform, and we are upgrading our version from 2.3 to 2.63 and adding a new feature, requestable datasets. As of today, the new version is ready on the feature server.
We’d like your support in testing this upgraded version on the feature server. The main goal is to confirm that the new version behaves the same way as the old one, and to identify any issues or problems.
We’ve provided more detailed instructions on this document. Sample actions you can test are:
Creating and modifying user profiles
Creating and modifying organisations
Creating and modifying datasets, including all metadata and resources and particularly requestable datasets
Adding gallery items to datasets
Testing the Python Library
A full list of testing scenarios is below. Feel free to choose any of them.
**Be sure to test on the feature server, not on the actual HDX site. Please use this template to record any issue you experience.**
You will receive an invitation to a Slack channel for ease of coordination. If you're not comfortable using Slack, please email questions to me at becky@humdata.org.
Thanks for your support!
Best wishes,
Becky
--
Testing scenarios/ideas
All testing to be done at this url: https://feature-data.humdata.org
User registration
Sign up as a new user
Request membership to a testing organization
Check user dashboard
Change your password and account details
Check members page
Check your role inside organization
Contact the other members from organization by sending a group message
Submit the Contact contributor form
Creation/edit datasets
Create a private dataset with 3 resources
create a private dataset
upload 3 resources
fill only the mandatory fields (red star marked fields)
save dataset
Edit private dataset
edit the previously created dataset
change details of a resource
add 2 more resources
change from private to public dataset
try to save
check errors
fill all the mandatory fields
save dataset
Edit private dataset
edit the previously created dataset
remove 2 resources
add 1 new resources
save dataset
Edit private dataset
edit the previous created dataset
change to public dataset
fill all the mandatory fields
add 3 different type of resources
save dataset
Repeat all steps for public datasets
Requestable Datasets
Please click on the link to see tests for requestable datasets.
Locations
Check locations landing page
Check active location page
Check inactive location page
QuickLinks (in the top navigation bar)
Check each quicklink if it loads
Check the data on each quicklink page
HXL Preview
If the data uses the HXL standard, then HDX can automatically create customizable graphs and key figures to help you highlight the most important aspects of your dataset. This is called a "HXL Preview." For a HXL Preview to be generated, your dataset needs:
A CSV with HXL tags as the first resource. HXL is easy! Check out the 30-second tutorial. The CSV can be stored on HDX or as a remote resource at another URL.
To be tagged with "HXL" on the dataset page. This is not referring to the HXL tags inside the CSV, but rather the metadata tags that you set for the whole dataset. This is a flag to HDX to try and process the CSV as a HXL-ated dataset.
Upload a csv file that contains hxl tags and check if hxl preview appears.
Geo Preview
Upload a zipped shapefile or geojson and check if the geopreview is generated (hint: for shapefiles, the file type must be set to "zipped shapefile" instead of the default "zip" for geopreview to be triggered)
Python HDX Library [for Python programmers]
Test the HDX Ckan with the new site, trying as many different API calls and edge cases as you can think of.
HDX Homepage [desktop version]
Go to homepage
Check the search box in the top toolbar. When you start typing a word, do you see useful autocomplete suggestions?
Repeat the same test with the search box in the centre of the page.
Click on trending terms and check if the results appear reasonable
Check each item from the carousel and click on each item to see if it opens the appropriate page
Check page 2 of carousel
Click on each item from footer and see if it opens the appropriate page
HDX Homepage [mobile version]
Go to homepage
Check if page displays in a readable way on a smaller screen (phone or tablet)
Check top right menu and click on items
Check the search box in the top toolbar. When you start typing a word, do you see useful autocomplete suggestions?
Check the search box in the center of the page.
Click on trending terms and check the results
Check each item from carousel and click on each item. Carousel has to look different on mobile
Click on each item from footer
Map Explorer [desktop embedded version]
From home page click on the item of carousel (Explore)
Add layers as you want
Change choropleth to bubble
Remove layers as you want
Click on map and check filtering
Click on chart and check filtering
If user is logged in click on “save”. Follow the screens and check the links and information displayed
If user is not logged in click on “login”
Map Explorer [desktop full page version]
Same actions as in above.
Map Explorer [mobile full version]
From home page click on first item of carousel (Explore). On a mobile device you should be redirected to full page explore for mobile
Add layers
Remove layers
Filter layers and charts
Data nerds!
From the Map Explorer, click on “info” in any layer
Download the data and compare to what you see in the map explorer
Check that totals and values align with what is in the data