Internal testing draft plan below:
next step:
- dev+design to align on which server to conduct a test
- slimmed down version of file store on one of the non-production server
- description of test for each feature - with help from CJ + nalae - with more randomness to test
A list of HDX features for periodic test:
*testing to be done on feature- . Please check with yumi/dan prior to testing to make sure feature- is in mirrored state as production.
- Add and edit data
- Add a private dataset with 3 resources under HDX Org
- (Login as HDX org admin account) Go to "Add Data" and create a private dataset (alternatively access "Add data" from HDX org page under the logo)
- Upload 3 resources
- Fill out the mandatory fields (red starred marked fields)
- Publish the private dataset
- Logout from your admin/editor account. Try to find the private dataset under HDX org (it should not be visible to non-HDX org member). Login as either HDX org member or admin and try to find the private dataset you created(it should be visible)
- Edit private dataset
- Go to the private dataset page you created and click on "Edit"
- Change details of a resource
- Add 2 more resources and delete one of the old resources
- Switch the privacy setting from "Private" to "Public" and fill out all mandatory fields
- Publish
- Check errors on dataset page
- Repeat a and b for public datasets
- HDX Connect
- (Login with your HDX org admin account) Go to "Add Data" and add a (temp) HDX connect dataset. Fill out all required fields (*) and publish.
- (Logout from your HDX admin account) Find the HDX Connect dataset you created and(if you're not logged in - it should ask you to login. Login as HDX org editor or member) request access from "Data" view on main nav as well as from
- (HDX Connect) dataset page. Make 2 requests (1 you will approve, 2 you will decline as a maintainer).
- Check in mailhog - make sure you received the 2 requests with messages you had entered. (if the test was not performed on production - these emails are caught in mailhog and actually not sent. so check the mailhog inbox + click on link to request page)
- Login again as a HDX admin + approve one of the requests (with attachment - use dummy xls or csv) and decline the other request.
- Check in mailhog (one should be approved with attachment and the other should be declined).
- Finally, delete the HDX connect dataset. Check on "Data" view on main nav to confirm its deleted.
- Send "Contact the contributor" and "group message" (choose from: to everyone, all admin, all editors)
- (without logging in) Send a message to contributor from any dataset page. Do the same task while logged in (from any account) and make sure your email is pre-populated. Check in mailhog
- (Login as HDX org admin) Send a group message from any HDX dataset page. You can pick from all/all admins/all editors. Check in mailhog
- Send a question via "contact us" in FAQ page
- New user registration
- New signup
- Sign up as a new user using a new email address
- Make sure you receive email to "verify your email address"
- Click on the URL in the email to complete the registration (create user name, password, fill out your name etc)
- Follow different subjects - location, topic etc
- Request membership to request to join the existing organization or request to create a new organization
- Check the membership request email in mailhog
- Logout and Login again(using account you just created) - check that you're directed to Dashboard when you login
- Approve new member as org admin
- (Login as HDX admin) Go to HDX org page > "Members" tab. (or if you're continuing test from a - you can access the member's tab from the email link in step vi)
- "Approve" the request and assign a role (admin/editor/member)
- New signup
- Membership management
- Invite a new user to join org
- (Login as HDX admin) Go to HDX org page.
- Invite/add a new member from the 'members' tab. If the invited user is already signed up on HDX, the full name should appear as a dropdown option(by either entering the email address or full name) + should be immediately added as a chosen role(please refresh the page to check).
If the invited user doesn't have account on HDX - she/he should receive an email to change password. - Check in mailhog for 2 emails, 1 addressed to all members of the org that someone is added, 2 to the invited user to inform their account was created and need to update the password.
- Invite a new user to join org
- Sysadmin tasks
- Make a dashboard /event page + edit existing dashboard/event page
- Add/Change carousel item on homepage
- Go to https://feature-data.humdata.org/ckan-admin/carousel/show (this URL may change in the coming weeks due to changes in security for sysadmin)
- Add a carousel item > publish > check on homepage for changes
- Delete a carousel item > publish > check on homepage
- Edit a carousel item > publish > check on homepage
- Data Check (A. validate a local file + remote resource on Tools + B. validate a hxl-tagged resource on HDX)
- Quick Charts (A. test making quick charts on Tools + B. After testing 2(add data with hxlated data), turn on
Note: if you experienced any bug/issue, make a Jira ticket and tag Yumi/Dan.
Week of / Features tested | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | |
(example) Week of 1/1/2019 | x (no issue) | x (Jira link) | x (no issue) | ||||||||||
Week of 6/10/2019 | |||||||||||||
Volunteer testing draft plan below
Dear Volunteer,
HDX runs on the open-source CKAN platform, and we are upgrading our version from 2.3 to 2.63 and adding a new feature, requestable datasets. As of today, the new version is ready on the feature server.
We’d like your support in testing this upgraded version on the feature server. The main goal is to confirm that the new version behaves the same way as the old one, and to identify any issues or problems.
We’ve provided more detailed instructions on this document. Sample actions you can test are:
Creating and modifying user profiles
Creating and modifying organisations
Creating and modifying datasets, including all metadata and resources and particularly requestable datasets
Adding gallery items to datasets
Testing the Python Library
A full list of testing scenarios is below. Feel free to choose any of them.
**Be sure to test on the feature server, not on the actual HDX site. Please use this template to record any issue you experience.**
You will receive an invitation to a Slack channel for ease of coordination. If you're not comfortable using Slack, please email questions to me at becky@humdata.org.
Thanks for your support!
Best wishes,
Becky
--
Testing scenarios/ideas
All testing to be done at this url: https://feature-data.humdata.org
User registration
Sign up as a new user
Request membership to a testing organization
Check user dashboard
Change your password and account details
Check members page
Check your role inside organization
Contact the other members from organization by sending a group message
Submit the Contact contributor form
Creation/edit datasets
Create a private dataset with 3 resources
create a private dataset
upload 3 resources
fill only the mandatory fields (red star marked fields)
save dataset
Edit private dataset
edit the previously created dataset
change details of a resource
add 2 more resources
change from private to public dataset
try to save
check errors
fill all the mandatory fields
save dataset
Edit private dataset
edit the previously created dataset
remove 2 resources
add 1 new resources
save dataset
Edit private dataset
edit the previous created dataset
change to public dataset
fill all the mandatory fields
add 3 different type of resources
save dataset
Repeat all steps for public datasets
Requestable Datasets
Please click on the link to see tests for requestable datasets.
Locations
Check locations landing page
Check active location page
Check inactive location page
QuickLinks (in the top navigation bar)
Check each quicklink if it loads
Check the data on each quicklink page
HXL Preview
If the data uses the HXL standard, then HDX can automatically create customizable graphs and key figures to help you highlight the most important aspects of your dataset. This is called a "HXL Preview." For a HXL Preview to be generated, your dataset needs:
A CSV with HXL tags as the first resource. HXL is easy! Check out the 30-second tutorial. The CSV can be stored on HDX or as a remote resource at another URL.
To be tagged with "HXL" on the dataset page. This is not referring to the HXL tags inside the CSV, but rather the metadata tags that you set for the whole dataset. This is a flag to HDX to try and process the CSV as a HXL-ated dataset.
Upload a csv file that contains hxl tags and check if hxl preview appears.
Geo Preview
Upload a zipped shapefile or geojson and check if the geopreview is generated (hint: for shapefiles, the file type must be set to "zipped shapefile" instead of the default "zip" for geopreview to be triggered)
Python HDX Library [for Python programmers]
Test the HDX Ckan with the new site, trying as many different API calls and edge cases as you can think of.
HDX Homepage [desktop version]
Go to homepage
Check the search box in the top toolbar. When you start typing a word, do you see useful autocomplete suggestions?
Repeat the same test with the search box in the centre of the page.
Click on trending terms and check if the results appear reasonable
Check each item from the carousel and click on each item to see if it opens the appropriate page
Check page 2 of carousel
Click on each item from footer and see if it opens the appropriate page
HDX Homepage [mobile version]
Go to homepage
Check if page displays in a readable way on a smaller screen (phone or tablet)
Check top right menu and click on items
Check the search box in the top toolbar. When you start typing a word, do you see useful autocomplete suggestions?
Check the search box in the center of the page.
Click on trending terms and check the results
Check each item from carousel and click on each item. Carousel has to look different on mobile
Click on each item from footer
Map Explorer [desktop embedded version]
From home page click on the item of carousel (Explore)
Add layers as you want
Change choropleth to bubble
Remove layers as you want
Click on map and check filtering
Click on chart and check filtering
If user is logged in click on “save”. Follow the screens and check the links and information displayed
If user is not logged in click on “login”
Map Explorer [desktop full page version]
Same actions as in above.
Map Explorer [mobile full version]
From home page click on first item of carousel (Explore). On a mobile device you should be redirected to full page explore for mobile
Add layers
Remove layers
Filter layers and charts
Data nerds!
From the Map Explorer, click on “info” in any layer
Download the data and compare to what you see in the map explorer
Check that totals and values align with what is in the data