Fork me on GitHub

Firefox Test Engineering Test Results

Generated on 15-Jul-2018 at 20:19:20.

A total of 3,006,781 tests ran between 20-May-2018 and 15-Jul-2018.

Tests with lowest pass rate

Percentage of tests that had the expected outcome.

test_profile_deletion_confirmation 0%
test_that_user_can_create_and_delete_group 0%
test_that_user_can_add_external_account 0%
test_that_search_returns_results_for_irc_nickname 0%
test_that_search_returns_results_for_first_name 0%
test_that_search_returns_results_for_email_substring 0%
test_that_non_us_user_can_set_get_involved_date 0%
test_that_links_in_the_services_page_return_200_code 0%
test_that_filter_by_region_works 0%
test_that_filter_by_country_works 0%
test_user_can_sign_in 50%
test_webdriver_fxa_popup_without_logo_displayed 100%
test_webdriver_fxa_popup_without_logo_present 100%
test_webdriver_with_fxa_popup 100%
test_cannot_invite_github_non_nda_user_to_access_group 56%
test_cannot_add_github_non_nda_as_access_group_curator 62%
test_group_deletion_confirmation 75%
test_that_non_us_user_can_set_get_involved_date 81%
test_new_user_cannot_see_groups_or_functional_areas 81%
test_login_logout 81%
test_inviting_an_invalid_email_address 81%
test_that_links_in_the_services_page_return_200_code 88%
test_that_filter_by_region_works 88%
test_that_filter_by_country_works 88%
test_that_search_returns_results_for_first_name 80%
test_that_search_returns_results_for_email_substring 82%
test_that_search_returns_results_for_irc_nickname 84%
test_edit_profile_information 86%
test_that_non_us_user_can_set_get_involved_date 86%
test_login_logout 86%
test_that_user_can_create_and_delete_group 88%
test_that_user_can_add_external_account 88%
test_group_description_edit 88%
test_profile_creation 88%
test_that_search_returns_results_for_irc_nickname 85%
test_that_search_returns_results_for_email_substring 86%
test_search_for_not_existing_mozillian_when_logged_in 86%
test_inviting_an_invalid_email_address 86%
test_logout_verify_bid 86%
test_profile_creation 88%
test_that_user_can_add_external_account 88%
test_that_search_returns_results_for_first_name 88%
test_group_description_edit 88%
test_group_type_change 88%
test_profile_deletion_confirmation 88%
test_group_description_edit 88%
test_that_links_in_the_services_page_return_200_code 90%
test_that_filter_by_city_works 90%
test_github_non_nda_user_cannot_create_access_group 90%
test_that_user_can_view_external_accounts 90%
test_group_deletion_confirmation 92%
test_that_search_returns_results_for_first_name 92%
test_that_filter_by_region_works 92%
test_skill_deletion 92%
test_organic_flow_param_values 88%
test_search_flow_param_values 98%
test_campaign_flow_param_values 98%
test_organic_flow_param_values 88%
test_search_flow_param_values 98%
test_campaign_flow_param_values 98%
test_organic_flow_param_values 87%
test_campaign_flow_param_values 99%
test_search_flow_param_values 99%
test_that_user_can_create_and_delete_group 0%
test_skill_deletion 50%
test_200_for_anonymous_users 100%
test_search_for_not_existing_mozillian_when_not_logged_in 100%
test_skill_addition 100%
test_that_filter_by_city_works 100%
test_that_filter_by_country_works 100%
test_that_filter_by_region_works 100%
test_that_links_in_footer_return_200_code 100%
test_that_links_in_the_about_page_return_200_code 100%

Tests with most failures

Tests with the highest total number of failures.

test_verify_firefox_aliases_redirect_to_correct_products 79
test_verify_firefox_aliases_redirect_to_correct_products 79
test_verify_firefox_aliases_redirect_to_correct_products 79
test_verify_firefox_aliases_redirect_to_correct_products 13
test_verify_firefox_aliases_redirect_to_correct_products 13
test_verify_firefox_aliases_redirect_to_correct_products 13
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 3
test_verify_firefox_aliases_redirect_to_correct_products 3
test_verify_firefox_aliases_redirect_to_correct_products 3
test_verify_firefox_aliases_redirect_to_correct_products 3
test_that_search_returns_results_for_irc_nickname 11
test_search_for_not_existing_mozillian_when_logged_in 10
test_that_search_returns_results_for_email_substring 10
test_logout_verify_bid 10
test_inviting_an_invalid_email_address 10
test_login_logout 9
test_that_search_returns_results_for_first_name 9
test_that_user_can_add_external_account 9
test_group_description_edit 9
test_profile_creation 9
test_that_search_returns_results_for_first_name 10
test_that_search_returns_results_for_email_substring 9
test_that_search_returns_results_for_irc_nickname 8
test_edit_profile_information 7
test_that_non_us_user_can_set_get_involved_date 7
test_login_logout 7
test_new_user_cannot_see_groups_or_functional_areas 6
test_that_filter_by_region_works 6
test_profile_creation 6
test_group_description_edit 6
test_organic_flow_param_values 89
test_search_flow_param_values 13
test_campaign_flow_param_values 12
test_organic_flow_param_values 82
test_search_flow_param_values 15
test_campaign_flow_param_values 11
test_organic_flow_param_values 94
test_campaign_flow_param_values 5
test_search_flow_param_values 5
test_group_description_edit 5
test_profile_deletion_confirmation 5
test_that_user_can_view_external_accounts 4
test_that_links_in_the_services_page_return_200_code 4
test_github_non_nda_user_cannot_create_access_group 4
test_that_filter_by_city_works 4
test_logout_verify_bid 3
test_that_search_returns_results_for_first_name 3
test_that_filter_by_region_works 3
test_skill_deletion 3
test_cannot_invite_github_non_nda_user_to_access_group 7
test_cannot_add_github_non_nda_as_access_group_curator 6
test_group_deletion_confirmation 4
test_that_non_us_user_can_set_get_involved_date 3
test_new_user_cannot_see_groups_or_functional_areas 3
test_login_logout 3
test_inviting_an_invalid_email_address 3
test_group_description_edit 2
test_group_type_change 2
test_logout_verify_bid 2
test_verify_firefox_aliases_redirect_to_correct_products 8
test_verify_firefox_aliases_redirect_to_correct_products 8
test_verify_firefox_aliases_redirect_to_correct_products 8
test_verify_firefox_aliases_redirect_to_correct_products 2
test_verify_firefox_aliases_redirect_to_correct_products 2
test_verify_firefox_aliases_redirect_to_correct_products 2
test_verify_firefox_aliases_redirect_to_correct_products 1
test_verify_locales_redirect_to_the_expected_product 1
test_verify_firefox_aliases_redirect_to_correct_products 1
test_verify_firefox_aliases_redirect_to_correct_products 1
test_that_user_can_view_external_accounts 1
test_that_non_us_user_can_set_get_involved_date 1
test_that_search_returns_results_for_email_substring 1
test_that_search_returns_results_for_first_name 1
test_that_filter_by_region_works 1
test_that_filter_by_country_works 1
test_that_filter_by_city_works 1
test_skill_deletion 1
test_skill_addition 1
test_that_search_returns_results_for_irc_nickname 1

Slowest tests

Slowest average test durations.

test_that_filter_by_region_works a minute
test_skill_deletion a minute
test_that_filter_by_country_works a minute
test_inviting_an_invalid_email_address a minute
test_that_filter_by_city_works a minute
test_github_non_nda_user_cannot_create_access_group a minute
test_that_user_can_view_external_accounts a minute
test_that_non_us_user_can_set_get_involved_date a minute
test_logout_verify_bid a minute
test_that_user_can_modify_external_accounts_irc_nickname a minute
test_that_non_us_user_can_set_get_involved_date 2 minutes
test_skill_addition a minute
test_cannot_add_github_non_nda_as_access_group_curator a minute
test_cannot_invite_github_non_nda_user_to_access_group a minute
test_that_user_can_modify_external_accounts_irc_nickname a minute
test_group_type_change a minute
test_skill_deletion a minute
test_group_invitations a minute
test_inviting_an_invalid_email_address a minute
test_that_user_can_create_and_delete_group a minute
test_that_current_version_selected_in_top_crashers_header 15 minutes
test_search_change_column 2 minutes
test_that_lowest_version_topcrashers_do_not_return_errors a minute
test_selecting_one_version_doesnt_show_other_versions a minute
test_that_top_crashers_reports_links_work 57 seconds
test_that_top_crashers_reports_links_work 51 seconds
test_top_crasher_reports_tab_has_uuid_report 49 seconds
test_that_top_crasher_filter_browser_return_results 49 seconds
test_that_top_crashers_reports_links_work 48 seconds
test_search_change_facet 45 seconds
test_that_non_us_user_can_set_get_involved_date 2 minutes
test_that_user_can_modify_external_accounts_irc_nickname a minute
test_profile_creation a minute
test_skill_deletion a minute
test_group_description_edit a minute
test_that_user_can_create_and_delete_group a minute
test_creating_profile_without_checking_privacy_policy_checkbox a minute
test_edit_profile_information a minute
test_group_deletion_confirmation 59 seconds
test_group_invitations 59 seconds
test_that_non_us_user_can_set_get_involved_date 2 minutes
test_that_user_can_create_and_delete_group a minute
test_skill_deletion a minute
test_that_user_can_modify_external_accounts_irc_nickname a minute
test_profile_creation a minute
test_inviting_an_invalid_email_address a minute
test_group_description_edit a minute
test_skill_addition a minute
test_creating_profile_without_checking_privacy_policy_checkbox a minute
test_that_filter_by_region_works a minute
test_that_non_us_user_can_set_get_involved_date 2 minutes
test_that_user_can_modify_external_accounts_irc_nickname a minute
test_group_invitations a minute
test_skill_deletion a minute
test_edit_profile_information a minute
test_profile_creation a minute
test_creating_profile_without_checking_privacy_policy_checkbox 59 seconds
test_profile_deletion_confirmation 58 seconds
test_that_user_can_create_and_delete_group 58 seconds
test_that_search_returns_results_for_email_substring 57 seconds
test_that_non_us_user_can_set_get_involved_date 2 minutes
test_group_description_edit a minute
test_creating_profile_without_checking_privacy_policy_checkbox a minute
test_that_user_can_modify_external_accounts_irc_nickname a minute
test_profile_creation a minute
test_skill_deletion 59 seconds
test_group_type_change 57 seconds
test_group_invitations 57 seconds
test_group_deletion_confirmation 55 seconds
test_skill_addition 52 seconds
test_that_non_us_user_can_set_get_involved_date 2 minutes
test_that_user_can_modify_external_accounts_irc_nickname a minute
test_profile_creation a minute
test_skill_deletion a minute
test_group_description_edit a minute
test_creating_profile_without_checking_privacy_policy_checkbox 56 seconds
test_that_user_can_create_and_delete_group 56 seconds
test_group_invitations 55 seconds
test_edit_profile_information 55 seconds
test_skill_addition 52 seconds
test_that_non_us_user_can_set_get_involved_date 2 minutes
test_that_user_can_modify_external_accounts_irc_nickname a minute
test_profile_creation a minute
test_skill_deletion a minute
test_creating_profile_without_checking_privacy_policy_checkbox 59 seconds
test_group_description_edit 59 seconds
test_that_user_can_create_and_delete_group 56 seconds
test_group_invitations 54 seconds
test_edit_profile_information 53 seconds
test_skill_addition 52 seconds
test_that_non_us_user_can_set_get_involved_date 2 minutes
test_that_user_can_modify_external_accounts_irc_nickname a minute
test_profile_creation a minute
test_creating_profile_without_checking_privacy_policy_checkbox a minute
test_that_user_can_create_and_delete_group a minute
test_skill_deletion a minute
test_skill_addition a minute
test_group_description_edit 55 seconds
test_group_invitations 52 seconds
test_edit_profile_information 52 seconds

Longest running tests

Most machine time consumed by tests over multiple executions.

test_verify_releng_aliases_match_what_we_expect 37 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 29 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 29 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 29 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 29 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 29 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 29 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 29 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 29 minutes
test_verify_product_details_is_in_sync_with_ship_it 17 minutes
test_that_non_us_user_can_set_get_involved_date 2 hours
test_that_user_can_modify_external_accounts_irc_nickname an hour
test_profile_creation an hour
test_skill_deletion an hour
test_group_description_edit an hour
test_creating_profile_without_checking_privacy_policy_checkbox an hour
test_that_user_can_create_and_delete_group an hour
test_group_invitations 59 minutes
test_edit_profile_information 58 minutes
test_skill_addition 56 minutes
test_search_change_column 2 hours
test_that_lowest_version_topcrashers_do_not_return_errors an hour
test_selecting_one_version_doesnt_show_other_versions an hour
test_that_top_crashers_reports_links_work 52 minutes
test_that_top_crashers_reports_links_work 52 minutes
test_that_top_crashers_reports_links_work 52 minutes
test_that_top_crashers_reports_links_work 51 minutes
test_search_with_multiple_lines 50 minutes
test_top_crasher_reports_tab_has_uuid_report 49 minutes
test_search_change_facet 44 minutes
test_that_non_us_user_can_set_get_involved_date an hour
test_that_user_can_modify_external_accounts_irc_nickname 47 minutes
test_creating_profile_without_checking_privacy_policy_checkbox 43 minutes
test_profile_creation 43 minutes
test_skill_deletion 42 minutes
test_group_description_edit 41 minutes
test_that_user_can_create_and_delete_group 38 minutes
test_group_invitations 37 minutes
test_edit_profile_information 37 minutes
test_logout_verify_bid 36 minutes
test_that_non_us_user_can_set_get_involved_date an hour
test_that_user_can_modify_external_accounts_irc_nickname 46 minutes
test_profile_creation 41 minutes
test_skill_deletion 40 minutes
test_group_description_edit 39 minutes
test_creating_profile_without_checking_privacy_policy_checkbox 37 minutes
test_that_user_can_create_and_delete_group 36 minutes
test_edit_profile_information 35 minutes
test_group_invitations 35 minutes
test_group_deletion_confirmation 34 minutes
test_organic_flow_param_values 4 hours
test_campaign_flow_param_values 3 hours
test_search_flow_param_values 3 hours
test_logout_verify_bid 44 minutes
test_profile_deletion_confirmation 44 minutes
test_that_filter_by_city_works 44 minutes
test_that_filter_by_region_works 44 minutes
test_that_filter_by_country_works 41 minutes
test_that_user_can_view_external_accounts 39 minutes
test_new_user_cannot_see_groups_or_functional_areas 39 minutes
test_private_groups_field_as_public_when_logged_in 38 minutes
test_that_links_in_the_services_page_return_200_code 37 minutes
test_that_search_returns_results_for_irc_nickname 37 minutes
test_organic_flow_param_values 3 hours
test_search_flow_param_values 3 hours
test_campaign_flow_param_values 3 hours
test_organic_flow_param_values 3 hours
test_search_flow_param_values 2 hours
test_campaign_flow_param_values 2 hours
test_organic_flow_param_values 3 hours
test_campaign_flow_param_values 3 hours
test_search_flow_param_values 2 hours