Fork me on GitHub

Firefox Test Engineering Test Results

Generated on 22-Jun-2018 at 08:19:20.

A total of 3,587,237 tests ran between 27-Apr-2018 and 22-Jun-2018.

Tests with lowest pass rate

Percentage of tests that had the expected outcome.

test_that_search_returns_results_for_first_name 76%
test_that_search_returns_results_for_irc_nickname 78%
test_that_search_returns_results_for_email_substring 78%
test_new_user_cannot_see_groups_or_functional_areas 80%
test_search_for_not_existing_mozillian_when_logged_in 81%
test_private_groups_field_as_public_when_logged_in 82%
test_that_links_in_the_services_page_return_200_code 82%
test_that_user_can_view_external_accounts 83%
test_login_logout 84%
test_that_filter_by_region_works 84%
test_that_search_returns_results_for_irc_nickname 84%
test_that_search_returns_results_for_email_substring 85%
test_that_user_can_view_external_accounts 86%
test_search_for_not_existing_mozillian_when_logged_in 86%
test_that_search_returns_results_for_first_name 86%
test_profile_creation 87%
test_logout_verify_bid 87%
test_inviting_an_invalid_email_address 87%
test_group_type_change 87%
test_login_logout 87%
test_organic_flow_param_values 83%
test_search_flow_param_values 98%
test_campaign_flow_param_values 98%
test_organic_flow_param_values 87%
test_search_flow_param_values 97%
test_campaign_flow_param_values 98%
test_organic_flow_param_values 88%
test_search_flow_param_values 97%
test_campaign_flow_param_values 98%
test_user_can_sign_in 79%
test_webdriver_fxa_popup_without_logo_displayed 100%
test_webdriver_fxa_popup_without_logo_present 100%
test_webdriver_with_fxa_popup 100%
test_user_can_sign_in 81%
test_webdriver_fxa_popup_without_logo_displayed 100%
test_webdriver_fxa_popup_without_logo_present 100%
test_webdriver_with_fxa_popup 100%
test_search_for_valid_signature 0%
test_that_current_version_selected_in_top_crashers_header 100%
test_that_top_crasher_filter_browser_return_results 100%
test_that_top_crasher_filter_all_return_results 100%
test_that_lowest_version_topcrashers_do_not_return_errors 100%
test_that_exploitable_crash_report_is_not_displayed_for_logged_out_users 100%
test_that_bugzilla_link_contain_current_site 100%
test_that_7_days_is_selected_default_for_nightlies 100%
test_supersearch_fields 100%
test_super_search_page_is_loaded 100%
test_that_current_version_selected_in_top_crashers_header 0%
test_that_current_version_selected_in_top_crashers_header 100%
test_that_top_crasher_filter_browser_return_results 100%
test_that_top_crasher_filter_all_return_results 100%
test_that_lowest_version_topcrashers_do_not_return_errors 100%
test_that_exploitable_crash_report_is_not_displayed_for_logged_out_users 100%
test_that_bugzilla_link_contain_current_site 100%
test_that_7_days_is_selected_default_for_nightlies 100%
test_supersearch_fields 100%
test_super_search_page_is_loaded 100%
test_search_change_column 0%
test_that_top_crasher_filter_browser_return_results 100%
test_that_top_crasher_filter_all_return_results 100%
test_that_lowest_version_topcrashers_do_not_return_errors 100%
test_that_exploitable_crash_report_is_not_displayed_for_logged_out_users 100%
test_that_bugzilla_link_contain_current_site 100%
test_that_7_days_is_selected_default_for_nightlies 100%
test_supersearch_fields 100%
test_super_search_page_is_loaded 100%
test_selecting_one_version_doesnt_show_other_versions 100%

Tests with most failures

Tests with the highest total number of failures.

test_verify_firefox_aliases_redirect_to_correct_products 79
test_verify_firefox_aliases_redirect_to_correct_products 79
test_verify_firefox_aliases_redirect_to_correct_products 79
test_verify_firefox_aliases_redirect_to_correct_products 13
test_verify_firefox_aliases_redirect_to_correct_products 13
test_verify_firefox_aliases_redirect_to_correct_products 13
test_verify_firefox_aliases_redirect_to_correct_products 5
test_verify_firefox_aliases_redirect_to_correct_products 5
test_verify_firefox_aliases_redirect_to_correct_products 5
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 4
test_that_search_returns_results_for_first_name 23
test_that_search_returns_results_for_irc_nickname 21
test_that_search_returns_results_for_email_substring 21
test_new_user_cannot_see_groups_or_functional_areas 19
test_search_for_not_existing_mozillian_when_logged_in 18
test_that_links_in_the_services_page_return_200_code 17
test_private_groups_field_as_public_when_logged_in 17
test_that_user_can_view_external_accounts 16
test_that_filter_by_region_works 15
test_login_logout 15
test_that_search_returns_results_for_irc_nickname 16
test_that_search_returns_results_for_email_substring 15
test_that_user_can_view_external_accounts 14
test_that_search_returns_results_for_first_name 14
test_search_for_not_existing_mozillian_when_logged_in 14
test_group_type_change 13
test_inviting_an_invalid_email_address 13
test_login_logout 13
test_logout_verify_bid 13
test_profile_creation 13
test_organic_flow_param_values 205
test_search_flow_param_values 20
test_campaign_flow_param_values 18
test_organic_flow_param_values 156
test_search_flow_param_values 39
test_campaign_flow_param_values 29
test_organic_flow_param_values 143
test_search_flow_param_values 37
test_campaign_flow_param_values 29
test_verify_firefox_aliases_redirect_to_correct_products 8
test_verify_firefox_aliases_redirect_to_correct_products 8
test_verify_firefox_aliases_redirect_to_correct_products 8
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 2
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 2
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 2
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 2
test_verify_locales_redirect_to_the_expected_product 2
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 2
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 2
test_selecting_one_version_doesnt_show_other_versions 7
test_search_change_column 5
test_search_change_facet 3
test_search_with_one_line 3
test_search_with_multiple_lines 3
test_search_for_valid_signature 3
test_that_only_plugin_reports_have_plugin_icon 3
test_that_reports_form_has_same_product 3
test_that_reports_form_has_same_product 2
test_that_only_browser_reports_have_browser_icon 2
test_new_user_cannot_see_groups_or_functional_areas 7
test_that_search_returns_results_for_email_substring 6
test_that_user_can_view_external_accounts 5
test_search_for_not_existing_mozillian_when_logged_in 4
test_private_groups_field_when_not_logged_in 4
test_that_search_returns_results_for_irc_nickname 3
test_that_search_returns_results_for_first_name 3
test_that_links_in_the_services_page_return_200_code 3
test_that_filter_by_region_works 3
test_that_filter_by_country_works 3
test_search_for_valid_signature 4
test_search_change_column 3
test_that_current_version_selected_in_top_crashers_header 2
test_that_top_crasher_filter_browser_return_results 2
test_that_exploitable_crash_report_is_not_displayed_for_logged_out_users 2
test_that_bugzilla_link_contain_current_site 2
test_selecting_one_version_doesnt_show_other_versions 2
test_search_with_multiple_lines 2
test_that_only_plugin_reports_have_plugin_icon 2
test_that_current_version_selected_in_top_crashers_header 2

Slowest tests

Slowest average test durations.

test_that_current_version_selected_in_top_crashers_header 15 minutes
test_search_change_column 2 minutes
test_that_lowest_version_topcrashers_do_not_return_errors a minute
test_selecting_one_version_doesnt_show_other_versions a minute
test_that_top_crashers_reports_links_work 57 seconds
test_that_top_crashers_reports_links_work 51 seconds
test_top_crasher_reports_tab_has_uuid_report 49 seconds
test_that_top_crasher_filter_browser_return_results 49 seconds
test_that_top_crashers_reports_links_work 48 seconds
test_search_change_facet 45 seconds
test_that_non_us_user_can_set_get_involved_date 2 minutes
test_that_user_can_modify_external_accounts_irc_nickname a minute
test_cannot_invite_github_non_nda_user_to_access_group a minute
test_cannot_add_github_non_nda_as_access_group_curator a minute
test_that_user_can_create_and_delete_group a minute
test_group_invitations a minute
test_profile_creation a minute
test_skill_deletion a minute
test_group_description_edit a minute
test_group_deletion_confirmation a minute
test_that_top_crashers_reports_links_work 11 minutes
test_search_change_column 2 minutes
test_that_lowest_version_topcrashers_do_not_return_errors a minute
test_selecting_one_version_doesnt_show_other_versions a minute
test_that_top_crashers_reports_links_work 53 seconds
test_search_with_multiple_lines 51 seconds
test_that_top_crashers_reports_links_work 50 seconds
test_top_crasher_reports_tab_has_uuid_report 50 seconds
test_search_change_facet 49 seconds
test_that_top_crashers_reports_links_work 48 seconds
test_that_non_us_user_can_set_get_involved_date 2 minutes
test_that_user_can_modify_external_accounts_irc_nickname a minute
test_profile_creation a minute
test_search_for_not_existing_mozillian_when_logged_in a minute
test_group_description_edit a minute
test_that_user_can_create_and_delete_group a minute
test_skill_deletion a minute
test_creating_profile_without_checking_privacy_policy_checkbox a minute
test_edit_profile_information 59 seconds
test_group_type_change 58 seconds
test_that_non_us_user_can_set_get_involved_date 2 minutes
test_that_user_can_modify_external_accounts_irc_nickname a minute
test_profile_creation a minute
test_skill_deletion 58 seconds
test_group_description_edit 55 seconds
test_creating_profile_without_checking_privacy_policy_checkbox 55 seconds
test_group_invitations 52 seconds
test_edit_profile_information 51 seconds
test_that_user_can_create_and_delete_group 51 seconds
test_skill_addition 50 seconds
test_that_non_us_user_can_set_get_involved_date 2 minutes
test_that_user_can_modify_external_accounts_irc_nickname a minute
test_profile_creation a minute
test_skill_deletion 57 seconds
test_group_description_edit 56 seconds
test_creating_profile_without_checking_privacy_policy_checkbox 56 seconds
test_edit_profile_information 52 seconds
test_that_user_can_create_and_delete_group 52 seconds
test_group_invitations 52 seconds
test_skill_addition 49 seconds
test_search_change_column 2 minutes
test_that_lowest_version_topcrashers_do_not_return_errors a minute
test_that_top_crashers_reports_links_work a minute
test_that_only_plugin_reports_have_plugin_icon 55 seconds
test_selecting_one_version_doesnt_show_other_versions 55 seconds
test_that_top_crashers_reports_links_work 54 seconds
test_that_top_crashers_reports_links_work 53 seconds
test_that_only_browser_reports_have_browser_icon 53 seconds
test_that_reports_form_has_same_product 52 seconds
test_top_crasher_reports_tab_has_uuid_report 52 seconds
test_search_change_column 2 minutes
test_that_lowest_version_topcrashers_do_not_return_errors a minute
test_selecting_one_version_doesnt_show_other_versions 55 seconds
test_that_only_plugin_reports_have_plugin_icon 54 seconds
test_that_only_browser_reports_have_browser_icon 50 seconds
test_that_top_crashers_reports_links_work 45 seconds
test_that_top_crashers_reports_links_work 45 seconds
test_search_with_multiple_lines 45 seconds
test_that_top_crashers_reports_links_work 44 seconds
test_top_crasher_reports_tab_has_uuid_report 42 seconds
test_search_change_column 2 minutes
test_that_lowest_version_topcrashers_do_not_return_errors a minute
test_that_top_crashers_reports_links_work a minute
test_top_crasher_reports_tab_has_uuid_report 56 seconds
test_that_top_crashers_reports_links_work 54 seconds
test_selecting_one_version_doesnt_show_other_versions 53 seconds
test_that_top_crashers_reports_links_work 50 seconds
test_that_top_crashers_reports_links_work 50 seconds
test_search_change_facet 47 seconds
test_that_top_crasher_filter_all_return_results 44 seconds
test_search_change_column 2 minutes
test_that_lowest_version_topcrashers_do_not_return_errors a minute
test_top_crasher_reports_tab_has_uuid_report a minute
test_that_top_crashers_reports_links_work 54 seconds
test_selecting_one_version_doesnt_show_other_versions 53 seconds
test_that_top_crashers_reports_links_work 49 seconds
test_that_top_crashers_reports_links_work 48 seconds
test_that_top_crashers_reports_links_work 47 seconds
test_search_change_facet 46 seconds
test_search_with_multiple_lines 41 seconds

Longest running tests

Most machine time consumed by tests over multiple executions.

test_verify_releng_aliases_match_what_we_expect 36 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 28 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 28 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 28 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 28 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_verify_product_details_is_in_sync_with_ship_it 15 minutes
test_that_non_us_user_can_set_get_involved_date 2 hours
test_that_user_can_modify_external_accounts_irc_nickname an hour
test_profile_creation an hour
test_skill_deletion an hour
test_group_description_edit an hour
test_creating_profile_without_checking_privacy_policy_checkbox an hour
test_group_invitations an hour
test_that_user_can_create_and_delete_group an hour
test_edit_profile_information an hour
test_logout_verify_bid an hour
test_search_change_column 3 hours
test_that_lowest_version_topcrashers_do_not_return_errors 2 hours
test_selecting_one_version_doesnt_show_other_versions an hour
test_that_top_crashers_reports_links_work an hour
test_that_top_crashers_reports_links_work an hour
test_that_top_crashers_reports_links_work an hour
test_that_top_crashers_reports_links_work an hour
test_top_crasher_reports_tab_has_uuid_report an hour
test_search_with_multiple_lines an hour
test_search_change_facet an hour
test_that_non_us_user_can_set_get_involved_date 2 hours
test_that_user_can_modify_external_accounts_irc_nickname an hour
test_skill_deletion an hour
test_profile_creation an hour
test_creating_profile_without_checking_privacy_policy_checkbox an hour
test_group_description_edit an hour
test_group_invitations 59 minutes
test_logout_verify_bid 59 minutes
test_edit_profile_information 58 minutes
test_that_user_can_create_and_delete_group 57 minutes
test_organic_flow_param_values 5 hours
test_search_flow_param_values 4 hours
test_campaign_flow_param_values 4 hours
test_organic_flow_param_values 5 hours
test_search_flow_param_values 4 hours
test_campaign_flow_param_values 4 hours
test_logout_verify_bid an hour
test_that_filter_by_region_works 56 minutes
test_that_filter_by_city_works 56 minutes
test_profile_deletion_confirmation 56 minutes
test_that_filter_by_country_works 53 minutes
test_that_user_can_view_external_accounts 53 minutes
test_new_user_cannot_see_groups_or_functional_areas 53 minutes
test_private_groups_field_as_public_when_logged_in 52 minutes
test_that_links_in_the_services_page_return_200_code 52 minutes
test_that_search_returns_results_for_irc_nickname 49 minutes
test_search_change_column an hour
test_that_lowest_version_topcrashers_do_not_return_errors 54 minutes
test_that_top_crashers_reports_links_work 36 minutes
test_that_top_crashers_reports_links_work 35 minutes
test_that_current_version_selected_in_top_crashers_header 34 minutes
test_that_top_crashers_reports_links_work 34 minutes
test_that_top_crasher_filter_browser_return_results 31 minutes
test_selecting_one_version_doesnt_show_other_versions 31 minutes
test_that_current_version_selected_in_top_crashers_header 31 minutes
test_that_reports_form_has_same_product 30 minutes
test_organic_flow_param_values 5 hours
test_search_flow_param_values 4 hours
test_campaign_flow_param_values 4 hours
test_verify_releng_aliases_match_what_we_expect 3 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 2 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 2 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 2 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 2 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 2 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 2 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 2 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 2 minutes
test_verify_product_details_is_in_sync_with_ship_it a minute