Fork me on GitHub

Firefox Test Engineering Test Results

Generated on 25-Feb-2018 at 09:19:15.

A total of 4,987,642 tests ran between 31-Dec-2017 and 25-Feb-2018.

Tests with lowest pass rate

Percentage of tests that had the expected outcome.

test_filter_panel_reset_button 0%
test_filter_by_job_keyword 0%
test_filter_by_test_status 0%
test_unclassified_failure 25%
test_open_unclassified_failure_log 25%
test_filter_jobs 76%
test_close_open_panels 81%
test_remove_email_address_filter 81%
test_set_as_top_of_range 83%
test_expanding_group_count 84%
test_filter_panel_reset_button 0%
test_filter_by_job_keyword 0%
test_filter_by_test_status 0%
test_open_unclassified_failure_log 35%
test_expanding_group_count 65%
test_unclassified_failure 67%
test_clear_pinboard 76%
test_load_next_results 76%
test_close_open_panels 82%
test_remove_email_address_filter 88%
test_that_reports_form_has_same_product 83%
test_that_current_version_selected_in_top_crashers_header 89%
test_that_top_crasher_filter_browser_return_results 89%
test_that_top_crasher_filter_all_return_results 89%
test_that_only_plugin_reports_have_plugin_icon 89%
test_that_only_browser_reports_have_browser_icon 89%
test_that_lowest_version_topcrashers_do_not_return_errors 89%
test_that_exploitable_crash_report_is_not_displayed_for_logged_out_users 89%
test_that_bugzilla_link_contain_current_site 89%
test_that_7_days_is_selected_default_for_nightlies 89%
test_that_filter_by_region_works 87%
test_skill_deletion 87%
test_private_groups_field_as_public_when_logged_in 88%
test_that_filter_by_country_works 88%
test_that_filter_by_city_works 88%
test_skill_addition 88%
test_that_search_returns_results_for_irc_nickname 88%
test_profile_deletion_confirmation 88%
test_login_logout 88%
test_that_non_us_user_can_set_get_involved_date 88%
test_that_filter_by_city_works 85%
test_that_user_can_modify_external_accounts_irc_nickname 87%
test_that_non_us_user_can_set_get_involved_date 87%
test_that_filter_by_region_works 87%
test_that_filter_by_country_works 87%
test_edit_profile_information 87%
test_skill_deletion 87%
test_skill_addition 87%
test_that_search_returns_results_for_irc_nickname 87%
test_private_groups_field_as_public_when_logged_in 88%
test_search_flow_param_values 93%
test_campaign_flow_param_values 94%
test_organic_flow_param_values 94%
test_verify_firefox_aliases_redirect_to_correct_products 83%
test_verify_firefox_aliases_redirect_to_correct_products 83%
test_verify_firefox_aliases_redirect_to_correct_products 83%
test_verify_firefox_aliases_redirect_to_correct_products 91%
test_verify_firefox_aliases_redirect_to_correct_products 91%
test_verify_firefox_aliases_redirect_to_correct_products 91%
test_verify_locales_redirect_to_the_expected_product 95%
test_verify_locales_redirect_to_the_expected_product 95%
test_verify_locales_redirect_to_the_expected_product 95%
test_verify_locales_redirect_to_the_expected_product 95%
test_verify_locales_redirect_to_the_expected_product 95%
test_verify_locales_redirect_to_the_expected_product 95%
test_verify_locales_redirect_to_the_expected_product 95%
test_verify_locales_redirect_to_the_expected_product 95%
test_verify_locales_redirect_to_the_expected_product 95%
test_verify_locales_redirect_to_the_expected_product 95%
test_verify_locales_redirect_to_the_expected_product 95%
test_verify_locales_redirect_to_the_expected_product 95%
test_verify_locales_redirect_to_the_expected_product 95%
test_verify_locales_redirect_to_the_expected_product 95%
test_search_flow_param_values 99%
test_organic_flow_param_values 99%
test_campaign_flow_param_values 99%
test_activity_stream 90%
test_activity_stream 90%
test_activity_stream 90%
test_response_codes 99%
test_response_codes 99%
test_response_codes 99%
test_that_snippets_are_well_formed_xml 99%
test_that_snippets_are_well_formed_xml 99%
test_that_snippets_are_well_formed_xml 99%
test_legacy 99%

Tests with most failures

Tests with the highest total number of failures.

test_verify_locales_redirect_to_the_expected_product 111
test_verify_locales_redirect_to_the_expected_product 110
test_verify_locales_redirect_to_the_expected_product 110
test_verify_locales_redirect_to_the_expected_product 110
test_verify_locales_redirect_to_the_expected_product 110
test_verify_locales_redirect_to_the_expected_product 110
test_verify_locales_redirect_to_the_expected_product 110
test_verify_locales_redirect_to_the_expected_product 110
test_verify_locales_redirect_to_the_expected_product 110
test_verify_locales_redirect_to_the_expected_product 110
test_verify_locales_redirect_to_the_expected_product 89
test_verify_locales_redirect_to_the_expected_product 89
test_verify_locales_redirect_to_the_expected_product 89
test_verify_locales_redirect_to_the_expected_product 89
test_verify_locales_redirect_to_the_expected_product 89
test_verify_locales_redirect_to_the_expected_product 89
test_verify_locales_redirect_to_the_expected_product 89
test_verify_locales_redirect_to_the_expected_product 89
test_verify_locales_redirect_to_the_expected_product 89
test_verify_locales_redirect_to_the_expected_product 89
test_response_codes 91
test_response_codes 91
test_response_codes 91
test_that_snippets_are_well_formed_xml 91
test_that_snippets_are_well_formed_xml 91
test_that_snippets_are_well_formed_xml 91
test_legacy 91
test_response_codes 90
test_response_codes 90
test_response_codes 90
test_activity_stream 794
test_activity_stream 43
test_activity_stream 43
test_response_codes 2
test_response_codes 1
test_response_codes 1
test_response_codes 1
test_response_codes 1
test_response_codes 1
test_that_snippets_are_well_formed_xml 1
test_that_filter_by_city_works 19
test_that_user_can_modify_external_accounts_irc_nickname 17
test_that_filter_by_region_works 16
test_edit_profile_information 16
test_that_filter_by_country_works 16
test_skill_deletion 16
test_skill_addition 16
test_that_search_returns_results_for_irc_nickname 16
test_that_non_us_user_can_set_get_involved_date 16
test_private_groups_field_as_public_when_logged_in 15
test_that_filter_by_region_works 12
test_skill_deletion 12
test_private_groups_field_as_public_when_logged_in 11
test_profile_deletion_confirmation 11
test_edit_profile_information 11
test_that_filter_by_country_works 11
test_that_filter_by_city_works 11
test_skill_addition 11
test_that_search_returns_results_for_irc_nickname 11
test_login_logout 11
test_open_unclassified_failure_log 51
test_filter_jobs 16
test_unclassified_failure 15
test_close_open_panels 13
test_remove_email_address_filter 13
test_expanding_group_count 11
test_filter_by_email 11
test_load_next_results 10
test_filter_panel_reset_button 9
test_filter_by_test_status 9
test_that_reports_form_has_same_product 9
test_that_current_version_selected_in_top_crashers_header 6
test_search_for_valid_signature 6
test_that_top_crasher_filter_plugin_return_results 6
test_that_top_crasher_filter_browser_return_results 6
test_that_top_crasher_filter_all_return_results 6
test_that_only_plugin_reports_have_plugin_icon 6
test_that_only_browser_reports_have_browser_icon 6
test_that_lowest_version_topcrashers_do_not_return_errors 6
test_that_exploitable_crash_report_is_not_displayed_for_logged_out_users 6
test_search_flow_param_values 24
test_campaign_flow_param_values 23
test_organic_flow_param_values 23
test_search_flow_param_values 19
test_organic_flow_param_values 18
test_campaign_flow_param_values 17

Slowest tests

Slowest average test durations.

test_load_next_results 28 minutes
test_remove_email_address_filter 13 minutes
test_pin_job_from_job_details 6 minutes
test_pin_job 5 minutes
test_filter_by_email 4 minutes
test_next_job_shortcut 4 minutes
test_previous_job_shortcut 4 minutes
test_view_unclassified_jobs 3 minutes
test_close_open_panels 2 minutes
test_clear_pinboard 2 minutes
test_load_next_results 22 minutes
test_remove_email_address_filter 8 minutes
test_filter_by_email 3 minutes
test_pin_job_from_job_details 2 minutes
test_close_open_panels 2 minutes
test_previous_job_shortcut 2 minutes
test_next_job_shortcut 2 minutes
test_view_unclassified_jobs 2 minutes
test_pin_job 2 minutes
test_expanding_group_count a minute
test_that_user_can_modify_external_accounts_irc_nickname a minute
test_that_non_us_user_can_set_get_involved_date a minute
test_skill_deletion a minute
test_edit_profile_information 59 seconds
test_skill_addition 56 seconds
test_that_filter_by_region_works 54 seconds
test_group_description_edit 54 seconds
test_that_user_can_create_and_delete_group 54 seconds
test_that_filter_by_city_works 53 seconds
test_that_filter_by_country_works 52 seconds
test_that_non_us_user_can_set_get_involved_date 48 seconds
test_that_user_can_modify_external_accounts_irc_nickname 46 seconds
test_group_description_edit 45 seconds
test_profile_creation 45 seconds
test_that_filter_by_country_works 44 seconds
test_skill_deletion 44 seconds
test_creating_profile_without_checking_privacy_policy_checkbox 44 seconds
test_that_user_can_create_and_delete_group 43 seconds
test_group_deletion_confirmation 42 seconds
test_group_invitations 42 seconds
test_search_change_column a minute
test_that_lowest_version_topcrashers_do_not_return_errors 49 seconds
test_that_only_plugin_reports_have_plugin_icon 47 seconds
test_that_only_browser_reports_have_browser_icon 41 seconds
test_selecting_one_version_doesnt_show_other_versions 34 seconds
test_that_top_crashers_reports_links_work 34 seconds
test_that_top_crashers_reports_links_work 33 seconds
test_that_top_crashers_reports_links_work 33 seconds
test_that_top_crashers_reports_links_work 32 seconds
test_public_api_navigation 29 seconds
test_search_change_column a minute
test_that_lowest_version_topcrashers_do_not_return_errors 50 seconds
test_that_only_plugin_reports_have_plugin_icon 46 seconds
test_that_only_browser_reports_have_browser_icon 42 seconds
test_selecting_one_version_doesnt_show_other_versions 34 seconds
test_that_top_crashers_reports_links_work 31 seconds
test_that_top_crashers_reports_links_work 31 seconds
test_that_top_crashers_reports_links_work 31 seconds
test_that_top_crashers_reports_links_work 31 seconds
test_top_crasher_reports_tab_has_uuid_report 30 seconds
test_search_change_column a minute
test_that_lowest_version_topcrashers_do_not_return_errors 49 seconds
test_that_only_plugin_reports_have_plugin_icon 46 seconds
test_that_only_browser_reports_have_browser_icon 41 seconds
test_selecting_one_version_doesnt_show_other_versions 34 seconds
test_that_top_crashers_reports_links_work 32 seconds
test_that_top_crashers_reports_links_work 32 seconds
test_that_top_crashers_reports_links_work 31 seconds
test_that_top_crashers_reports_links_work 31 seconds
test_public_api_navigation 31 seconds
test_logout_verify_bid 39 seconds
test_profile_deletion_confirmation 36 seconds
test_that_filter_by_region_works 35 seconds
test_that_filter_by_country_works 35 seconds
test_that_filter_by_city_works 33 seconds
test_new_user_cannot_see_groups_or_functional_areas 32 seconds
test_that_links_in_the_services_page_return_200_code 32 seconds
test_that_user_can_view_external_accounts 32 seconds
test_that_search_returns_results_for_irc_nickname 31 seconds
test_private_groups_field_as_public_when_logged_in 31 seconds
test_verify_releng_aliases_match_what_we_expect a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_verify_product_details_is_in_sync_with_ship_it a moment
test_verify_releng_aliases_match_what_we_expect a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_verify_product_details_is_in_sync_with_ship_it a moment

Longest running tests

Most machine time consumed by tests over multiple executions.

test_verify_releng_aliases_match_what_we_expect 37 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 22 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 22 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 22 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 22 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 22 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 22 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 22 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 22 minutes
test_verify_product_details_is_in_sync_with_ship_it 16 minutes
test_that_non_us_user_can_set_get_involved_date an hour
test_that_user_can_modify_external_accounts_irc_nickname an hour
test_skill_deletion an hour
test_profile_creation an hour
test_group_description_edit an hour
test_logout_verify_bid an hour
test_group_deletion_confirmation an hour
test_that_user_can_create_and_delete_group an hour
test_creating_profile_without_checking_privacy_policy_checkbox an hour
test_group_invitations an hour
test_load_next_results 5 hours
test_remove_email_address_filter 3 hours
test_filter_by_email an hour
test_previous_job_shortcut an hour
test_pin_job_from_job_details an hour
test_close_open_panels an hour
test_pin_job an hour
test_view_unclassified_jobs an hour
test_next_job_shortcut an hour
test_clear_pinboard an hour
test_verify_releng_aliases_match_what_we_expect 16 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 7 minutes
test_verify_product_details_is_in_sync_with_ship_it 7 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 7 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 7 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 7 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 7 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 7 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 7 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 7 minutes
test_response_codes 2 hours
test_response_codes 2 hours
test_response_codes 2 hours
test_response_codes 2 hours
test_response_codes 2 hours
test_response_codes 2 hours
test_legacy 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_that_non_us_user_can_set_get_involved_date 55 minutes
test_profile_creation 55 minutes
test_logout_verify_bid 55 minutes
test_creating_profile_without_checking_privacy_policy_checkbox 54 minutes
test_that_user_can_modify_external_accounts_irc_nickname 53 minutes
test_group_description_edit 52 minutes
test_skill_deletion 49 minutes
test_that_search_returns_results_for_irc_nickname 48 minutes
test_that_filter_by_city_works 47 minutes
test_that_user_can_create_and_delete_group 47 minutes
test_search_change_column 2 hours
test_that_lowest_version_topcrashers_do_not_return_errors an hour
test_that_only_plugin_reports_have_plugin_icon an hour
test_that_only_browser_reports_have_browser_icon an hour
test_selecting_one_version_doesnt_show_other_versions 54 minutes
test_that_top_crashers_reports_links_work 50 minutes
test_that_top_crashers_reports_links_work 50 minutes
test_that_top_crashers_reports_links_work 49 minutes
test_that_top_crashers_reports_links_work 48 minutes
test_top_crasher_reports_tab_has_uuid_report 46 minutes
test_search_change_column 2 hours
test_that_lowest_version_topcrashers_do_not_return_errors an hour
test_that_only_plugin_reports_have_plugin_icon an hour
test_that_only_browser_reports_have_browser_icon an hour
test_selecting_one_version_doesnt_show_other_versions 49 minutes
test_that_top_crashers_reports_links_work 45 minutes
test_that_top_crashers_reports_links_work 45 minutes
test_that_top_crashers_reports_links_work 45 minutes
test_that_top_crashers_reports_links_work 45 minutes
test_top_crasher_reports_tab_has_uuid_report 42 minutes
test_legacy an hour
test_response_codes an hour
test_response_codes an hour
test_response_codes an hour
test_response_codes an hour
test_response_codes an hour
test_activity_stream an hour
test_response_codes an hour
test_that_snippets_are_well_formed_xml an hour
test_that_snippets_are_well_formed_xml an hour
test_logout_verify_bid an hour
test_that_filter_by_region_works 56 minutes
test_that_filter_by_city_works 56 minutes
test_that_filter_by_country_works 56 minutes
test_profile_deletion_confirmation 55 minutes
test_new_user_cannot_see_groups_or_functional_areas 52 minutes
test_that_links_in_the_services_page_return_200_code 52 minutes
test_that_user_can_view_external_accounts 52 minutes
test_private_groups_field_as_public_when_logged_in 51 minutes
test_that_search_returns_results_for_irc_nickname 51 minutes