Fork me on GitHub

Firefox Test Engineering Test Results

Generated on 01-May-2018 at 16:19:18.

A total of 5,060,648 tests ran between 06-Mar-2018 and 01-May-2018.

Tests with lowest pass rate

Percentage of tests that had the expected outcome.

test_remove_email_address_filter 0%
test_filter_by_email 0%
test_view_unclassified_jobs 0%
test_filter_jobs 0%
test_open_unclassified_failure_log 0%
test_close_open_panels 57%
test_get_next_results 78%
test_get_next_results 78%
test_get_next_results 78%
test_next_job_shortcut 86%
test_remove_email_address_filter 0%
test_filter_by_email 0%
test_view_unclassified_jobs 0%
test_filter_jobs 0%
test_open_unclassified_failure_log 0%
test_close_open_panels 91%
test_pin_job_from_job_details 98%
test_previous_job_shortcut 98%
test_clear_the_quick_filter_shortcut 98%
test_get_next_results 98%
test_user_can_sign_in 29%
test_del 94%
test_create_new_account 96%
test_create_new_account 96%
test_new_account_pw_does_not_contain_numbers 96%
test_new_account_pw_does_not_contain_numbers 96%
test_default_environment_should_be_dev 96%
test_webdriver_fxa_popup_without_logo_displayed 100%
test_webdriver_fxa_popup_without_logo_present 100%
test_webdriver_with_fxa_popup 100%
test_user_can_sign_in 37%
test_default_environment_should_be_dev 96%
test_del 96%
test_create_new_account 98%
test_create_new_account 98%
test_new_account_pw_does_not_contain_numbers 98%
test_new_account_pw_does_not_contain_numbers 98%
test_webdriver_fxa_popup_without_logo_displayed 100%
test_webdriver_fxa_popup_without_logo_present 100%
test_webdriver_with_fxa_popup 100%
test_that_non_us_user_can_set_get_involved_date 83%
test_creating_profile_without_checking_privacy_policy_checkbox 83%
test_group_description_edit 91%
test_group_deletion_confirmation 91%
test_group_type_change 92%
test_that_search_returns_results_for_email_substring 92%
test_that_user_can_view_external_accounts 92%
test_that_search_returns_results_for_irc_nickname 92%
test_that_user_can_add_external_account 92%
test_that_user_can_create_and_delete_group 92%
test_creating_profile_without_checking_privacy_policy_checkbox 81%
test_that_non_us_user_can_set_get_involved_date 81%
test_new_user_cannot_see_groups_or_functional_areas 91%
test_group_invitations 92%
test_edit_profile_information 93%
test_that_filter_by_city_works 93%
test_skill_deletion 93%
test_search_for_not_existing_mozillian_when_logged_in 93%
test_that_search_returns_results_for_first_name 93%
test_that_filter_by_region_works 94%
test_public_api_navigation 77%
test_search_for_valid_signature 81%
test_search_change_facet 88%
test_selecting_one_version_doesnt_show_other_versions 88%
test_search_with_multiple_lines 88%
test_search_change_column 88%
test_top_crasher_reports_tab_has_uuid_report 88%
test_search_with_one_line 89%
test_that_top_crasher_filter_browser_return_results 89%
test_that_top_crasher_filter_all_return_results 89%
test_public_api_navigation 75%
test_search_for_valid_signature 84%
test_top_crasher_reports_tab_has_uuid_report 89%
test_selecting_one_version_doesnt_show_other_versions 89%
test_search_with_multiple_lines 89%
test_that_top_crasher_filter_plugin_return_results 89%
test_that_top_crasher_filter_browser_return_results 90%
test_that_top_crasher_filter_all_return_results 90%
test_that_only_browser_reports_have_browser_icon 90%
test_search_with_one_line 90%
test_organic_flow_param_values 97%
test_search_flow_param_values 98%
test_campaign_flow_param_values 98%
test_search_flow_param_values 98%
test_campaign_flow_param_values 98%
test_organic_flow_param_values 98%

Tests with most failures

Tests with the highest total number of failures.

test_legacy 563
test_response_codes 3
test_response_codes 2
test_that_snippets_are_well_formed_xml 2
test_response_codes 1
test_response_codes 1
test_response_codes 1
test_that_snippets_are_well_formed_xml 1
test_response_codes 0
test_that_snippets_are_well_formed_xml 0
test_verify_firefox_aliases_redirect_to_correct_products 13
test_verify_firefox_aliases_redirect_to_correct_products 13
test_verify_firefox_aliases_redirect_to_correct_products 13
test_verify_firefox_aliases_redirect_to_correct_products 9
test_verify_firefox_aliases_redirect_to_correct_products 9
test_verify_firefox_aliases_redirect_to_correct_products 9
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 8
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 8
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 8
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 8
test_that_non_us_user_can_set_get_involved_date 23
test_creating_profile_without_checking_privacy_policy_checkbox 22
test_group_deletion_confirmation 12
test_group_description_edit 12
test_that_user_can_view_external_accounts 11
test_that_user_can_create_and_delete_group 11
test_that_search_returns_results_for_email_substring 11
test_that_search_returns_results_for_first_name 11
test_group_type_change 11
test_skill_addition 11
test_creating_profile_without_checking_privacy_policy_checkbox 22
test_that_non_us_user_can_set_get_involved_date 21
test_new_user_cannot_see_groups_or_functional_areas 10
test_group_invitations 9
test_search_for_not_existing_mozillian_when_logged_in 8
test_skill_deletion 8
test_that_filter_by_city_works 8
test_that_search_returns_results_for_first_name 8
test_edit_profile_information 8
test_group_deletion_confirmation 7
test_open_unclassified_failure_log 43
test_view_unclassified_jobs 43
test_remove_email_address_filter 38
test_filter_jobs 38
test_filter_by_email 38
test_close_open_panels 4
test_pin_job_from_job_details 1
test_get_next_results 1
test_previous_job_shortcut 1
test_clear_the_quick_filter_shortcut 1
test_public_api_navigation 23
test_search_for_valid_signature 19
test_search_change_facet 12
test_selecting_one_version_doesnt_show_other_versions 12
test_search_with_multiple_lines 12
test_search_change_column 12
test_top_crasher_reports_tab_has_uuid_report 12
test_that_top_crasher_filter_plugin_return_results 11
test_that_top_crasher_filter_browser_return_results 11
test_that_top_crasher_filter_all_return_results 11
test_organic_flow_param_values 35
test_search_flow_param_values 34
test_campaign_flow_param_values 30
test_public_api_navigation 16
test_search_for_valid_signature 10
test_top_crasher_reports_tab_has_uuid_report 7
test_that_top_crasher_filter_plugin_return_results 7
test_selecting_one_version_doesnt_show_other_versions 7
test_search_with_multiple_lines 7
test_that_top_crasher_filter_browser_return_results 6
test_that_top_crasher_filter_all_return_results 6
test_that_only_browser_reports_have_browser_icon 6
test_search_with_one_line 6
test_user_can_sign_in 74
test_del 5
test_create_new_account 3
test_create_new_account 3
test_new_account_pw_does_not_contain_numbers 3
test_new_account_pw_does_not_contain_numbers 3
test_default_environment_should_be_dev 3
test_webdriver_fxa_popup_without_logo_displayed 0
test_webdriver_fxa_popup_without_logo_present 0
test_webdriver_with_fxa_popup 0
test_search_flow_param_values 33
test_campaign_flow_param_values 31
test_organic_flow_param_values 28

Slowest tests

Slowest average test durations.

test_that_non_us_user_can_set_get_involved_date a minute
test_that_user_can_modify_external_accounts_irc_nickname a minute
test_group_description_edit a minute
test_that_user_can_create_and_delete_group a minute
test_skill_deletion a minute
test_edit_profile_information a minute
test_profile_creation a minute
test_group_invitations a minute
test_group_deletion_confirmation 58 seconds
test_logout_verify_bid 57 seconds
test_filter_jobs 2 minutes
test_close_open_panels 2 minutes
test_load_next_results 2 minutes
test_view_unclassified_jobs a minute
test_pin_job a minute
test_next_job_shortcut a minute
test_pin_job_from_job_details a minute
test_open_unclassified_failure_log a minute
test_get_next_results a minute
test_clear_pinboard a minute
test_that_non_us_user_can_set_get_involved_date a minute
test_that_user_can_modify_external_accounts_irc_nickname a minute
test_skill_deletion a minute
test_that_user_can_create_and_delete_group a minute
test_group_description_edit a minute
test_profile_creation a minute
test_edit_profile_information a minute
test_skill_addition 59 seconds
test_creating_profile_without_checking_privacy_policy_checkbox 59 seconds
test_group_invitations 59 seconds
test_search_change_column a minute
test_that_only_plugin_reports_have_plugin_icon 56 seconds
test_that_lowest_version_topcrashers_do_not_return_errors 55 seconds
test_that_only_browser_reports_have_browser_icon 49 seconds
test_selecting_one_version_doesnt_show_other_versions 40 seconds
test_that_top_crashers_reports_links_work 38 seconds
test_that_top_crashers_reports_links_work 36 seconds
test_that_top_crashers_reports_links_work 35 seconds
test_that_top_crashers_reports_links_work 35 seconds
test_top_crasher_reports_tab_has_uuid_report 34 seconds
test_search_change_column a minute
test_that_only_plugin_reports_have_plugin_icon 55 seconds
test_that_lowest_version_topcrashers_do_not_return_errors 54 seconds
test_that_only_browser_reports_have_browser_icon 47 seconds
test_selecting_one_version_doesnt_show_other_versions 39 seconds
test_that_top_crashers_reports_links_work 38 seconds
test_that_top_crashers_reports_links_work 37 seconds
test_top_crasher_reports_tab_has_uuid_report 35 seconds
test_that_top_crashers_reports_links_work 35 seconds
test_that_top_crashers_reports_links_work 35 seconds
test_search_change_column a minute
test_that_lowest_version_topcrashers_do_not_return_errors 54 seconds
test_that_only_plugin_reports_have_plugin_icon 52 seconds
test_that_only_browser_reports_have_browser_icon 45 seconds
test_selecting_one_version_doesnt_show_other_versions 38 seconds
test_that_top_crashers_reports_links_work 36 seconds
test_that_top_crashers_reports_links_work 35 seconds
test_that_top_crashers_reports_links_work 35 seconds
test_top_crasher_reports_tab_has_uuid_report 35 seconds
test_that_top_crashers_reports_links_work 34 seconds
test_load_next_results a minute
test_close_open_panels 44 seconds
test_clear_the_quick_filter_shortcut 44 seconds
test_clear_pinboard 44 seconds
test_previous_job_shortcut 42 seconds
test_view_unclassified_jobs 42 seconds
test_pin_job_from_job_details 41 seconds
test_next_job_shortcut 41 seconds
test_expanding_group_count 41 seconds
test_filter_by_email 41 seconds
test_logout_verify_bid 42 seconds
test_that_user_can_view_external_accounts 42 seconds
test_that_search_returns_results_for_irc_nickname 42 seconds
test_that_filter_by_city_works 39 seconds
test_profile_deletion_confirmation 39 seconds
test_that_filter_by_country_works 38 seconds
test_new_user_cannot_see_groups_or_functional_areas 38 seconds
test_that_links_in_the_services_page_return_200_code 37 seconds
test_that_filter_by_region_works 37 seconds
test_private_groups_field_as_public_when_logged_in 35 seconds
test_verify_releng_aliases_match_what_we_expect a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_verify_product_details_is_in_sync_with_ship_it a moment
test_user_can_sign_in 49 seconds
test_del 34 seconds
test_create_new_account 7 seconds
test_default_environment_should_be_dev 7 seconds
test_create_new_account 7 seconds
test_new_account_pw_does_not_contain_numbers 7 seconds
test_new_account_pw_does_not_contain_numbers 7 seconds
test_webdriver_with_fxa_popup a moment
test_webdriver_fxa_popup_without_logo_displayed a moment
test_webdriver_fxa_popup_without_logo_present a moment

Longest running tests

Most machine time consumed by tests over multiple executions.

test_verify_releng_aliases_match_what_we_expect 37 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_verify_product_details_is_in_sync_with_ship_it 16 minutes
test_that_non_us_user_can_set_get_involved_date 2 hours
test_that_user_can_modify_external_accounts_irc_nickname 2 hours
test_profile_creation 2 hours
test_creating_profile_without_checking_privacy_policy_checkbox an hour
test_skill_deletion an hour
test_group_description_edit an hour
test_group_invitations an hour
test_edit_profile_information an hour
test_skill_addition an hour
test_that_user_can_create_and_delete_group an hour
test_that_non_us_user_can_set_get_involved_date 2 hours
test_that_user_can_modify_external_accounts_irc_nickname an hour
test_creating_profile_without_checking_privacy_policy_checkbox an hour
test_group_description_edit an hour
test_profile_creation an hour
test_skill_deletion an hour
test_group_invitations an hour
test_that_user_can_create_and_delete_group an hour
test_logout_verify_bid an hour
test_group_deletion_confirmation an hour
test_search_change_column 2 hours
test_that_lowest_version_topcrashers_do_not_return_errors an hour
test_that_only_plugin_reports_have_plugin_icon an hour
test_that_only_browser_reports_have_browser_icon an hour
test_selecting_one_version_doesnt_show_other_versions an hour
test_that_top_crashers_reports_links_work an hour
test_that_top_crashers_reports_links_work an hour
test_that_top_crasher_filter_plugin_return_results an hour
test_that_top_crashers_reports_links_work an hour
test_top_crasher_reports_tab_has_uuid_report an hour
test_search_change_column an hour
test_that_lowest_version_topcrashers_do_not_return_errors an hour
test_that_only_plugin_reports_have_plugin_icon an hour
test_that_only_browser_reports_have_browser_icon an hour
test_top_crasher_reports_tab_has_uuid_report 57 minutes
test_that_top_crashers_reports_links_work 56 minutes
test_that_top_crashers_reports_links_work 56 minutes
test_selecting_one_version_doesnt_show_other_versions 56 minutes
test_that_top_crashers_reports_links_work 54 minutes
test_that_top_crashers_reports_links_work 54 minutes
test_logout_verify_bid an hour
test_that_search_returns_results_for_irc_nickname an hour
test_that_links_in_the_services_page_return_200_code an hour
test_private_groups_field_as_public_when_logged_in an hour
test_that_filter_by_city_works an hour
test_that_filter_by_region_works an hour
test_profile_deletion_confirmation an hour
test_that_filter_by_country_works an hour
test_that_search_returns_results_for_first_name an hour
test_new_user_cannot_see_groups_or_functional_areas an hour
test_that_snippets_are_well_formed_xml an hour
test_response_codes an hour
test_response_codes an hour
test_response_codes an hour
test_response_codes an hour
test_response_codes an hour
test_response_codes an hour
test_that_snippets_are_well_formed_xml an hour
test_that_snippets_are_well_formed_xml an hour
test_legacy an hour
test_response_codes an hour
test_that_snippets_are_well_formed_xml an hour
test_response_codes an hour
test_response_codes an hour
test_response_codes an hour
test_response_codes an hour
test_response_codes an hour
test_that_snippets_are_well_formed_xml an hour
test_that_snippets_are_well_formed_xml an hour
test_legacy an hour
test_response_codes 2 hours
test_response_codes an hour
test_response_codes an hour
test_response_codes an hour
test_that_snippets_are_well_formed_xml an hour
test_response_codes an hour
test_response_codes an hour
test_that_snippets_are_well_formed_xml an hour
test_that_snippets_are_well_formed_xml an hour
test_legacy 55 minutes
test_organic_flow_param_values 5 hours
test_search_flow_param_values 4 hours
test_campaign_flow_param_values 4 hours