Fork me on GitHub

Firefox Test Engineering Test Results

Generated on 22-Apr-2018 at 00:19:20.

A total of 4,033,652 tests ran between 25-Feb-2018 and 21-Apr-2018.

Tests with lowest pass rate

Percentage of tests that had the expected outcome.

test_remove_email_address_filter 0%
test_filter_by_email 0%
test_view_unclassified_jobs 0%
test_filter_jobs 0%
test_open_unclassified_failure_log 0%
test_close_open_panels 73%
test_previous_job_shortcut 82%
test_get_next_results 85%
test_get_next_results 85%
test_get_next_results 85%
test_remove_email_address_filter 0%
test_filter_by_email 0%
test_view_unclassified_jobs 0%
test_filter_jobs 0%
test_open_unclassified_failure_log 0%
test_close_open_panels 91%
test_pin_job_from_job_details 98%
test_previous_job_shortcut 98%
test_clear_the_quick_filter_shortcut 98%
test_get_next_results 98%
test_user_can_sign_in 39%
test_del 90%
test_create_new_account 93%
test_new_account_pw_does_not_contain_numbers 93%
test_default_environment_should_be_dev 93%
test_create_new_account 97%
test_new_account_pw_does_not_contain_numbers 97%
test_webdriver_fxa_popup_without_logo_displayed 100%
test_webdriver_fxa_popup_without_logo_present 100%
test_webdriver_with_fxa_popup 100%
test_user_can_sign_in 46%
test_default_environment_should_be_dev 96%
test_del 96%
test_create_new_account 97%
test_new_account_pw_does_not_contain_numbers 97%
test_create_new_account 98%
test_new_account_pw_does_not_contain_numbers 98%
test_webdriver_fxa_popup_without_logo_displayed 100%
test_webdriver_fxa_popup_without_logo_present 100%
test_webdriver_with_fxa_popup 100%
test_creating_profile_without_checking_privacy_policy_checkbox 84%
test_that_non_us_user_can_set_get_involved_date 84%
test_group_deletion_confirmation 92%
test_group_description_edit 92%
test_group_type_change 92%
test_that_search_returns_results_for_irc_nickname 92%
test_that_search_returns_results_for_first_name 92%
test_that_search_returns_results_for_email_substring 92%
test_skill_addition 92%
test_skill_deletion 93%
test_public_api_navigation 82%
test_search_for_valid_signature 85%
test_search_change_column 90%
test_search_change_facet 91%
test_that_top_crasher_filter_all_return_results 91%
test_selecting_one_version_doesnt_show_other_versions 91%
test_search_with_multiple_lines 91%
test_that_top_crasher_filter_plugin_return_results 91%
test_top_crasher_reports_tab_has_uuid_report 91%
test_that_top_crasher_filter_browser_return_results 92%
test_public_api_navigation 82%
test_top_crasher_reports_tab_has_uuid_report 89%
test_selecting_one_version_doesnt_show_other_versions 89%
test_search_with_multiple_lines 89%
test_search_for_valid_signature 89%
test_that_top_crasher_filter_browser_return_results 91%
test_that_top_crasher_filter_all_return_results 91%
test_that_only_browser_reports_have_browser_icon 91%
test_search_with_one_line 91%
test_that_top_crasher_filter_plugin_return_results 91%
test_that_non_us_user_can_set_get_involved_date 84%
test_creating_profile_without_checking_privacy_policy_checkbox 84%
test_new_user_cannot_see_groups_or_functional_areas 93%
test_group_invitations 94%
test_that_filter_by_region_works 95%
test_edit_profile_information 95%
test_that_filter_by_city_works 95%
test_skill_deletion 95%
test_search_for_not_existing_mozillian_when_logged_in 95%
test_profile_deletion_confirmation 95%
test_that_user_can_view_external_accounts 95%
test_that_search_returns_results_for_irc_nickname 95%
test_that_search_returns_results_for_email_substring 96%
test_search_for_not_existing_mozillian_when_logged_in 96%
test_private_groups_field_as_public_when_logged_in 96%
test_new_user_cannot_see_groups_or_functional_areas 96%
test_profile_deletion_confirmation 96%
test_that_filter_by_country_works 96%
test_that_filter_by_region_works 96%
test_that_search_returns_results_for_first_name 96%
test_legacy 90%
test_response_codes 100%
test_that_snippets_are_well_formed_xml 100%
test_response_codes 100%
test_response_codes 100%
test_response_codes 100%
test_that_snippets_are_well_formed_xml 100%
test_response_codes 100%
test_response_codes 100%
test_that_snippets_are_well_formed_xml 100%

Tests with most failures

Tests with the highest total number of failures.

test_legacy 563
test_response_codes 2
test_that_snippets_are_well_formed_xml 2
test_response_codes 1
test_response_codes 1
test_response_codes 1
test_that_snippets_are_well_formed_xml 1
test_response_codes 0
test_response_codes 0
test_that_snippets_are_well_formed_xml 0
test_verify_firefox_aliases_redirect_to_correct_products 9
test_verify_firefox_aliases_redirect_to_correct_products 9
test_verify_firefox_aliases_redirect_to_correct_products 9
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 7
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 7
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 7
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 7
test_verify_firefox_aliases_redirect_to_correct_products 7
test_verify_firefox_aliases_redirect_to_correct_products 7
test_verify_firefox_aliases_redirect_to_correct_products 7
test_creating_profile_without_checking_privacy_policy_checkbox 21
test_that_non_us_user_can_set_get_involved_date 21
test_group_deletion_confirmation 11
test_group_description_edit 11
test_group_type_change 10
test_that_search_returns_results_for_email_substring 10
test_that_search_returns_results_for_first_name 10
test_that_search_returns_results_for_irc_nickname 10
test_skill_addition 10
test_skill_deletion 9
test_open_unclassified_failure_log 53
test_view_unclassified_jobs 53
test_remove_email_address_filter 48
test_filter_jobs 48
test_filter_by_email 48
test_close_open_panels 5
test_pin_job_from_job_details 1
test_get_next_results 1
test_previous_job_shortcut 1
test_clear_the_quick_filter_shortcut 1
test_public_api_navigation 24
test_search_for_valid_signature 20
test_search_change_column 13
test_search_change_facet 12
test_that_top_crasher_filter_plugin_return_results 12
test_that_top_crasher_filter_all_return_results 12
test_selecting_one_version_doesnt_show_other_versions 12
test_search_with_multiple_lines 12
test_top_crasher_reports_tab_has_uuid_report 12
test_that_top_crasher_filter_browser_return_results 11
test_creating_profile_without_checking_privacy_policy_checkbox 19
test_that_non_us_user_can_set_get_involved_date 19
test_new_user_cannot_see_groups_or_functional_areas 8
test_group_invitations 7
test_search_for_not_existing_mozillian_when_logged_in 6
test_skill_deletion 6
test_that_filter_by_region_works 6
test_profile_deletion_confirmation 6
test_that_filter_by_city_works 6
test_edit_profile_information 6
test_user_can_sign_in 78
test_del 11
test_create_new_account 8
test_new_account_pw_does_not_contain_numbers 8
test_default_environment_should_be_dev 8
test_create_new_account 3
test_new_account_pw_does_not_contain_numbers 3
test_webdriver_fxa_popup_without_logo_displayed 0
test_webdriver_fxa_popup_without_logo_present 0
test_webdriver_with_fxa_popup 0
test_that_user_can_view_external_accounts 7
test_that_search_returns_results_for_irc_nickname 7
test_private_groups_field_as_public_when_logged_in 6
test_that_search_returns_results_for_email_substring 6
test_search_for_not_existing_mozillian_when_logged_in 6
test_profile_deletion_confirmation 6
test_new_user_cannot_see_groups_or_functional_areas 6
test_that_search_returns_results_for_first_name 5
test_that_filter_by_region_works 5
test_that_filter_by_country_works 5
test_public_api_navigation 12
test_top_crasher_reports_tab_has_uuid_report 7
test_selecting_one_version_doesnt_show_other_versions 7
test_search_with_multiple_lines 7
test_search_for_valid_signature 7
test_that_top_crasher_filter_plugin_return_results 6
test_that_top_crasher_filter_browser_return_results 6
test_that_top_crasher_filter_all_return_results 6
test_that_only_browser_reports_have_browser_icon 6
test_search_with_one_line 6
test_user_can_sign_in 66
test_default_environment_should_be_dev 4
test_del 4
test_create_new_account 3
test_new_account_pw_does_not_contain_numbers 3
test_create_new_account 2
test_new_account_pw_does_not_contain_numbers 2
test_webdriver_fxa_popup_without_logo_displayed 0
test_webdriver_fxa_popup_without_logo_present 0
test_webdriver_with_fxa_popup 0

Slowest tests

Slowest average test durations.

test_that_non_us_user_can_set_get_involved_date a minute
test_that_user_can_modify_external_accounts_irc_nickname a minute
test_group_description_edit a minute
test_skill_deletion a minute
test_that_user_can_create_and_delete_group a minute
test_edit_profile_information a minute
test_profile_creation a minute
test_group_invitations 58 seconds
test_group_deletion_confirmation 57 seconds
test_cannot_invite_github_non_nda_user_to_access_group 57 seconds
test_that_non_us_user_can_set_get_involved_date a minute
test_that_user_can_modify_external_accounts_irc_nickname a minute
test_skill_deletion a minute
test_that_user_can_create_and_delete_group a minute
test_group_description_edit a minute
test_profile_creation a minute
test_creating_profile_without_checking_privacy_policy_checkbox a minute
test_edit_profile_information a minute
test_group_deletion_confirmation a minute
test_skill_addition a minute
test_search_change_column a minute
test_that_only_plugin_reports_have_plugin_icon 55 seconds
test_that_lowest_version_topcrashers_do_not_return_errors 54 seconds
test_that_only_browser_reports_have_browser_icon 48 seconds
test_selecting_one_version_doesnt_show_other_versions 38 seconds
test_that_top_crashers_reports_links_work 38 seconds
test_that_top_crashers_reports_links_work 38 seconds
test_top_crasher_reports_tab_has_uuid_report 35 seconds
test_that_top_crashers_reports_links_work 35 seconds
test_that_top_crashers_reports_links_work 35 seconds
test_search_change_column a minute
test_that_only_plugin_reports_have_plugin_icon 56 seconds
test_that_lowest_version_topcrashers_do_not_return_errors 55 seconds
test_that_only_browser_reports_have_browser_icon 49 seconds
test_selecting_one_version_doesnt_show_other_versions 39 seconds
test_that_top_crashers_reports_links_work 38 seconds
test_that_top_crashers_reports_links_work 35 seconds
test_that_top_crashers_reports_links_work 35 seconds
test_that_top_crashers_reports_links_work 35 seconds
test_top_crasher_reports_tab_has_uuid_report 34 seconds
test_search_change_column a minute
test_that_lowest_version_topcrashers_do_not_return_errors 53 seconds
test_that_only_plugin_reports_have_plugin_icon 52 seconds
test_that_only_browser_reports_have_browser_icon 45 seconds
test_selecting_one_version_doesnt_show_other_versions 37 seconds
test_that_top_crashers_reports_links_work 35 seconds
test_that_top_crashers_reports_links_work 35 seconds
test_that_top_crashers_reports_links_work 35 seconds
test_top_crasher_reports_tab_has_uuid_report 34 seconds
test_that_top_crashers_reports_links_work 33 seconds
test_load_next_results 2 minutes
test_clear_pinboard a minute
test_clear_the_quick_filter_shortcut 52 seconds
test_open_unclassified_failure_log 50 seconds
test_view_unclassified_jobs 48 seconds
test_pin_job 46 seconds
test_pin_job_from_job_details 45 seconds
test_previous_job_shortcut 43 seconds
test_filter_jobs 43 seconds
test_close_open_panels 42 seconds
test_load_next_results a minute
test_view_unclassified_jobs 44 seconds
test_clear_pinboard 44 seconds
test_close_open_panels 43 seconds
test_clear_the_quick_filter_shortcut 42 seconds
test_previous_job_shortcut 42 seconds
test_open_unclassified_failure_log 41 seconds
test_pin_job_from_job_details 41 seconds
test_filter_by_email 41 seconds
test_next_job_shortcut 40 seconds
test_logout_verify_bid 43 seconds
test_that_search_returns_results_for_irc_nickname 41 seconds
test_that_filter_by_country_works 41 seconds
test_that_filter_by_city_works 39 seconds
test_profile_deletion_confirmation 38 seconds
test_that_filter_by_region_works 38 seconds
test_search_for_not_existing_mozillian_when_logged_in 38 seconds
test_new_user_cannot_see_groups_or_functional_areas 38 seconds
test_that_links_in_the_services_page_return_200_code 38 seconds
test_that_user_can_view_external_accounts 36 seconds
test_verify_releng_aliases_match_what_we_expect a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_verify_product_details_is_in_sync_with_ship_it a moment
test_user_can_sign_in 47 seconds
test_del 31 seconds
test_create_new_account 8 seconds
test_default_environment_should_be_dev 8 seconds
test_create_new_account 7 seconds
test_new_account_pw_does_not_contain_numbers 7 seconds
test_new_account_pw_does_not_contain_numbers 7 seconds
test_webdriver_with_fxa_popup a moment
test_webdriver_fxa_popup_without_logo_displayed a moment
test_webdriver_fxa_popup_without_logo_present a moment

Longest running tests

Most machine time consumed by tests over multiple executions.

test_verify_releng_aliases_match_what_we_expect 37 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 26 minutes
test_verify_product_details_is_in_sync_with_ship_it 16 minutes
test_that_non_us_user_can_set_get_involved_date 2 hours
test_that_user_can_modify_external_accounts_irc_nickname 2 hours
test_profile_creation 2 hours
test_creating_profile_without_checking_privacy_policy_checkbox an hour
test_skill_deletion an hour
test_group_description_edit an hour
test_group_invitations an hour
test_edit_profile_information an hour
test_skill_addition an hour
test_that_user_can_create_and_delete_group an hour
test_that_non_us_user_can_set_get_involved_date 2 hours
test_that_user_can_modify_external_accounts_irc_nickname an hour
test_creating_profile_without_checking_privacy_policy_checkbox an hour
test_group_description_edit an hour
test_profile_creation an hour
test_skill_deletion an hour
test_logout_verify_bid an hour
test_group_invitations an hour
test_that_user_can_create_and_delete_group an hour
test_that_user_can_view_external_accounts an hour
test_search_change_column 3 hours
test_that_lowest_version_topcrashers_do_not_return_errors 2 hours
test_that_only_plugin_reports_have_plugin_icon an hour
test_that_only_browser_reports_have_browser_icon an hour
test_selecting_one_version_doesnt_show_other_versions an hour
test_that_top_crashers_reports_links_work an hour
test_that_top_crashers_reports_links_work an hour
test_that_top_crashers_reports_links_work an hour
test_top_crasher_reports_tab_has_uuid_report an hour
test_that_top_crashers_reports_links_work an hour
test_search_change_column 2 hours
test_that_lowest_version_topcrashers_do_not_return_errors an hour
test_that_only_plugin_reports_have_plugin_icon an hour
test_that_only_browser_reports_have_browser_icon an hour
test_selecting_one_version_doesnt_show_other_versions an hour
test_that_top_crashers_reports_links_work an hour
test_top_crasher_reports_tab_has_uuid_report an hour
test_that_top_crashers_reports_links_work an hour
test_that_top_crashers_reports_links_work an hour
test_that_top_crashers_reports_links_work an hour
test_logout_verify_bid an hour
test_that_search_returns_results_for_irc_nickname an hour
test_that_filter_by_region_works an hour
test_that_filter_by_city_works an hour
test_that_links_in_the_services_page_return_200_code an hour
test_private_groups_field_as_public_when_logged_in an hour
test_that_filter_by_country_works an hour
test_profile_deletion_confirmation an hour
test_that_search_returns_results_for_first_name an hour
test_new_user_cannot_see_groups_or_functional_areas an hour
test_that_snippets_are_well_formed_xml 2 hours
test_response_codes 2 hours
test_response_codes 2 hours
test_response_codes 2 hours
test_response_codes 2 hours
test_response_codes 2 hours
test_response_codes 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_legacy an hour
test_response_codes 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_response_codes 2 hours
test_response_codes 2 hours
test_response_codes 2 hours
test_response_codes 2 hours
test_response_codes 2 hours
test_that_snippets_are_well_formed_xml an hour
test_that_snippets_are_well_formed_xml an hour
test_legacy an hour
test_response_codes 2 hours
test_response_codes an hour
test_response_codes an hour
test_response_codes an hour
test_that_snippets_are_well_formed_xml an hour
test_response_codes an hour
test_response_codes an hour
test_that_snippets_are_well_formed_xml an hour
test_that_snippets_are_well_formed_xml an hour
test_legacy an hour
test_search_change_column an hour
test_that_lowest_version_topcrashers_do_not_return_errors 54 minutes
test_that_only_plugin_reports_have_plugin_icon 50 minutes
test_that_only_browser_reports_have_browser_icon 43 minutes
test_selecting_one_version_doesnt_show_other_versions 35 minutes
test_that_top_crashers_reports_links_work 34 minutes
test_that_top_crashers_reports_links_work 33 minutes
test_that_top_crashers_reports_links_work 32 minutes
test_that_top_crashers_reports_links_work 32 minutes
test_top_crasher_reports_tab_has_uuid_report 31 minutes