Fork me on GitHub

Firefox Test Engineering Test Results

Generated on 22-Aug-2017 at 03:19:10.

A total of 4,048,750 tests ran between 27-Jun-2017 and 22-Aug-2017.

Tests with lowest pass rate

Percentage of tests that had the expected outcome.

test_200_for_anonymous_users 0%
test_search_for_not_existing_mozillian_when_not_logged_in 0%
test_skill_addition 0%
test_skill_deletion 0%
test_that_filter_by_city_works 0%
test_that_filter_by_country_works 0%
test_that_filter_by_region_works 0%
test_that_links_in_footer_return_200_code 0%
test_that_links_in_the_about_page_return_200_code 0%
test_that_links_in_the_services_page_return_200_code 0%
test_load_next_results 0%
test_expanding_group_count 0%
test_filter_by_test_status 0%
test_open_single_result 9%
test_filter_by_job_keyword 12%
test_switch_repo 17%
test_open_unclassified_failure_log 21%
test_unclassified_failure 21%
test_filter_by_email 22%
test_clear_pinboard 31%
test_public_api_navigation 35%
test_top_crasher_reports_tab_has_uuid_report 46%
test_selecting_one_version_doesnt_show_other_versions 51%
test_search_for_valid_signature 52%
test_that_only_browser_reports_have_browser_icon 53%
test_that_top_crasher_filter_browser_return_results 54%
test_that_top_crasher_filter_all_return_results 54%
test_search_with_multiple_lines 54%
test_search_change_column 56%
test_that_top_crasher_filter_plugin_return_results 57%
test_that_search_returns_results_for_irc_nickname 25%
test_that_search_returns_results_for_first_name 25%
test_group_description_edit 39%
test_search_for_not_existing_mozillian_when_logged_in 43%
test_that_user_can_create_and_delete_group 58%
test_that_search_returns_results_for_email_substring 66%
test_group_invitations 67%
test_login_logout 67%
test_group_type_change 69%
test_that_user_can_modify_external_accounts_irc_nickname 69%
test_search_for_not_existing_mozillian_when_logged_in 34%
test_new_user_cannot_see_groups_or_functional_areas 59%
test_that_filter_by_region_works 72%
test_that_filter_by_city_works 72%
test_that_search_returns_results_for_first_name 79%
test_profile_deletion_confirmation 92%
test_that_search_returns_results_for_email_substring 92%
test_logout_verify_bid 92%
test_that_user_can_view_external_accounts 93%
test_that_links_in_the_services_page_return_200_code 93%
test_the_development_channel_section 0%
test_that_user_can_make_a_contribution_without_logging_into_amo 0%
test_web_extension_submission 0%
test_that_user_can_contribute_to_an_addon 0%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 0%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 0%
test_user_my_favorites_page 14%
test_that_firebug_has_install_link 51%
test_that_verifies_the_url_of_the_statistics_page 60%
test_that_addon_number_of_total_downloads_is_correct 60%
test_web_extension_submission 0%
test_that_user_can_make_a_contribution_without_logging_into_amo 0%
test_that_user_can_contribute_to_an_addon 0%
test_the_development_channel_section 0%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 38%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 61%
test_that_install_button_is_clickable 67%
test_that_version_information_is_displayed 67%
test_that_searching_for_a_tag_returns_results 75%
test_that_checks_if_the_extensions_are_sorted_by_newest 91%
test_that_firebug_rating_is_correct 0%
test_the_development_channel_section 0%
test_that_searching_for_a_tag_returns_results 39%
test_that_search_results_return_20_results_per_page 76%
test_that_daily_users_in_api_equals_daily_users_in_details_page 93%
test_that_addon_number_of_total_downloads_is_correct 94%
test_sorting_by_downloads 94%
test_sorting_by_number_of_most_users 97%
test_that_checks_content_in_json_endpoints_from_statistics_urls 99%
test_that_featured_themes_exist_on_the_home 99%
test_campaign_flow_param_values 99%
test_search_flow_param_values 99%
test_organic_flow_param_values 100%
test_campaign_flow_param_values 100%
test_organic_flow_param_values 100%
test_search_flow_param_values 100%

Tests with most failures

Tests with the highest total number of failures.

test_public_api_navigation 168
test_top_crasher_reports_tab_has_uuid_report 140
test_selecting_one_version_doesnt_show_other_versions 128
test_search_for_valid_signature 125
test_that_only_browser_reports_have_browser_icon 123
test_that_top_crasher_filter_browser_return_results 119
test_that_top_crasher_filter_all_return_results 119
test_search_with_multiple_lines 119
test_search_change_column 115
test_that_top_crasher_filter_plugin_return_results 113
test_verify_firefox_aliases_redirect_to_correct_products 174
test_verify_firefox_aliases_redirect_to_correct_products 173
test_verify_firefox_aliases_redirect_to_correct_products 167
test_verify_firefox_aliases_redirect_to_correct_products 10
test_verify_firefox_aliases_redirect_to_correct_products 10
test_verify_firefox_aliases_redirect_to_correct_products 10
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 9
test_verify_firefox_aliases_redirect_to_correct_products 7
test_verify_firefox_aliases_redirect_to_correct_products 7
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 7
test_load_next_results 58
test_expanding_group_count 58
test_filter_by_test_status 58
test_open_single_result 53
test_filter_by_job_keyword 51
test_switch_repo 48
test_open_unclassified_failure_log 46
test_unclassified_failure 46
test_filter_by_email 45
test_clear_pinboard 40
test_that_search_returns_results_for_first_name 50
test_that_search_returns_results_for_irc_nickname 50
test_group_description_edit 41
test_search_for_not_existing_mozillian_when_logged_in 38
test_that_user_can_create_and_delete_group 28
test_that_search_returns_results_for_email_substring 23
test_group_invitations 22
test_login_logout 22
test_inviting_an_invalid_email_address 21
test_profile_deletion_confirmation 21
test_the_development_channel_section 72
test_that_user_can_make_a_contribution_without_logging_into_amo 72
test_web_extension_submission 72
test_that_user_can_contribute_to_an_addon 72
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 72
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 72
test_user_my_favorites_page 62
test_that_firebug_has_install_link 35
test_that_verifies_the_url_of_the_statistics_page 29
test_that_addon_number_of_total_downloads_is_correct 29
test_web_extension_submission 69
test_that_user_can_contribute_to_an_addon 69
test_that_user_can_make_a_contribution_without_logging_into_amo 69
test_the_development_channel_section 69
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 43
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 27
test_that_version_information_is_displayed 23
test_that_install_button_is_clickable 23
test_that_searching_for_a_tag_returns_results 17
test_that_checks_if_the_extensions_are_sorted_by_newest 6
test_200_for_anonymous_users 9
test_302_redirect_for_anonymous_users 9
test_skill_addition 9
test_skill_deletion 9
test_that_filter_by_city_works 9
test_that_filter_by_country_works 9
test_that_filter_by_region_works 9
test_that_links_in_footer_return_200_code 9
test_that_links_in_the_about_page_return_200_code 9
test_that_links_in_the_services_page_return_200_code 9
test_the_development_channel_section 70
test_that_searching_for_a_tag_returns_results 43
test_that_firebug_rating_is_correct 32
test_that_search_results_return_20_results_per_page 17
test_that_daily_users_in_api_equals_daily_users_in_details_page 5
test_that_addon_number_of_total_downloads_is_correct 4
test_sorting_by_downloads 4
test_sorting_by_number_of_most_users 2
test_that_reviews_in_api_equals_reviews_in_details_page 1
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 1
test_search_for_not_existing_mozillian_when_logged_in 47
test_new_user_cannot_see_groups_or_functional_areas 29
test_that_filter_by_region_works 20
test_that_filter_by_city_works 20
test_that_search_returns_results_for_first_name 15
test_logout_verify_bid 6
test_that_search_returns_results_for_email_substring 6
test_profile_deletion_confirmation 6
test_login_logout 5
test_that_user_can_view_external_accounts 5
test_verify_firefox_aliases_redirect_to_correct_products 11
test_verify_firefox_aliases_redirect_to_correct_products 11
test_verify_firefox_aliases_redirect_to_correct_products 11
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 3
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 3
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 3
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 3
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 3
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 2
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 2

Slowest tests

Slowest average test durations.

test_that_search_results_return_20_results_per_page 2 minutes
test_that_user_can_make_a_contribution_without_logging_into_amo a minute
test_that_user_can_contribute_to_an_addon a minute
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results a minute
test_sorting_by_downloads a minute
test_sorting_by_most_recently_updated a minute
test_user_can_login_and_logout a minute
test_user_can_update_profile_information_in_account_settings_page a minute
test_the_name_of_each_site_navigation_menu_in_the_header 59 seconds
test_web_extension_submission 57 seconds
test_that_search_results_return_20_results_per_page a minute
test_that_user_can_make_a_contribution_without_logging_into_amo a minute
test_that_user_can_contribute_to_an_addon a minute
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results a minute
test_sorting_by_most_recently_updated a minute
test_user_can_login_and_logout a minute
test_sorting_by_downloads a minute
test_the_name_of_each_site_navigation_menu_in_the_header a minute
test_user_can_update_profile_information_in_account_settings_page a minute
test_image_viewer_navigation 56 seconds
test_that_search_results_return_20_results_per_page 2 minutes
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results a minute
test_sorting_by_downloads a minute
test_sorting_by_most_recently_updated a minute
test_the_name_of_each_site_navigation_menu_in_the_header 58 seconds
test_image_viewer_navigation 55 seconds
test_navigating_to_author_addons 40 seconds
test_sorting_by_number_of_most_users 40 seconds
test_sorting_by_newest 39 seconds
test_that_checks_if_the_extensions_are_sorted_by_recently_updated 38 seconds
test_that_user_can_create_and_delete_group 5 minutes
test_that_user_can_modify_external_accounts_irc_nickname 3 minutes
test_that_non_us_user_can_set_get_involved_date 2 minutes
test_group_description_edit 2 minutes
test_edit_profile_information a minute
test_logout_verify_bid a minute
test_new_user_cannot_see_groups_or_functional_areas a minute
test_skill_deletion a minute
test_skill_addition 53 seconds
test_group_invitations 51 seconds
test_status_results_success 3 minutes
test_get_next_results 53 seconds
test_load_next_results 49 seconds
test_status_results_coalesced 43 seconds
test_remove_email_address_filter 40 seconds
test_close_open_panels 37 seconds
test_treeherder_dropdown 36 seconds
test_filter_by_test_status 36 seconds
test_filter_by_job_keyword 36 seconds
test_expanding_group_count 35 seconds
test_private_groups_field_when_not_logged_in a minute
test_that_non_us_user_can_set_get_involved_date 25 seconds
test_login_logout 25 seconds
test_that_user_can_add_external_account 25 seconds
test_edit_profile_information 24 seconds
test_skill_deletion 24 seconds
test_group_description_edit 24 seconds
test_profile_deletion_confirmation 24 seconds
test_search_for_not_existing_mozillian_when_logged_in 24 seconds
test_that_search_returns_results_for_first_name 24 seconds
test_search_change_column a minute
test_that_lowest_version_topcrashers_do_not_return_errors 51 seconds
test_that_only_plugin_reports_have_plugin_icon 42 seconds
test_that_only_browser_reports_have_browser_icon 37 seconds
test_selecting_one_version_doesnt_show_other_versions 34 seconds
test_that_top_crashers_reports_links_work 33 seconds
test_that_top_crashers_reports_links_work 33 seconds
test_top_crasher_reports_tab_has_uuid_report 29 seconds
test_that_top_crashers_reports_links_work 28 seconds
test_search_with_multiple_lines 28 seconds
test_search_change_column a minute
test_that_lowest_version_topcrashers_do_not_return_errors 51 seconds
test_that_only_plugin_reports_have_plugin_icon 43 seconds
test_that_only_browser_reports_have_browser_icon 37 seconds
test_selecting_one_version_doesnt_show_other_versions 33 seconds
test_that_top_crashers_reports_links_work 32 seconds
test_that_top_crashers_reports_links_work 32 seconds
test_that_top_crashers_reports_links_work 31 seconds
test_public_api_navigation 31 seconds
test_top_crasher_reports_tab_has_uuid_report 28 seconds
test_new_user_cannot_see_groups_or_functional_areas a minute
test_logout_verify_bid a minute
test_profile_deletion_confirmation 41 seconds
test_that_filter_by_region_works 41 seconds
test_search_for_not_existing_mozillian_when_logged_in 38 seconds
test_that_filter_by_country_works 36 seconds
test_that_links_in_the_services_page_return_200_code 36 seconds
test_that_filter_by_city_works 35 seconds
test_that_user_can_view_external_accounts 33 seconds
test_login_logout 33 seconds
test_verify_firefox_aliases_redirect_to_correct_products a moment
test_verify_firefox_aliases_redirect_to_correct_products a moment
test_verify_firefox_aliases_redirect_to_correct_products a moment
test_verify_releng_aliases_match_what_we_expect a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment

Longest running tests

Most machine time consumed by tests over multiple executions.

test_verify_releng_aliases_match_what_we_expect 37 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 25 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 25 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 25 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 24 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 24 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 24 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 24 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 24 minutes
test_verify_locales_redirect_to_the_expected_product 24 minutes
test_that_search_results_return_20_results_per_page an hour
test_that_user_can_make_a_contribution_without_logging_into_amo an hour
test_that_user_can_contribute_to_an_addon an hour
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results an hour
test_user_can_login_and_logout an hour
test_sorting_by_downloads an hour
test_sorting_by_most_recently_updated an hour
test_user_can_update_profile_information_in_account_settings_page an hour
test_the_name_of_each_site_navigation_menu_in_the_header an hour
test_image_viewer_navigation an hour
test_that_user_can_make_a_contribution_without_logging_into_amo 2 hours
test_that_search_results_return_20_results_per_page an hour
test_that_user_can_contribute_to_an_addon an hour
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results an hour
test_image_viewer_navigation an hour
test_sorting_by_most_recently_updated an hour
test_sorting_by_downloads an hour
test_user_can_login_and_logout an hour
test_the_name_of_each_site_navigation_menu_in_the_header an hour
test_user_can_update_profile_information_in_account_settings_page an hour
test_that_search_results_return_20_results_per_page an hour
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results an hour
test_sorting_by_most_recently_updated an hour
test_sorting_by_downloads an hour
test_the_name_of_each_site_navigation_menu_in_the_header an hour
test_image_viewer_navigation an hour
test_navigating_to_author_addons 56 minutes
test_sorting_by_number_of_most_users 43 minutes
test_sorting_by_newest 43 minutes
test_click_on_other_collections 43 minutes
test_search_change_column 3 hours
test_that_lowest_version_topcrashers_do_not_return_errors 3 hours
test_that_only_plugin_reports_have_plugin_icon 2 hours
test_that_only_browser_reports_have_browser_icon 2 hours
test_that_top_crashers_reports_links_work 2 hours
test_selecting_one_version_doesnt_show_other_versions an hour
test_that_top_crashers_reports_links_work an hour
test_top_crasher_reports_tab_has_uuid_report an hour
test_search_with_multiple_lines an hour
test_search_change_facet an hour
test_that_user_can_modify_external_accounts_irc_nickname 2 hours
test_that_user_can_create_and_delete_group 2 hours
test_that_non_us_user_can_set_get_involved_date an hour
test_edit_profile_information an hour
test_group_description_edit an hour
test_logout_verify_bid an hour
test_new_user_cannot_see_groups_or_functional_areas 56 minutes
test_inviting_an_invalid_email_address 54 minutes
test_skill_deletion 53 minutes
test_skill_addition 52 minutes
test_organic_flow_param_values 10 hours
test_search_flow_param_values 8 hours
test_campaign_flow_param_values 8 hours
test_snippet_set_present 2 hours
test_snippet_set_present 2 hours
test_all_links 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_all_links 2 hours
test_all_links 2 hours
test_snippet_set_present 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_snippet_set_present 2 hours
test_all_links 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_snippet_set_present an hour
test_that_snippets_are_well_formed_xml an hour
test_all_links an hour
test_snippet_set_present an hour
test_all_links an hour
test_that_snippets_are_well_formed_xml an hour
test_status_results_success 2 hours
test_load_next_results 41 minutes
test_get_next_results 40 minutes
test_treeherder_dropdown 30 minutes
test_status_results_coalesced 29 minutes
test_filter_panel_reset_button 28 minutes
test_close_open_panels 27 minutes
test_remove_email_address_filter 27 minutes
test_filter_by_job_keyword 26 minutes
test_filter_by_job_keyword 26 minutes