Fork me on GitHub

Firefox Test Engineering Test Results

Generated on 18-Nov-2017 at 07:19:10.

A total of 4,072,424 tests ran between 23-Sep-2017 and 18-Nov-2017.

Tests with lowest pass rate

Percentage of tests that had the expected outcome.

test_web_extension_submission 0%
test_that_firebug_has_install_link 0%
test_that_user_can_make_a_contribution_without_logging_into_amo 0%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 0%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 0%
test_that_user_can_contribute_to_an_addon 0%
test_user_my_favorites_page 12%
test_that_searching_for_a_tag_returns_results 42%
test_that_various_search_terms_return_results 46%
test_that_install_button_is_clickable 46%
test_load_next_results 41%
test_filter_by_test_status 48%
test_open_single_result 53%
test_status_results_success 55%
test_filter_panel_reset_button 56%
test_expanding_group_count 56%
test_close_open_panels 60%
test_switch_repo 60%
test_filter_by_email 61%
test_remove_email_address_filter 61%
test_web_extension_submission 0%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 0%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 0%
test_that_user_can_make_a_contribution_without_logging_into_amo 0%
test_that_user_can_contribute_to_an_addon 0%
test_that_checks_if_the_extensions_are_sorted_by_recently_updated 85%
test_create_and_delete_collection 95%
test_that_searching_for_a_tag_returns_results 95%
test_that_various_search_terms_return_results 98%
test_that_items_menu_fly_out_while_hovering 98%
test_that_searching_for_a_tag_returns_results 18%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 44%
test_that_addon_number_of_total_downloads_is_correct 76%
test_that_daily_users_in_api_equals_daily_users_in_details_page 78%
test_that_reviews_in_api_equals_reviews_in_details_page 80%
test_sorting_by_downloads 91%
test_that_icon_is_correct 93%
test_that_items_menu_fly_out_while_hovering 96%
test_that_firebug_images_is_correct 96%
test_that_last_complete_themes_page_is_not_empty 96%
test_group_description_edit 71%
test_edit_profile_information 88%
test_that_user_can_modify_external_accounts_irc_nickname 88%
test_login_logout 91%
test_that_search_returns_results_for_first_name 92%
test_invite 92%
test_profile_creation 92%
test_logout_verify_bid 92%
test_that_user_can_view_external_accounts 94%
test_that_search_returns_results_for_email_substring 94%
test_organic_flow_param_values 92%
test_campaign_flow_param_values 99%
test_search_flow_param_values 99%
test_organic_flow_param_values 92%
test_campaign_flow_param_values 99%
test_search_flow_param_values 99%
test_activity_stream 84%
test_snippet_set_present 93%
test_snippet_set_present 97%
test_all_links 100%
test_snippet_set_present 100%
test_that_snippets_are_well_formed_xml 100%
test_all_links 100%
test_all_links 100%
test_that_snippets_are_well_formed_xml 100%
test_that_snippets_are_well_formed_xml 100%
test_that_search_returns_results_for_first_name 89%
test_logout_verify_bid 93%
test_login_logout 94%
test_that_user_can_view_external_accounts 96%
test_that_search_returns_results_for_email_substring 96%
test_profile_deletion_confirmation 96%
test_that_filter_by_country_works 97%
test_that_filter_by_city_works 99%
test_that_links_in_the_services_page_return_200_code 99%
test_that_links_in_the_about_page_return_200_code 99%
test_that_reports_form_has_same_product 93%
test_public_api_navigation 97%
test_that_top_crasher_filter_plugin_return_results 99%
test_top_crasher_reports_tab_has_uuid_report 99%
test_that_top_crashers_reports_links_work 99%
test_that_current_version_selected_in_top_crashers_header 100%
test_selecting_one_version_doesnt_show_other_versions 100%
test_super_search_page_is_loaded 100%
test_supersearch_fields 100%
test_that_7_days_is_selected_default_for_nightlies 100%

Tests with most failures

Tests with the highest total number of failures.

test_verify_firefox_aliases_redirect_to_correct_products 284
test_verify_firefox_aliases_redirect_to_correct_products 284
test_verify_firefox_aliases_redirect_to_correct_products 284
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 42
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 42
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 42
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 42
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 41
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 41
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 40
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 26
test_web_extension_submission 26
test_that_user_can_make_a_contribution_without_logging_into_amo 26
test_that_firebug_has_install_link 26
test_that_user_can_contribute_to_an_addon 26
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 26
test_user_my_favorites_page 23
test_that_searching_for_a_tag_returns_results 15
test_that_license_link_works 14
test_that_items_menu_fly_out_while_hovering 14
test_snippet_set_present 450
test_snippet_set_present 227
test_activity_stream 219
test_all_links 22
test_snippet_set_present 18
test_that_snippets_are_well_formed_xml 14
test_all_links 12
test_all_links 12
test_that_snippets_are_well_formed_xml 8
test_that_snippets_are_well_formed_xml 7
test_load_next_results 44
test_filter_by_test_status 39
test_open_single_result 35
test_status_results_success 34
test_expanding_group_count 33
test_filter_panel_reset_button 33
test_close_open_panels 30
test_remove_email_address_filter 29
test_filter_by_email 29
test_filter_by_job_keyword 29
test_verify_firefox_aliases_redirect_to_correct_products 15
test_verify_firefox_aliases_redirect_to_correct_products 15
test_verify_firefox_aliases_redirect_to_correct_products 15
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 7
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 7
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 7
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 7
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 7
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 6
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 6
test_that_user_can_contribute_to_an_addon 40
test_web_extension_submission 40
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 40
test_that_user_can_make_a_contribution_without_logging_into_amo 40
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 40
test_that_checks_if_the_extensions_are_sorted_by_recently_updated 6
test_that_searching_for_a_tag_returns_results 2
test_create_and_delete_collection 2
test_that_items_menu_fly_out_while_hovering 1
test_that_last_complete_themes_page_is_not_empty 1
test_that_searching_for_a_tag_returns_results 37
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 25
test_that_addon_number_of_total_downloads_is_correct 11
test_that_daily_users_in_api_equals_daily_users_in_details_page 10
test_that_reviews_in_api_equals_reviews_in_details_page 9
test_sorting_by_downloads 4
test_that_icon_is_correct 3
test_that_complete_themes_categories_are_not_extensions_categories 2
test_that_complete_themes_loads_landing_page_correctly 2
test_that_license_link_works 2
test_organic_flow_param_values 222
test_campaign_flow_param_values 39
test_search_flow_param_values 37
test_organic_flow_param_values 114
test_campaign_flow_param_values 19
test_search_flow_param_values 19
test_group_description_edit 19
test_that_user_can_modify_external_accounts_irc_nickname 8
test_edit_profile_information 8
test_login_logout 6
test_profile_creation 5
test_invite 5
test_logout_verify_bid 5
test_that_search_returns_results_for_first_name 5
test_that_user_can_view_external_accounts 4
test_creating_profile_without_checking_privacy_policy_checkbox 4

Slowest tests

Slowest average test durations.

test_that_search_results_return_20_results_per_page a minute
test_that_user_can_make_a_contribution_without_logging_into_amo a minute
test_that_user_can_contribute_to_an_addon a minute
test_image_viewer_navigation a minute
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results a minute
test_sorting_by_downloads a minute
test_sorting_by_most_recently_updated 59 seconds
test_the_name_of_each_site_navigation_menu_in_the_header 59 seconds
test_user_can_login_and_logout 59 seconds
test_user_can_update_profile_information_in_account_settings_page 56 seconds
test_that_search_results_return_20_results_per_page 2 minutes
test_that_user_can_make_a_contribution_without_logging_into_amo a minute
test_the_name_of_each_site_navigation_menu_in_the_header a minute
test_that_user_can_contribute_to_an_addon a minute
test_image_viewer_navigation a minute
test_sorting_by_most_recently_updated a minute
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results a minute
test_sorting_by_downloads a minute
test_user_can_update_profile_information_in_account_settings_page a minute
test_click_on_other_collections a minute
test_that_search_results_return_20_results_per_page 2 minutes
test_click_on_other_collections a minute
test_that_rating_in_api_equals_rating_in_details_page a minute
test_the_name_of_each_site_navigation_menu_in_the_header a minute
test_sorting_by_downloads a minute
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results a minute
test_sorting_by_most_recently_updated a minute
test_image_viewer_navigation a minute
test_that_review_usernames_are_clickable 52 seconds
test_that_checks_if_the_extensions_are_sorted_by_newest 46 seconds
test_that_user_can_modify_external_accounts_irc_nickname 3 minutes
test_that_non_us_user_can_set_get_involved_date 2 minutes
test_edit_profile_information 2 minutes
test_group_description_edit a minute
test_logout_verify_bid a minute
test_skill_deletion a minute
test_skill_addition a minute
test_that_search_returns_results_for_email_substring a minute
test_new_user_cannot_see_groups_or_functional_areas a minute
test_invite a minute
test_status_results_success 2 minutes
test_load_next_results a minute
test_filter_jobs a minute
test_get_next_results a minute
test_filter_by_test_status a minute
test_remove_email_address_filter a minute
test_filter_by_job_keyword a minute
test_filter_by_job_keyword a minute
test_filter_by_email a minute
test_set_as_top_of_range 58 seconds
test_search_change_column a minute
test_that_lowest_version_topcrashers_do_not_return_errors 57 seconds
test_that_only_plugin_reports_have_plugin_icon 50 seconds
test_that_only_browser_reports_have_browser_icon 45 seconds
test_that_top_crashers_reports_links_work 38 seconds
test_that_top_crashers_reports_links_work 38 seconds
test_that_top_crashers_reports_links_work 37 seconds
test_selecting_one_version_doesnt_show_other_versions 37 seconds
test_that_top_crashers_reports_links_work 36 seconds
test_top_crasher_reports_tab_has_uuid_report 32 seconds
test_search_change_column a minute
test_that_lowest_version_topcrashers_do_not_return_errors 58 seconds
test_that_only_plugin_reports_have_plugin_icon 48 seconds
test_that_only_browser_reports_have_browser_icon 43 seconds
test_selecting_one_version_doesnt_show_other_versions 37 seconds
test_that_top_crashers_reports_links_work 36 seconds
test_that_top_crashers_reports_links_work 34 seconds
test_that_top_crashers_reports_links_work 33 seconds
test_that_top_crashers_reports_links_work 32 seconds
test_search_with_multiple_lines 31 seconds
test_logout_verify_bid a minute
test_new_user_cannot_see_groups_or_functional_areas a minute
test_profile_deletion_confirmation 43 seconds
test_search_for_not_existing_mozillian_when_logged_in 40 seconds
test_that_filter_by_country_works 39 seconds
test_that_user_can_view_external_accounts 38 seconds
test_login_logout 38 seconds
test_that_filter_by_city_works 37 seconds
test_that_filter_by_region_works 36 seconds
test_private_groups_field_as_public_when_logged_in 36 seconds
test_verify_releng_aliases_match_what_we_expect a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_firefox_aliases_redirect_to_correct_products a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_firefox_aliases_redirect_to_correct_products a moment
test_verify_firefox_aliases_redirect_to_correct_products a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_releng_aliases_match_what_we_expect a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_firefox_aliases_redirect_to_correct_products a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment

Longest running tests

Most machine time consumed by tests over multiple executions.

test_verify_releng_aliases_match_what_we_expect 36 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 23 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 23 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 23 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 23 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 23 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 23 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 23 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 23 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 22 minutes
test_that_search_results_return_20_results_per_page an hour
test_that_user_can_make_a_contribution_without_logging_into_amo 55 minutes
test_the_name_of_each_site_navigation_menu_in_the_header 43 minutes
test_that_user_can_contribute_to_an_addon 43 minutes
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results 42 minutes
test_sorting_by_downloads 42 minutes
test_sorting_by_most_recently_updated 41 minutes
test_user_can_update_profile_information_in_account_settings_page 40 minutes
test_click_on_other_collections 39 minutes
test_image_viewer_navigation 39 minutes
test_that_search_results_return_20_results_per_page an hour
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results 46 minutes
test_the_name_of_each_site_navigation_menu_in_the_header 46 minutes
test_sorting_by_downloads 45 minutes
test_sorting_by_most_recently_updated 45 minutes
test_image_viewer_navigation 41 minutes
test_click_on_other_collections 37 minutes
test_that_review_usernames_are_clickable 33 minutes
test_view_the_source_in_the_version_information 33 minutes
test_that_checks_if_the_extensions_are_sorted_by_newest 29 minutes
test_that_user_can_modify_external_accounts_irc_nickname 3 hours
test_that_non_us_user_can_set_get_involved_date 2 hours
test_edit_profile_information 2 hours
test_group_description_edit 2 hours
test_logout_verify_bid an hour
test_skill_deletion an hour
test_new_user_cannot_see_groups_or_functional_areas an hour
test_skill_addition an hour
test_that_user_can_create_and_delete_group an hour
test_creating_profile_without_checking_privacy_policy_checkbox an hour
test_that_search_results_return_20_results_per_page 29 minutes
test_that_user_can_contribute_to_an_addon 28 minutes
test_that_user_can_make_a_contribution_without_logging_into_amo 27 minutes
test_that_checks_featured_extensions_header 24 minutes
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results 19 minutes
test_user_can_update_profile_information_in_account_settings_page 19 minutes
test_user_can_login_and_logout 18 minutes
test_sorting_by_downloads 18 minutes
test_image_viewer_navigation 18 minutes
test_sorting_by_most_recently_updated 18 minutes
test_organic_flow_param_values 9 hours
test_search_flow_param_values 8 hours
test_campaign_flow_param_values 8 hours
test_status_results_success an hour
test_load_next_results an hour
test_filter_by_test_status an hour
test_remove_email_address_filter 58 minutes
test_filter_jobs 51 minutes
test_filter_by_job_keyword 50 minutes
test_filter_by_email 49 minutes
test_set_as_top_of_range 48 minutes
test_filter_panel_reset_button 48 minutes
test_treeherder_dropdown 46 minutes
test_that_snippets_are_well_formed_xml 2 hours
test_snippet_set_present 2 hours
test_all_links 2 hours
test_all_links 2 hours
test_snippet_set_present 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_all_links 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_snippet_set_present 2 hours
test_activity_stream 18 minutes
test_snippet_set_present 2 hours
test_snippet_set_present an hour
test_all_links an hour
test_all_links an hour
test_all_links an hour
test_snippet_set_present an hour
test_that_snippets_are_well_formed_xml an hour
test_that_snippets_are_well_formed_xml an hour
test_that_snippets_are_well_formed_xml an hour
test_response_codes 23 minutes
test_search_change_column an hour
test_that_lowest_version_topcrashers_do_not_return_errors an hour
test_that_only_plugin_reports_have_plugin_icon 52 minutes
test_that_only_browser_reports_have_browser_icon 48 minutes
test_selecting_one_version_doesnt_show_other_versions 40 minutes
test_that_top_crashers_reports_links_work 37 minutes
test_that_top_crashers_reports_links_work 37 minutes
test_that_top_crashers_reports_links_work 36 minutes
test_top_crasher_reports_tab_has_uuid_report 34 minutes
test_search_with_multiple_lines 33 minutes