Fork me on GitHub

Firefox Test Engineering Test Results

Generated on 22-Oct-2017 at 18:19:11.

A total of 4,005,842 tests ran between 27-Aug-2017 and 21-Oct-2017.

Tests with lowest pass rate

Percentage of tests that had the expected outcome.

test_load_next_results 0%
test_expanding_group_count 7%
test_filter_by_test_status 12%
test_open_single_result 27%
test_switch_repo 34%
test_remove_email_address_filter 36%
test_filter_by_email 39%
test_close_open_panels 57%
test_filter_panel_reset_button 59%
test_status_results_success 61%
test_web_extension_submission 0%
test_that_user_can_make_a_contribution_without_logging_into_amo 0%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 0%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 0%
test_that_user_can_contribute_to_an_addon 0%
test_that_firebug_has_install_link 2%
test_could_install_jetpack 25%
test_user_my_favorites_page 34%
test_the_development_channel_section 59%
test_that_searching_for_a_tag_returns_results 71%
test_organic_flow_param_values 78%
test_campaign_flow_param_values 100%
test_search_flow_param_values 100%
test_organic_flow_param_values 82%
test_campaign_flow_param_values 100%
test_search_flow_param_values 100%
test_web_extension_submission 0%
test_that_user_can_make_a_contribution_without_logging_into_amo 0%
test_that_user_can_contribute_to_an_addon 0%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 10%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 12%
test_that_install_button_is_clickable 47%
test_that_version_information_is_displayed 47%
test_the_development_channel_section 82%
test_that_searching_for_a_tag_returns_results 97%
test_that_new_review_is_saved 98%
test_group_description_edit 73%
test_invite 76%
test_that_search_returns_results_for_first_name 90%
test_that_user_can_modify_external_accounts_irc_nickname 93%
test_login_logout 94%
test_profile_creation 96%
test_creating_profile_without_checking_privacy_policy_checkbox 96%
test_skill_addition 96%
test_skill_deletion 96%
test_profile_deletion_confirmation 97%
test_create_new_account 96%
test_new_account_pw_does_not_contain_numbers 96%
test_default_environment_should_be_dev 96%
test_user_can_sign_in 96%
test_del 97%
test_create_new_account 100%
test_new_account_pw_does_not_contain_numbers 100%
test_webdriver_fxa_popup_without_logo_displayed 100%
test_webdriver_fxa_popup_without_logo_present 100%
test_webdriver_with_fxa_popup 100%
test_that_search_returns_results_for_first_name 83%
test_that_filter_by_region_works 95%
test_profile_deletion_confirmation 97%
test_that_filter_by_country_works 97%
test_logout_verify_bid 97%
test_login_logout 97%
test_search_for_not_existing_mozillian_when_logged_in 97%
test_that_user_can_view_external_accounts 97%
test_that_search_returns_results_for_irc_nickname 97%
test_that_links_in_the_services_page_return_200_code 97%
test_that_searching_for_a_tag_returns_results 18%
test_the_development_channel_section 82%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 85%
test_sorting_by_downloads 92%
test_that_daily_users_in_api_equals_daily_users_in_details_page 93%
test_that_addon_number_of_total_downloads_is_correct 95%
test_that_reviews_in_api_equals_reviews_in_details_page 96%
test_that_complete_themes_can_be_sorted_by_popularity 97%
test_website_link 99%
test_that_clicking_top_rated_shows_addons_sorted_by_rating 99%
test_that_reports_form_has_same_product 90%
test_public_api_navigation 94%
test_that_top_crasher_filter_plugin_return_results 99%
test_top_crasher_reports_tab_has_uuid_report 99%
test_that_top_crashers_reports_links_work 99%
test_that_current_version_selected_in_top_crashers_header 100%
test_selecting_one_version_doesnt_show_other_versions 100%
test_super_search_page_is_loaded 100%
test_supersearch_fields 100%
test_that_7_days_is_selected_default_for_nightlies 100%

Tests with most failures

Tests with the highest total number of failures.

test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 59
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 59
test_that_user_can_make_a_contribution_without_logging_into_amo 59
test_web_extension_submission 59
test_that_user_can_contribute_to_an_addon 59
test_that_firebug_has_install_link 58
test_could_install_jetpack 44
test_user_my_favorites_page 39
test_the_development_channel_section 24
test_that_searching_for_a_tag_returns_results 17
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 46
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 45
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 44
test_verify_firefox_aliases_redirect_to_correct_products 43
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 43
test_verify_firefox_aliases_redirect_to_correct_products 43
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 43
test_verify_firefox_aliases_redirect_to_correct_products 43
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 42
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 42
test_load_next_results 56
test_expanding_group_count 52
test_filter_by_test_status 49
test_open_single_result 41
test_switch_repo 37
test_remove_email_address_filter 36
test_filter_by_email 34
test_close_open_panels 24
test_filter_panel_reset_button 23
test_status_results_success 22
test_organic_flow_param_values 487
test_campaign_flow_param_values 3
test_search_flow_param_values 2
test_web_extension_submission 60
test_that_user_can_make_a_contribution_without_logging_into_amo 60
test_that_user_can_contribute_to_an_addon 60
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 54
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 53
test_that_install_button_is_clickable 32
test_that_version_information_is_displayed 32
test_the_development_channel_section 11
test_that_searching_for_a_tag_returns_results 2
test_header_site_navigation_menus_are_correct 1
test_organic_flow_param_values 294
test_campaign_flow_param_values 3
test_search_flow_param_values 1
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 6
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 6
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 6
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 6
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 5
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 5
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 5
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 5
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 5
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 5
test_snippet_set_present 38
test_snippet_set_present 37
test_snippet_set_present 36
test_that_snippets_are_well_formed_xml 19
test_that_snippets_are_well_formed_xml 18
test_that_snippets_are_well_formed_xml 16
test_all_links 2
test_all_links 2
test_all_links 1
test_all_links 30
test_snippet_set_present 24
test_that_snippets_are_well_formed_xml 24
test_that_snippets_are_well_formed_xml 18
test_all_links 16
test_all_links 15
test_that_snippets_are_well_formed_xml 15
test_snippet_set_present 14
test_snippet_set_present 10
test_that_searching_for_a_tag_returns_results 61
test_the_development_channel_section 13
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 11
test_sorting_by_downloads 6
test_that_daily_users_in_api_equals_daily_users_in_details_page 5
test_that_addon_number_of_total_downloads_is_correct 4
test_that_reviews_in_api_equals_reviews_in_details_page 3
test_that_complete_themes_can_be_sorted_by_popularity 2
test_that_clicking_top_rated_shows_addons_sorted_by_rating 1
test_website_link 1

Slowest tests

Slowest average test durations.

test_that_search_results_return_20_results_per_page a minute
test_that_user_can_make_a_contribution_without_logging_into_amo a minute
test_that_user_can_contribute_to_an_addon a minute
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results a minute
test_sorting_by_most_recently_updated a minute
test_user_can_login_and_logout a minute
test_sorting_by_downloads a minute
test_user_can_update_profile_information_in_account_settings_page a minute
test_image_viewer_navigation a minute
test_the_name_of_each_site_navigation_menu_in_the_header a minute
test_that_search_results_return_20_results_per_page 2 minutes
test_that_user_can_make_a_contribution_without_logging_into_amo a minute
test_that_user_can_contribute_to_an_addon a minute
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results a minute
test_sorting_by_downloads a minute
test_sorting_by_most_recently_updated a minute
test_user_can_update_profile_information_in_account_settings_page a minute
test_the_name_of_each_site_navigation_menu_in_the_header a minute
test_user_can_login_and_logout a minute
test_image_viewer_navigation 58 seconds
test_that_search_results_return_20_results_per_page 2 minutes
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results a minute
test_sorting_by_downloads a minute
test_the_name_of_each_site_navigation_menu_in_the_header a minute
test_image_viewer_navigation a minute
test_sorting_by_most_recently_updated a minute
test_navigating_to_author_addons 43 seconds
test_that_checks_if_the_extensions_are_sorted_by_recently_updated 43 seconds
test_sorting_by_number_of_most_users 43 seconds
test_sorting_by_newest 42 seconds
test_that_user_can_modify_external_accounts_irc_nickname 3 minutes
test_that_non_us_user_can_set_get_involved_date 2 minutes
test_edit_profile_information 2 minutes
test_group_description_edit a minute
test_logout_verify_bid a minute
test_skill_deletion a minute
test_new_user_cannot_see_groups_or_functional_areas a minute
test_skill_addition a minute
test_that_user_can_create_and_delete_group 58 seconds
test_invite 56 seconds
test_status_results_success 2 minutes
test_get_next_results a minute
test_filter_by_job_keyword 52 seconds
test_filter_by_test_status 51 seconds
test_load_next_results 50 seconds
test_remove_email_address_filter 49 seconds
test_filter_by_job_keyword 47 seconds
test_treeherder_dropdown 46 seconds
test_close_open_panels 44 seconds
test_status_results_superseded 43 seconds
test_search_change_column a minute
test_that_lowest_version_topcrashers_do_not_return_errors 54 seconds
test_that_only_plugin_reports_have_plugin_icon 46 seconds
test_that_only_browser_reports_have_browser_icon 43 seconds
test_selecting_one_version_doesnt_show_other_versions 38 seconds
test_that_top_crashers_reports_links_work 36 seconds
test_that_top_crashers_reports_links_work 36 seconds
test_that_top_crashers_reports_links_work 34 seconds
test_that_top_crashers_reports_links_work 33 seconds
test_top_crasher_reports_tab_has_uuid_report 32 seconds
test_search_change_column a minute
test_that_lowest_version_topcrashers_do_not_return_errors 59 seconds
test_that_only_plugin_reports_have_plugin_icon 48 seconds
test_that_only_browser_reports_have_browser_icon 42 seconds
test_selecting_one_version_doesnt_show_other_versions 39 seconds
test_that_top_crashers_reports_links_work 35 seconds
test_that_top_crashers_reports_links_work 34 seconds
test_search_with_multiple_lines 33 seconds
test_top_crasher_reports_tab_has_uuid_report 32 seconds
test_that_top_crashers_reports_links_work 32 seconds
test_logout_verify_bid a minute
test_new_user_cannot_see_groups_or_functional_areas a minute
test_search_for_not_existing_mozillian_when_logged_in 43 seconds
test_that_filter_by_region_works 40 seconds
test_profile_deletion_confirmation 39 seconds
test_that_filter_by_city_works 37 seconds
test_that_filter_by_country_works 37 seconds
test_that_user_can_view_external_accounts 37 seconds
test_that_links_in_the_services_page_return_200_code 36 seconds
test_that_search_returns_results_for_irc_nickname 35 seconds
test_verify_releng_aliases_match_what_we_expect a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_del 28 seconds
test_user_can_sign_in 28 seconds
test_default_environment_should_be_dev 8 seconds
test_create_new_account 7 seconds
test_new_account_pw_does_not_contain_numbers 6 seconds
test_create_new_account 4 seconds
test_new_account_pw_does_not_contain_numbers 3 seconds
test_webdriver_with_fxa_popup a moment
test_webdriver_fxa_popup_without_logo_present a moment
test_webdriver_fxa_popup_without_logo_displayed a moment

Longest running tests

Most machine time consumed by tests over multiple executions.

test_verify_releng_aliases_match_what_we_expect 36 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 26 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 26 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 26 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 26 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 25 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 25 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 25 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 25 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 25 minutes
test_that_search_results_return_20_results_per_page an hour
test_that_user_can_make_a_contribution_without_logging_into_amo an hour
test_that_user_can_contribute_to_an_addon an hour
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results 53 minutes
test_user_can_login_and_logout 52 minutes
test_sorting_by_downloads 52 minutes
test_user_can_update_profile_information_in_account_settings_page 51 minutes
test_sorting_by_most_recently_updated 51 minutes
test_the_name_of_each_site_navigation_menu_in_the_header 49 minutes
test_image_viewer_navigation 48 minutes
test_that_search_results_return_20_results_per_page 2 hours
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results an hour
test_sorting_by_most_recently_updated an hour
test_the_name_of_each_site_navigation_menu_in_the_header an hour
test_sorting_by_downloads an hour
test_image_viewer_navigation an hour
test_that_review_usernames_are_clickable 54 minutes
test_click_on_other_collections 50 minutes
test_navigating_to_author_addons 49 minutes
test_sorting_by_number_of_most_users 49 minutes
test_that_search_results_return_20_results_per_page 2 hours
test_that_user_can_make_a_contribution_without_logging_into_amo an hour
test_that_user_can_contribute_to_an_addon an hour
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results an hour
test_sorting_by_downloads an hour
test_sorting_by_most_recently_updated an hour
test_the_name_of_each_site_navigation_menu_in_the_header 58 minutes
test_user_can_login_and_logout 58 minutes
test_user_can_update_profile_information_in_account_settings_page 57 minutes
test_image_viewer_navigation 55 minutes
test_that_user_can_modify_external_accounts_irc_nickname 3 hours
test_that_non_us_user_can_set_get_involved_date 2 hours
test_edit_profile_information 2 hours
test_group_description_edit 2 hours
test_logout_verify_bid an hour
test_new_user_cannot_see_groups_or_functional_areas an hour
test_skill_deletion an hour
test_skill_addition an hour
test_that_user_can_create_and_delete_group an hour
test_group_deletion_confirmation an hour
test_organic_flow_param_values 8 hours
test_campaign_flow_param_values 7 hours
test_search_flow_param_values 7 hours
test_that_snippets_are_well_formed_xml 2 hours
test_snippet_set_present 2 hours
test_all_links 2 hours
test_all_links 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_snippet_set_present 2 hours
test_all_links 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_snippet_set_present 2 hours
test_snippet_set_present 2 hours
test_snippet_set_present 2 hours
test_all_links 2 hours
test_all_links 2 hours
test_snippet_set_present 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_all_links 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_status_results_success an hour
test_get_next_results 48 minutes
test_filter_by_test_status 40 minutes
test_load_next_results 40 minutes
test_remove_email_address_filter 35 minutes
test_treeherder_dropdown 35 minutes
test_filter_by_job_keyword 34 minutes
test_filter_by_job_keyword 33 minutes
test_set_as_top_of_range 32 minutes
test_filter_by_email 31 minutes
test_search_change_column an hour
test_that_lowest_version_topcrashers_do_not_return_errors 59 minutes
test_that_only_plugin_reports_have_plugin_icon 50 minutes
test_that_only_browser_reports_have_browser_icon 48 minutes
test_selecting_one_version_doesnt_show_other_versions 41 minutes
test_that_top_crashers_reports_links_work 36 minutes
test_that_top_crashers_reports_links_work 36 minutes
test_that_top_crashers_reports_links_work 36 minutes
test_top_crasher_reports_tab_has_uuid_report 33 minutes
test_search_with_multiple_lines 32 minutes