Fork me on GitHub

Firefox Test Engineering Test Results

Generated on 23-Sep-2017 at 07:19:11.

A total of 4,044,427 tests ran between 29-Jul-2017 and 22-Sep-2017.

Tests with lowest pass rate

Percentage of tests that had the expected outcome.

test_load_next_results 0%
test_filter_by_test_status 0%
test_expanding_group_count 0%
test_open_single_result 19%
test_switch_repo 22%
test_remove_email_address_filter 29%
test_filter_by_email 40%
test_filter_by_job_keyword 57%
test_open_unclassified_failure_log 57%
test_filter_jobs 59%
test_that_search_returns_results_for_first_name 48%
test_that_search_returns_results_for_irc_nickname 52%
test_group_description_edit 64%
test_invite 76%
test_that_user_can_create_and_delete_group 79%
test_login_logout 88%
test_that_user_can_modify_external_accounts_irc_nickname 89%
test_that_search_returns_results_for_email_substring 90%
test_search_for_not_existing_mozillian_when_logged_in 91%
test_profile_deletion_confirmation 91%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 0%
test_web_extension_submission 0%
test_that_user_can_make_a_contribution_without_logging_into_amo 0%
test_that_user_can_contribute_to_an_addon 0%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 0%
test_that_firebug_has_install_link 8%
test_could_install_jetpack 20%
test_the_development_channel_section 29%
test_user_my_favorites_page 30%
test_that_searching_for_a_tag_returns_results 76%
test_organic_flow_param_values 85%
test_campaign_flow_param_values 99%
test_search_flow_param_values 100%
test_web_extension_submission 0%
test_that_user_can_make_a_contribution_without_logging_into_amo 0%
test_that_user_can_contribute_to_an_addon 0%
test_that_install_button_is_clickable 19%
test_that_version_information_is_displayed 19%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 27%
test_the_development_channel_section 29%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 41%
test_that_searching_for_a_tag_returns_results 76%
test_that_checks_if_the_extensions_are_sorted_by_newest 92%
test_new_user_cannot_see_groups_or_functional_areas 63%
test_that_search_returns_results_for_first_name 75%
test_search_for_not_existing_mozillian_when_logged_in 84%
test_that_filter_by_region_works 89%
test_profile_deletion_confirmation 91%
test_that_filter_by_city_works 92%
test_login_logout 92%
test_logout_verify_bid 92%
test_that_user_can_view_external_accounts 93%
test_that_search_returns_results_for_irc_nickname 93%
test_organic_flow_param_values 89%
test_campaign_flow_param_values 100%
test_search_flow_param_values 100%
test_that_7_days_is_selected_default_for_nightlies 90%
test_selecting_one_version_doesnt_show_other_versions 90%
test_search_with_multiple_lines 91%
test_that_reports_form_has_same_product 91%
test_public_api_navigation 94%
test_search_for_valid_signature 94%
test_that_reports_form_has_same_product 97%
test_that_reports_form_has_same_product 97%
test_that_only_plugin_reports_have_plugin_icon 97%
test_that_top_crasher_filter_browser_return_results 99%
test_create_new_account 97%
test_new_account_pw_does_not_contain_numbers 97%
test_default_environment_should_be_dev 97%
test_user_can_sign_in 97%
test_del 98%
test_create_new_account 100%
test_new_account_pw_does_not_contain_numbers 100%
test_webdriver_fxa_popup_without_logo_displayed 100%
test_webdriver_fxa_popup_without_logo_present 100%
test_webdriver_with_fxa_popup 100%
test_that_searching_for_a_tag_returns_results 29%
test_the_development_channel_section 36%
test_sorting_by_downloads 90%
test_that_daily_users_in_api_equals_daily_users_in_details_page 95%
test_that_addon_number_of_total_downloads_is_correct 97%
test_that_complete_themes_can_be_sorted_by_popularity 97%
test_sorting_by_number_of_most_users 98%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 98%
test_that_reviews_in_api_equals_reviews_in_details_page 99%
test_searching_for_themes 99%

Tests with most failures

Tests with the highest total number of failures.

test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 79
test_web_extension_submission 79
test_that_user_can_make_a_contribution_without_logging_into_amo 79
test_that_user_can_contribute_to_an_addon 79
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 79
test_that_firebug_has_install_link 73
test_could_install_jetpack 63
test_the_development_channel_section 56
test_user_my_favorites_page 55
test_that_searching_for_a_tag_returns_results 19
test_load_next_results 58
test_filter_by_test_status 58
test_expanding_group_count 58
test_open_single_result 47
test_switch_repo 45
test_remove_email_address_filter 41
test_filter_by_email 35
test_filter_by_job_keyword 25
test_open_unclassified_failure_log 25
test_filter_jobs 24
test_verify_firefox_aliases_redirect_to_correct_products 43
test_verify_firefox_aliases_redirect_to_correct_products 43
test_verify_firefox_aliases_redirect_to_correct_products 43
test_verify_firefox_aliases_redirect_to_correct_products 17
test_verify_firefox_aliases_redirect_to_correct_products 17
test_verify_firefox_aliases_redirect_to_correct_products 17
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 8
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 8
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 8
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 7
test_web_extension_submission 75
test_that_user_can_make_a_contribution_without_logging_into_amo 75
test_that_user_can_contribute_to_an_addon 75
test_that_version_information_is_displayed 61
test_that_install_button_is_clickable 61
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 55
test_the_development_channel_section 53
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 44
test_that_searching_for_a_tag_returns_results 18
test_that_checks_if_the_extensions_are_sorted_by_newest 6
test_organic_flow_param_values 299
test_campaign_flow_param_values 5
test_search_flow_param_values 4
test_that_search_returns_results_for_first_name 42
test_that_search_returns_results_for_irc_nickname 38
test_group_description_edit 29
test_invite 19
test_that_user_can_create_and_delete_group 17
test_login_logout 10
test_that_user_can_modify_external_accounts_irc_nickname 9
test_that_search_returns_results_for_email_substring 8
test_skill_addition 7
test_profile_deletion_confirmation 7
test_organic_flow_param_values 200
test_campaign_flow_param_values 8
test_search_flow_param_values 4
test_snippet_set_present 35
test_snippet_set_present 35
test_snippet_set_present 35
test_that_snippets_are_well_formed_xml 17
test_that_snippets_are_well_formed_xml 17
test_that_snippets_are_well_formed_xml 16
test_all_links 2
test_all_links 1
test_all_links 1
test_new_user_cannot_see_groups_or_functional_areas 34
test_that_search_returns_results_for_first_name 23
test_search_for_not_existing_mozillian_when_logged_in 15
test_that_filter_by_region_works 10
test_profile_deletion_confirmation 8
test_logout_verify_bid 7
test_login_logout 7
test_that_filter_by_city_works 7
test_that_search_returns_results_for_irc_nickname 6
test_that_search_returns_results_for_email_substring 6
test_that_searching_for_a_tag_returns_results 61
test_the_development_channel_section 55
test_sorting_by_downloads 9
test_that_daily_users_in_api_equals_daily_users_in_details_page 4
test_that_complete_themes_can_be_sorted_by_popularity 3
test_that_addon_number_of_total_downloads_is_correct 3
test_sorting_by_number_of_most_users 2
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 2
test_website_link 1
test_that_checks_content_in_json_endpoints_from_statistics_urls 1

Slowest tests

Slowest average test durations.

test_that_search_results_return_20_results_per_page 2 minutes
test_that_user_can_make_a_contribution_without_logging_into_amo a minute
test_that_user_can_contribute_to_an_addon a minute
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results a minute
test_sorting_by_downloads a minute
test_sorting_by_most_recently_updated a minute
test_user_can_login_and_logout a minute
test_the_name_of_each_site_navigation_menu_in_the_header a minute
test_user_can_update_profile_information_in_account_settings_page a minute
test_image_viewer_navigation 59 seconds
test_that_search_results_return_20_results_per_page a minute
test_that_user_can_make_a_contribution_without_logging_into_amo a minute
test_that_user_can_contribute_to_an_addon a minute
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results a minute
test_sorting_by_most_recently_updated a minute
test_sorting_by_downloads a minute
test_user_can_login_and_logout a minute
test_the_name_of_each_site_navigation_menu_in_the_header a minute
test_user_can_update_profile_information_in_account_settings_page a minute
test_image_viewer_navigation 58 seconds
test_that_search_results_return_20_results_per_page 2 minutes
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results a minute
test_sorting_by_most_recently_updated a minute
test_sorting_by_downloads a minute
test_the_name_of_each_site_navigation_menu_in_the_header a minute
test_image_viewer_navigation 59 seconds
test_navigating_to_author_addons 43 seconds
test_that_checks_if_the_extensions_are_sorted_by_recently_updated 42 seconds
test_sorting_by_number_of_most_users 41 seconds
test_sorting_by_newest 41 seconds
test_that_user_can_create_and_delete_group 11 minutes
test_that_user_can_modify_external_accounts_irc_nickname 3 minutes
test_that_non_us_user_can_set_get_involved_date 2 minutes
test_group_description_edit 2 minutes
test_edit_profile_information a minute
test_logout_verify_bid a minute
test_new_user_cannot_see_groups_or_functional_areas a minute
test_skill_deletion a minute
test_skill_addition a minute
test_invite 55 seconds
test_status_results_success 2 minutes
test_get_next_results 59 seconds
test_load_next_results 47 seconds
test_filter_by_test_status 45 seconds
test_remove_email_address_filter 44 seconds
test_treeherder_dropdown 42 seconds
test_expanding_group_count 38 seconds
test_filter_by_job_keyword 38 seconds
test_filter_by_job_keyword 38 seconds
test_switch_repo 37 seconds
test_search_change_column a minute
test_that_lowest_version_topcrashers_do_not_return_errors a minute
test_that_only_plugin_reports_have_plugin_icon 49 seconds
test_that_only_browser_reports_have_browser_icon 43 seconds
test_selecting_one_version_doesnt_show_other_versions 40 seconds
test_that_top_crashers_reports_links_work 37 seconds
test_that_top_crashers_reports_links_work 35 seconds
test_search_with_multiple_lines 33 seconds
test_top_crasher_reports_tab_has_uuid_report 33 seconds
test_that_top_crashers_reports_links_work 33 seconds
test_search_change_column a minute
test_that_lowest_version_topcrashers_do_not_return_errors 50 seconds
test_that_only_plugin_reports_have_plugin_icon 44 seconds
test_that_only_browser_reports_have_browser_icon 41 seconds
test_selecting_one_version_doesnt_show_other_versions 36 seconds
test_that_top_crashers_reports_links_work 33 seconds
test_that_top_crashers_reports_links_work 32 seconds
test_that_top_crashers_reports_links_work 32 seconds
test_top_crasher_reports_tab_has_uuid_report 29 seconds
test_search_change_facet 29 seconds
test_new_user_cannot_see_groups_or_functional_areas a minute
test_logout_verify_bid a minute
test_that_filter_by_region_works 44 seconds
test_search_for_not_existing_mozillian_when_logged_in 43 seconds
test_profile_deletion_confirmation 40 seconds
test_that_filter_by_city_works 38 seconds
test_that_filter_by_country_works 37 seconds
test_that_user_can_view_external_accounts 37 seconds
test_that_links_in_the_services_page_return_200_code 37 seconds
test_that_search_returns_results_for_irc_nickname 36 seconds
test_verify_releng_aliases_match_what_we_expect a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_ie6_winxp_useragent_5_1_redirects_to_correct_version a moment
test_del 29 seconds
test_user_can_sign_in 28 seconds
test_create_new_account 7 seconds
test_default_environment_should_be_dev 7 seconds
test_new_account_pw_does_not_contain_numbers 6 seconds
test_create_new_account 4 seconds
test_new_account_pw_does_not_contain_numbers 3 seconds
test_webdriver_with_fxa_popup a moment
test_webdriver_fxa_popup_without_logo_present a moment
test_webdriver_fxa_popup_without_logo_displayed a moment

Longest running tests

Most machine time consumed by tests over multiple executions.

test_verify_releng_aliases_match_what_we_expect 36 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 28 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 28 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 28 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 28 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 27 minutes
test_that_search_results_return_20_results_per_page 2 hours
test_that_user_can_make_a_contribution_without_logging_into_amo an hour
test_that_user_can_contribute_to_an_addon an hour
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results an hour
test_sorting_by_downloads an hour
test_sorting_by_most_recently_updated an hour
test_user_can_login_and_logout an hour
test_user_can_update_profile_information_in_account_settings_page an hour
test_the_name_of_each_site_navigation_menu_in_the_header an hour
test_image_viewer_navigation an hour
test_that_search_results_return_20_results_per_page 2 hours
test_that_user_can_make_a_contribution_without_logging_into_amo 2 hours
test_that_user_can_contribute_to_an_addon an hour
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results an hour
test_image_viewer_navigation an hour
test_sorting_by_downloads an hour
test_sorting_by_most_recently_updated an hour
test_the_name_of_each_site_navigation_menu_in_the_header an hour
test_user_can_login_and_logout an hour
test_user_can_update_profile_information_in_account_settings_page an hour
test_that_search_results_return_20_results_per_page 2 hours
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results an hour
test_sorting_by_most_recently_updated an hour
test_the_name_of_each_site_navigation_menu_in_the_header an hour
test_sorting_by_downloads an hour
test_image_viewer_navigation an hour
test_click_on_other_collections an hour
test_navigating_to_author_addons an hour
test_that_review_usernames_are_clickable 59 minutes
test_that_checks_if_the_extensions_are_sorted_by_recently_updated 55 minutes
test_that_user_can_modify_external_accounts_irc_nickname 4 hours
test_that_user_can_create_and_delete_group 3 hours
test_that_non_us_user_can_set_get_involved_date 2 hours
test_group_description_edit 2 hours
test_edit_profile_information 2 hours
test_logout_verify_bid 2 hours
test_new_user_cannot_see_groups_or_functional_areas an hour
test_skill_deletion an hour
test_skill_addition an hour
test_group_deletion_confirmation an hour
test_organic_flow_param_values 9 hours
test_campaign_flow_param_values 7 hours
test_search_flow_param_values 7 hours
test_all_links 2 hours
test_snippet_set_present 2 hours
test_snippet_set_present 2 hours
test_all_links 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_all_links 2 hours
test_snippet_set_present 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_all_links 2 hours
test_snippet_set_present 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_all_links 2 hours
test_snippet_set_present 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_all_links 2 hours
test_that_snippets_are_well_formed_xml 2 hours
test_snippet_set_present 2 hours
test_logout_verify_bid 2 hours
test_new_user_cannot_see_groups_or_functional_areas 2 hours
test_that_filter_by_region_works an hour
test_profile_deletion_confirmation an hour
test_that_user_can_view_external_accounts 59 minutes
test_that_search_returns_results_for_irc_nickname 58 minutes
test_search_for_not_existing_mozillian_when_logged_in 57 minutes
test_that_filter_by_city_works 54 minutes
test_that_search_returns_results_for_first_name 53 minutes
test_that_links_in_the_services_page_return_200_code 52 minutes
test_status_results_success an hour
test_get_next_results 44 minutes
test_load_next_results 39 minutes
test_treeherder_dropdown 33 minutes
test_remove_email_address_filter 31 minutes
test_filter_by_test_status 30 minutes
test_filter_panel_reset_button 30 minutes
test_filter_by_job_keyword 29 minutes
test_set_as_top_of_range 29 minutes
test_expanding_group_count 29 minutes