Fork me on GitHub

Firefox Test Engineering Test Results

Generated on 11-Dec-2017 at 01:19:09.

A total of 2,561,891 tests ran between 16-Oct-2017 and 29-Nov-2017.

Tests with lowest pass rate

Percentage of tests that had the expected outcome.

test_that_various_search_terms_return_results 0%
test_that_icon_is_correct 0%
test_that_install_button_is_clickable 0%
test_that_items_menu_fly_out_while_hovering 0%
test_that_last_complete_themes_page_is_not_empty 0%
test_that_learn_more_link_is_correct 0%
test_that_license_link_works 0%
test_that_home_page_in_api_equals_home_page_in_details_page 0%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 0%
test_that_most_popular_link_is_default 0%
test_filter_panel_reset_button 55%
test_filter_by_job_keyword 57%
test_filter_jobs 57%
test_load_next_results 59%
test_filter_by_test_status 59%
test_close_open_panels 61%
test_status_results_success 62%
test_unclassified_failure 66%
test_remove_email_address_filter 66%
test_open_unclassified_failure_log 68%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 0%
test_that_searching_for_a_tag_returns_results 24%
test_that_addon_number_of_total_downloads_is_correct 52%
test_that_daily_users_in_api_equals_daily_users_in_details_page 57%
test_that_reviews_in_api_equals_reviews_in_details_page 62%
test_that_icon_is_correct 86%
test_sorting_by_downloads 86%
test_that_install_button_is_clickable 90%
test_that_last_complete_themes_page_is_not_empty 90%
test_that_firebug_images_is_correct 90%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 0%
test_web_extension_submission 0%
test_that_user_can_make_a_contribution_without_logging_into_amo 0%
test_that_user_can_contribute_to_an_addon 0%
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 0%
test_that_checks_if_the_extensions_are_sorted_by_recently_updated 65%
test_that_searching_for_a_tag_returns_results 88%
test_that_items_menu_fly_out_while_hovering 94%
test_that_last_complete_themes_page_is_not_empty 94%
test_that_learn_more_link_is_correct 94%
test_group_description_edit 76%
test_logout_verify_bid 78%
test_login_logout 78%
test_edit_profile_information 84%
test_that_user_can_modify_external_accounts_irc_nickname 87%
test_skill_deletion 89%
test_group_invitations 91%
test_invite 93%
test_inviting_an_invalid_email_address 95%
test_that_user_can_view_external_accounts 95%
test_activity_stream 66%
test_snippet_set_present 87%
test_snippet_set_present 93%
test_activity_stream 98%
test_activity_stream 98%
test_snippet_set_present 100%
test_all_links 100%
test_that_snippets_are_well_formed_xml 100%
test_that_snippets_are_well_formed_xml 100%
test_that_snippets_are_well_formed_xml 100%
test_campaign_flow_param_values 98%
test_organic_flow_param_values 98%
test_search_flow_param_values 98%
test_campaign_flow_param_values 98%
test_search_flow_param_values 98%
test_organic_flow_param_values 98%
test_that_search_returns_results_for_first_name 84%
test_logout_verify_bid 88%
test_login_logout 88%
test_that_search_returns_results_for_email_substring 92%
test_profile_deletion_confirmation 92%
test_that_filter_by_country_works 94%
test_that_filter_by_region_works 94%
test_that_user_can_view_external_accounts 96%
test_that_filter_by_city_works 98%
test_skill_addition 100%
test_that_reports_form_has_same_product 96%
test_public_api_navigation 98%
test_that_current_version_selected_in_top_crashers_header 100%
test_search_with_one_line 100%
test_selecting_one_version_doesnt_show_other_versions 100%
test_super_search_page_is_loaded 100%
test_supersearch_fields 100%
test_that_7_days_is_selected_default_for_nightlies 100%
test_that_bugzilla_link_contain_current_site 100%
test_that_exploitable_crash_report_not_displayed_for_not_logged_in_users 100%

Tests with most failures

Tests with the highest total number of failures.

test_activity_stream 648
test_snippet_set_present 447
test_snippet_set_present 222
test_activity_stream 33
test_activity_stream 33
test_snippet_set_present 3
test_all_links 2
test_that_snippets_are_well_formed_xml 1
test_all_links 1
test_that_snippets_are_well_formed_xml 1
test_verify_firefox_aliases_redirect_to_correct_products 284
test_verify_firefox_aliases_redirect_to_correct_products 284
test_verify_firefox_aliases_redirect_to_correct_products 284
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 3
test_verify_firefox_aliases_redirect_to_correct_products 2
test_ie6_winxp_useragent_5_2_redirects_to_correct_version 2
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 2
test_verify_firefox_aliases_redirect_to_correct_products 2
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 2
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 2
test_filter_panel_reset_button 25
test_filter_jobs 24
test_filter_by_job_keyword 24
test_load_next_results 23
test_filter_by_test_status 23
test_close_open_panels 22
test_status_results_success 21
test_unclassified_failure 19
test_remove_email_address_filter 19
test_open_unclassified_failure_log 18
test_that_various_search_terms_return_results 3
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 3
test_that_install_button_is_clickable 3
test_that_items_menu_fly_out_while_hovering 3
test_that_last_complete_themes_page_is_not_empty 3
test_that_learn_more_link_is_correct 3
test_that_license_link_works 3
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 3
test_that_most_popular_link_is_default 3
test_that_home_page_in_api_equals_home_page_in_details_page 3
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 21
test_that_searching_for_a_tag_returns_results 16
test_that_addon_number_of_total_downloads_is_correct 10
test_that_daily_users_in_api_equals_daily_users_in_details_page 9
test_that_reviews_in_api_equals_reviews_in_details_page 8
test_sorting_by_downloads 3
test_that_icon_is_correct 3
test_that_complete_themes_categories_are_not_extensions_categories 2
test_that_complete_themes_loads_landing_page_correctly 2
test_that_license_link_works 2
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_out 17
test_web_extension_submission 17
test_that_user_can_make_a_contribution_without_logging_into_amo 17
test_that_user_can_contribute_to_an_addon 17
test_that_make_contribution_button_is_clickable_and_loads_paypal_frame_while_user_is_logged_in 17
test_that_checks_if_the_extensions_are_sorted_by_recently_updated 6
test_that_searching_for_a_tag_returns_results 2
test_that_items_menu_fly_out_while_hovering 1
test_that_last_complete_themes_page_is_not_empty 1
test_that_learn_more_link_is_correct 1
test_group_description_edit 13
test_login_logout 12
test_logout_verify_bid 12
test_edit_profile_information 9
test_that_user_can_modify_external_accounts_irc_nickname 7
test_skill_deletion 6
test_group_invitations 5
test_invite 4
test_profile_creation 3
test_that_filter_by_region_works 3
test_campaign_flow_param_values 38
test_search_flow_param_values 36
test_organic_flow_param_values 35
test_campaign_flow_param_values 19
test_organic_flow_param_values 19
test_search_flow_param_values 19
test_that_search_returns_results_for_first_name 8
test_login_logout 6
test_logout_verify_bid 6
test_profile_deletion_confirmation 4
test_that_search_returns_results_for_email_substring 4
test_that_filter_by_country_works 3
test_that_filter_by_region_works 3
test_that_user_can_view_external_accounts 2
test_that_filter_by_city_works 1
test_skill_deletion 0

Slowest tests

Slowest average test durations.

test_that_search_results_return_20_results_per_page 2 minutes
test_the_name_of_each_site_navigation_menu_in_the_header 2 minutes
test_click_on_other_collections 2 minutes
test_image_viewer_navigation a minute
test_sorting_by_downloads a minute
test_sorting_by_most_recently_updated a minute
test_that_user_can_make_a_contribution_without_logging_into_amo a minute
test_user_can_update_profile_information_in_account_settings_page a minute
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results a minute
test_that_user_can_contribute_to_an_addon a minute
test_that_checks_featured_extensions_header 12 minutes
test_that_user_can_contribute_to_an_addon a minute
test_that_user_can_make_a_contribution_without_logging_into_amo 53 seconds
test_that_clicking_featured_shows_addons_sorted_by_featured 45 seconds
test_that_checks_all_categories_side_navigation 44 seconds
test_create_and_delete_collection 38 seconds
test_user_my_collections_page 37 seconds
test_user_can_access_the_edit_profile_page 35 seconds
test_searching_for_complete_themes 34 seconds
test_searching_for_collections 34 seconds
test_click_on_other_collections 2 minutes
test_that_search_results_return_20_results_per_page 2 minutes
test_the_name_of_each_site_navigation_menu_in_the_header a minute
test_sorting_by_downloads a minute
test_sorting_by_most_recently_updated a minute
test_image_viewer_navigation a minute
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results a minute
test_that_checks_if_the_extensions_are_sorted_by_newest a minute
test_that_checks_if_the_extensions_are_sorted_by_recently_updated 55 seconds
test_navigating_to_author_addons 51 seconds
test_that_user_can_modify_external_accounts_irc_nickname 3 minutes
test_that_non_us_user_can_set_get_involved_date 2 minutes
test_edit_profile_information 2 minutes
test_group_description_edit a minute
test_logout_verify_bid a minute
test_login_logout a minute
test_skill_deletion a minute
test_that_search_returns_results_for_email_substring a minute
test_skill_addition a minute
test_new_user_cannot_see_groups_or_functional_areas a minute
test_load_next_results a minute
test_get_next_results a minute
test_filter_jobs a minute
test_status_results_success a minute
test_filter_by_test_status a minute
test_remove_email_address_filter a minute
test_filter_by_job_keyword a minute
test_set_as_top_of_range a minute
test_filter_by_job_keyword a minute
test_filter_by_email a minute
test_search_change_column a minute
test_that_lowest_version_topcrashers_do_not_return_errors 57 seconds
test_that_only_plugin_reports_have_plugin_icon 52 seconds
test_that_only_browser_reports_have_browser_icon 48 seconds
test_selecting_one_version_doesnt_show_other_versions 39 seconds
test_that_top_crashers_reports_links_work 38 seconds
test_that_top_crashers_reports_links_work 38 seconds
test_that_top_crashers_reports_links_work 37 seconds
test_that_top_crashers_reports_links_work 36 seconds
test_search_with_multiple_lines 34 seconds
test_search_change_column a minute
test_that_lowest_version_topcrashers_do_not_return_errors 58 seconds
test_that_only_plugin_reports_have_plugin_icon 51 seconds
test_that_only_browser_reports_have_browser_icon 46 seconds
test_selecting_one_version_doesnt_show_other_versions 40 seconds
test_that_top_crashers_reports_links_work 36 seconds
test_that_top_crashers_reports_links_work 35 seconds
test_that_top_crashers_reports_links_work 34 seconds
test_top_crasher_reports_tab_has_uuid_report 33 seconds
test_search_with_multiple_lines 33 seconds
test_logout_verify_bid a minute
test_new_user_cannot_see_groups_or_functional_areas a minute
test_profile_deletion_confirmation 45 seconds
test_search_for_not_existing_mozillian_when_logged_in 40 seconds
test_that_filter_by_country_works 40 seconds
test_login_logout 39 seconds
test_that_user_can_view_external_accounts 39 seconds
test_that_filter_by_region_works 37 seconds
test_private_groups_field_as_public_when_logged_in 37 seconds
test_that_links_in_the_services_page_return_200_code 37 seconds
test_verify_releng_aliases_match_what_we_expect a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_verify_locales_redirect_to_the_expected_product a moment
test_user_can_sign_in 37 seconds
test_del 31 seconds
test_create_new_account 5 seconds
test_default_environment_should_be_dev 4 seconds
test_new_account_pw_does_not_contain_numbers 4 seconds
test_new_account_pw_does_not_contain_numbers 4 seconds
test_create_new_account 4 seconds
test_webdriver_fxa_popup_without_logo_displayed a moment
test_webdriver_with_fxa_popup a moment
test_webdriver_fxa_popup_without_logo_present a moment

Longest running tests

Most machine time consumed by tests over multiple executions.

test_verify_releng_aliases_match_what_we_expect 23 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 15 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 15 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 15 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 15 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 15 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 15 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 15 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 15 minutes
test_ie6_winxp_useragent_5_1_redirects_to_correct_version 13 minutes
test_that_user_can_modify_external_accounts_irc_nickname 2 hours
test_that_non_us_user_can_set_get_involved_date an hour
test_edit_profile_information an hour
test_group_description_edit an hour
test_logout_verify_bid an hour
test_that_user_can_create_and_delete_group an hour
test_skill_deletion an hour
test_skill_addition 54 minutes
test_creating_profile_without_checking_privacy_policy_checkbox 52 minutes
test_group_invitations 51 minutes
test_load_next_results 59 minutes
test_status_results_success 49 minutes
test_remove_email_address_filter 46 minutes
test_filter_by_test_status 45 minutes
test_filter_jobs 42 minutes
test_set_as_top_of_range 38 minutes
test_filter_by_email 38 minutes
test_filter_by_job_keyword 38 minutes
test_filter_panel_reset_button 37 minutes
test_clear_pinboard 34 minutes
test_that_search_results_return_20_results_per_page 41 minutes
test_the_name_of_each_site_navigation_menu_in_the_header 23 minutes
test_sorting_by_most_recently_updated 22 minutes
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results 21 minutes
test_sorting_by_downloads 21 minutes
test_image_viewer_navigation 20 minutes
test_click_on_other_collections 18 minutes
test_view_the_source_in_the_version_information 18 minutes
test_that_checks_if_the_extensions_are_sorted_by_newest 15 minutes
test_navigating_to_author_addons 14 minutes
test_that_search_results_return_20_results_per_page 37 minutes
test_that_user_can_make_a_contribution_without_logging_into_amo 22 minutes
test_the_name_of_each_site_navigation_menu_in_the_header 21 minutes
test_image_viewer_navigation 19 minutes
test_sorting_by_downloads 19 minutes
test_sorting_by_most_recently_updated 19 minutes
test_that_user_can_contribute_to_an_addon 19 minutes
test_that_search_all_add_ons_results_have_pagination_that_moves_through_results 19 minutes
test_user_can_update_profile_information_in_account_settings_page 18 minutes
test_click_on_other_collections 16 minutes
test_organic_flow_param_values 6 hours
test_search_flow_param_values 5 hours
test_campaign_flow_param_values 5 hours
test_snippet_set_present an hour
test_that_snippets_are_well_formed_xml an hour
test_all_links an hour
test_snippet_set_present an hour
test_that_snippets_are_well_formed_xml an hour
test_all_links an hour
test_snippet_set_present an hour
test_all_links an hour
test_that_snippets_are_well_formed_xml an hour
test_response_codes 34 minutes
test_snippet_set_present an hour
test_that_snippets_are_well_formed_xml an hour
test_all_links an hour
test_snippet_set_present an hour
test_all_links an hour
test_that_snippets_are_well_formed_xml an hour
test_that_snippets_are_well_formed_xml an hour
test_all_links an hour
test_snippet_set_present an hour
test_activity_stream 25 minutes
test_search_change_column an hour
test_that_lowest_version_topcrashers_do_not_return_errors 41 minutes
test_that_only_plugin_reports_have_plugin_icon 36 minutes
test_that_only_browser_reports_have_browser_icon 33 minutes
test_selecting_one_version_doesnt_show_other_versions 28 minutes
test_that_top_crashers_reports_links_work 25 minutes
test_that_top_crashers_reports_links_work 25 minutes
test_that_top_crashers_reports_links_work 25 minutes
test_that_top_crashers_reports_links_work 24 minutes
test_search_with_multiple_lines 23 minutes
test_search_change_column an hour
test_that_lowest_version_topcrashers_do_not_return_errors 39 minutes
test_that_only_plugin_reports_have_plugin_icon 34 minutes
test_that_only_browser_reports_have_browser_icon 30 minutes
test_selecting_one_version_doesnt_show_other_versions 26 minutes
test_that_top_crashers_reports_links_work 24 minutes
test_that_top_crashers_reports_links_work 24 minutes
test_that_top_crashers_reports_links_work 23 minutes
test_that_top_crashers_reports_links_work 22 minutes
test_top_crasher_reports_tab_has_uuid_report 22 minutes