Calibre-Web Tests

Tested environment

Program library	Installed Version	Test class
Platform	Linux 5.4.0-52-generic #57-Ubuntu SMP Thu Oct 15 10:57:00 UTC 2020 x86_64 x86_64	Basic
Python	3.8.5	Basic
Babel	2.8.0	Basic
backports-abc	0.5	Basic
Flask	1.1.2	Basic
Flask-Babel	1.0.0	Basic
Flask-Login	0.5.0	Basic
Flask-Principal	0.4.0	Basic
iso-639	0.4.5	Basic
Jinja2	2.11.2	Basic
PyPDF2	1.26.0	Basic
pytz	2020.1	Basic
requests	2.23.0	Basic
singledispatch	3.4.0.3	Basic
six	1.15.0	Basic
SQLAlchemy	1.3.20	Basic
tornado	6.0.4	Basic
Unidecode	1.1.1	Basic
Wand	0.5.9	Basic
Werkzeug	1.0.1	Basic
Pillow	8.0.1	TestCoverEditBooks
google-api-python-client	1.12.5	TestEbookConvertGDrive
httplib2	0.18.1	TestEbookConvertGDrive
lxml	4.6.1	TestEbookConvertGDrive
oauth2client	4.1.3	TestEbookConvertGDrive
Pillow	8.0.1	TestEbookConvertGDrive
PyDrive	1.3.1	TestEbookConvertGDrive
PyYAML	5.3.1	TestEbookConvertGDrive
comicapi	2.1.1	TestEditAdditionalBooks
lxml	4.6.1	TestEditAdditionalBooks
Pillow	8.0.1	TestEditAdditionalBooks
rarfile	4.0	TestEditAdditionalBooks
lxml	4.6.1	TestEditBooks
Pillow	8.0.1	TestEditBooks
google-api-python-client	1.12.5	TestEditBooksOnGdrive
httplib2	0.18.1	TestEditBooksOnGdrive
lxml	4.6.1	TestEditBooksOnGdrive
oauth2client	4.1.3	TestEditBooksOnGdrive
Pillow	8.0.1	TestEditBooksOnGdrive
PyDrive	1.3.1	TestEditBooksOnGdrive
PyYAML	5.3.1	TestEditBooksOnGdrive
google-api-python-client	1.12.5	TestSetupGdrive
httplib2	0.18.1	TestSetupGdrive
oauth2client	4.1.3	TestSetupGdrive
PyDrive	1.3.1	TestSetupGdrive
PyYAML	5.3.1	TestSetupGdrive
goodreads	0.3.2	TestGoodreads
jsonschema	3.2.0	TestKoboSync
Flask-SimpleLDAP	1.4.0	TestLdapLogin
jsonschema	3.2.0	TestLdapLogin
python-ldap	3.3.1	TestLdapLogin
Flask-Dance	3.1.0	TestOAuthLogin
SQLAlchemy-Utils	0.36.8	TestOAuthLogin

Test Group/Test case	Count	Pass	Fail	Error	Skip	View
TestAnonymous	13	13	0	0	0	Detail
TestAnonymous - test_check_locale_guest	PASS
TestAnonymous - test_guest_about	PASS
TestAnonymous - test_guest_change_visibility_category	PASS
TestAnonymous - test_guest_change_visibility_format	PASS
TestAnonymous - test_guest_change_visibility_hot	PASS
TestAnonymous - test_guest_change_visibility_language	PASS
TestAnonymous - test_guest_change_visibility_publisher	PASS
TestAnonymous - test_guest_change_visibility_rated	PASS
TestAnonymous - test_guest_change_visibility_rating	PASS
TestAnonymous - test_guest_change_visibility_series	PASS
TestAnonymous - test_guest_random_books_available	PASS
TestAnonymous - test_guest_restricted_settings_visibility	PASS
TestAnonymous - test_guest_visibility_sidebar	PASS
TestCli	7	6	0	0	1	Detail
TestCli - test_already_started	PASS
TestCli - test_bind_to_single_interface	PASS
TestCli - test_cli_SSL_files	PASS
TestCli - test_cli_different_folder	PASS
TestCli - test_cli_different_settings_database	PASS
TestCli - test_cli_gdrive_location	SKIP Not Implemented
TestCli - test_environ_port_setting	PASS
TestCoverEditBooks	1	0	1	0	0	Detail
TestCoverEditBooks - test_upload_jpg	FAIL Traceback (most recent call last): File "/home/matthias/Entwicklung/calibre-web-test/test/test_cover_edit_books.py", line 92, in test_upload_jpg self.assertTrue(self.check_element_on_page((By.ID, 'flash_alert')), "BMP file is not detected") AssertionError: False is not true : BMP file is not detected
TestDeleteDatabase	1	1	0	0	0	Detail
TestDeleteDatabase - test_delete_books_in_database	PASS
TestEbookConvert	11	11	0	0	0	Detail
TestEbookConvert - test_convert_deactivate	PASS
TestEbookConvert - test_convert_email	PASS
TestEbookConvert - test_convert_failed_and_email	PASS
TestEbookConvert - test_convert_only	PASS
TestEbookConvert - test_convert_parameter	PASS
TestEbookConvert - test_convert_wrong_excecutable	PASS
TestEbookConvert - test_email_failed	PASS
TestEbookConvert - test_email_only	PASS
TestEbookConvert - test_kindle_send_not_configured	PASS
TestEbookConvert - test_ssl_smtp_setup_error	PASS
TestEbookConvert - test_starttls_smtp_setup_error	PASS
TestEbookConvertGDrive	6	6	0	0	0	Detail
TestEbookConvertGDrive - test_convert_email	PASS
TestEbookConvertGDrive - test_convert_failed_and_email	PASS
TestEbookConvertGDrive - test_convert_only	PASS
TestEbookConvertGDrive - test_convert_parameter	PASS
TestEbookConvertGDrive - test_email_failed	PASS
TestEbookConvertGDrive - test_email_only	PASS
TestEditAdditionalBooks	12	11	0	0	1	Detail
TestEditAdditionalBooks - test_change_upload_formats	PASS
TestEditAdditionalBooks - test_delete_book	PASS
TestEditAdditionalBooks - test_delete_role	PASS
TestEditAdditionalBooks - test_edit_book_identifier	PASS
TestEditAdditionalBooks - test_edit_book_identifier_capital	PASS
TestEditAdditionalBooks - test_edit_book_identifier_standard	PASS
TestEditAdditionalBooks - test_edit_special_book_identifier	PASS
TestEditAdditionalBooks - test_upload_edit_role	PASS
TestEditAdditionalBooks - test_upload_metadata_cbr	PASS
TestEditAdditionalBooks - test_upload_metadata_cbt	PASS
TestEditAdditionalBooks - test_writeonly_calibre_database	SKIP Not implemented
TestEditAdditionalBooks - test_writeonly_path	PASS
TestEditBooks	33	30	1	0	2	Detail
TestEditBooks - test_download_book	PASS
TestEditBooks - test_edit_author	PASS
TestEditBooks - test_edit_category	PASS
TestEditBooks - test_edit_comments	PASS
TestEditBooks - test_edit_custom_bool	PASS
TestEditBooks - test_edit_custom_categories	PASS
TestEditBooks - test_edit_custom_float	PASS
TestEditBooks - test_edit_custom_int	PASS
TestEditBooks - test_edit_custom_rating	PASS
TestEditBooks - test_edit_custom_single_select	PASS
TestEditBooks - test_edit_custom_text	PASS
TestEditBooks - test_edit_language	PASS
TestEditBooks - test_edit_publisher	PASS
TestEditBooks - test_edit_publishing_date	SKIP Not Implemented
TestEditBooks - test_edit_rating	PASS
TestEditBooks - test_edit_series	PASS
TestEditBooks - test_edit_title	PASS
TestEditBooks - test_rename_uppercase_lowercase	SKIP Not Implemented
TestEditBooks - test_typeahead_author	PASS
TestEditBooks - test_typeahead_functions	PASS
TestEditBooks - test_typeahead_language	PASS
TestEditBooks - test_typeahead_publisher	PASS
TestEditBooks - test_typeahead_series	PASS
TestEditBooks - test_typeahead_tag	PASS
TestEditBooks - test_upload_book_cbr	PASS
TestEditBooks - test_upload_book_cbt	PASS
TestEditBooks - test_upload_book_cbz	PASS
TestEditBooks - test_upload_book_epub	PASS
TestEditBooks - test_upload_book_fb2	PASS
TestEditBooks - test_upload_book_lit	PASS
TestEditBooks - test_upload_book_mobi	PASS
TestEditBooks - test_upload_book_pdf	PASS
TestEditBooks - test_upload_cover_hdd	FAIL Traceback (most recent call last): File "/home/matthias/Entwicklung/calibre-web-test/test/test_edit_books.py", line 737, in test_upload_cover_hdd self.assertTrue(False, "Browser-Cache Problem: Old Cover is displayed instead of New Cover") AssertionError: False is not true : Browser-Cache Problem: Old Cover is displayed instead of New Cover
TestEditBooksList	3	3	0	0	0	Detail
TestEditBooksList - test_edit_books_list	PASS
TestEditBooksList - test_list_visibility	PASS
TestEditBooksList - test_merge_book	PASS
TestEditBooksOnGdrive	19	18	1	0	0	Detail
TestEditBooksOnGdrive - test_download_book	PASS
TestEditBooksOnGdrive - test_edit_author	PASS
TestEditBooksOnGdrive - test_edit_category	PASS
TestEditBooksOnGdrive - test_edit_comments	PASS
TestEditBooksOnGdrive - test_edit_custom_bool	PASS
TestEditBooksOnGdrive - test_edit_custom_categories	PASS
TestEditBooksOnGdrive - test_edit_custom_float	PASS
TestEditBooksOnGdrive - test_edit_custom_int	PASS
TestEditBooksOnGdrive - test_edit_custom_rating	PASS
TestEditBooksOnGdrive - test_edit_custom_single_select	PASS
TestEditBooksOnGdrive - test_edit_custom_text	PASS
TestEditBooksOnGdrive - test_edit_language	PASS
TestEditBooksOnGdrive - test_edit_publisher	PASS
TestEditBooksOnGdrive - test_edit_rating	PASS
TestEditBooksOnGdrive - test_edit_series	PASS
TestEditBooksOnGdrive - test_edit_title	PASS
TestEditBooksOnGdrive - test_upload_book_epub	PASS
TestEditBooksOnGdrive - test_upload_book_lit	PASS
TestEditBooksOnGdrive - test_upload_cover_hdd	FAIL Traceback (most recent call last): File "/home/matthias/Entwicklung/calibre-web-test/test/test_edit_ebooks_gdrive.py", line 721, in test_upload_cover_hdd self.assertTrue(False, "Browser-Cache Problem: Old Cover is displayed instead of New Cover") AssertionError: False is not true : Browser-Cache Problem: Old Cover is displayed instead of New Cover
TestSTARTTLS	3	3	0	0	0	Detail
TestSTARTTLS - test_STARTTLS	PASS
TestSTARTTLS - test_STARTTLS_SSL_setup_error	PASS
TestSTARTTLS - test_STARTTLS_resend_password	PASS
TestSSL	5	5	0	0	0	Detail
TestSSL - test_SSL_None_setup_error	PASS
TestSSL - test_SSL_STARTTLS_setup_error	PASS
TestSSL - test_SSL_logging_email	PASS
TestSSL - test_SSL_only	PASS
TestSSL - test_email_limit	PASS
TestSetupGdrive	1	1	0	0	0	Detail
TestSetupGdrive - test_config_gdrive	PASS
TestGoodreads	3	3	0	0	0	Detail
TestGoodreads - test_author_page	PASS
TestGoodreads - test_author_page_invalid	PASS
TestGoodreads - test_goodreads_about	PASS
TestKoboSync	8	8	0	0	0	Detail
TestKoboSync - test_kobo_about	PASS
TestKoboSync - test_shelves_add_remove_books	PASS
TestKoboSync - test_sync_changed_book	PASS
TestKoboSync - test_sync_invalid	PASS
TestKoboSync - test_sync_reading_state	PASS
TestKoboSync - test_sync_shelf	PASS
TestKoboSync - test_sync_unchanged	PASS
TestKoboSync - test_sync_upload	PASS
TestLdapLogin	11	10	0	0	1	Detail
TestLdapLogin - test_LDAP_SSL	PASS
TestLdapLogin - test_LDAP_SSL_CERTIFICATE	SKIP Unknown how to test certificate
TestLdapLogin - test_LDAP_STARTTLS	PASS
TestLdapLogin - test_LDAP_fallback_Login	PASS
TestLdapLogin - test_LDAP_import	PASS
TestLdapLogin - test_LDAP_login	PASS
TestLdapLogin - test_invalid_LDAP	PASS
TestLdapLogin - test_ldap_about	PASS
TestLdapLogin - test_ldap_authentication	PASS
TestLdapLogin - test_ldap_kobo_sync	PASS
TestLdapLogin - test_ldap_opds_download_book	PASS
TestLogging	7	6	0	0	1	Detail
TestLogging - test_access_log_recover	PASS
TestLogging - test_debug_log	PASS
TestLogging - test_failed_login	PASS
TestLogging - test_failed_register	SKIP Not Implemented
TestLogging - test_logfile_change	PASS
TestLogging - test_logfile_recover	PASS
TestLogging - test_logviewer	PASS
TestLogin	12	12	0	0	0	Detail
TestLogin - test_digest_login	PASS
TestLogin - test_login_capital_letters_user_unicode_password	PASS
TestLogin - test_login_delete_admin	PASS
TestLogin - test_login_empty_password	PASS
TestLogin - test_login_locale_select	PASS
TestLogin - test_login_protected	PASS
TestLogin - test_login_remember_me	PASS
TestLogin - test_login_rename_user	PASS
TestLogin - test_login_unicode_user_space_end_password	PASS
TestLogin - test_login_user_with_space_password_end_space	PASS
TestLogin - test_next	PASS
TestLogin - test_robots	PASS
TestOAuthLogin	2	2	0	0	0	Detail
TestOAuthLogin - test_oauth_about	PASS
TestOAuthLogin - test_visible_oauth	PASS
TestOPDSFeed	20	20	0	0	0	Detail
TestOPDSFeed - test_opds	PASS
TestOPDSFeed - test_opds_author	PASS
TestOPDSFeed - test_opds_calibre_companion	PASS
TestOPDSFeed - test_opds_cover	PASS
TestOPDSFeed - test_opds_download_book	PASS
TestOPDSFeed - test_opds_formats	PASS
TestOPDSFeed - test_opds_guest_user	PASS
TestOPDSFeed - test_opds_hot	PASS
TestOPDSFeed - test_opds_language	PASS
TestOPDSFeed - test_opds_non_admin	PASS
TestOPDSFeed - test_opds_publisher	PASS
TestOPDSFeed - test_opds_random	PASS
TestOPDSFeed - test_opds_ratings	PASS
TestOPDSFeed - test_opds_read_unread	PASS
TestOPDSFeed - test_opds_search	PASS
TestOPDSFeed - test_opds_series	PASS
TestOPDSFeed - test_opds_shelf_access	PASS
TestOPDSFeed - test_opds_tags	PASS
TestOPDSFeed - test_opds_top_rated	PASS
TestOPDSFeed - test_recently_added	PASS
TestReader	5	4	1	0	0	Detail
TestReader - test_comic_reader	PASS
TestReader - test_epub_reader	PASS
TestReader - test_pdf_reader	PASS
TestReader - test_sound_listener	PASS
TestReader - test_txt_reader	FAIL Traceback (most recent call last): File "/home/matthias/Entwicklung/calibre-web-test/test/test_reader.py", line 59, in test_txt_reader self.assertTrue('hörte' in content.text, 'Encoding of textfile viewer is not respected properly') AssertionError: False is not true : Encoding of textfile viewer is not respected properly
TestRegister	7	7	0	0	0	Detail
TestRegister - test_forgot_password	PASS
TestRegister - test_limit_domain	PASS
TestRegister - test_register_no_server	PASS
TestRegister - test_registering_only_email	PASS
TestRegister - test_registering_user	PASS
TestRegister - test_registering_user_fail	PASS
TestRegister - test_user_change_password	PASS
TestShelf	11	10	0	0	1	Detail
TestShelf - test_add_shelf_from_search	PASS
TestShelf - test_arrange_shelf	PASS
TestShelf - test_delete_book_of_shelf	PASS
TestShelf - test_private_shelf	PASS
TestShelf - test_public_private_shelf	PASS
TestShelf - test_public_shelf	PASS
TestShelf - test_rename_shelf	PASS
TestShelf - test_shelf_action_non_shelf_edit_role	PASS
TestShelf - test_shelf_anonymous	PASS
TestShelf - test_shelf_database_change	SKIP Change Database Not Implemented
TestShelf - test_shelf_long_name	PASS
TestUpdater	8	7	0	0	1	Detail
TestUpdater - test_check_update_nightly_errors	PASS
TestUpdater - test_check_update_nightly_request_errors	PASS
TestUpdater - test_check_update_stable_errors	PASS
TestUpdater - test_check_update_stable_versions	PASS
TestUpdater - test_perform_update	PASS
TestUpdater - test_perform_update_stable_errors	PASS
TestUpdater - test_perform_update_timeout	SKIP Takes too long
TestUpdater - test_reconnect_database	PASS
TestUserTemplate	21	21	0	0	0	Detail
TestUserTemplate - test_allow_column_restriction	PASS
TestUserTemplate - test_allow_tag_restriction	PASS
TestUserTemplate - test_archived_format_template	PASS
TestUserTemplate - test_author_user_template	PASS
TestUserTemplate - test_best_user_template	PASS
TestUserTemplate - test_category_user_template	PASS
TestUserTemplate - test_deny_column_restriction	PASS
TestUserTemplate - test_deny_tag_restriction	PASS
TestUserTemplate - test_detail_random_user_template	PASS
TestUserTemplate - test_download_user_template	PASS
TestUserTemplate - test_format_user_template	PASS
TestUserTemplate - test_hot_user_template	PASS
TestUserTemplate - test_language_user_template	PASS
TestUserTemplate - test_limit_book_languages	PASS
TestUserTemplate - test_list_user_template	PASS
TestUserTemplate - test_publisher_user_template	PASS
TestUserTemplate - test_random_user_template	PASS
TestUserTemplate - test_read_user_template	PASS
TestUserTemplate - test_recent_user_template	PASS
TestUserTemplate - test_series_user_template	PASS
TestUserTemplate - test_ui_language_settings	PASS
TestCalibreWebVisibilitys	37	31	1	0	5	Detail
TestCalibreWebVisibilitys - test_about	PASS
TestCalibreWebVisibilitys - test_admin_SMTP_Settings	PASS
TestCalibreWebVisibilitys - test_admin_add_user	PASS
TestCalibreWebVisibilitys - test_admin_change_password	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_archived	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_authors	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_category	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_file_formats	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_hot	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_language	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_publisher	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_random	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_rated	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_rating	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_read	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_series	PASS
TestCalibreWebVisibilitys - test_allow_columns	PASS
TestCalibreWebVisibilitys - test_allow_tags	PASS
TestCalibreWebVisibilitys - test_archive_books	PASS
TestCalibreWebVisibilitys - test_authors_max_settings	PASS
TestCalibreWebVisibilitys - test_change_title	PASS
TestCalibreWebVisibilitys - test_checked_logged_in	PASS
TestCalibreWebVisibilitys - test_hide_custom_column	PASS
TestCalibreWebVisibilitys - test_link_column_to_read_status	PASS
TestCalibreWebVisibilitys - test_random_books_available	PASS
TestCalibreWebVisibilitys - test_restrict_columns	PASS
TestCalibreWebVisibilitys - test_restrict_tags	PASS
TestCalibreWebVisibilitys - test_save_views_authors	SKIP ToDo
TestCalibreWebVisibilitys - test_save_views_formats	SKIP ToDo
TestCalibreWebVisibilitys - test_save_views_lang	SKIP ToDo
TestCalibreWebVisibilitys - test_save_views_recent	PASS
TestCalibreWebVisibilitys - test_save_views_series	SKIP ToDo
TestCalibreWebVisibilitys - test_save_views_unread	SKIP ToDo
TestCalibreWebVisibilitys - test_search_functions	FAIL Traceback (most recent call last): File "/home/matthias/Entwicklung/calibre-web-test/test/test_visiblilitys.py", line 389, in test_search_functions self.assertEqual(200, resp.status_code) AssertionError: 200 != 404
TestCalibreWebVisibilitys - test_search_string	PASS
TestCalibreWebVisibilitys - test_user_email_available	PASS
TestCalibreWebVisibilitys - test_user_visibility_sidebar	PASS
TestCalibreHelper	16	16	0	0	0	Detail
TestCalibreHelper - test_author_sort	PASS
TestCalibreHelper - test_author_sort_comma	PASS
TestCalibreHelper - test_author_sort_junior	PASS
TestCalibreHelper - test_author_sort_oneword	PASS
TestCalibreHelper - test_author_sort_roman	PASS
TestCalibreHelper - test_check_Limit_Length	PASS
TestCalibreHelper - test_check_char_replacement	PASS
TestCalibreHelper - test_check_chinese_Characters	PASS
TestCalibreHelper - test_check_deg_eur_replacement	PASS
TestCalibreHelper - test_check_doubleS	PASS
TestCalibreHelper - test_check_finish_Dot	PASS
TestCalibreHelper - test_check_high23	PASS
TestCalibreHelper - test_check_umlauts	PASS
TestCalibreHelper - test_random_password	PASS
TestCalibreHelper - test_split_authors	PASS
TestCalibreHelper - test_whitespaces	PASS
Total	283	265	5	0	13