Kitodo.Production 3.7.0

What's new

Improved support for AV media

• Visualisation of audio as a waveform (see #5803 for details)
• Add media partials for audio and video (see #5504 for details)
• thanks to @markusweigelt from SLUB Dresden for these contributions

Mass import functionality extended

• Allow multiple values for same key in mass import csv (see #5998 for details)
• Allow quotes in imported csv files (see #6012 for details)
• Enrich process with LABEL and ORDERLABEL during mass import (see #6143 for details)
• thanks to @BartChris from USB Köln for these contributions

OCR-D

• First preliminary OCR-D Workflow integration (see #5809 for details)
• thanks to @markusweigelt from SLUB Dresden for this contribution

Updated test framework

• The test framework JUnit has been completey updated from the old version 4 to the newer version 5 (thanks to @henning-gerhardt from SLUB Dresden for this contribution)

In addtion there have been many other bug fixes and improvements. (see full list below)

Database changes

There have been multiple changes to the database schema of Kitodo.Production since version 3.6.x. Please use the attached file migration_3-6-0_to_3-7-0.sql to migrate your database to the current schema.

For a fresh install please use the file kitodo_3-7-0.sql included in this release instead.

Changelog

• Task action processor by @markusweigelt in #5657
• Change version to 3.7.0-SNAPSHOT by @solth in #5795
• Unrender options without function during advanced pagination by @pontus-osterdahl in #5698
• Remove the OCR interface by @matthias-ronge in #5684
• Make individual terms in process properties searchable by @BartChris in #5685
• Fix process selection st by @solth in #5765
• UI improvements by @oliver-stoehr in #5797
• Sort template projects by title by @solth in #5745
• Fix ordering of projects by project title by @henning-gerhardt in #5802
• Enable editing and delete info comments patch by @pontus-osterdahl in #5785
• Enable edit and delete info-comments by @pontus-osterdahl in #5703
• Improve correction icon by @oliver-stoehr in #5679
• Print comments onto docket by @oliver-stoehr in #5747
• Always reset password input fields when opening 'change password' dialog by @solth in #5811
• Add security policy by @solth in #5804
• Bump org.json:json from 20230227 to 20231013 by @dependabot in #5814
• Always display page labels in metadata editor by @solth in #5816
• Fix quering for user search in one query by @henning-gerhardt in #5812
• Bump org.apache.activemq:activemq-client from 5.17.2 to 5.17.6 by @dependabot in #5823
• Visualisation of audio as a waveform by @markusweigelt in #5803
• Use type track for audio and video MIME types instead of type page for physical division type by @markusweigelt in #5834
• Reload page on client change by @solth in #5826
• Update messages_es.properties by @danilopenagos in #5833
• Add list function for renaming media of multiple processes by @solth in #5824
• OCR-D Workflow integration (without entity implementation) by @markusweigelt in #5809
• Make use of full page width on role edit details page by @solth in #5843
• Complete DFG-Viewer ruleset's XSLT file by @matthias-ronge in #5842
• Remove ID of the command interface by @matthias-ronge in #5681
• Adjust metadata replacement by @henning-gerhardt in #5800
• Fix wrong password change by @henning-gerhardt in #5807
• Filtering of single and multiple select fields by @markusweigelt in #5810
• Update used build plugins by @henning-gerhardt in #5851
• Update MetsModsGoobi_to_MetsKitodo.xsl by @matthias-ronge in #5858
• Relocate mysql dependency by @henning-gerhardt in #5849
• Remove unused statistic button by @henning-gerhardt in #5798
• Update Spanish Messages and Errors by @danilopenagos in #5864
• Updating Bouncy Castle dependency (security fix) by @henning-gerhardt in #5867
• Prevent NPE by @matthias-ronge in #5831
• Synchronize accesses to 'taskList' by @matthias-ronge in #5776
• Remove unused imports by @solth in #5875
• Display tooltip instead of the overlay in preview by @markusweigelt in #5845
• Do not try to load process table on other list pages by @solth in #5868
• Remove redundant filter and task status menus by @solth in #5865
• Validate task and tasks status in combination by @solth in #5878
• Catch import configuration errors during mass import by @solth in #5866
• Handle error opening metadata file by @solth in #5872
• Handle potential ConfigException during catalogue configuration import by @solth in #5863
• Update Kitodo Messages by @danilopenagos in #5891
• Fix Listing ST by @solth in #5892
• Refactor test framework to load test resources dynamically by @solth in #5876
• Add media partials for audio and video by @markusweigelt in #5504
• Bump org.springframework.security:spring-security-config from 5.7.10 to 5.7.11 by @dependabot in #5912
• Catch Exceptions in indexing processes, log warning and continue by @matthias-ronge in #5894
• Fix typo by @oliver-stoehr in #5920
• Add integration and unit tests for ImportService by @solth in #5919
• Update location of chrome driver for testing by @solth in #5923
• Delete legacy SQL files by @matthias-ronge in #5914
• Updated used action from version 3 to version 4 by @henning-gerhardt in #5922
• Adds a way to import processes that only exist as files by @matthias-ronge in #5903
• Prevent saving a broken METS file by @matthias-ronge in #5883
• Assign ID to logical divisions in imported METS files which don't have one by @matthias-ronge in #5931
• CodeQL support for Java application by @henning-gerhardt in #5937
• Fix type comparison security issue by @solth in #5938
• Use secure random generator on string generation by @henning-gerhardt in #5941
• Fix DTD security issue by @solth in #5940
• Create SecureRandom only once per class by @henning-gerhardt in #5943
• Make pagination scope default value configureable by @pontus-osterdahl in #5855
• Remove unused part of the image management interface by @matthias-ronge in #5683
• Allow datatype Long when indexing by @BartChris in #5936
• Fix layout of 'new comment' popup dialog by @solth in #5939
• Enable debug logging from KitodoRestClient by @matthias-ronge in #5908
• Use efficient isEmpty call over inefficient empty string comparison by @henning-gerhardt in #5944
• Replace size() comparison calls with isEmpty calls by @henning-gerhardt in #5947
• Remove unused class variable by @henning-gerhardt in #5948
• Improvements media partials by @markusweigelt in #5942
• Add missing hashCode methods by @henning-gerhardt in #5946
• Update issue template for development fund by @solth in #5973
• Change log level to "info" for KitodoRestClient class on automatic test execution by @henning-gerhardt in #5972
• Update Spanish Messages Files by @danilopenagos in #5962
• Remove duplicate key and trailing spaces from message files by @solth in #5959
• Add tests for mass import by @solth in #5961
• Fix blurry derivatives caused by using wrong subfile by @oliver-stoehr in #6001
• Add missing filterable attribute in ruleset.xsd by @henning-gerhardt in #6006
• Remove unused method 'parseDate' by @solth in #5974
• Create hashCode methods on class generation by @henning-gerhardt in #5975
• H2 upgrade by @henning-gerhardt in #6015
• Fix dereferenced variable may be null by @matthias-ronge in #5956
• Replace bit or with logical or condition by @henning-gerhardt in #5953
• Import service Selenium test by @solth in #6018
• Fix NullPointerException by @matthias-ronge in #5994
• Remove spotbugs on automatic build by @henning-gerhardt in #5971
• Fix issues reported by Coverity Scan by @stweil in #5995
• Allow multiple values for same key in mass import csv by @BartChris in #5998
• Fix permission denied messages while running tests by @henning-gerhardt in #6022
• Save SM links in order by @matthias-ronge in #5966
• Fix potential input resource leak by @matthias-ronge in #5954
• Add XMLUtils test class by @solth in #6033
• Add tests for FolderGenerator class by @solth in #6035
• Add tests for MetadataValidationService by @solth in #6036
• Remove unused class FacesUtils by @solth in #6034
• Kitodo-API: Replace Junit4 with Junit5 calls by @henning-gerhardt in #6030
• Fix Windows cannot find Selenium drivers by @matthias-ronge in #6048
• Improve calendar tests by @oliver-stoehr in #5949
• Bump org.xmlunit:xmlunit-core from 2.9.0 to 2.10.0 by @dependabot in #6056
• Fix some issues reported by Coverity Scan by @stweil in #6057
• Fix Tomcat start with Eclipse broken, local-config ignored by @matthias-ronge in #6000
• Add url encoding for SearchInterfaceTypes other than SRU by @gerlingsm in #6007
• Write debug file on METS export by @matthias-ronge in #5970
• Add tests for CommentForm class. by @solth in #6039
• Delete unused methods from ProcessForm by @solth in #6040
• Show growl message when layout settings were loaded by @solth in #6019
• Bump org.bouncycastle:bcprov-jdk18on from 1.77 to 1.78 by @dependabot in #6062
• Inactive projects by @solth in #6058
• Add missing German message key translation by @solth in #6064
• Handle enter event in input fields by @BartChris in #6063
• Disabled elements should not be focused, extends PR #6063 by @BartChris in #6067
• Metadata editor tests by @solth in #6028
• Metadata editor selenium tests by @solth in #6054
• Add missing clone method to Course class by @henning-gerhardt in #5977
• Update messages_es.properties by @danilopenagos in #6068
• Update from commons-configuration to commons-configuration2 by @henning-gerhardt in #6029
• Refactor guard clauses into their own class by @matthias-ronge in #5756
• [Kitodo-Validation] Remove unused dependencies by @henning-gerhardt in #6070
• [Kitodo-Command] Replace Junit4 with Junit5 in Kitodo Command module by @henning-gerhardt in #6071
• [Kitodo-Docket] Replace Junit4 with Junit5 and do some code cleanup by @henning-gerhardt in #6072
• [Kitodo Imagemanagement] Replace Junit4 with Junit5 by @henning-gerhardt in #6073
• [Kitodo-Filemanagment] Replace Junit4 with Junit5 by @henning-gerhardt in #6074
• [Kitodo-LongTermPreservationValidation] Replace Junit4 with Junit5 by @henning-gerhardt in #6075
• [Kitodo-PersistentIdentifier] Replace Junit4 with Junit5 by @henning-gerhardt in #6076
• [Kitodo-QueryUrlImport] Replace Junit 4 with Junit5 and fix test dependency by @henning-gerhardt in #6077
• [Kitodo-XmlSchemaConverter] Replace Junit 4 with Junit5 and fix test dependency by @henning-gerhardt in #6078
• [Kitodo-DataEditor] Replace Junit4 with Junit5 by @henning-gerhardt in #6079
• Fix wrong value for the metadata "processTitle" in process hierarchies by @BartChris in #6080
• Handle exception during Kitodo Script execution by @solth in #6083
• Add missing line for version 3.4 to SECURITY.md by @solth in #6090
• Remove not-implemented interface by @matthias-ronge in #6046
• Add test for CountableMetadata by @solth in #6097
• [Kitodo-DataManagement] Replace Junit 4 with Junit 5 by @henning-gerhardt in #6092
• Add tests für CalendarService by @oliver-stoehr in #6102
• Sort list for correct test comparing by @henning-gerhardt in #6103
• Fix typo: add missing "r" by @gerlingsm in #6113
• Fix display customization menu being unusable after updating file references by @solth in #6101
• [Kitodo DataFormat] Replace Junit4 with Junit5 by @henning-gerhardt in #6104
• Fix typo by @matthias-ronge in #6122
• Add relation between import configurations and clients by @solth in #6124
• Use special property revision to set the version only once by @stweil in #6127
• Process parent link by @solth in #5869
• Remove execute right from shell files by @henning-gerhardt in #5978
• Allow quotes in imported csv files and make mass import more resilient by @BartChris in #6012
• Add logging for Service Manager by @matthias-ronge in #6107
• Fix mets file id check including an option for use of this check by @henning-gerhardt in #6123
• Update mockito version (required for OpenJDK 22) by @stweil in #6136
• Make DocketTest an integration test by @matthias-ronge in #6121
• Keep previous selection of new structure type if possible by @oliver-stoehr in #6120
• docs: Remove reference to non-existing file contentServerConfig.xml by @stweil in #6115
• Add option to show last comment directly in comment column by @oliver-stoehr in #6150
• Improve filter menu suggestions by @oliver-stoehr in #6147
• [Kitodo Core] Replace Junit 4 with Junit 5 by @henning-gerhardt in #6093
• Remove junit4 support by @henning-gerhardt in #6163
• Add missing Override annotation by @solth in #6157
• Correction comment state by @solth in #6155
• Enrich process with LABEL and ORDERLABEL during mass import by @BartChris in #6143
• Revert "Use special property revision to set the version only once" by @henning-gerhardt in #6156
• Kitodo.Production 3.7.0 by @solth in #6169

Full Changelog: kitodo-production-3.6.0...kitodo-production-3.7.0

Known bugs: https://github.com/kitodo/kitodo-production/issues?q=is%3Aissue+is%3Aopen+label%3Abug