Documentation Index

Fetch the complete documentation index at: https://docs.lobster-world.com/llms.txt

Use this file to discover all available pages before exploring further.

_data release 4.6.12

Prev Next

Release notes – LDP – data-4.6.12

Release date: 2024-10-30

This version contains all tickets of 4.6.12-BETA plus additional bug fixes and minor improvements.

Notes

setMaxMessageSize in startup.xml now only allows values up to (including) 2,097,151 kiB as limit. If a larger value is set it led to the deactivation of the max size check, except when downloading files via FTP where all files (independent of their size) were rejected. With this patch, attempts to set larger values will lead to a failure during startup. Please check your setting and adjust it to a working value, accordingly.

PrintCustomResponse is now deprecated: As many issues with printer connections are typically caused by configuration issues in the driver or operating system, Lobster_data is unable to provide support. Consequently, we have decided to discontinue support for this class. However, existing processes will not be affected and will continue to function in the future. Additionally, many printers already support various protocols, such as FTP or SMB, and can accept jobs via these.

MongoDB: Updated and compiled MongoDB support using latest version 5.1.1 - will not work with older version 4.x drivers.

Phase 3 performance updates: the initial loading of the mapping structure has been optimized, significantly improving performance, especially for large source or destination trees.

Bug fixes

DATA-42660

Phase 1 (Cron:SQL): fixed possible NullPointerException in MultipleSqlCron.

DATA-42639

Phase 3 (Mapping Test): IU preview switches to wrong encoding.

DATA-42665

Phase 6 (Message): don't fill queue context and name if profile does not belong to the same client.

DATA-42687

Profile: Fixed file name containing Job*** is changed to JOB***.

DATA-42696

SQLBulkUnit: Salesforce Bulk Unit doesn't work with the new driver version.

DATA-42673

Dashboard: Graph does not refresh after changing from node controller to working node.

DATA-42634

Channel (HTTP): empty OAuth2 Access Refresh Token.

DATA-42481

Swagger: Wrong comma when using "enum" by setting allowed attribute.

DATA-42663

Cloud Storage Cron Legacy Connection: Deletion of processed file fails.

DATA-42695

Cloud Storage Cron: File Pattern does not apply on literal file name (AwsS3Storage).

DATA-42642

Preparser: EncodingByBomOrXmlPreParser to refer to XML Header.

DATA-42248

Fixed fetching of config for session manager.

DATA-42570

Hide container scrollbar and centering fix for diagrams.

Features

DATA-42523

ETL: support JSONLines in data source JSON.

DATA-42657

Macros: offer copy/paste of functions.

DATA-42618

Crypto: Added support for the new OpenSSH export format.

DATA-42667

Channels: Show the number of channels / filtered channels in the channel overview footer.

DATA-37850

Support for ZUGFeRD 2.2

DATA-42475

HttpClient: configurable CookieSpec behavior when using "lobster_cookiespec" header.

Misc

DATA-42674

TCP: optimize getting job count on queue.

DATA-42533

Client side optimization in visualization of large trees.

DATA-42714

CData: Added Workday JDBC Driver to Business Connector Overview.

Removed vtd (xml) debug terminal messages.

ETL: file preview encoding fix.

ETL: omit line break auto append for templates without velocity engine.

ETL: fixed potential ClassCastException from Json parser & fixed ".." extract variables feature used by UI.

ETL: fixed field prefix wrapping for generated SQL statements.

Release notes – LDP – data-4.6.12-BETA

Release date: 2024-09-24

Bug fixes

DATA-42095

Modules: refresh entries before drag & drop in different group to avoid cache problems.

DATA-41972

Logs: system logging tab should not initially be visible when you don't have the permission.

DATA-42184

Jobs per profile: Context menu does not appear.

DATA-41994

Suspend table check requires a dw_log_fields table on the hub database even if log db is defined.

DATA-42003

AMQP: importing AMQP Profile created in 4.1.0 to 4.6.10 is not compatible.

DATA-42063

SAP: ability to use Idoc templates when only being connected to a SAP system.

DATA-42209

TCP: unable to add multiple TCP/IP clients with same port.

DATA-41971

Databases: show all database aliases regardless of client limitations.

DATA-42522

Databases: fixed bug leading to the truncation of micro- and nanoseconds.

DATA-42069

TestCaseManager: stop testcases when license expires.

DATA-42331

GoogleCloudStorage: Root Objects Not Accessible.

DATA-42508

Cloud Storage Cron: variable VAR_SYS_FILE_PATH contains only path fragment. VAR_SYS_FILE_PATH contains just the path of directories, without the final file name. The file name is available via VAR_FILENAME.

DATA-42500

Modules: check group existence before moving via drag & drop.

DATA-42067

Phase 1 (Cron:HTTP): preceding plus char is appended for every query parameter if url encoding is enabled.

DATA-42124

Phase 1 (Cron:SQL): select statements with join condition(s) are truncated for creating tree.

DATA-41010

Phase 1 (OPC UA): Subscription settings are not saved if only IoT client has been activated.

DATA-42202

Phase 3: function "send mail" ran into an exception when logging filter messages and trying to send a mail using default configuration.

DATA-42356

Phase 3: function "delete-file-or-directory" didn't delete files containing particular characters.

DATA-41996

Phase 3: function "abort job and schedule again after x seconds" should not reset timer on server restart.

DATA-42518

Phase 3: function "http" cuts mime-type (parameter f) when using own media-type.

DATA-42490

Phase 3: test files are sorted incorrectly in the restart dialog box.

DATA-41584

Phase 6 (OFTP via DMZ): fixed effect leading to empty dw_... directories after successful sending attempts.

DATA-42515

ASM: check directory in files view (IndexOutOfBoundsException).

DATA-42567

ETL: not all possible fields are offered in GUI if a complex SQL statement is used.

DATA-42249

Don't show EDIFACT-templates when trying to load Tradacoms templates.

DATA-42246

Possible reset of permanent ids on startup if hub database becomes available mid startup.

DATA-42614

Update-Service: incorrectly distributed _pro_dmz patch.

DATA-42284

Plugins (SQL Console): timeout in SQL Console does not work.

DATA-42536

Plugins (SQL Console): select statement is being executed as update in SQL Console when certain white spaces are used.

DATA-39689

Expired certificates: exclude "let's encrypt" certificates in home view and pinboard (fixed).

DATA-42203

setMaxMessageSize only supported values up to ca. 2 GB but allowed higher values to be set essentially leading to the deactivation of that function.

DATA-42486

Variable AMQP_Type is not passed to JMS header.

DATA-42488

ContentInspection: Index out of bound exception if merge class does skip all files.

DATA-42578

ExcelWithHeaderUnit: Invalid column index exception when a series of empty rows is created.

DATA-42584

dw_log_fields entries are not replicated to DataCockpit (using a SQL database).

DATA-42598

Some function extends from wrong super class and therefore are shown in DataFlow diagram.

DATA-42579

FTP-client operations: Fixed issue with TLS session resumptions when SNI is used when communicating with particular FTP-servers.

DATA-42591

OPC/UA: fixed NullPointerException in IoT-filter when trying to access fields as folder.

DATA-42316

OPC/UA (client configuration): omit the username and password in the XML when saving the configuration with empty fields.

DATA-42513

Semantic check: Iterations of a node does not work.

DATA-41680

Channel (HTTP): refresh token fix exception (NPE).

DATA-42243

Update-Center: login waits until patch request.

DATA-42407

Adjust background http requests from www.lobster-world.com to prevent unnecessary loading time.

DATA-42106

DataCockpit SSO: login doesn't redirect correctly.

DATA-42222

DataCockpit: Roles overwriting user right "May see all profiles of selected client".

Features

DATA-38079

Phase 1 (Cron:DB): possibility to adjust timeout for test sql.

DATA-42086

Phase 1 (Http): optional response with empty payload.

DATA-42001

Phase 3: function "decode base64" got a new parameter to configure the behavior in case of a decoding error.

DATA-42064

Phase 3: function "extract xml" got a new parameter allowing to specify a map containing namespace definitions.

DATA-42464

Phase 3: new function "perform MongoDB operation".

DATA-42420

Phase 3: new function to set status message of a running profile during Phase 3.

DATA-42074

Phase 3: offer search & replace of namespaces.

DATA-41885

Phase 3: create structure from clipboard (enter text manually).

DATA-41596

Phase 6: SignXMLPostExecutor can now be configured in order to change signature algorithm, type, etc.

DATA-42549

SignXMLPostExecutor and XMLNoTemplateUnit now support more signature algorithms and key types.

DATA-42450

New custom response "MongoDBResponse".

DATA-41993

New system function to replicate a file on a load balance environment.

DATA-42296

Expert Search (Profile): add option to search for profile changes (history notes).

DATA-42201

New PreParser for the validation of an xml against an xsd.

DATA-41862

Schematron validation preparser.

DATA-42482

Show macro Id in Macro management view.

DATA-41791

TestCaseManager: add shorter time periods for TestCase deletion.

DATA-42026

CloudStorage Azure File: NPE when accessing file in root folder.

DATA-42010

JSON IU: offer NoUnicodeEscapingTransformer to prevent replacing chars with unicode.

DATA-41600

Extend Mapping Plan for repetitive Edifact data elements.

DATA-41540

Update-Center: Download each CData driver individually.

DATA-41655

Swagger-/OpenAPI: Interface description responses.

DATA-42481

Swagger-/OpenAPI: Data type additional allowed attribute "enum".

DATA-41567

SQL assistant: select views from database.

DATA-42275

New report about (un)used channels.

DATA-41707

Constants: include statements and config files for constant usage report and offer preselection in const overview.

DATA-42268

Offer permanent profile values in sql, mongo & http cron settings.

DATA-42302

CryptoTools: Added support for the import of binary PKCS#8 encrypted private keys (.epk-files).

DATA-42325

Offer sql timeout for basic SQL and business connector SQL.

DATA-42337

GeneratePdfPostExecuter now supports ZPL as report type. In order to actually be able to use this, an additional library in addition to Jasper reports is required.

DATA-42394

SshService: Implemented workaround to ensure shutdown of network connection with some versions of the SSH-Library.

DATA-41799

FtpService: Allow commands PBSZ and PROT to be issued before authentication.

DATA-42457

TemplateParserUnit: ability to offer more encoding than ISO-8859-1.

DATA-42484

Support of "abort all execution exception" during "check environment phase".

DATA-42581

Retrieval of SSH-server-keys could end up in a NullPointerException if the connection ran into a particular error.

DATA-42501

ErrorRetrieveCron: Class lists only the first error of a job.

DATA-42442

Optional new limit for max. records of a profile.

DATA-42475

HttpClient: configurable CookieSpec behavior.

DATA-42016

Workflow: show job number in workflow log and the workflow name in triggered profile job log.

DATA-42293

Support ZIP files in "Import CSR" file upload.

DATA-42651

Optimize GUI and StorageService for Redis DB.

Usability

DATA-42580

Cron Connectors: Improve usability by adding link to tutorial.

DATA-41883

Phase 3: open in new browser tab possible with mouse over icon on the context menu item.

DATA-42147

Phase 3: improved handling of field assignment when mapping source to target structure (larger drop zone).

DATA-42533

Phase 3: performance improvement of mapping trees for large structures.

DATA-42146

Phase 6: optimize width of response unit window.

DATA-41727

ASM: tooltip for base dir requirements when using load balance.

DATA-41886

Display checkbox "via DMZ" only when configured.

DATA-40035

Automated search in restart job dialog when user settings have "auto search" enabled.

DATA-41891

TransportManager: menu items in navigation should be disabled without a valid connection to remote server.

DATA-42541

CertificateExchange: change grid column name "Error Text" to "Info text".

DATA-42554

Partner channel: Context based help within specific channel types.

DATA-42571

Channels (HTTP): Tooltip for "Use preemptive login" checkbox.

Misc

DATA-42407

Adjust background http requests from www.lobster-world.com to api.lobster-world.com.

DATA-41363

Phase 0: change default encoding from 8859-1 to UTF-8 for JSON and XML (include identical value ISO-8859-1).

DATA-41992

Phase 1: reset field "Start on IS only" (factory name) on non load balance systems.

DATA-41973

View passwords in the channel settings as a non-administrator.

DATA-42168

Added EDIFACT templates for 88.1, 90.1, 90.2, 91.1, 91.2, 92.1, 93.2

DATA-42358

HTTP Server: Update Jetty library to 10.0.24

DATA-41940

SSH Service: Update SSH library to 1.7.59

DATA-42250

FtpServer and Monitoring: Avoid log flooding by shortening messages if the error is occurred by a bad behaving monitoring system.

DATA-42248

Added timeout for ClientSession based on Vaadin heartbeats.

DATA-42487

Statistics overview: tooltip for time in ms.

DATA-42516

Increase initial "valid until" value to 50 years.

DATA-42519

Remove paper plane icon due to similarity to Telegram icon.

DATA-42534

Expert search: support for searching mails in cc/bcc.

DATA-42526

Fixed possible memory leak in main view.

DATA-42301

Fixed a problem in BouncyCastle leading to the effect that TLS-Server were ignoring EC-based keys for the handshake.

DATA-41978

Workflow: sync-triggered jobs are not shown by its job# in the Jobs overview.

DATA-42381

DataCockpit: Documentation for using cookies.

ETL: Fixed clipboard lookup.

Char replacement for prefix text ("." to "_") when adding profile to source tree.

Added additional info to Insight _data.

Language fixes.