Ability to define data targets in CloverDX Data Catalog and Wrangler to allow you to connect and write your data to any system.
New mapping mode in Wrangler will help you transform incoming data into the required layout.
Integrate your Wrangler transformations into Designer-built processes ensuring that your domain experts/business users can effectively collaborate with your data engineering team.
New validation steps in CloverDX Wrangler will help you quickly validate your data and increase confidence in your results.
New Snowflake and Google BigQuery connectors in CloverDX Marketplace. Snowflake connector allows you to write to Snowflake from your Wrangler jobs while BigQuery is designed for high-performance writes from your graphs.
Other features, including:
Health check job for your libraries to allow you to monitor connectivity to your sources and targets
Support for CloverDX Server deployments on Java 17 for increased performance and security
Platform updates and security fixes
Usability improvements
3. Release highlights
Data Targets in Data Catalog
Interactive visual data mapping in Wrangler
Wrangler jobs as business logic in graphs
New steps in Wrangler: validation and data transformation
Health check for CloverDX libraries
Java 17 support
See full release notes for more details
4. Data targets in Data Catalog
Publish data targets for Wrangler users to write data to
Concept analogous to Data sources – built and deployed via CloverDX libraries
Targets are implemented as subgraphs – allows custom logic, post processing, validations,…
Standard targets and target templates available on CloverDX Marketplace
5. Visual data mapping in Wrangler
Data target can define data layout: required and optional columns
Interactive mapping mode in Wrangler to map to requested layout
Interactive mapping with online validation for quick response
Automapping functionality to help when mapping large number of columns
6. Wrangler jobs as business logic in graphs
Let the core business logic be implemented by the domain experts
Business users implement mappings and business logic as Wrangler jobs
IT Integrates these Wrangler jobs as components of larger graphs
WRANGLER DESIGNER
7. New Wrangler steps
New validation steps for increased trust in your data
Validate if not empty, Validate value range, Validate pattern match, Validate text length, and
Validate against list
Transformation steps
Split column to split a column into multiple columns
based on a delimiter
Improved formula editor with content assist and real-
time syntax validation
8. Library health check
Verify connector health
Test connections to databases, APIs, file
systems, …
Schedule to check health periodically
Monitoring and notifications
Monitor library status via Dashboard
Send notifications on failures, configure
severity for each connector separately
9. Platform updates
Support for Java 17 when running our Apache Tomcat stack
All stacks still use Java 17 as default except for Docker to allow Job queue
Benefits of Java 17
Better performance – both in speed as well as lower memory consumption
Job queue can be enabled in Docker containers
JDK 17 is LTS – will be supported until at least 2027, JDK 11 ends in 2024
Application server Java
Apache Tomcat 9 Eclipse Temurin JDK 11 or JDK 17
VMware tc Server Standard 4.1 (Tomcat 9) Bellsoft Liberica OpenJDK 11
Red Hat JBoss Web Server 5.4 Red Hat OpenJDK 11
10. New libraries in Marketplace
Snowflake data target
Data target for high-performance writes to Snowflake
Does not require any specific metadata
Google Big Query
Support for writing to Big Query using high-performance streaming API
Primarily Designer usage but also Wrangler data target
11. Other changes
Snowflake driver update
Newer driver fixed various issues and supports new (simpler) JDBC URL
Support package and logs: download packages and logs with single click
Download support package from all cluster nodes at once
Download logs for complete execution tree with single click
New APIs
Abort job via REST API
Support package download API for single node as well as whole cluster
12. Compatibility
SMB (Samba) access change: no anonymous access allowed
CloverDX now implements stricter access control to comply with SMB specs. Create a guest
user without a password as a workaround.
Disallow sandboxes with reserved names/locations
Cannot create sandbox Libraries, Sandboxes etc. to prevent collisions with built-in locations