Release Notes

Release Date: November 8th, 2022

What’s New

As we continue to build our cloud-native architecture, we are building components to integrate with other cloud services. In this release, you can select AWS DocumentDB as the provider for your Staging Repository. We’ve also built a MongoDB Atlas Hydrator so you can send data to MongoDB’s cloud solution: MongoDB Atlas. Continue to read on for all new features, bug fixes, and improvements.

New Components

New Features

Others

• Farbic8 updated to version 6.1.1

• OkHttp updated to version 4.9.3

• Caffeine updated to version 2.9.3

Supported Versions

Discovery provides support and bug fixing for the following versions:

• Version 1.1.0 or newer.

  • “recordData” parameter has been changed to “recordDataStrategy”.

  • To use “recordDataStrategy”, it must be set outside of the config block.

• Version 1.0.0 is still currently supported, but will become deprecated by December 2022. If you are in this version, plan to upgrade soon.

Deprecated Versions

Releases that are no longer recommended for use are listed below.

• 0.9 or previous

Bugs Fixed

• Discovery API’s Post Component was failing to parse response from elastic

• Prevent creation of seeds with duplicate name

• Mongo credential source should default to “admin”

• Failed to encode 'Credential'. Encoding '_id' errored with: Can't find a codec for class java.lang.Object

• Import fails with unhelpful error message

• Aggregation merge should support empty values and also others than just content

Improvements

• Staging Repository using DocumentDB supports aggregation stages

• Jobs can be configured with a global timeout setting

• Support long input for TriggerProperties

• Ingestion projects should inherit Staging version from ingestion-common

• Port aggregation optimization tweaks

• Add new step for staging to check for specific fields

• Add individual initiation of engines in security component (discovery-api)

• Update components to use new Credential format

• Clean-up duplicate code and package Search Engine common code

• Update snap component (discovery-api) for OpenSearch

• Update security component (discovery-api) for OpenSearch

• Remove Guava dependency

• Enable encode endpoint to pdp-hugging-face-service to create sentence embeddings

• Create an endpoint to download models from hugging-face

• Implement call to get the status of all buckets in the staging client

• Credentials Service uses SecretsService

• Update vectorQuery component (discovery-api) for Opensearch

• Remove IngestionConfig in favor of configuration properties