Version 1.1.0

Owned by Sofia Ho
Last updated: Apr 18, 2024
2 min read

Release Notes

Release Date: August 11th, 2022

What’s New

We’re pleased to announce version 1.1.0! This minor release includes a new Elasticsearch connector, a new Find Entity processor and a new OpenSearch hydrator! We have enhanced security by enabling basic user and password authentication on several components. We have also upgraded our components to use Java 17 and Micronaut 3.x. Continue to read on for all new features, bug fixes and improvements.

New Components

New Components

Description

New Components

Description

Elasticsearch Connector

Retrieves data from Elasticsearch

Find Entity Processor

Identifies an entity based on the configured parts of speech tags (NOUN, ADJ, JJ, JJR, JJS, AFX, NN, PROPN, NNP, NNPS, NNS) and the number of tokens that makes up the entity.

OpenSearch Hydrator

Sends data to OpenSearch index

New Features

Components

New Features

Components

New Features

Admin API

  • Basic authentication

Discovery API

  • Basic authentication

  • Enabled to capture user feedback

  • Supports OpenSearch

Elasticsearch Connector

  • Basic authentication

Field Mapper

  • Transliteration: Normalizes accents and special characters.

    • For example: Béla HARSÁNYI -> Bela HARSANYI

Staging API

  • Basic authentication

Others

  • Upgraded to Java 17

  • Upgraded to Micronaut 3.x

Supported Versions

Discovery provides support and bug fixing for the following versions:

  • Version 1.0

Deprecated Versions

Releases that are no longer recommended for use are listed below.

  • 0.9 or previous

Breaking changes

  • Parameter “recordData” in the config has been renamed to “recordDataStrategy” and it should be used outside of the config block

Bugs Fixed

  • When trying to clone a processor, the processor was getting overwritten and not getting cloned

  • Elasticsearch connector was not adding all document data during scan

  • Field mapper creates empty nodes when the source field is missing

  • Only call scanner.calculateDiff when required

Improvements

  • Added a cache for instantiated variables and objects for the script processor to improve performance

  • Integrated Datadog with OpenSearch to enable monitoring

  • Refactored pdp-core to use Reactor instead of RxJava

  • Maintenance job is triggered as a broadcast when the seed is deleted

  • Cleaned up deprecated classes that have been replaced by resilience4j

  • Refactored spaCy client from Discovery API into Core Repository

  • Modified the NLP processor so it uses the spaCy client provided by the Core Repository

  • Merged JobService and JobStorageService

  • Removed storage service in favor of repositories

 

©2024 Pureinsights Technology Corporation