Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Version

Summary

1.14.0

(February 19th, 2024)

  • Elasticsearch Connector:

    • Option to use aggregations as a starting point has been enabled.

  • Language Detector:

    • Option to define more than 1 field to be recognized by the language detector.

  • Bugs Fixed: 0

  • Minor Improvements: 0

Expand
titleOthers

PDP Discovery 1.13.0 was tested in AWS EKS v1.28

Release Notes

1.13.0

(January 2nd, 2024)

  • Chunk Processor:

    • Overlapping sentences: Overlap size is configurable.

  • Breaking changes:

    • If upgrading from a version prior to 1.7.0, export the existing configuration, delete the configuration indices (ingestion: seed, processor, and pipeline / discovery: endpoint and processor), and re-import it after the upgrade has been performed.

  • Bugs Fixed: 0

  • Minor Improvements: 0

Expand
titleOthers

PDP Discovery 1.12.0 was tested in AKS v1.28 with Azure CNI.

PDP Discovery 1.11.0 was tested in GKE v1.28.4 with GCP.

Release Notes

1.12.0

(November 23rd, 2023)

  • ChatGPT Completions Processor (alpha version):

    • Parameter added so model is configurable.

  • Hugging Face Service now supports:

    • Summarization: Given a text the main ideas will be extracted from within that text.

    • Sentiment Analysis: Given a text, it will be classified into positive, negative, or neutral according to its perceived emotion.

    • Zero-shot Classification: Given a text and a set of labels, the text will be classified into the best fitting label.

  • Chunk Processor:

    • Overlapping sentences: The chunks are created using a fixed number of contiguous sentences, incrementing the position of the first sentence for each chunk, until the full text is exhausted.

  • Breaking changes:

    • If upgrading from a version prior to 1.7.0, export the existing configuration, delete the configuration indices (ingestion: seed, processor, and pipeline / discovery: endpoint and processor), and re-import it after the upgrade has been performed.

  • Bugs Fixed: 0

  • Minor Improvements: 0

Expand
titleOthers

PDP Discovery 1.11.0 was tested in GKE v1.27

Release Notes

1.11.0

(October 16th, 2023)

  • Discovery API supports OpenAI integration (alpha version):

    • OpenAI Query Embeddings Processor

    • ChatGPT Completions Processor

  • Ingestion API supports OpenAI integration (alpha version):

    • OpenAI Embeddings Content Processor

  • RDB Connector supports connections to MSSQL. It can also execute and retrieve data from a stored procedure within MSSQL.

  • Staging API supports:

    • Regex filters

    • ‘Lower than or equal' and 'Greater than or equal’ operations.

  • Breaking changes:

    • If upgrading from a version prior to 1.7.0, export the existing configuration, delete the configuration indices (ingestion: seed, processor, and pipeline / discovery: endpoint and processor), and re-import it after the upgrade has been performed.

  • Bugs Fixed: 1

  • Minor Improvements: 4

Expand
titleUpgraded dependencies

Graalvm updated to version 23.0.1

Micronaut BOM updated to version 3.10.0

Micronaut OpenAPI updated to version 4.10.0

PDP Discovery 1.9.0 was tested in AKS v1.25.11, v1.26.6, and v1.27.1

Release Notes

1.10.0 (August 30th, 2023)

  • Search UI endpoint is configurable

  • Website connector can filter by content type

  • Breaking changes:

    • If upgrading from a version prior to 1.7.0, export the existing configuration, delete the configuration indices (ingestion: seed, processor, and pipeline / discovery: endpoint and processor), and re-import it after the upgrade has been performed.

  • Bugs Fixed: 8

  • Minor Improvements: 3

Expand
titleUpgraded dependencies

SnakeYAML upgraded to version 2.0

Graalvm upgraded to version 23.0.1

Release Notes

1.9.0

(July 18th, 2023)

  • Binary Data Service supports Azure Blob Storage.

  • ‘Show more’ option for featured snippets

  • Breaking changes:

    • If upgrading from a version prior to 1.7.0, export the existing configuration, delete the configuration indices (ingestion: seed, processor, and pipeline / discovery: endpoint and processor), and re-import it after the upgrade has been performed.

  • Bugs Fixed: 3

  • Minor Improvements: 9

  • PDP Discovery 1.9.0 was tested in AKS v1.25.11, v1.26.6, and v1.27.1

Release Notes

1.8.0

(June 6th, 2023)

  • Binary Data Service supports GCS

  • Semantic Title Search

  • Breaking changes:

    • If upgrading from a version prior to 1.7.0, export the existing configuration, delete the configuration indices (ingestion: seed, processor, and pipeline / discovery: endpoint and processor), and re-import it after the upgrade has been performed.

  • Bugs Fixed: 8

  • Minor Improvements: 6

Release Notes

1.7.0

(April 25th, 2023)

  • Binary Data Service supports S3

  • Breaking changes:

    • If upgrading from an older version, export the existing configuration, delete the configuration indices (ingestion: seed, processor, and pipeline / discovery: endpoint and processor), and re-import it after the upgrade has been performed.

  • Bugs Fixed: 8

  • Minor Improvements: 5

Expand
titleUpgraded Dependencies

Apache Commons Collections updated to version 4.4

Apache Commons IO updated to version 2.11.0

Apache Commons Lang updated to version 3.12.0

Apache Commons Pool2 updated to version 2.11.1

AWS Java SDK S3 updated to version 1.12.412

Cron Utils updated to version 9.2.0

Fabric8 updated to version 6.4.1

Groovy updated to version 3.0.14

Hoverfly updated to version 0.14.3

Jackson updated to version 2.14.1

JSONPath updated to version 2.7.0

Jython updated to version 2.7.3

OkHTTP3 Mock Web Server updated to version 4.10.0

MongoJack updated to version 4.8.0

MongoDB updated to version 4.8.2

Nashorn updated to version 15.4

OkHTTP3 updated to version 4.10.0

Quartz updated to version 2.3.2

RabbitMQ updated to version 5.16.0

Reflections updated to version 0.10.2

Resilience4j updated to version 2.0.2

Rhino updated to version 1.7.14

Snappy updated to version 1.1.9.0

SSHj updated to version 0.34.0

Zstd updated to version 1.5.4-2

EvalEx updated to version 3.0.3

SystemStubs Jupiter updated to version 2.0.2

Java JWT updated to version 4.2.2

JWKS RSA updated to version 0.21.3

Lingua updated to version 1.2.2

Azure Blob Storage updated to version 12.20.2

Azure Identity updated to version 1.8.1

MySQL updated to version 8.0.31

MySQL Test updated to version 1.17.6

AWS Java SDK S3 updated to version 1.12.430

Norconex HTTP Collector updated to version 3.0.0

Apache Bridge updated to version 2.7.5

Open CSV updated to version 5.7.1

JMESPath Jackson updated to version 0.5.1

JSoup updated to version 1.15.4

Lingua updated to version 1.2.2

Tesseract For Java updated to version 5.5.0

Groovy updated to version 4.0.10

Jython updated to version 2.7.3

Javascript Engine updated to version 22.3.0

Apache Tika Core updated to version 2.6.0

Neo4j Driver updated to version 5.5.0

OpenSearch updated to version 2.5.0

Release Notes

1.6.0

(March 14th, 2023)

  • HuggingFace service

  • Discovery API components integrated with credentials service

  • Upgraded MongoDB dependency to version 6.0.3

  • Breaking changes:

    • When configuring the S3 connector, the region must be in the format AWS requires it. (e.g. “us-east-1” instead of “"US_EAST_1")

  • Bugs Fixed: 6

  • Minor Improvements: 7

Release Notes

1.5.0

(February 1st, 2023)

  • Engine scoring for Search Relevancy Scoring Dashboard

  • Discovery API supports Atlas vector search

  • Discovery API: Elastic component upgraded to work with ES 8.x

  • Bugs Fixed: 2

  • Minor Improvements: 13

Release Notes

1.4.0

(December 21st, 2022)

  • Mongo Atlas connector

  • Staging API supports batch requests

  • Discovery API supports Mongo Atlas

  • User feedback can be applied to search results

  • Bugs Fixed: 3

  • Minor Improvements: 7

Release Notes

1.3.0

(November 8th, 2022)

  • Mongo Atlas hydrator

  • Staging repository can be used in Discovery API

  • Staging repository supports DocumentDB

  • Ingestion API: Seeds can be paused and resumed

  • Bugs Fixed: 6

  • Minor Improvements: 18

Expand
titleUpgraded dependencies

Farbic8 updated to version 6.1.1

OkHttp updated to version 4.9.3

Caffeine updated to version 2.9.3

Release Notes

1.2.0

(September 27th, 2022)

  • Secrets service

  • Discovery API: Snap Component can be configured to use “OR” or “AND”

  • Basic authentication for several components

  • Staging Repository: Bucket status can be retrieved and paginated

  • Bugs Fixed: 2

  • Minor Improvements: 9

Expand
titleUpgraded dependencies

CronUtils updated to version 9.2.0

Jackson updated to version 2.13.2

Groovy updated to version 3.0.11

MongoDB updated to version 4.7.0

Mongojack updated to version 4.7.0

Nashorn updated to version 15.3

sshj updated to version 0.33.0

zstd updated to version 1.5.2-2

Tika updated to version 2.3.0

Release Notes

1.1.0

(August 11th, 2022)

  • Elasticsearch connector

  • Find entity processor

  • Opensearch hydrator

  • Breaking changes:

    • “recordData” parameter has been changed to “recordDataStrategy”.

    • To use “recordDataStrategy”, it must be set outside of the config block.

  • Bugs Fixed: 4

  • Minor Improvements: 9

Release Notes

...