This processor allows the reading parquet files from a PDP record.

Supported parquet types include:

• String
• List
• Int64
• A date in Int96 format
• Boolean

Configuration

Example configuration in a processor:

{
  "type": "parquet-processor",
  "name": "Parquet processor",
  "description": "This is a parquet processor configuration.",
  "config": {
    "key": "/blob"
  }
}

config.key

(Required, String) Record field where the parquet content can be found

Output example

{
  "Occupation": "Assistant",
  "Email": "user@example.com",
  "Phone": "555-1111",
  "First Name": "Name",
  "__pdp__": {
    "id": "INSERT-0-0",
    "checksum": null,
    "originalId": "INSERT-0-0",
    "prefixedId": "INSERT-0-0",
    "action": "INSERT",
    "seedId": "7bf01fa9-64c2-4926-88e4-62f66c608b73",
    "executionId": "f2d3c3f6-7d0c-404e-ad00-c34ef768b612",
    "executionStart": 1730218616320,
    "parentId": "INSERT-0",
    "errors": null,
    "pdpData": true,
    "errored": false
  },
  "Last Name": "LastName"
}