D4.3 – The PISTIS Product Beta version

This document, Deliverable D4.3, serves as the accompanying manuscript for the Beta version (second release) of the PISTIS Platform, with the source code available via GitHub. This high-fidelity prototype evolves the Alpha version (D4.2) into a fuller, production-ready, federated platform designed to support demonstrator scenarios by interconnecting components developed in WP2 and WP3.

The PISTIS platform comprises a global PISTIS Cloud Platform (the “PISTIS Marketplace” at https://www.pistis-market.eu) and local “PISTIS Data Factory” environments deployed privately by stakeholders.

The Beta release significantly enhances the platform across key areas:

  • Data Ingestion and Preparation: Adds end-to-end streaming via Kafka, broader batch check-in (more formats, FTP/API), a redesigned, no-code Job Configurator (scheduling, GDPR check, encryption, lineage), smoother data transformations, and automatic, insight-driven data quality assessment.
  • Data Discovery and Exchange: Features a rebuilt Marketplace UI, an updated metadata model (with anonymised/transformed flags), a new recommender system, and searchable encryption supporting sentence-level semantic queries. The Factory Connector now supports subscriptions and stream transfers.
  • Trust and Compliance: Integrates a richer Smart Contract Checker (ODRL modeling), GAN-based synthetic data generation, quantitative k-anonymity risk metrics, lineage diffs with blockchain anchoring, and an ontology-driven GDPR Checker. Security is advanced with OpenDSU and SSI keys for encryption, and the User Wallet now handles NFT/investment/subscription flows.
  • Monetisation and Finance: Expands with offer drafting, RDF-based asset bundling, integrated FAIR valuation, an NFT Generator, an Investment Planner, and a Digital DLT-FIAT Wallet supporting investment reimbursements and ISO 20022 FIAT integration. Ledgers are upgraded to handle NFT, subscription, and investment flows.
  • System and Identity Management: Includes an Identity Manager with eIDAS support (Keycloak v25), a standalone Access Policy Editor, a Data Factory-level System & Activities Monitor, and integration of AI repositories and the Model Editor into the platform UI.

The deliverable also provides an update on the PISTIS architecture and component changes that have evolved since D4.1.