TotalAgility Kafka Connector
Download TotalAgility Kafka Connector Overview
Features
Seamless Kafka integration
Directly connects Tungsten TotalAgility workflows with Kafka to publish business and lifecycle events in real time.
REST-based event publishing
Uses Kafka REST APIs to publish events, making the connector cloud-friendly and easy to deploy without native Kafka client dependencies.
Generic and reusable event model
Supports publishing structured events using a standard envelope while allowing full flexibility for business-specific data payloads.
Configuration via TotalAgility Server Variables
Kafka connection details such as REST endpoint, topic name, and authentication credentials are managed centrally using TotalAgility Server Variables.
Supports event-driven process design
Enables TotalAgility processes to emit events at multiple stages, supporting downstream orchestration, analytics, and monitoring use cases.
Secure authentication
Uses API key–based authentication over HTTPS to securely publish events to Kafka environments.
Decoupled enterprise integration
Allows multiple downstream applications to independently consume events from Kafka without impacting TotalAgility process execution.
Cloud and on-prem ready
Works with Confluent Cloud Kafka and Apache Kafka deployments that expose REST-based producer endpoints.
Benefits
Automates the publication of business and lifecycle events from TotalAgility to Kafka, reducing the need for custom integrations and manual data handoffs.
Enables event-driven integration between TotalAgility and downstream systems, supporting real-time processing, analytics, and orchestration.
Decouples TotalAgility workflows from consuming applications, allowing multiple systems to independently react to the same events.
Provides a consistent and reusable event publishing mechanism using a standard event structure defined at the process level.
Centralizes event distribution through Kafka, creating a reliable event backbone for enterprise integrations.
Delivers a ready-to-use connector that can be configured using TotalAgility Server Variables, with no custom Kafka client development required.
Technical Details
Inputs
Kafka REST Base URL – The Kafka REST endpoint used to publish events (for example, Confluent Cloud or a REST Proxy endpoint).
Kafka Cluster ID – Identifier of the Kafka cluster where the target topic is hosted.
Kafka Topic Name – The Kafka topic to which events will be published.
API Key – Kafka API key used for authenticating REST requests.
API Secret – Secret associated with the Kafka API key.
TotalAgility SDK URL – URL for connecting to the TotalAgility SDK service, used to retrieve runtime context and server variables.
Session ID – Active TotalAgility session identifier.
Event Type – Logical name of the business or lifecycle event being published (e.g., ServiceRequestReceived, ServiceRequestCompleted).
Process Name – Name of the TotalAgility process generating the event.
Job ID – TotalAgility Job ID used to uniquely identify the business transaction.
Environment – Execution environment identifier (e.g., DEV, TEST, PROD).
Additional Data (JSON) – A JSON-formatted string containing event-specific business data defined by the TotalAgility process.
Outputs
The Kafka Connector produces one or more of the following outputs after execution within a TotalAgility workflow:
Event Publication Confirmation – Indicates that the event has been successfully published to the configured Kafka topic.
Kafka Topic Information – Confirms the target Kafka topic to which the event was published.
Partition and Offset Details – Kafka metadata such as partition ID and message offset returned by the Kafka REST API (if available).
Timestamp Information – UTC timestamp associated with the published event.
Success or Error Response – A JSON response returned to TotalAgility summarizing the publication result, including any Kafka REST API messages or errors.
Geographic Availability
Additional Information
The Kafka Connector is designed to simplify and accelerate enterprise event-driven integration by bridging Tungsten TotalAgility’s process automation capabilities with Kafka’s distributed event streaming platform. It enables TotalAgility workflows to publish business and lifecycle events in real time, without requiring custom Kafka client development.
All connector configuration, including Kafka connection details, authentication credentials, and target topics, is managed securely using TotalAgility Server Variables and reused automatically during event publication. Event payloads are defined at the process level, allowing teams to standardize event structures while retaining flexibility for business-specific data.
This connector is ideal for organizations looking to adopt event-driven architectures, decouple workflow execution from downstream systems, and enable real-time analytics, monitoring, and orchestration using Kafka as an enterprise event backbone.
