
3rd Party LLM Connectors for TotalAgility
3rd Party LLM Connectors for TotalAgility Overview
Features
Connectors examples and templates to integrate 3rd party LLMs into TotalAgility as Custom Services. Ready to run examples are provided for:
- AWS Bedrock Nova models (AWS Lambda API)
- Azure hosted Claude models (Messages API)
- Google Studio Gemini Pro models (Gemin API)
Use these Custom Services to create Custom LLMs, Agents or to provide LLM services in TotalAgility Cases or Workflows.
For a full list of capabilites and usage documentation, see project page on the Tungsten Automation Labs GitHub.
Benefits
Integrate Large Language Models that do not use the OpenAI Completions API out of the box. The project provides native integration templates for Anthropic Claude Messages API, Google Gemini API or AWS Bedrock API. No additional middleware required. API keys are stored securely in TotalAgility or a TotalAgility connected keystore.
Technical Details
Inputs
Prompts, data, images and/or documents, including tiffs & PDF files.
Outputs
LLM responses (text).
Geographic Availability
Additional Information
For support, please use the issues feature on GitHub.
