Features

Features

Knull provides a comprehensive set of features for enterprise AI governance.

Governance & IAM

Multi-Tenant RBAC

Secure your AI control plane with fine-grained access control:

  • Organizations & Teams: Group users and resources into hierarchical structures.
  • Role-Based Permissions: Assign specific permissions (e.g., model:add, policy:view) to users.
  • Invite System: Onboard teams securely via email invitations.

API Key Management

  • Enterprise Keys: Generate and manage API keys with metadata and owner tracking.
  • Budget Enforcement: Set token and USD budget limits per policy.
  • Usage Quotas: Granular control over model access per team.

Cloud & Provisioning

AWS Bedrock Orchestration

Knull acts as a bridge to your cloud infrastructure:

  • One-Click Provisioning: Enable or disable Bedrock models directly from the Knull UI.
  • Inference Profiles: Support for Application-level and System-level cost tracking.
  • Assume Role Support: Securely connect to cross-account AWS resources via IAM roles.

Multi-Provider Hub

Connect to any LLM provider through a unified interface:

  • Azure OpenAI: Optimized with automatic HTTP/1.1 enforcement.
  • Anthropic & Bedrock: Native support for Claude models.
  • OpenAI Compatible: Seamless integration with Ollama, vLLM, and others.

Analytics & Observability

Advanced Cost Tracking

  • Sankey Diagrams: Visualize the flow of AI costs from teams to models.
  • Time-Series Analysis: Track token usage and costs with hourly granularity.
  • AWS Cost Explorer: Integrated cloud cost data for accurate financial reporting.

Audit Logging

Track every administrative action in the system:

  • Configuration Changes: Who changed what and when.
  • Access Logs: Complete history of user logins and API key usage.
  • Error Tracking: Detailed logs for troubleshooting failed requests.

Data Plane Features

AI-Native Routing

  • Model-based Routing: Automatic selection of backends based on the model field.
  • Header & Body Mutation: Modify requests on the fly for custom logic or security.
  • CEL Cost Calculation: Use Common Expression Language for complex cost formulas.
ArchitectureConfiguration