Skip to Content

Rust SDK

The Trunkate AI Rust SDK offers the absolute lowest-latency, zero-cost abstraction bindings targeting the reqwest and tokio asynchronous runtimes.

Installation

cargo add trunkate-ai

Usage (Universal Budget)

Trunkate’s budget parameter uses a StringOrInt enum to support both absolute tokens and proactive percentage buffers.

use trunkate_ai::{Client, StringOrInt}; #[tokio::main] async fn main() -> Result<(), Box<dyn std::error::Error>> { let client = Client::new(None); let text = "Your very long context..."; // OPTION A: Fixed Token Budget (Integer) let res = client.optimize(text, None, Some(StringOrInt::Int(500)), None).await?; // OPTION B: Proactive Percentage Buffer (String) let res2 = client.optimize(text, None, Some(StringOrInt::String("20%".to_string())), None).await?; println!("Optimized: {}", res.text); Ok(()) }

Parameter Reference

ParameterTypeRequiredDescription
textStringYesThe natural language prompt to optimize.
taskOption<String>NoOptional guidance for preservation ranking.
budgetOption<StringOrInt>NoAbsolute tokens (Int(500)) or percentage (String("20%")).
modelOption<String>NoTarget LLM (default: gpt-4o).
Last updated on