AI API cost
AI API cost is driven by tokens, not by requests: you pay for the tokens you send and the tokens the model returns, at a per-model rate, with output normally priced higher than input. Reducing cost therefore means sending less context, capping output, or choosing a cheaper model for the work that does not need an expensive one.
How is AI API usage priced?
Almost universally per token, quoted per million tokens, with separate input and output rates. A token is roughly three-quarters of an English word, so a 1,000-word prompt is on the order of 1,300 tokens.
Why do two models with the same token count cost different amounts?
Because the rate is per model, not per token in general. Within one family the largest and smallest models can differ by more than an order of magnitude for identical input, which is why model choice is usually the largest lever available to you.
Where the money actually goes
In most applications a small number of request shapes dominate the bill — long system prompts repeated on every call, retrieved context that is larger than it needs to be, or an expensive model used for classification. You cannot find those by estimating; you find them by looking at what each request actually cost.
- Trim system prompts and retrieved context — they are charged on every call
- Cap max output tokens where the task has a natural length
- Route simple work to smaller models and keep the large ones for work that needs them
- Measure per request, then optimise the shapes that dominate
Why can Astrodyne cost less?
Astrodyne aggregates demand and maintains the provider relationships behind one API. That lets eligible accounts access commercial terms normally associated with larger buyers, without negotiating each provider relationship themselves. Availability and pricing advantages vary by model.
Frequently asked questions
What is AI API cost made of?
Input tokens plus output tokens, each at a per-model rate. Requests themselves are not usually billed; the tokens inside them are.
How can I reduce AI API costs?
Send less context, cap output length, and use a smaller model where the task allows. Then measure per-request cost so you optimise the calls that actually dominate the bill.
How do I calculate LLM token costs?
(input tokens ÷ 1,000,000 × input rate) + (output tokens ÷ 1,000,000 × output rate), multiplied by the number of requests. The calculator does this for you.
Is Astrodyne cheaper than buying directly from model providers?
Only where Astrodyne can show it. Astrodyne publishes a price comparison for a model when it holds both an approved Astrodyne price and a current published direct rate to compare against. Where that comparison is not available, the pricing page says so rather than implying a saving. Availability and any pricing advantage vary by model.
How does Astrodyne billing work?
Astrodyne is prepaid. You top up a balance in US dollars, and settled usage is deducted from it. A request reserves against the balance before it runs, so it can never spend more than you have funded, and every request shows its own tokens and charge.