LLMPrices Model

Account LLMPrices Model

This module defines the LLMPrices model for managing provider/model-specific markup factors used in account billing. It enables proportional billing across all accounts based on their usage of different LLM providers and models.

Classes

LLMPrices: Stores markup prices for each (charge_type, provider, model) combination.

Key Features

Tracks markup factors for each provider/model/charge type.
Enforces uniqueness for (charge_type, provider, model) combinations.
Supports flexible billing and cost allocation for LLM usage.

Example

from smarter.apps.account.models import LLMPrices

markup = LLMPrices.objects.get(provider="openai", model="gpt-4").price
account_charge = provider_cost * markup * account_usage_ratio

class smarter.apps.account.models.llm_prices.LLMPrices(*args, **kwargs)[source]

Bases: TimestampedModel

LLMPrices model for managing markup factors in account billing.

Stores provider/model-specific price markups, enabling proportional billing across all accounts based on their usage.

Parameters:

charge_type – String. The type of charge (e.g., completion, plugin, tool).
provider – String. The LLM provider (e.g., OpenAI, Meta AI).
model – String. The model name.
price – Decimal. The price in USD per million tokens, markup included. cost_of() uses it to price charges, which budgets that measure cost compare to their limits.

Note

Markup factors are used to calculate each account’s share of provider costs.

Example usage:

# Calculate account charge for provider/model usage
markup = LLMPrices.objects.get(provider="openai", model="gpt-4").price
account_charge = provider_cost * markup * account_usage_ratio

TODO:: create a Choice or FK to charge_type field.
TODO:: create some form of referential integrity for model and provider fields.
TODO:: establish reasonable boundaries on price field.