Django ORM

All models for the LLMHost app.

class smarter.apps.llmhost.models.LLMHost(*args, **kwargs)[source]

Bases: MetaDataWithOwnershipModel

Implements the LLMHost API model.

Models a self-hosted LLM: its provenance (e.g. a Hugging Face repo), its serving stack (inference engine + endpoint), and the hardware it’s deployed on. Distinct from a hosted/third-party provider config — this assumes the org owns the deployment lifecycle.

Parameters:

id (Unknown) – Primary key: ID
created_at (Unknown) – Created at
updated_at (Unknown) – Updated at
name (Unknown) – Name. Name in camelCase, e.g., ‘apiKey’, no special characters.
description (Unknown) – Description. A brief description of this resource. Be verbose, but not too verbose.
version (Unknown) – Version. Semantic version in the format MAJOR.MINOR.PATCH, e.g., ‘1.0.0’.
annotations (Unknown) – Annotations. Key-value pairs for annotating this resource.
huggingface_repo_id (Unknown) – Huggingface repo id. e.g. ‘meta-llama/Meta-Llama-3-8B-Instruct’
huggingface_revision (Unknown) – Huggingface revision. Commit SHA or tag pinned for reproducible deploys.
license (Unknown) – License
model_architecture (Unknown) – Model architecture. e.g. ‘llama’, ‘mistral’, ‘mixtral’, ‘qwen2’
parameter_count (Unknown) – Parameter count
context_window (Unknown) – Context window
quantization (Unknown) – Quantization
embedding_dimensions (Unknown) – Embedding dimensions. Set only for embedding models.
supports_streaming (Unknown) – Supports streaming
supports_function_calling (Unknown) – Supports function calling
supports_vision (Unknown) – Supports vision
inference_engine (Unknown) – Inference engine
api_format (Unknown) – Api format
endpoint_url (Unknown) – Endpoint url. Base URL of the inference server.
api_key (Unknown) – Api key
deployment_type (Unknown) – Deployment type
cloud_provider (Unknown) – Cloud provider
region (Unknown) – Region
instance_type (Unknown) – Instance type. e.g. ‘g5.2xlarge’
gpu_type (Unknown) – Gpu type. e.g. ‘A100-80GB’
gpu_count (Unknown) – Gpu count
vram_required_gb (Unknown) – Vram required gb
status (Unknown) – Status
is_active (Unknown) – Is active
health_check_url (Unknown) – Health check url
last_health_check_at (Unknown) – Last health check at
last_health_ok (Unknown) – Last health ok
cost_per_hour (Unknown) – Cost per hour
engine_config (Unknown) – Engine config. Engine-specific launch args, sampling defaults, etc.

Relationship fields:

Parameters:

user_profile (Unknown) – User profile (related name: llmhost)
tags (Unknown) – Tags. Tags for categorizing and organizing this resource. (related name: llmhost)
tagged_items (Unknown) – Tagged items (related name: +)

class ApiFormat(*values)[source]

Bases: TextChoices

CUSTOM = 'custom'

HUGGINGFACE = 'huggingface'

OLLAMA_NATIVE = 'ollama_native'

OPENAI_COMPATIBLE = 'openai_compatible'

class CloudProvider(*values)[source]

Bases: TextChoices

AWS = 'aws'

AZURE = 'azure'

GCP = 'gcp'

ON_PREM = 'on_prem'

OTHER = 'other'

class DeploymentType(*values)[source]

Bases: TextChoices

BARE_METAL = 'bare_metal'

CLOUD_INSTANCE = 'cloud_instance'

DOCKER = 'docker'

KUBERNETES = 'kubernetes'

exception DoesNotExist: Bases: ObjectDoesNotExist

class InferenceEngine(*values)[source]

Bases: TextChoices

CUSTOM = 'custom'

LLAMA_CPP = 'llama_cpp'

OLLAMA = 'ollama'

SGLANG = 'sglang'

TGI = 'tgi'

TRANSFORMERS = 'transformers'

TRITON = 'triton'

VLLM = 'vllm'

exception MultipleObjectsReturned: Bases: MultipleObjectsReturned

exception NotUpdated: Bases: ObjectNotUpdated, DatabaseError

class Quantization(*values)[source]

Bases: TextChoices

AWQ = 'awq'

BF16 = 'bf16'

FP16 = 'fp16'

GGUF = 'gguf'

GPTQ = 'gptq'

INT4 = 'int4'

INT8 = 'int8'

NONE = 'none'

class Status(*values)[source]

Bases: TextChoices

ACTIVE = 'active'

DEGRADED = 'degraded'

DEPLOYING = 'deploying'

DEPRECATED = 'deprecated'

DOWNLOADING = 'downloading'

ERROR = 'error'

INACTIVE = 'inactive'

PENDING = 'pending'

annotations

JSONField

Annotations. Key-value pairs for annotating this resource.

Type:: Type

api_format