manage.py deploy_builtin_llm_clients

This module is used to deploy a customer API.

class smarter.apps.llm_client.management.commands.deploy_builtin_llm_clients.Command(stdout=None, stderr=None, no_color=False, force_color=False)

Bases: SmarterCommand

Deploy built-in llm_clients and plugins for a Smarter account.

This management command automates the deployment of default llm_clients and plugins for a given account. The account can be specified by its account number. The deployment process reads YAML manifest files from predefined directories, applies each manifest to create plugins and llm_clients, and then deploys each llm_client as a Celery task.

The deployed llm_clients are accessible at URLs of the form: [llm_client-name].[account-number].api.example.com/llm-client/

Deployment Steps:

• Retrieve the account and its admin user using the provided account number.

• Iterate through all plugin manifest files and create each plugin.

• Iterate through all llm_client manifest files, create each llm_client, and deploy it asynchronously.

• Output progress and status messages for each operation.

This command is intended for administrators to quickly provision standard llm_clients and plugins for new or existing accounts, ensuring consistent setup and deployment across environments.

__init__(stdout=None, stderr=None, no_color=False, force_color=False)

account: Account | None = None

add_arguments(parser)

Add arguments to the command.

create_and_deploy_llm_client(filespec)

Create and deploy an llm_client by name.

Apply the Smarter yaml manifest: - Read and Parse the YAML file - load in the body of the POST request - get a response - check the response - get the llm_client by name - deploy the llm_client as a Celery task

Return type:

bool

create_plugin(filespec)

Create a plugin by name.

Apply the Smarter yaml manifest: - Read and Parse the YAML file - load in the body of the POST request - get a response - check the response

Return type:

bool

delete_llm_client(name)

Delete an llm_client by name.

handle(*args, **options)

Deploy built-in llm_clients for an account.

property url: str

user: User

user_profile: UserProfile | None = None