Provider Model

Verification functions for provider models in the Smarter app. These functions are responsible for verifying various capabilities of provider models, such as streaming, tools, text input, image input, audio input, fine-tuning, search, code interpreter, text to image, text to audio, text to text, translation, and summarization. Each verification function checks if the capability is already verified and valid. If not, it performs a test to verify the capability and updates the verification status accordingly.

smarter.apps.provider.verification.provider_model.should_log(level)[source]

Check if logging should be done based on the waffle switch.

smarter.apps.provider.verification.provider_model.verify_model_audio_input(provider_model, **kwargs)[source]

Verify audio input capabilities of the provider model.

Return type:

bool

smarter.apps.provider.verification.provider_model.verify_model_code_interpreter(provider_model, **kwargs)[source]

Verify code interpreter capabilities of the provider model.

Return type:

bool

smarter.apps.provider.verification.provider_model.verify_model_fine_tuning(provider_model, **kwargs)[source]

Verify fine-tuning capabilities of the provider model.

Return type:

bool

smarter.apps.provider.verification.provider_model.verify_model_image_input(provider_model, **kwargs)[source]

Verify image input capabilities of the provider model.

Return type:

bool

Verify search capabilities of the provider model. DEPRECATED: OpenAI has deprecated the search endpoint.

Return type:

bool

smarter.apps.provider.verification.provider_model.verify_model_streaming(provider_model, **kwargs)[source]

Verify streaming capabilities of the provider model.

Return type:

bool

smarter.apps.provider.verification.provider_model.verify_model_summarization(provider_model, **kwargs)[source]

Verify summarization capabilities of the provider model.

Return type:

bool

smarter.apps.provider.verification.provider_model.verify_model_text_input(provider_model, **kwargs)[source]

Verify text input capabilities of the provider model.

Return type:

bool

smarter.apps.provider.verification.provider_model.verify_model_text_to_audio(provider_model, **kwargs)[source]

Verify text to audio capabilities of the provider model.

Return type:

bool

smarter.apps.provider.verification.provider_model.verify_model_text_to_image(provider_model, **kwargs)[source]

Verify text to image capabilities of the provider model.

Return type:

bool

smarter.apps.provider.verification.provider_model.verify_model_text_to_text(provider_model, **kwargs)[source]

Verify text to text capabilities of the provider model.

Return type:

bool

smarter.apps.provider.verification.provider_model.verify_model_tools(provider_model, **kwargs)[source]

Verify tools capabilities of the provider model.

Return type:

bool

smarter.apps.provider.verification.provider_model.verify_model_translation(provider_model, **kwargs)[source]

Verify translation capabilities of the provider model.

Return type:

bool

smarter.apps.provider.verification.provider_model.verify_provider_model(provider_model_id, **kwargs)[source]

Top-level test bank on provider model.