PR-500 simplified client wrapper functions

[mogith-pn]

Why

• https://clarifai.atlassian.net/browse/PR-500
• The client wrapper function in model upload code, still needed some abstraction for converting images/video/audio into openai compatible format before sending to chat function.

How

• Since it can be abstacted into the runner data utils function, moved those preprocessing steps into SDK.

Tests

• PR tested with model upload into production after making changes - https://clarifai.com/mogith-p-n/test-co/models/smollm
• Uploaded model code - https://github.com/Clarifai/model-uploads/tree/smollm-model/SmolLM/SmolLM2-1.7B-Instruct
• Tested all the functions after deployment.

[Copilot]

Pull Request Overview

This PR simplifies the client wrapper functions by introducing a unified helper to format OpenAI chat messages with various media types (image, audio, video) and by adding base64 conversion methods to the corresponding data types.

• Updated PIL image conversions by importing PILImage and aligning type hints.
• Added build_openai_chat_format and internal helper functions to process images, audio, and video.
• Extended data types with new to_base64_str methods for Image, Audio, and Video objects.

Reviewed Changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.

File	Description
clarifai/runners/utils/data_utils.py	Updated image conversion functions and added media processing functions for chat messages.
clarifai/runners/utils/data_types.py	Added to_base64_str utility methods for converting media bytes to base64 strings.

Comments suppressed due to low confidence (2)

clarifai/runners/utils/data_utils.py:132

• [nitpick] Consider using a distinct local variable for the base64 string conversion in _process_audio instead of reassigning the parameter 'audio', to improve code clarity.

if audio.bytes:

clarifai/runners/utils/data_utils.py:158

• [nitpick] Consider using a separate variable to hold the base64 string in _process_video rather than overwriting the parameter 'video', for improved readability.

if video.bytes:

[github-actions]

Package	Line Rate	Health
clarifai	43%	❌
clarifai.cli	59%	➖
clarifai.client	73%	➖
clarifai.client.auth	74%	➖
clarifai.constants	100%	✔
clarifai.datasets	100%	✔
clarifai.datasets.export	80%	✔
clarifai.datasets.upload	75%	➖
clarifai.datasets.upload.loaders	37%	❌
clarifai.models	100%	✔
clarifai.modules	0%	❌
clarifai.rag	72%	➖
clarifai.runners	10%	❌
clarifai.runners.models	67%	➖
clarifai.runners.utils	59%	➖
clarifai.schema	100%	✔
clarifai.urls	80%	✔
clarifai.utils	76%	➖
clarifai.utils.evaluation	67%	➖
clarifai.workflows	94%	✔
Summary	68% (5803 / 8577)	➖

Minimum allowed line rate is 50%

[luv-bansal]

Looks good, but not sure , should we add build_openai_chat_format function to utils/openai_convertor.py file?

[luv-bansal]

Not sure, do you think we could move this to here