Skip to content

MLX snippet updates #1397

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
May 5, 2025
Merged

MLX snippet updates #1397

merged 4 commits into from
May 5, 2025

Conversation

pcuenca
Copy link
Member

@pcuenca pcuenca commented Apr 29, 2025

h/t @gary149

export const mlxvlm = (model: ModelData): string[] => [
`pip install --upgrade mlx-vlm

mlx_vlm.generate --model ${model.id} \\
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure if we should use one \, two, three, or what.

Comment on lines +1301 to +1305
const mlxlm = (model: ModelData): string[] => [
`pip install --upgrade mlx-lm

mlx_lm.generate --model ${model.id} --prompt "Hello"`,
];
Copy link
Member Author

@pcuenca pcuenca Apr 29, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

An alternative is to use a "real" snippet like the ones in the model cards, but I think a CLI one-liner is enough here.

Copy link
Member

@julien-c julien-c left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

conceptually, LGTM!

Copy link
Member

@Vaibhavs10 Vaibhavs10 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

NICEEE! anything blocking the merge? @pcuenca

@pcuenca
Copy link
Member Author

pcuenca commented May 5, 2025

@Vaibhavs10 Nope, I was just waiting in case you or Victor would provide any feedback. Also, I was anxious about the failing tests, even if they looked unrelated 😂. I think I escaped the bash line continuation backslash characters properly, but we can find out in production!

@pcuenca pcuenca merged commit 88989d2 into main May 5, 2025
5 checks passed
@pcuenca pcuenca deleted the mlx-update branch May 5, 2025 16:16
@gary149
Copy link
Collaborator

gary149 commented May 6, 2025

LGTM (sry for late reply)
image

@pcuenca
Copy link
Member Author

pcuenca commented May 7, 2025

Nice, thank you @gary149! Waiting for it to be deployed to check VLMs too!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants