-
Notifications
You must be signed in to change notification settings - Fork 372
MLX snippet updates #1397
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
MLX snippet updates #1397
Conversation
export const mlxvlm = (model: ModelData): string[] => [ | ||
`pip install --upgrade mlx-vlm | ||
|
||
mlx_vlm.generate --model ${model.id} \\ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Not sure if we should use one \
, two, three, or what.
const mlxlm = (model: ModelData): string[] => [ | ||
`pip install --upgrade mlx-lm | ||
|
||
mlx_lm.generate --model ${model.id} --prompt "Hello"`, | ||
]; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
An alternative is to use a "real" snippet like the ones in the model cards, but I think a CLI one-liner is enough here.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
conceptually, LGTM!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
NICEEE! anything blocking the merge? @pcuenca
@Vaibhavs10 Nope, I was just waiting in case you or Victor would provide any feedback. Also, I was anxious about the failing tests, even if they looked unrelated 😂. I think I escaped the bash line continuation backslash characters properly, but we can find out in production! |
Nice, thank you @gary149! Waiting for it to be deployed to check VLMs too! |
h/t @gary149