Skip to content

5 second example results in immediate crash #275

@abra-code

Description

@abra-code

Hello:
my first time trying to run the server. I followed the pip installation process and executed the example:
mlx-openai-server launch --model-path mlx-community/Qwen3-Coder-Next-4bit --model-type lm

There are some deep dependencies going into weeds of multimodal mlx_vlm or torchvision unsatisfied modules despite the request for simple text-only mode.

It could be that the mlx-openai-server dependencies are messed up or maybe less imports can be included on app side for lm mode. Please advise.

mlx-openai-server-launch-missing-deps.txt

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions