Skip to content
Discussion options

You must be logged in to vote

Yes, but: (1) It depends on the model impl. If a model supports safetensor layout, you may use safetensor (2) We no longer maintain safetensor support. So the safetensor support in a model could be just a placeholder and may not work correctly.

You can check the gguf.md doc for gguf conversion. Or using ready-to-use ggufs from https://huggingface.co/audio-cpp/audio.cpp-gguf

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by 0xShug0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants