Deepseek Ocr

Forkjoin.ai conversion of deepseek-ai/DeepSeek-OCR to GGUF format for edge deployment.

Model Details

Usage

With llama.cpp

./llama-cli -m deepseek-ocr-gguf.gguf -p "Your prompt here" -n 256

With Ollama

Create a Modelfile:

FROM ./deepseek-ocr-gguf.gguf
ollama create deepseek-ocr-gguf -f Modelfile
ollama run deepseek-ocr-gguf

About Forkjoin.ai

Forkjoin.ai runs AI models at the edge -- in-browser, on-device, zero cloud cost. These converted models power real-time inference, speech recognition, and natural language capabilities.

All conversions are optimized for edge deployment within browser and mobile memory constraints.

License

Apache 2.0 (follows upstream model license)

Downloads last month
14
GGUF
Model size
3B params
Architecture
deepseek_vl_v2
Hardware compatibility
Log In to add your hardware
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for forkjoin-ai/deepseek-ocr-gguf

Quantized
(9)
this model