NuExtract3 released: open-weight 4B VLM for Markdown, OCR and structured extraction (self-hostable) [P]

Disclaimer: I work for Numind, the company behind this open-weight model

We just released a 4B model based on Qwen3.5-4B, under Apache-2.0 license. The goal is to make information extraction from complex documents more practical with an open model: PDFs, screenshots, forms, tables, receipts, invoices, multi-page documents, and other visually structured inputs.

Try it, we have a huggingface space that is completely free (you don't even have to sign-up): https://huggingface.co/spaces/numind/NuExtract3

If you ever used NuMarkdown, NuExtract3 is the successor.

There are some examples to guide you. Feel free to re-use this model for any task.

https://preview.redd.it/pm2xbooyxn2h1.png?width=1672&format=png&auto=webp&s=1a8a7b262190c8325159496dae98c3d2dfab493c

https://preview.redd.it/b5z7ylfzxn2h1.png?width=1758&format=png&auto=webp&s=a07b3abd6e5065c2635de047bdf154357f903e4c

A few things it is designed for:

• converting document images to Markdown
• extracting structured data from documents using a target json template
• handling tables, forms, and layout-heavy pages
• working with both text and visual document inputs
• serving as a local/open-weight alternative for document extraction pipelines

It was trained on a node of 8xH100 for 3 days to train on as much context as we could, so it should perform fairly well even on long document. For Markdown, we'd still recommend going page by page for the best results and inference speed, since you can parallelize better this way.

It's very easy to self-host, since we provide fairly extensive documentation, Safetensors, GGUF and MLX weights. With as little as 4GB of VRAM, you should be good to go. We provide multiple quantizations (GPTQ, W8A8, FP8, Q4, Q6...) so you should be able to run it anywhere.

We mostly tried vLLM, SGLang, llama.cpp.

We have a blog post and a pretty decent model card:

• https://about.nuextract.ai/blog/nuextract-3-release
• https://huggingface.co/numind/NuExtract3
• https://huggingface.co/collections/numind/nuextract3

I'm currently writing a paper on this model so I'll post it as soon as it's accepted. It's not yet on Arxiv yet as it has been submitted in a peer-review journal/conference.

I'll try to answer as many questions as possible if you have any. We would really appreciate feedback from the community.

We also have a discord if you're interested
https://discord.com/invite/3tsEtJNCDe