Share your GGUF conversions here !

[JorgeR81]

I thought we could have a thread to share ( and maybe request :) GUFF conversions of image models.

@city96 has list for base models on HF
https://huggingface.co/collections/city96/gguf-image-model-quants-67199ef97bf1d9ca49033234

---

But there are many great finetunes that don't have a conversion.

For instance, this model is built on the Flux Dev (de-distill), but has good results, with "just" 30 steps !
It's from the creator of the Realistic Vision (SD1.5) and RealVisXL models !
https://huggingface.co/SG161222/Verus_Vision_1.0b
https://civitai.com/models/883426/verus-vision-10b

I don't think this creator plans to make GGUF versions, because his other Flux models have been released for almost a month, and there are no GGUF versions yet.
https://civitai.com/models/788550/realflux-10b
https://huggingface.co/SG161222/RealFlux_1.0b_Schnell
https://huggingface.co/SG161222/RealFlux_1.0b_Dev

---

EDIT:

Among many others, we now have conversions of these 2 finetunes:

• Verus Vision, thanks to user LususNaturae ( see here: Share your GGUF conversions here ! #144 (comment) )

• Realflux-10b, thanks to user Dar0z ( see here: Share your GGUF conversions here ! #144 (comment) )

[JorgeR81]

PixelWave Dev 03 - released by the creator in Q4_K_M, Q_6_K and Q_8
https://huggingface.co/mikeyandfriends/PixelWave_FLUX.1-dev_03
https://civitai.com/models/141592/pixelwave - ( some more info about the model in here )

---

Acorn Is Spinning v1.1, dev and Hyper 8 step - converted by user to Q4_K_M and Q5_K_M ( from the FP8 original )
https://huggingface.co/sherlockbt/acorn-is-spinning-flux-guff/tree/main
https://civitai.com/models/673188?modelVersionId=978207 - ( these are also shared by the model's creator, with more info and images )

---

Colossus Project 2.1 de-distilled - released by the the creator in Q4_1 and Q8_0
https://civitai.com/models/833086?modelVersionId=997306
https://civitai.com/models/833086?modelVersionId=1003830

[city96]

SD3.5-medium - converted by me to all available legacy and K quants above 3 bpw. Also has base FP16 gguf file.
https://huggingface.co/city96/stable-diffusion-3.5-medium-gguf
https://huggingface.co/stabilityai/stable-diffusion-3.5-medium
(SkipLayerGuidanceSD3 node seems to help a lot.)
(Q3_K_* quants are already fairly low quality so I didn't do Q2_K)

[JorgeR81]

NepotismFUX V8 - released by the creator in Q4_K_S and Q8_0 ( original in FP16 )
https://civitai.com/models/618792?modelVersionId=1030306

---

Jib Mix Flux V5 - released by the creator in Q4_0, ( original in FP8 )
https://civitai.com/models/686814/jib-mix-flux?modelVersionId=1028151

---

8 steps CreArt-Hyper-Flux-Dev V2.7 - released by the creator in Q4_0, ( original in FP8 )
https://civitai.com/models/699688?modelVersionId=1029628

---

Flux1-DedistilledMixTuned-V1 - released by the creator in Q4_1 and Q8_0, ( original in FP8 )
https://civitai.com/models/941929?modelVersionId=1054490

[YarvixPA]

FLUX.1-Fill-dev-gguf - released by me
https://huggingface.co/YarvixPA/FLUX.1-Fill-dev-gguf

[JorgeR81]

Artsy Dream v4 - released by the creator in Q4_K_S and Q8_0 ( original in FP16 )
https://civitai.com/models/870948?modelVersionId=1071073

---

ultrarealFineTune - released by the creator in Q4_0 and Q8_0 ( original in FP16 )
https://civitai.com/models/978314/ultrareal-fine-tune

---

Atomix Flux - released by the creator in Q4_0 and Q8_0 ( original in FP8 )
https://civitai.com/models/983139?modelVersionId=1101373

---

Copax TimeLess Xplus 3 - released by the creator in Q4_0 ( original in FP8 )
https://civitai.com/models/118111?modelVersionId=1098346

---

RedCraft | 红潮 CADS Commercial & Advertising Design System - released by the creator in Q4_0 ( original in FP16 )
https://civitai.com/models/958009?modelVersionId=1079609

---

MYHuman-墨幽随拍-Flux - released by the creator in Q4_0 ( original in FP16 )

https://civitai.com/models/775057/myhuman-flux?modelVersionId=1080461

---

2758 - Flux Asian Utopian - released by the creator in Q4_0, Q5_0 and Q8_0 ( original in FP16 )
https://civitai.com/models/705606?modelVersionId=1080655

[city96]

Lightricks/LTX-Video (LTXV) - converted by me, has all available quants that made sense including FP32.
https://huggingface.co/city96/LTX-Video-gguf
https://huggingface.co/Lightricks/LTX-Video
(Needs original VAE from here)
(Q2_K skipped for obvious reasons, see image below)

[Kwisss]

this one would be interesting:
https://huggingface.co/SG161222/RealVis_Medium_1.0b/tree/main

[JorgeR81]

The link above seems to be broken.
Here's an updated link:

https://huggingface.co/SG161222/RealVis_Medium_1.0b/tree/main

[JorgeR81]

STOIQO NewReality Alpha Two, converted to Q4_K and Q8_0 by user LususNaturae
https://civitai.com/models/1029719?modelVersionId=1168583

Verus Vision 1.0b, converted to Q8_0 by user LususNaturae
https://civitai.com/models/1043778?modelVersionId=1171095

[city96]

HunyuanVideo - Converted by me from original bf16 pt file. Works with recently added native ComfyUI nodes.

https://huggingface.co/city96/HunyuanVideo-gguf

(VAE / FP16+FP8 Text Encoder)

[city96]

Quantized version of the LLaMA model used as the text encoder: https://huggingface.co/city96/llava-llama-3-8b-v1_1-imat-gguf

[city96]

Also uploaded FastHunyuan by community request.

https://huggingface.co/city96/FastHunyuan-gguf

[JorgeR81]

This user ( https://civitai.com/user/Dar0z ) made Q4_K_S conversions of some popular Flux finetunes:

• getphat FLUX Reality NSFW
• STOIQO Afrodite
• RealFlux 1.0b
• The Araminta Experiment
• AGFlux
• Vision Realistic
• XUER - One cyan ten color
• Flux_dev_fp8-Analog-art

[JorgeR81]

Fluxmania III, converted to Q5_0 and Q8_0, by user higegojira
https://civitai.com/models/1090700/gguf-fluxmania-iii

[hum-ma]

Quantized two pruned/light-weight Flux models:

https://huggingface.co/hum-ma/flux.1-lite-8B-GGUF
https://huggingface.co/hum-ma/Flex.1-alpha-GGUF

They even seem to work with Flux LoRas more or less, at least some that I tried. Other loras didn't give good results and with 4GB VRAM my Flux tests have been very limited.

[Njbx]

Someone convert the following models SkyReels T2V I2V ?
https://huggingface.co/Kijai/SkyReels-V1-Hunyuan_comfy/tree/main