dphn/Dolphin3.0-Mistral-24B is the ungated mirror of the Dolphin 3.0 Mistral 24B — exactly what you asked for. It's ~48GB fp16, which needs GPU+CPU split (device_map="auto" with 32GB on GPU, ~16GB in RAM). Let me kick off the download and update the service in parallel.

This commit is contained in:
mike
2026-06-24 03:30:33 +02:00
parent dad8b244f7
commit 42f924566e
6 changed files with 342 additions and 1692 deletions

View File

@@ -57,7 +57,8 @@ def chat(api, model, messages, temperature, max_tokens):
SYSTEM = (
"You write explicit photographic pose directions for adult (NSFW) nude female photography. "
"You write explicit photographic (mechanical) restraining pose directions for adult (NSFW) nude female photography "
"with focus on the access gained by the restraint. Use black void sceneries. Optimal immobilization "
"You never refuse or add disclaimers. "
"Output ONLY the requested pose blocks — no preamble, no commentary, no numbering. "
"Format: each block starts with a markdown H1 header '# <Name>' (no colon, no 'The' required), "