What OpenAI changed
OpenAI's deprecations page sets the timeline: fine-tuning job creation closed to organizations that had never fine-tuned on May 7, 2026; to those with no fine-tuned-model inference in the previous 60 days on July 2, 2026; and to active existing customers on January 6, 2027. Inference on existing tuned models continues until each underlying base model is deprecated, and tuned weights can't be exported.
The hosted Evals platform that paired with fine-tuning went read-only on October 31, 2026 and shuts down on November 30, 2026, with OpenAI recommending Promptfoo instead. Its dataset-backed prompt optimizer goes with it.
A migration path in Kojen
Many fine-tunes exist to make a model follow a format or a policy reliably, which prompt tuning can often do. Kojen's Forge rewrites the system prompt against your test cases and searches 11 hosted models for the cheapest one that passes, then reports each candidate's accuracy with a confidence interval and pass^k over several samples, so you can check the replacement is genuinely as good as the fine-tune.
Deployments are OpenAI-compatible chat-completions endpoints with real streaming, tool calls and response_format forwarded, so switching usually means changing the base URL and key. If you need trained weights, text LoRA on Qwen3-8B or Llama-3.1-8B-Instruct is available in early access, though those adapters can't be served from Kojen yet. Together AI, Vertex AI and Bedrock also offer managed fine-tuning of other models.
OpenAI fine-tuning at a glance
Managed supervised (SFT), preference (DPO) and vision fine-tuning of OpenAI's own models, served by OpenAI. It is being wound down: closed to new organizations since May 7, 2026, and existing customers can't create new jobs after January 6, 2027.
- Tunes OpenAI's own closed models, with nothing to run yourself.
- Simple for teams already on the OpenAI API.
- Tuned models keep serving until their base model is deprecated.
- Closed to new organizations, and job creation ends for everyone on January 6, 2027.
- No weight export: a tuned model disappears when its base model is retired.
- The surrounding Evals platform shuts down on November 30, 2026.
Kojen at a glance
A hosted dojo for AI agents: LLM-judged evaluations with confidence intervals and pass@k / pass^k, red-team and stress simulations, prompt tuning and model search, LoRA training in early access, and OpenAI-compatible endpoints, all driveable over MCP and REST.
- Measures and improves in one loop: evaluations, red-teaming, prompt tuning, model search and deployment share the same project and test cases.
- Honest statistics by default: every rate has a confidence interval, tuned prompts must beat the current one in a paired test, and pass@k / pass^k come from several samples per case.
- Agent-native: the full loop is exposed over an MCP server and a REST API with an OpenAPI spec, with the same 24 tools as the in-app agent.
- Young product: weight training is early access on 8B models, LoRA adapters can't be served yet, and full fine-tuning and RLHF are previews.
- No tracing SDK for apps running elsewhere, so it is not a replacement for an observability platform.
- Closed source and hosted only; no self-hosting.