feat(media): add Higgsfield to video and image generators, allow typed models by myxamediyar · Pull Request #9756 · simstudioai/sim

myxamediyar · 2026-11-06T21:03:01Z

Summary

Add Higgsfield as a provider in the Video Generator: Kling 3.0 Turbo/Pro/Standard, Kling 2.5 Turbo Pro, Seedance 2.0, MiniMax H3, Hailuo 2.3 Standard (text-to-video)
Add Higgsfield to the Image Generator: SOUL, SOUL V2, SOUL Cinema, Z-Image Turbo
Model settings come from Higgsfield's model pages and are validated before a paid request
Switch the video and image model fields to comboboxes so users can type a model the catalog doesn't list yet
Typed models send the prompt only; IDs are checked as safe model names or endpoint paths
Retired IDs (veo-3, dall-e-3, gpt-image-1) keep their existing errors; a plain model ID from another provider fails fast
Custom Fal.ai endpoints require the user's own Fal.ai key, so the hosted key can't be under-billed on an unpriced endpoint
Combobox: mediaModelOptions skips the LLM model-permission filter for these fields, restoreDefaultWhenCleared refills the default after a provider switch, and hidden alias options stay hidden
Legacy Video Generator V1/V2 and Image Generator V1 keep their dropdowns

Type of Change

New feature

Testing

Compared provider requests built on staging vs this branch for 2,605 cases (every existing model ID and alias, with/without settings, retired IDs, every block version's param mapping): no differences
Exercised typed model IDs: valid paths per provider, path traversal, query injection, settings rejection, hosted Fal key rejection
Type-check, lint, check:audits, and the block-registry check passed locally; full test suite runs in CI
Not yet run against the live Higgsfield API

Checklist

Code follows project style guidelines
Self-reviewed my changes
Tests added/updated and passing (new tests pass the test-audit authoring gate)
No new warnings introduced
I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA)

🤖 Generated with Claude Code

vercel · 2026-11-06T21:03:08Z

The latest updates on your projects. Learn more about Vercel for GitHub.

1 Skipped Deployment

Project	Deployment	Actions	Updated
docs	Skipped		Nov 7, 2026 1:50am UTC

greptile-apps · 2026-11-06T21:11:38Z

Confidence Score: 5/5

[Medium impact] The PR appears safe to merge; no new actionable issues were found.

Summary

Adds Higgsfield image and video generation and lets users type model IDs outside the catalog.

The Video Generator can send video requests to Higgsfield.
The Image Generator can send image requests to Higgsfield.
The newer media generators accept model IDs that are not in their catalogs.

Diagram

%%{init: {'theme': 'neutral'}}%%
flowchart TD
  A[Image or video generator] --> B{Listed model?}
  B -->|Yes| C[Check supported settings]
  B -->|No| D[Check model ID and reject settings]
  D --> E{Custom Fal.ai endpoint?}
  E -->|Yes| F[Require user-owned key]
  E -->|No| G[Build provider request]
  F --> G
  C --> G
  G --> H[Submit and wait for result]
  H --> I[Download and store media]

_{Reviews (4) · Last reviewed commit: "refactor(higgsfield): share one API clie..." · Reviewed by Greptile}

cubic-dev-ai

All reported issues were addressed across 26 files

_{Reply with feedback, questions, or to request a fix.

Turn on auto-fix | Re-trigger cubic}

myxamediyar · 2026-11-06T21:16:04Z

@greptile

myxamediyar · 2026-11-06T21:16:05Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-11-06T21:16:12Z

@cubic-dev-ai review this PR

@myxamediyar I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

All reported issues were addressed across 27 files

_{Reply with feedback, questions, or to request a fix.

Turn on auto-fix | Re-trigger cubic}

myxamediyar · 2026-11-06T21:23:23Z

@greptile

myxamediyar · 2026-11-06T21:23:24Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-11-06T21:23:30Z

@cubic-dev-ai review this PR

@myxamediyar I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

No issues found across 28 files

Confidence score: 5/5

Automated review surfaced no issues in the provided summaries.
No files require special attention.

_{Turn on auto-fix | Re-trigger cubic}

…d models - Add Higgsfield as a provider in the Video Generator (Kling 3.0, Kling 2.5 Turbo, Seedance 2.0, MiniMax H3, Hailuo 2.3) and Image Generator (SOUL, SOUL V2, SOUL Cinema, Z-Image Turbo) - Switch the video and image model fields to comboboxes so users can type a model the catalog does not list - Send typed model IDs with the prompt only; validate them as safe model names or endpoint paths - Keep retired model errors, reject stale cross-provider values, and require a user Fal.ai key for custom Fal endpoints

…ault after provider switch - trim `model` at the image and video input schemas so a padded catalog ID still matches its catalog entry - reject `visualReference` for typed direct-video models, which only send the prompt - refill the combobox default after a provider switch even if the user had cleared the field - update the image operations test to the typed-model behavior Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

…Higgsfield helpers - move the typed-model checks from mocked fetch calls to buildImageGenerationRequest, covering padded catalog and retired IDs - add TSDoc to higgsfieldStatusUrl and higgsfieldFailureMessage - say in the combobox comments that a cleared required field gets its default back when reopened Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

…d media generators Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

waleedlatif1 · 2026-11-07T01:50:47Z

@greptile

waleedlatif1 · 2026-11-07T01:50:48Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-11-07T01:50:54Z

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

No issues found across 30 files

Confidence score: 5/5

Automated review surfaced no issues in the provided summaries.
No files require special attention.

_{Turn on auto-fix | Re-trigger cubic}

waleedlatif1 · 2026-11-07T02:00:15Z

@myxamediyar merged. Before merging I rebased on #9749 and pointed the Higgsfield block tools at lib/media/higgsfield.ts, so the base URL, auth header and status handling now live in one place.

Tested live: SOUL V2 with settings, Z-Image Turbo, a typed SOUL Cinema ID (prompt only), Kling 3.0 Turbo (3s, 9:16, 720p) and Kling 3.0 Std with sound off. All came back fine, and bad input was rejected with clear errors.

For next time:

When two PRs hit the same vendor, put the shared client in the first PR and build the second on top of it. That avoids the duplicate helpers and the generated-file conflicts.
Diffing 2,605 requests against staging was a really good way to prove there was no regression. Keep doing that.

myxamediyar marked this pull request as ready for review November 6, 2026 21:06

greptile-apps Bot reviewed Nov 6, 2026

View reviewed changes

Comment thread apps/sim/lib/internal/image/request.ts Resolved

Comment thread ...Id]/components/panel/components/editor/components/sub-block/components/combobox/combobox.tsx Resolved

Comment thread apps/sim/lib/internal/video/direct-request.ts Resolved

cubic-dev-ai Bot reviewed Nov 6, 2026

View reviewed changes

vercel Bot temporarily deployed to Preview November 6, 2026 21:15 Inactive

greptile-apps Bot reviewed Nov 6, 2026

View reviewed changes

Comment thread apps/sim/lib/internal/image/operations.test.ts Resolved

Comment thread apps/sim/lib/media/higgsfield.ts Resolved

cubic-dev-ai Bot reviewed Nov 6, 2026

View reviewed changes

Comment thread ...Id]/components/panel/components/editor/components/sub-block/components/combobox/combobox.tsx Resolved

vercel Bot temporarily deployed to Preview November 6, 2026 21:23 Inactive

cubic-dev-ai Bot reviewed Nov 6, 2026

View reviewed changes

myxamediyar assigned waleedlatif1 Nov 6, 2026

waleedlatif1 mentioned this pull request Nov 7, 2026

v0.9.47: Hex project search and notebook reads, Flow and Jama brand icons, leading-zero codes kept as text in CSV imports, Higgsfield #9758

Merged

myxamediyar and others added 4 commits November 6, 2026 17:48

refactor(higgsfield): share one API client between the block tools an…

f7c6b00

…d media generators Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

waleedlatif1 force-pushed the feat/higgsfield-media-models branch from 1b3b6c6 to f7c6b00 Compare November 7, 2026 01:50

vercel Bot temporarily deployed to Preview November 7, 2026 01:50 Inactive

cubic-dev-ai Bot reviewed Nov 7, 2026

View reviewed changes

waleedlatif1 merged commit 2eb80dd into staging Nov 7, 2026
79 checks passed

waleedlatif1 deleted the feat/higgsfield-media-models branch November 7, 2026 01:58

Conversation

myxamediyar commented Nov 6, 2026

Summary

Type of Change

Testing

Checklist

Uh oh!

vercel Bot commented Nov 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

greptile-apps Bot commented Nov 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Confidence Score: 5/5

Summary

Diagram

Uh oh!

Uh oh!

Uh oh!

Uh oh!

cubic-dev-ai Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

myxamediyar commented Nov 6, 2026

Uh oh!

myxamediyar commented Nov 6, 2026

Uh oh!

cubic-dev-ai Bot commented Nov 6, 2026

Uh oh!

Uh oh!

Uh oh!

cubic-dev-ai Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

myxamediyar commented Nov 6, 2026

Uh oh!

myxamediyar commented Nov 6, 2026

Uh oh!

cubic-dev-ai Bot commented Nov 6, 2026

Uh oh!

cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

Uh oh!

waleedlatif1 commented Nov 7, 2026

Uh oh!

waleedlatif1 commented Nov 7, 2026

Uh oh!

cubic-dev-ai Bot commented Nov 7, 2026

Uh oh!

cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

waleedlatif1 commented Nov 7, 2026

Uh oh!

This branch was previously deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

vercel Bot commented Nov 6, 2026 •

edited

Loading

greptile-apps Bot commented Nov 6, 2026 •

edited

Loading

cubic-dev-ai Bot left a comment •

edited

Loading

cubic-dev-ai Bot left a comment •

edited

Loading