Image Generation API Benchmark

13 passed · 5 failed · 0 skipped · 18 total

Michaelangelo the Ninja Turtle + Cinderella

"Michaelangelo the Ninja Turtle standing next to Cinderella, whimsical storybook illustration style"

nano-banana — ninja-cinderella
nano-bananagemini
Total: 6.5s
Size: 2156KB png
nano-banana-2 — ninja-cinderella
nano-banana-2gemini
Total: 13.1s
Size: 2342KB png
nano-banana-pro — ninja-cinderella
nano-banana-progemini
Total: 19.0s
Size: 988KB jpg
flux-schnell — ninja-cinderella
flux-schnellfireworks
Total: 1.9s
Size: 708KB jpg
flux-dev-fp8 — ninja-cinderella
flux-dev-fp8fireworks
Total: 3.9s
Size: 565KB jpg
FAILED
flux-2-maxbfl
Total: 15.5s
BFL: Request Moderated
FAILED
flux-2-probfl
Total: 5.5s
BFL: Request Moderated
FAILED
flux-2-klein-9bbfl
Total: 3.5s
BFL: Request Moderated
FAILED
flux-2-klein-4bbfl
Total: 3.0s
BFL: Request Moderated

A cozy cabin in the woods

"A cozy cabin in the woods surrounded by pine trees and soft falling snow, warm light glowing from the windows, storybook illustration style"

nano-banana — cozy-cabin
nano-bananagemini
Total: 4.9s
Size: 1786KB png
nano-banana-2 — cozy-cabin
nano-banana-2gemini
Total: 13.1s
Size: 2110KB png
FAILED
nano-banana-progemini
Total: 70.0s
exception TypeError: fetch failed sending request
flux-schnell — cozy-cabin
flux-schnellfireworks
Total: 2.4s
Size: 905KB jpg
flux-dev-fp8 — cozy-cabin
flux-dev-fp8fireworks
Total: 3.8s
Size: 632KB jpg
flux-2-max — cozy-cabin
flux-2-maxbfl
Total: 30.1s · Submit: 300ms · Polls: 11 · Download: 958ms
Size: 1890KB png
flux-2-pro — cozy-cabin
flux-2-probfl
Total: 18.4s · Submit: 175ms · Polls: 6 · Download: 2436ms
Size: 2003KB png
flux-2-klein-9b — cozy-cabin
flux-2-klein-9bbfl
Total: 7.3s · Submit: 718ms · Polls: 1 · Download: 3510ms
Size: 2103KB png
flux-2-klein-4b — cozy-cabin
flux-2-klein-4bbfl
Total: 5.9s · Submit: 426ms · Polls: 1 · Download: 2461ms
Size: 1922KB png

Benchmark Table

ModelEnginePromptStatusTotalSubmitPollsDownloadFile Size
nano-bananageminininja-cinderellaPASS6.5s---2156KB
nano-bananageminicozy-cabinPASS4.9s---1786KB
nano-banana-2geminininja-cinderellaPASS13.1s---2342KB
nano-banana-2geminicozy-cabinPASS13.1s---2110KB
nano-banana-progeminininja-cinderellaPASS19.0s---988KB
nano-banana-progeminicozy-cabinFAIL70.0s----
flux-schnellfireworksninja-cinderellaPASS1.9s---708KB
flux-schnellfireworkscozy-cabinPASS2.4s---905KB
flux-dev-fp8fireworksninja-cinderellaPASS3.9s---565KB
flux-dev-fp8fireworkscozy-cabinPASS3.8s---632KB
flux-2-maxbflninja-cinderellaFAIL15.5s----
flux-2-maxbflcozy-cabinPASS30.1s300ms11958ms1890KB
flux-2-probflninja-cinderellaFAIL5.5s----
flux-2-probflcozy-cabinPASS18.4s175ms62436ms2003KB
flux-2-klein-9bbflninja-cinderellaFAIL3.5s----
flux-2-klein-9bbflcozy-cabinPASS7.3s718ms13510ms2103KB
flux-2-klein-4bbflninja-cinderellaFAIL3.0s----
flux-2-klein-4bbflcozy-cabinPASS5.9s426ms12461ms1922KB

Generated 2026-03-04T03:42:33.292Z