· ai-devtools

Frontier Design Benchmark

Read on XLinkedIn×Frontier Design Benchmark Menu Home - Home - Gallery[12] - Leaderboard - Vote - Methodology - Rubric - Dataset - Blog by Contra Labs × BenchFlow Exploring the frontier of AI design capabilities through real client briefs from Contra’s marketplace, golden designs and model comparisons.


How frontier models rank in blind head-to-head votes on real client briefs from Contra’s marketplace. Frontier Design Benchmark is the first benchmark built on real world, high value, and complex design projects. It is judged by professional designers in the Contra Labs network, ensuring the quality of evaluation.

In the benchmark, we also built a design critique rubric and a list of AI slop patterns. The rubric scores are highly correlated with the designers’ ratings of the models (r = 0.94). These additional metrics provide explainable design quality judgement on top of pairwise preferences.

OBJ_01 BRIEF OBJ_02 DESIGNER OBJ_03 VOTE OBJ_04 RUBRIC 33design briefs 68professional designers 4,311blind votes 35rubric dimensions Golden Gallery Real client briefs, each with its golden: the design set beside the models’ outputs as the bar. Pick the better one, or call a tie.

Earlier coverage

Related coverage

Also worth reading

  1. next.js 16.5.0-canary.59 released
  2. next.js 16.5.0-canary.56 released
  3. scroll-state()
  4. Presentation: AI-Assisted Software Delivery: From Code to Production
  5. Qualcomm offers test drive of its rack-scale Nvidia AI challenger