Recipe Scaler Bench

Об эксперименте

Я сгенерировал одну и ту же UI-задачу десятками агентов и моделей и собрал результаты в один стенд. Разница в стоимости между самым дорогим и дешёвым вариантом — 410×.

Цели

Процедура

Одна задача: три экрана для продукта Recipe Scaler — desktop (1400px), mobile recipe (375px), promo (1400px). Инструмент: Paper MCP (и частично Figma MCP). Контент в макетах — на английском. Каждому прогону — свежий файл, без правок руками (максимум растянуть фрейм).

Ограничения

Промпт

task-paper-en.md — полный текст задания

I am creating a design for a product.

# Task
Create new pages:
1. A promo page describing the product. Screen width: 1400px.
2. A desktop screen interface — choose the main screen and design it. Screen width: 1400px.
3. A recipe screen interface for mobile. You need to design a recipe screen. Screen width: 375px.

# Where to create it and expected result
Where to create: https://app.paper.design/file/01M25BV5BZKPMTV0JY4DYD4QZE/1-0

If the mockups are long, you can make a tall frame/artboard/layout. You do not have to fit standard screen proportions.

Use Paper MCP to create the design.

Use English for the content inside the mockups.

You can use pregenerated images for illustations: './images'. If you have built-in tools for drawing images, you can use them too.

Below is the product information, which also describes the product capabilities.

# Product information
----
Recipe Scaler — app for those who cook
It reliably stores your recipes, helps you cook, works on your phone and computer, even offline.

Access from phone and computer
You will have access to your recipes both on your phone and computer. The apps will sync automatically, even from offline.
On each platform, the web application uses familiar ways of working: hotkeys on the computer, and standard gesture controls on the phone.
On the phone it works as PWA — install it on your home screen and you won't tell the difference from other apps.

Recalculate recipes for different serving sizes
This is where the app started: recalculating recipes for different serving sizes.
When recalculating, not only the ingredient list is updated, but also the recipe text.

Cooking assistance
The app will help you cook: it won't turn off the screen while cooking, will track time and even send push notifications. Timers are, of course, available on the computer too.

Shopping list
Add ingredients to your shopping list one by one from a recipe, or add the whole recipe at once.
Mark purchased items, sort the list the way you like, and share the list with the person going to the store.

Automagical recipe import
Recipe Scaler can import a recipe from text, a single link, or multiple links at once.
You can also upload a file in almost any text format and even photos of pages from a cookbook, notebook, or handwritten recipe journal.

AI assistant for recipes
If something goes wrong while you cook, the AI assistant can help you save the dish and figure out what to do next.
It can also explain the recipe, suggest the next step, and point out the equipment you may need.
It's like having a chef always at your fingertips, ready to answer your questions.

Discover section
Find new recipes in Discover.
Explore interesting authors, save recipes to your collection, and build your own shortlist of the best finds.

Health-friendly: nutrition calculation
Recipe Scaler will calculate the nutritional value (Kcal, protein, fat, carbs) for a dish and let you view it conveniently: for the entire dish, per 100 grams, or per serving.
If artificial intelligence makes a mistake in the numbers, you can always correct the nutritional value of the needed ingredient.

Cookbook
Download a public recipe collection (your own or someone else's) as a beautifully formatted PDF.
The cookbook includes recipes with photos, ingredients, and cooking instructions.

Telegram bot
Send the bot a recipe text or a link to it and the bot will save the recipe to your account.

Chrome extension for quick import
Install the Recipe Scaler Importer extension and import the recipe into your account in one click.

AI assistant integration
Connect your AI assistant to recipes. It can search recipes, add new ones, or help you cook the way you're used to: in chat, by voice. To connect, use the link: recipe-scaler.ru/mcp
For techies: yes, this is an MCP server.

Careful handling of your data
We are paranoid about your privacy.
The app works without sign-up: we don't know your email or your Google login. Even Telegram is only needed for saving recipes. Don't want it? Don't use it.
We don't use trackers or product analytics.
We don't allow AI models to train on your recipes.
Data export and an API are available, so we don't hold your data hostage.
More details: recipe-scaler.ru/#/privacy

If we've convinced you to try:
Go to app

If we haven't convinced you:
Write what's missing

Made by Mikhail Ozornin with Cursor. App idea inspired by app by Roman Shamin.
© Mikhail Ozornin, 2025

Качество (тиры)

Тиры — черновая разметка по посту; можно править в data/runs.json.

Выводы

  1. Opus — на коне. Дорого и сильно лучше GPT 5.x на этой задаче.
  2. Китайские модели часто оверфитятся на бенчмарки; в реальной UI-задаче разброс огромный.
  3. Хорошая модель обесценивает «дизайн разработчиком/продактом» без вкуса; дизайнерам пока есть работа.

Ссылки