Notebook

How to evaluate a design studio's portfolio: what founders miss

Hiring 5 min read

A studio portfolio is a marketing artefact, not evidence. Here is how to evaluate a studio's case studies like a hiring manager, with the five signals that actually predict good work.

Studio portfolios are marketing artefacts, not evidence. To evaluate a portfolio like a hiring manager, ignore the aesthetic on the first pass and look for three things instead: what problem the studio was hired to solve, what specifically they decided along the way, and what actually changed after the work shipped. Studios that only show the beautiful final artefact are hiding their process. Studios that only tell their process without an outcome are hiding their results.

This is the framework we use when founders ask us to look at their shortlist and give an honest read. Most portfolios look good enough at first glance. The signal is in the second read.

Why beautiful portfolios can mislead

Portfolios reward the wrong things. A studio that hires a great photographer, uses a well designed case study template and writes with confidence will look better than a studio doing better work under an uglier presentation. That gap is entirely reputational, and hiring a studio because their portfolio site is prettier is a version of judging a book by its cover.

The uncomfortable second fact: many portfolios show work the featured studio only partially did. Freelancers who contracted in for two weeks. Junior designers whose work was rescued by an art director. Case studies where the “before” state was invented for the case study.

Read defensively.

What to look for in a case study

A strong case study has five things. Missing any two is a flag; missing three is a walk away.

  • A specific problem statement. Not “the client needed a rebrand”. Something like “activation had flatlined at 24% and we had eight weeks to move it before the next raise.”
  • Decisions with reasoning. Not “we chose a bold serif”. Something like “we chose a serif because the audience was skewing older and we wanted to signal permanence.”
  • Wrong turns. Any real project has at least one. Case studies that read as a straight line from brief to finished work are usually a straight line from finished work back to a manufactured brief.
  • What shipped, not just what was designed. Screens are cheap. Products are hard. If the case study ends at the mockup, you have no evidence the studio can operate past the beauty shot.
  • An outcome the client would confirm. A number, a launch, a public quote from the founder. Something checkable.

Signs of strategic thinking, not decoration

Decoration says “we made this look better”. Strategy says “we made this decision instead of the obvious one, and here is why.”

Signs of strategy in a case study:

  • The studio changed the brief. Founders arrive with the wrong problem more often than not. Strong studios push back before touching the interface.
  • The studio killed features. Junior teams add. Senior teams remove.
  • The studio published the metric. Studios that talk about outcomes get hired to move outcomes. Studios that talk only about craft get hired to make things pretty.
  • The studio explains what they did not do. Restraint is a strategic signal that decorators cannot fake.

Strategic studios cost more upfront and less overall. Decorative studios cost less upfront and more forever.

What good outcomes look like

Good outcomes are specific, measured and boring. “Signups up 34% inside two months of launch.” “Time to first purchase down from six days to under one.” “Support tickets for onboarding dropped by half.”

Bad outcomes are vague and flattering. “The client was thrilled.” “The rebrand was received with excitement across the industry.” “We successfully delivered a comprehensive design system.” All three could describe any project ever completed.

If a case study has no measured outcome at all, ask why during the discovery call. Sometimes the client will not permit the metric to be published, which is fine. Sometimes there was no metric, which is not.

Red flags to walk away from

Any of these on their own should prompt a question. Two of them together should end the process.

  • Every case study looks like the same project in different colours. The studio has a single move and applies it everywhere.
  • The team page shows twenty faces but the case studies never name who did what. You cannot tell who you would actually get on your project.
  • Every client is anonymous. “A large fintech.” “A well known SaaS.” Real clients let real studios name them.
  • No case studies from the last twelve months. Something has stopped.
  • The case studies are shorter than the studio’s about page. Priorities are visible.
  • The site is a rebuild every eighteen months with no historical work. Studios that shed their own past make you nervous for a reason.

How many portfolios should you review?

Four to six. Fewer than four and you have no comparison; more than six and you are procrastinating.

Set a timer. Read each studio’s three strongest case studies in twenty minutes. Score each on the five things above out of two (missing, partial, present). Add them up. The scores will not decide who you hire, but they will surface which studios you actually want to talk to.

Common questions

Should we ask for work in progress? Yes, if you can. Most studios will not share other clients’ in progress work, and are right to refuse. But asking is a good test. If they are willing to show you something recent under NDA, they trust their process. If they only ever show polished case studies, you never see how the sausage is made until you are inside it.

Are award badges (Awwwards, FWA, One Design Awards) meaningful? As a first filter, yes. They confirm a studio ships work at a certain craft level. As a hiring signal, they are weaker than founders think. Some of the best studios in London and New York have never entered an award; some of the worst have won several. Use them to build the shortlist, not to make the final call.

What if the studio’s portfolio is under NDA? Common with studios that work with regulated industries (fintech, health, government). Ask to see the case studies under a mutual NDA before signing anything. If they refuse, ask for a walk through on a call. If they refuse that too, walk away.

Do we need to like their aesthetic? Yes, but only after you have judged their thinking. Most senior studios can flex across aesthetics. Only decorators are one trick. If you love the look of the case studies but the thinking underneath is thin, you are hiring the wrong studio.

Evaluating a portfolio well is not about spotting the studio with the best pixels. It is about spotting the studio that thinks hardest about your kind of problem. Once you have shortlisted, book a discovery call with Studio Yapa and let us show you what our thinking looks like under the artefact.