Job application

Jr. Designer / Jr. Art Director - Quality & Judgement

Starts Aug 24, 2026

Overview

We are building a team of designers to audit AI-generated questions about design work. The project works as a multiple choice QA of design observations. Raters will see an asset and a set of multiple choice questions and audit each one for quality. Your job is to decide whether the question is any good: whether it is clearly written, whether the answer marked correct is actually accurate, and whether it tests something a working designer would know rather than something anyone could guess. This is judgment work, not production design work. What matters is the accuracy of your eye and the consistency of your calls across a high volume of questions.

What you'll do

Inspect the design shown in the portal, and download the attached file to confirm it renders the same way.
Answer questions about the asset based on what you see is accurate.
Compare your answer answer against the original expert critique that the question was generated from, and judge whether they actually agree.
Run a set of checks on each question: is it clearly written, does it have one defensible answer, is the key right, does it match the source critique, and are the images intact.
Flag broken, incomplete, or misleading renders, judged against the images rather than the critique text.

Required skills

2 or more years of hands-on design production experience in product, visual, digital, or brand design
A portfolio showing craft-level attention to layout, spacing, hierarchy, and typography
The ability to look at a design and articulate precisely what is wrong with it in plain language, without reaching for jargon
Sound judgment about what separates an objective error from a matter of taste. A different font choice is a preference. A chart line running through a label is an error. You will be making this distinction constantly, on someone else's behalf
Willingness to disagree with the answer key. The role only works if you trust your own read over what the system asserts
Consistency. Two similar questions should get the same call from you on Monday and on Friday
Fluent written English, and the ability to write a short, clear reason for each flag
A reliable computer running Chrome, and around 10-12 hours a week you can commit consistently
Strongly Preferred:
Experience using AI design or generation tools in your own practice, and a view on where they succeed and fail
Breadth across mediums rather than depth in one. You will see websites, app interfaces, presentations, posters, branding, and data visualisation
Previous experience with structured data annotation, model evaluation, or design QA work
Experience writing or reviewing assessment questions, rubrics, or design critique frameworks
Engagement details:
Freelance engagement through Taste
Fully remote, hours are flexible within the week
Onboarding is a live call plus a written guide. Expect the first several questions to take longer while you calibrate to the checks

Jr. Designer / Jr. Art Director - Quality & Judgement

Overview

What you'll do

Required skills

Apply for this role