I’ve been burned twice now, and I’m trying to figure out where my vetting process is falling apart.
Here’s what happened: We found this creator with solid follower count, decent engagement, and a portfolio that looked legit. On paper, seemed perfect for our brand. We signed them for a 10-video campaign. Midway through, I started noticing their comments were weirdly bot-like—lots of generic “fire” and “needs this” type responses. Their engagement metrics looked good, but something felt off. Dug deeper and realized about 40% of their followers were probably fake.
Then there’s the creator who has real followers but their actual content doesn’t match their vibe. They’ll post aspirational lifestyle stuff, but when I went through their last 50 pieces of UGC, they’re all shilled to different brands in wildly different ways. Zero consistency. Which version of them would show up in our campaign?
I know I should be checking follower quality, engagement patterns, and portfolio depth. But what’s the system you actually use? Are you running profiles through analytics tools? Having them create sample content first? Asking for historical performance data from previous campaigns? Where’s the real early-warning signal that someone’s not a good fit?
This is where relationships trump analytics tools every single time. Here’s what I do: Before we ever discuss budget, I have a conversation. Real conversation. I’m looking for: Can they articulate why they want to work with us? Do they already know our brand or are we just another paycheck? What’s their content process—do they have one, or do they just wing it?
The creators who have an actual system for content creation are always more reliable. They can tell you their posting schedule, their engagement target, how they test ideas. The ones who just make stuff and hope it lands are unpredictable.
Second, I always ask for case studies from previous brand work. Not just the metrics—the actual creative brief feedback. If a creator can tell me, “your brief asked for X but I adjusted to Y because my audience responds better to Y,” that’s a creator who thinks. If they just copy briefs mechanically, that’s a red flag.
Third one: I ask them to create a sample piece with zero payment, just for evaluation. High-quality creators don’t mind this because they know it shows their real work. The ones who get defensive? Move on.
Okay from the creator side, please ask for our analytics breakdown. Real creators know their numbers—engagement rate by content type, audience demographics, which posts performed best and why. If a creator can’t tell you that, they’re not being intentional about their content.
Also, look at their recent comments section. Real engagement looks different from bot engagement. Look for specific comments—people referencing stuff the creator said, asking real questions, telling stories. Bot engagement is all “omg so good” with no substance. Takes 5 minutes to spot.
But here’s the thing: even creators with real followers might not be a vibe match for your brand. That’s not about authenticity—that’s about alignment. I’ve turned down campaigns because the brief felt inauthentic for what my audience expects from me. A good creator will tell you if something doesn’t fit. If they just say yes to everything, they’re chasing the check, not building their brand.
My advice: Don’t just vet the creator. Vet whether they actually care about their audience. The ones who do tend to be better partners overall.
You need a rubric. I built one after we had similar issues. Here’s what I check:
Bot Detection (5 min): Use a tool like HypeAudience or check follower growth patterns manually. Real growth looks jagged and organic; bot-purchased growth looks linear and suspiciously perfect.
Engagement Quality (15 min): Manually sample 20-30 comments from their top 5 posts. Count substantive comments vs. generic ones. Calculate the ratio. If it’s below 60% substantive, flag it.
Content Consistency (20 min): Pull their last 30 pieces and categorize by type, tone, product category they’re promoting. Real creators have a signature. Their UGC has a recognizable style. If every post looks radically different, either they’re desperate and taking any brief, or they’re not being selective.
Performance History (10 min): Ask for actual campaign performance data from their last 2-3 brand partnerships. Not just views—engagement rate, conversion (if they have it), and their own reflection on whether it worked.
Total time investment: ~45 min per creator. For a 10-video campaign budget, that’s worth it.
The biggest signal though: creators who actively reflect on their performance are more reliable. Creators who just move on to the next deal are less predictable.
The vetting process should mirror how you’d evaluate a business partner, because that’s what they are. I look for four things in order of importance:
-
Audience alignment (non-negotiable): Does their audience match your target customer? Demographics, psychographics, purchasing behavior. No amount of authenticity makes up for the wrong audience.
-
Content consistency (high importance): How consistent is their messaging and content style across platforms and campaigns? Creators who reinvent themselves for every brand are high-risk.
-
Engagement quality (high importance): Like Анна said, look at comment quality. But also: does their audience actually trust them? Do people buy based on their recommendations? That’s the metric that matters.
-
Communication style (medium importance): Can they take direction? Do they ask clarifying questions? Do they push back when something doesn’t make sense? Collaborative creators outperform order-takers.
For the 40% fake follower problem you spotted: there are services that audit this instantly. We use Modash—it shows you a follower quality score in seconds. There’s also HypeAudience, CreatorIQ, etc. For a 10-video campaign, paying for an audit tool for a month is standard operating cost.
But here’s what I’d do differently: Instead of vetting individual creators, consider working with a creator marketplace or agency that handles vetting for you. Yeah, you lose some control, but you gain confidence that someone’s already done this work.
Build a creator audit template and run every potential partner through it before first contact. This has saved us thousands in bad partnerships. Here’s the structure:
Tier 1 (Automated, 10 min): Follower quality score, engagement rate trend (last 90 days), fake follower estimate.
Tier 2 (Manual Review, 15 min): Content theme consistency score, audience demographics analysis, competitive fit (are they already saturated with competitors?).
Tier 3 (Conversation, 20 min): Sample brief, brief feedback, question about past campaign performance.
If they pass Tier 1 cleanly but fail Tier 2, you probably want higher-tier creators anyway. If they pass Tier 1 and 2 but fail Tier 3, they’re likely a poor collaborator.
We’ve also started asking creators for a test video (paid, minimalist brief) before the full campaign. Costs 30-50% of a full video, shows you their real process. The creators who shine here are always stronger partners across the board.
One more thing: Check how long they’ve been in business and what their retention rate is with repeat brand partners. Creators who work with the same brands repeatedly are usually solid. Creators who constantly churn brand partners? That’s a signal.
We just went through this (scaling creator partnerships from Russia into Europe), and honestly, the biggest red flag we found was: ask them about their failed campaigns. Every creator has had content that didn’t perform. The ones who learn from it and can articulate what they’d do differently—those are keepers. The ones who blame the brand or make excuses—move on.
We also started asking creators how they’d approach our specific brief. Not asking them to do free work, just: “walk me through your thinking on how you’d tackle this concept.” Their answer tells you whether they’re strategic or just executing. Good creators think about the why; bad ones think about the what.
For authenticity specifically: ask their previous brand partners for references. I know, nobody does this, but it works. One reference from a brand they’ve worked with teaches you way more than any metric.