Strategy
Grade an agency proposal on substance vs. vanity-metric theatre.
- Category
- Strategy
- Signup
- None
- Your data
- Stays in your browser
- Also in
- Claude, via MCP
How do you judge whether a marketing agency pitch is credible?
Score six checks: ties work to pipeline or revenue (25 points), explains how results are attributed (20), gives transparent reporting and data access (15), has relevant references (15), lets you own the accounts and data (15) and avoids guaranteed results (10). Yes scores full points, vague half. 75+ is credible, 45 to 74 proceed with caution, under 45 high risk.
Mixed signals. The gaps, usually attribution and pipeline linkage, are exactly where agencies hide behind impressions and reach. Push for specifics before committing budget.
The tell is always attribution: an agency that can’t explain how it connects work to revenue will report on whatever number looks best that month.
About this calculator
Every agency deck has a slide with a chart trending up and to the right, and a surprising number of them can't tell you why. This detector isn't here to be polite about it, it grades a pitch on the things that actually predict whether you'll get pipeline or just a monthly reel of impressions and vibes, and it tells you plainly when the answer is "run."
How to use it
- Answer six questions about the pitch honestly, not how you wish it went: does it tie work to pipeline or revenue, does it explain attribution, is reporting transparent, are the references relevant, do you retain ownership of accounts and data, and does it avoid guaranteed-results promises.
- Rate each "yes clearly," "somewhat/vague," or "no/avoided it."
- Read the credibility score, the BS meter, and the verdict before you sign anything.
Methodology
Each check carries a weight reflecting how much it predicts real accountability: tying work to pipeline is worth 25 points, explaining attribution 20, transparent reporting and relevant references 15 each, you owning the accounts and data 15, and avoiding guaranteed-results promises 10, totalling 100.
Each answer scores full weight for "yes," half weight for "vague," and zero for "no," and the weighted total becomes the credibility score. The BS meter is simply 100 minus that score.
A credibility score of 75+ is credible, negotiate scope, not trust. 45-74 is proceed with caution, the gaps are usually exactly where agencies hide behind impressions instead of results. Below 45 is high BS risk.
Attribution is the tell across all of it, an agency that can't explain how its work connects to revenue will always find a metric that looks good that month, impressions, reach, engagement, whatever moves. Clear attribution is the one thing spin can't fake.
Agency credibility score
Credibility = 25 × Pipeline + 20 × Attribution + 15 × Reporting + 15 × References + 15 × Ownership + 10 × No guarantees (each: Yes = 1, Vague = 0.5, No = 0) Risk meter = 100 − Credibility Band: 75+ credible, 45 to 74 caution, under 45 high risk
- Pipeline
- The agency commits to measures that connect to opportunities and revenue, not just impressions or clicks.
- Attribution
- They can explain how they will show which results their work caused.
- Ownership
- Ad accounts, analytics, creative and data stay in your name.
- No guarantees
- They avoid promising fixed results such as rankings or ROAS figures.
Avoiding guarantees scores positively because nobody controls auctions, algorithms or buyers; a guarantee is usually either hedged in the contract or a sign the agency will chase an easy metric. The weights and bands are the tool's.
Worked example: the default answers
An agency is vague about pipeline, cannot explain attribution, offers transparent reporting, has somewhat relevant references, agrees you own the accounts and guarantees a ROAS figure.
- Pipeline, vague = 25 × 0.5 = 12.5.
- Attribution, no = 0.
- Reporting, yes = 15.
- References, vague = 15 × 0.5 = 7.5.
- Ownership, yes = 15.
- No guarantees, no = 0.
- Credibility = 50, proceed with caution; risk meter = 50.
Ask two follow-up questions before signing: how will they measure their effect on pipeline, and what exactly is behind the guaranteed ROAS? A credible answer to both would move the score above 75. Check what you are paying for wasted spend with the ad spend waste calculator.
What a credible agency pitch includes
Credible agencies are specific about how they will be judged:
- Outcomes in your terms: qualified leads, pipeline and cost per opportunity, agreed up front.
- Measurement plan: tracking, CRM connection and how results will be attributed.
- Access: you own and can see every account and report.
- Relevant proof: references from businesses like yours that you can call.
- Honest limits: what they cannot control and what they need from you.
Hiring agencies in India vs the US
Indian agencies sometimes run ads from their own accounts and bill media with a margin, which can leave you without history if you change agency. Insist on accounts in your company's name, GST invoices that separate media from fees, and access to raw data. For what agency and in-house roles cost in India, see fractional CMO pricing in India.
US agencies more often work in client-owned accounts, but reporting can still focus on platform metrics. Ask for CRM-connected reporting and clarity on fees, minimum terms and who works on the account day to day.
Common agency selection mistakes
- Choosing on a polished pitch deck rather than references.
- Letting the agency own the ad accounts or analytics.
- Agreeing to report only on impressions, clicks or platform ROAS.
- Accepting guarantees without reading how they are defined.
- Not agreeing exit terms and data handover in advance.
FAQ
Because no legitimate agency can guarantee pipeline or revenue, too many variables sit outside their control, your product, your sales team, your market. An agency that promises guaranteed leads or rankings is usually selling confidence instead of substance, which is precisely the kind of vanity pitch this tool is built to catch.
Vague attribution. If they can't clearly explain how a specific piece of work connects to a specific pipeline or revenue outcome, everything else in the pitch, the case studies, the reporting dashboard, the references, becomes decoration. Push on this question first.
Possibly, but negotiate the specific gaps before signing: get attribution methodology in writing, ask for data and account ownership as a contract term, and request references that match your actual industry and stage, not just impressive-sounding logos.
Because an agency that controls your ad accounts, CRM data, or analytics setup can quietly become impossible to leave, and can also make performance look better than it is by controlling what you see. Owning your own accounts and data keeps the relationship accountable and makes switching agencies possible if the results don't hold up.
Because no agency controls auctions, algorithms or buyers. Guarantees are usually tied to easy metrics or hedged with conditions.
Possibly, if the gaps can be closed in the contract: agreed measures, account ownership and a trial period with a clear exit.
Numbers looking off?
If the model says one thing and the pipeline says another, that gap is usually where the revenue is. A 30-minute call finds it.
It starts with a 30-minute call. Pick a time below.