Analyze A/B test results for statistical significance with ship, extend, or kill recommendations
日本語の概要は準備中です。原文の説明を表示しています。
Analyzes email sequence performance metrics. Evaluates open rates, click rates, reply rates, and conversion by step. Identifies drop-off points, benchmarks against industry averages, and recommends optimizations.
インストールする前に、エージェントに与えられる指示の中身を確認できます。
Evaluates the performance of email outreach and nurture sequences. Ingests per-email metrics (opens, clicks, replies, conversions, unsubscribes), identifies drop-off points and underperforming steps, benchmarks against industry averages for B2B services, and outputs actionable optimization recommendations.
agency.config.json populated (sequences, benchmarks)crm-writer -- pull sequence engagement data from CRMreply-analyzer -- analyze reply quality and sentimentab-test-analyzer -- evaluate A/B test results within sequencesemail-copywriter -- rewrite underperforming emailsRead agency.config.json:
sequences[] -- defined sequences with expected benchmarksoutreach.daily_caps -- volume contextbenchmarks -- agency-specific benchmark targets if defined:
{
"benchmarks": {
"cold_outreach": {
"open_rate": 55,
"click_rate": 5,
"reply_rate": 8,
"positive_reply_rate": 3,
"meeting_rate": 2,
"unsubscribe_rate": 0.5
},
"nurture": {
"open_rate": 40,
"click_rate": 4,
"reply_rate": 5,
"conversion_rate": 12,
"unsubscribe_rate": 0.3
}
}
}
Accept parameters:
sequence_name -- (required) name of the sequence to analyzedata_source -- crm | csv | manual. Default: crmdate_range -- start and end dates for analysis periodcomparison_period -- previous period for trend analysis. Default: previous_equivalentinclude_rewrites -- boolean, generate improved copy for underperformers. Default: truegranularity -- per_email | per_step | aggregate. Default: per_emailQuery CRM for sequence performance data:
For each email in the sequence:
- Sent count
- Delivered count (sent - bounced)
- Open count (unique opens)
- Click count (unique clicks)
- Reply count (unique replies)
- Positive reply count (interested / meeting booked)
- Negative reply count (not interested / unsubscribe request)
- Neutral reply count (OOO, wrong person, info request)
- Unsubscribe count
- Bounce count (hard + soft)
- Conversion count (meeting booked / demo scheduled / proposal requested)
Accept a CSV with columns:
step, subject, sent, delivered, opened, clicked, replied, positive_replies, negative_replies, unsubscribed, bounced, converted
Prompt for per-step data:
For sequence "[name]", provide metrics for each step:
Step 1: [subject line]
Sent: ___ Opens: ___ Clicks: ___ Replies: ___ Meetings: ___ Unsubs: ___
Step 2: ...
For each email in the sequence, calculate:
Step [N]: "[Subject Line]"
---
Sent: [count]
Delivered: [count] ([delivery_rate]%)
Opened: [count] ([open_rate]%)
Clicked: [count] ([click_rate]%)
Replied: [count] ([reply_rate]%)
- Positive: [count] ([positive_rate]%)
- Negative: [count] ([negative_rate]%)
- Neutral: [count] ([neutral_rate]%)
Converted: [count] ([conversion_rate]%)
Unsubscribed: [count] ([unsubscribe_rate]%)
Bounced: [count] ([bounce_rate]%)
Calculate the drop-off between each step:
Step 1 -> Step 2: [X]% drop in opens, [Y]% drop in clicks
Step 2 -> Step 3: [X]% drop in opens, [Y]% drop in clicks
...
Compare each email against industry benchmarks:
Step [N] vs Benchmark:
Open rate: [actual]% vs [benchmark]% -- [ABOVE/BELOW/AT benchmark]
Click rate: [actual]% vs [benchmark]% -- [ABOVE/BELOW/AT benchmark]
Reply rate: [actual]% vs [benchmark]% -- [ABOVE/BELOW/AT benchmark]
Flag emails performing >20% below benchmark as "underperforming." Flag emails performing >20% above benchmark as "outperforming."
SEQUENCE FUNNEL: [name]
===
Sent: [count] (100%)
Delivered: [count] ([rate]%)
Opened: [count] ([rate]%) -- at least one email opened
Clicked: [count] ([rate]%)
Replied: [count] ([rate]%)
Positive replies: [count] ([rate]%)
Converted: [count] ([rate]%)
Identify the biggest drop-off points:
CRITICAL DROP-OFFS:
1. Step [N] -> Step [N+1]: [X]% drop -- [diagnosis]
2. Step [N] -> Step [N+1]: [X]% drop -- [diagnosis]
Drop-off diagnoses:
Total across all steps:
Unique contacts reached: [count]
Total emails sent: [count]
Total opens: [count] (avg [rate]% per email)
Total clicks: [count] (avg [rate]% per email)
Total replies: [count] (total reply rate: [rate]%)
Total conversions: [count] (sequence conversion rate: [rate]%)
Total unsubscribes: [count] (sequence unsub rate: [rate]%)
Cost per conversion: [if spend data available]
Rank all subject lines by open rate:
SUBJECT LINE RANKING:
1. "[subject]" -- [open_rate]% -- Style: [question/number/curiosity/direct]
2. "[subject]" -- [open_rate]% -- Style: [type]
3. "[subject]" -- [open_rate]% -- Style: [type]
...
Identify patterns:
Rank CTAs by click and reply rate:
CTA RANKING:
1. "[CTA text]" in Step [N] -- [click_rate]% clicks, [reply_rate]% replies
2. "[CTA text]" in Step [N] -- [click_rate]% clicks, [reply_rate]% replies
...
Identify patterns:
If reply-analyzer data available:
REPLY ANALYSIS:
Total replies: [count]
Positive (interested): [count] ([rate]%)
Negative (not interested): [count] ([rate]%)
Neutral (OOO, wrong person): [count] ([rate]%)
Common positive signals: [list]
Common objections in negative replies: [list]
Steps generating most positive replies: [step numbers]
If comparison period data is available:
PERIOD-OVER-PERIOD COMPARISON
===
Metric | Current | Previous | Change | Trend
Open rate | [%] | [%] | [+/-] | [up/down/flat]
Click rate | [%] | [%] | [+/-] | [up/down/flat]
Reply rate | [%] | [%] | [+/-] | [up/down/flat]
Conversion rate | [%] | [%] | [+/-] | [up/down/flat]
Unsub rate | [%] | [%] | [+/-] | [up/down/flat]
Flag significant changes (>10% shift in either direction).
Based on analysis, generate specific, actionable recommendations:
For each email flagged as underperforming:
STEP [N] OPTIMIZATION
---
Issue: [specific metric below benchmark]
Diagnosis: [likely cause based on patterns]
Recommendation: [specific change to make]
Priority: [HIGH/MEDIUM/LOW]
Rewrite (if include_rewrites = true):
Original subject: "[old subject]"
Recommended subject: "[new subject]" -- [reasoning]
Original CTA: "[old CTA]"
Recommended CTA: "[new CTA]" -- [reasoning]
Body changes: [specific suggestions]
SEQUENCE OPTIMIZATIONS
===
1. TIMING:
- [Recommendation about send days/times based on open patterns]
- [Recommendation about spacing between emails]
2. CONTENT:
- [Recommendation about content types that work best]
- [Recommendation about email length based on performance]
- [Recommendation about personalization approach]
3. STRUCTURE:
- [Should emails be added/removed?]
- [Should the sequence be shortened/extended?]
- [Should the CTA progression change?]
4. TARGETING:
- [Are certain segments performing differently?]
- [Should the sequence be split by segment?]
5. A/B TEST SUGGESTIONS:
- Test 1: [subject line variant] -- Expected impact: [%]
- Test 2: [CTA variant] -- Expected impact: [%]
- Test 3: [timing variant] -- Expected impact: [%]
Return structured JSON:
{
"sequence_name": "cold_outreach_d2c_india",
"analysis_date": "2026-03-07",
"date_range": {"start": "2026-02-01", "end": "2026-02-28"},
"summary": {
"total_contacts": 200,
"total_emails_sent": 950,
"sequence_open_rate": 52.3,
"sequence_click_rate": 4.8,
"sequence_reply_rate": 7.2,
"sequence_conversion_rate": 2.5,
"sequence_unsub_rate": 0.4,
"total_conversions": 5,
"health": "GOOD",
"vs_benchmark": "ABOVE_AVERAGE"
},
"per_email": [
{
"step": 1,
"subject": "Quick question about your Shopify store",
"sent": 200,
"open_rate": 58.5,
"click_rate": 6.2,
"reply_rate": 4.5,
"conversion_rate": 1.0,
"unsub_rate": 0.5,
"vs_benchmark": "ABOVE",
"status": "OUTPERFORMING"
}
],
"drop_offs": [
{
"from_step": 3,
"to_step": 4,
"open_rate_drop": 18.5,
"diagnosis": "Subject line fatigue -- Step 4 uses similar style to Step 3",
"recommendation": "Change Step 4 subject line style from question to curiosity gap"
}
],
"top_performers": [
{"step": 1, "metric": "open_rate", "value": 58.5, "reason": "Strong curiosity-based subject line"}
],
"underperformers": [
{"step": 4, "metric": "open_rate", "value": 38.2, "reason": "Subject line fatigue, poor timing"}
],
"recommendations": [
{
"type": "rewrite",
"step": 4,
"priority": "HIGH",
"change": "Replace subject line and lead with fresh angle",
"expected_impact": "+8-12% open rate",
"rewrite": {
"original_subject": "Following up on my last email",
"new_subject": "This cost [industry] brands 23% in lost revenue last quarter",
"reasoning": "Pattern interrupt instead of follow-up framing"
}
}
],
"ab_test_suggestions": [
{
"test": "Step 1 subject line: question vs statement",
"hypothesis": "Direct statement may outperform question for enterprise segment",
"sample_size_needed": 100,
"duration": "2 weeks"
}
],
"trend": {
"vs_previous_period": {
"open_rate_change": "+3.2%",
"reply_rate_change": "+1.1%",
"conversion_change": "+0.5%"
}
},
"generated_at": "2026-03-07T10:00:00Z"
}
Present the analysis report.
APPROVAL GATE: "Sequence analysis complete. [N] optimization recommendations. Apply the rewrites?"
If approved:
crm-writerTrigger phrases:
まだレビューはありません。使ってみた感想をお寄せください。
概要と使いどころ
Analyze A/B test results for statistical significance with ship, extend, or kill recommendations
日本語の概要は準備中です。原文の説明を表示しています。
Reallocate ad budget across campaigns and channels using ROAS and marginal return analysis
日本語の概要は準備中です。原文の説明を表示しています。
Generate structured creative briefs for ad designers with brand-consistent direction
日本語の概要は準備中です。原文の説明を表示しています。
Mine winning ad angles, hooks, and creative patterns from top-performing ads
日本語の概要は準備中です。原文の説明を表示しています。
Monitor competitor ads across Meta, Google, and LinkedIn with strategic analysis
日本語の概要は準備中です。原文の説明を表示しています。
Interactive onboarding wizard that generates agency.config.json for any B2B agency. Asks structured questions about the agency, services, ICP, tools, outreach preferences, and CRM setup. Outputs a complete config file.
日本語の概要は準備中です。原文の説明を表示しています。