Email Marketing Effectiveness: Measure What Changes
Email Marketing Effectiveness: Measure What Changes
Email Marketing Effectiveness: Measure What Changes

Research insights

Email Marketing Effectiveness: Measure What Changes

Email marketing effectiveness is the extent to which a campaign produces its intended customer or business outcome. Opens and clicks help diagnose the journey, but a campaign review also needs a defined audience, a meaningful conversion, a measurement window and the cost of achieving the result.

Email Marketing Effectiveness: Measure What Changes
On this page
  1. Define the journey and every denominator
  2. Treat opens as an imperfect diagnostic
  3. Test one decision with an appropriate comparison
  4. Find where the customer journey breaks
  5. Turn findings into an accountable decision

For a Vietnamese retailer, the question might be whether a replenishment reminder leads to additional completed orders. For a business service, it might be whether an invitation generates qualified enquiries. These objectives require different measures, so avoid comparing campaigns only by a single engagement rate.

Email Marketing Effectiveness: Measure What Changes
Illustrative question framework • INTAGE Vietnam

Define the journey and every denominator

Record messages sent, messages recorded as delivered, unique recipients clicking a relevant link, and people completing the intended action. State whether the click rate uses delivered messages or another denominator. Likewise, distinguish conversions per delivered message from conversions per landing-page visitor. Both can be informative, but they answer different questions.

For an illustrative calculation, 20 completed orders from 1,000 delivered messages is a 2% order rate per delivered message. If 100 people visited the landing page, the same orders represent 20% of those visitors. These are hypothetical numbers, not benchmarks or evidence of performance in Vietnam.

Treat opens as an imperfect diagnostic

Open tracking should not be treated as a direct count of attentive readers. Apple’s Mail Privacy Protection explanation describes how the feature prevents senders learning about Mail activity. This limits what an observed open can tell a marketer about actual reading.

Review opens alongside downstream actions and the measurement settings used by the email platform. A change in reported opens may reflect how activity is observed rather than a stronger subject line. Before comparing periods, document any platform, audience or tracking changes that could affect the measurement.

Test one decision with an appropriate comparison

If the decision concerns a subject line, randomly assign eligible recipients to two versions while keeping the sender, content, offer and timing comparable. Select the main outcome and observation period before launch. Do not stop the test simply because one version briefly moves ahead.

If the decision concerns the value of sending an email at all, include a randomly selected no-email holdout where feasible. Orders from recipients may have happened without the message. The difference between comparable groups provides more useful evidence than assigning every post-click purchase to the campaign. Report uncertainty when volumes are small.

Find where the customer journey breaks

Clicks without completed action call for a landing-page and offer review. Ask customers to explain the message, identify the next step and complete a realistic task on a prototype. Look for inconsistent prices, unclear conditions, difficult forms or an offer that does not match the subject line. Check that the mobile experience supports the same task.

Unsubscribes and complaints should be examined alongside frequency and relevance. Invite feedback on preferred topics and cadence without making continued participation difficult. Segment by a justified customer need or previous behaviour, and avoid inferring sensitive personal circumstances from a click.

Turn findings into an accountable decision

Report the objective, comparison, conversion definition, outcome window, costs and limitations together. Revenue attributed by a platform is not automatically incremental profit. Any return calculation should state which costs and contribution assumptions it includes.

Combine measurement with qualitative and quantitative customer research when the reasons behind a result remain unclear. Explore INTAGE Vietnam’s market research services for the research component of a campaign evaluation. Discuss a study brief that identifies the email decision, customer group and evidence needed.

Latest posts

Contact Us

Phone
(+84) 28 3820 5558
Email
[email protected]
Address
1st floor, Citilight Tower, 45 Vo Thi Sau St., Tan Dinh Ward, HCMC

INTAGE VIETNAM LIMITED LIABILITY COMPANY

Business registration certificate No. 0312603388 Issued by the Department of Planning and Investment  of Ho Chi Minh City on December 2, 2013
1st floor, Citilight Tower, 45 Vo Thi Sau St., Tan Dinh Ward, HCMC
Tel  : (+8428) 3820 5558
Email :[email protected]
Contact