A/B testing

  • Messaging

Business Requirement

Brand would like to make AB testing for specific engagements for Web Messaging channel 

Solution

To use sections for displaying Engagements. 

Configurations steps: 
Configure specific section and attach to desired button 
3.1_Solution options.png
Add variable at the webpage  ( web portal, where customer navigates)
javascript:
lpTag.section = ["target"] lpTag.newPage(document.URL)
Strategy
  1. identify a certain entry point(s) that you'd like to run the test and to check if you dont have conflicts with previous configured eng-ts 
  2. define your success criteria for a champ ( clicks, conversations, csat)
  3. you can have two different engagements setup targeting the same entry point.  In this method, you get a 50/50 split on the champion/challenger engagements.  
  4. You could turn off the existing engagement and run the new one for a defined time period and compare to the baseline.  In this method, it's important that no other a/b testing or changes are happening for baseline and test period. You would also want to pick a pretty stable entry point that doesn't have a lot of fluctuation with visitor traffic to make the assessment as fair as possible.
Reporting

Utilise the Business dashboard for messaging to report on Engagements.