• A/B Testing

     

    Rotation Ratio

    The rotation ratio  allows you to set how often( based on: the number of users, sessions, page views, etc.) , a Personalization Action or Campaign  is performed in relation to other  Actionsand Campaigns.

    For example: you may want to show a specific banner three times for each time another banner is shown.

    Screen Shot 2017-04-18 at 9.52.25 PM

     

    A/B Testing:

    When Targeting a Specific Audience, defining a rotation ratio between different Personalization Actions  within  a single Personalization Campaign allows you to A/B Test your personalized content, and  can provide valuable insight on the relative effectiveness of every personalization action.

    To define a Rotation Ratio between different Personalization Actions:

    1.  In the “Add Actions To Audience” Table( section 2 of the “Audiences.” Appears once you click on an audience or save a new Personalization Action):
    2. Click on “Set Rotation,”  located beneath the “Test” column.
    3. Choose what to base the rotation on -
      • User – Random  -  Visitors will be randomly assigned to different test conditions.
      • Page – Random  -  Personalization Actions will be presented to visitors  randomly based on the number of pages the action appeared on.
      • Session – Random -  Personalization Actions will be presented to visitors randomly, based on the number of sessions that made the action appeare.
    4.  Define the rotating ratio.

    For Example :

    Creating two versions of the same banner, designed to target the same audience, and  defining a 50% visitor based rotation between them, will cause half of the visitors to see one version of the banner, while the other half sees the other version.

     Multivariate Testing: 

    Often enough not only will a personalized campaign consist of more than one content adjustment, but there will be more than one campaign to test for every audience group.  When targeting a specific audience, defining a rotation ratio between two or more Personalization Campaigns allows you to Multivariate Test your overall Personalization Strategy.

    For Example:

    1. Variation A: three banners, two popups, and a Personalized Email
    2. Variation B: two popups, WYSIWYG Editor content Adjustment, and a Personalized Email.

     Note: When you are simply linking individual Actions to a newly defined Audience Group, they are automatically organized into the default Variation( most often variation #1).

    To organize Actions into  more than one variation of the same campaign simply check the “Multivariation content” checkbox, above the “New/Existing” button.

    To add a new Content Variation:

    • click on the green “New Content Variation” button.
    • Notice that add new individual Actions to every variation works same as before. It is only a matter of expanding every variations menu, and adding Actions same as before.

    To set a rotation between different Variations:

    1. click on the “Set rotation” link, next to the desired variation.
    2. Choose what to base the rotation on-
      • User – Random  -  Visitors will be randomly assigned to different test conditions.
      • Page – Random  -  Personalization Actions will be presented to visitors  randomly based on the number of pages the action appeared on.
      • Session – Random -  Personalization Actions will be presented to visitors randomly, based on the number of sessions that made the action appeare.
    3.  Define the rotating ratio.

    For example: 

    Setting a 50% User-random rotation between variations A and B, will cause half of the Audience Group members to see all Actions within variation A, while the other half sees all Actions in variation B.

    Note:  It is possible to define a rotation between different Actions within each variation, and between different variations.

     Testing Results - 

    Once the rotation is set, Personyze continuously monitors, analyzes, and displays statistical data in order to make it remarkably simple to choose the best performing Personalization Action and Personalization Strategy for every Audience Group. The results are displayed in the “Add Actions to Audience” table.  For every Personalization Action, the table presents:

    • Reached –  The absolute number of visits this action was executed, out of all the sessions to the website in a specified date range( displayed as an absolute number and a percentage ratio).
    • Impressions – the total number of times the action was executed over a specified date range.
    • Clicked - How many times the action was clicked on( for clickable actions), or filled its purpose ( form submitted, Facebook connect authorized, etc).
    • CTR – Click Through Rate.
    • Conversion rate – You can set Personzye to track unlimited number of goals ( You business KPI’s), Each goal metrics includes number of conversions and transaction value, Etc

    The Click through rate is automatically calculated for all clickable actions( such as: banners, popups, etc.), but with the WYSIWYG Editor, regardless of the number of content adjustments you’ve made, the entire webpage is considered to be edited. Therefore, You need to specify the elements clicks on which will be tracked for this particular metric. 

    To specify an element clicks unto which count towards the  CTR:

      1. Click on an element you wish to track.
      2. After the menu turns blue, choose the “Track Event” option.
      3. Monitor “Click” Events.
      4. Under the “What to Track” section, choose “Extra.”
    • CTR of Visits – Click Through Rate in proportion to the number of visits.
    • Unique Goals – How many times has this action reached it’s defined unique goal?

    The  WYSIWYG Editor allows us to monitor clicks on multiple elements and report the clicks under  as a single metric:

      1. Click on all of the elements you wish to track( one by one).
      2. Each time, after the menu turns blue, select the “Create Click Goal” option.
    • Conversion % – How many times has this action made the visitor match an Audience Definition singled out to be a Central Website Goal
    • Bounce % – Percentage of Visitors who viewed only one page and decided to leave the website.

     Note -  As long as the rotation ratio is defined Personyze keeps rotating between different versions of personalized content.