Release 1.9 – Feed A/B Testing Support
Written by Jeff Tseng on | 2 Comments
It”s finally here! Feed A/B testing! You guys have been asking for it forever and we finally got around to getting the A/B testing table working for all the post type channels such as the Stream, Feed Story, Publish User Action. This means that you’ll be able to use subtypes to categorize your feeds and A/B testing them accordingly.
We also got a request to have a graph of installs vs. time for the post channels and as well so we’ve that as well.
On a separate note, we recently added a new page to the developer site that outlines the Kontagent A/B testing framework. Check it out if you haven’t started using our A/B testing framework yet.
Stay tuned, we have another update coming very very soon!
I am new to Kontagent, though my company has been using it for a while now. We are evaluating whether we can use the built-in capabilities of the A/B testing system to visualize some internal A/B testing we are doing within our system.
I see that you have A/B test parameters for invites, notifications, and feeds using the type/subtype fields. Is there a way currently (or plans for something coming soon) to be able to either bucket users ourselves with other criteria, or be able to utilize Kontagent to visualize the results of our own A/B tests.
One example would be changing some in-game flows for their effect on virality, engagment and conversion.
It seems like we want something like the ability to tag page events with type/subtype which doesn’t appear to exist. More likely, we want to be able to tag users as being assigned to a group of our choosing and see their behaviors relative to a control group.
Alternatively, we may want more information on the Event APIs that are in private beta.
Any information or direction you can share would be most appreciated.
Thanks in advance,
Randy
Hi Randy,
Thanks for the feedback. We currently do not have a way to custom bucket users though we are well aware of the need for it. The scenarios that you are pointing out are definitely the types of use cases that we’ve been looking at.
As for events…they’re coming soon, very soon =)
Cheers,
Jeff