Does Evidently keep users in the same variant group throughout the experiment

0

We are looking into using Evidently for A/B testing but during trials have found that I could be assigned to one group but a little bit later would be assigned to another. I don't see info in the documentation stating explicitly that users will be assigned to a certain group throughout the whole duration. Does anybody here know the technicality of it?

asked 11 days ago19 views
1 Answer
0

If a feature is launched, users could be placed in a variant. This depends on the allocation percentage. If they're part of the launch, their variant depends on the feature's variations. If not part of a launch, they might be in an experiment variant, depending on its allocation. If not in either, they get the default variant.

[+] https://docs.aws.amazon.com/cloudwatchevidently/latest/APIReference/API_BatchEvaluateFeature.html

AWS
answered 10 days ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions