I checked tenths videos of A/B testing, this one deserves more likes
@classyman5627
2 ай бұрын
Fabulous explanation and very crisp video and demonstration with example.....thank you
@daniellekavanaugh7732
3 жыл бұрын
This is really helpful. I learned a lot. Learning more about A/B testing for UX and the natural variance is a new and very interesting concept to me. Thank you!
@TestingTheory
3 жыл бұрын
Glad it was helpful!
@oliverpaton556
3 жыл бұрын
100.... wow that's low
@TestingTheory
3 жыл бұрын
Yes that would be the extreme example and if it was that low you would need to see the trend and lift doing well too. That one data point in isolation isn't enough.
@thumbliner
4 жыл бұрын
Nice video. Nicer shirt.
@TestingTheory
4 жыл бұрын
Thanks!
@KelseyCodes
4 жыл бұрын
Could you do a video explaining lift? I’ve only seen it used in the context of data mining and association rules, but it seems like you’re using it different here and I’m not sure what this measure represents here.
@TestingTheory
4 жыл бұрын
Hi Kelsey I think this video will help you out. At 3:26 I start talking about lift. kzitem.info/news/bejne/w32auqZtsnyTgag
@KelseyCodes
4 жыл бұрын
@@TestingTheory thanks so much, that helped a lot.
@molacool
3 жыл бұрын
Binge-watching these AB testing videos :) ;)
@TestingTheory
3 жыл бұрын
Have fun!
@Big-Al-Bro
4 жыл бұрын
Nice vid on A/B testing and interpreting results through data quality, managerial significance, and statistical significance. Clear and concise!
@TestingTheory
4 жыл бұрын
Thanks for the comment Aleksandr
@neversaygoodbyeMBV
3 жыл бұрын
Great points, however, doesn't this method suffer from Peeking issues?
@TestingTheory
3 жыл бұрын
If you are peeking at your data for the right reasons, then you aren't suffering from peeking, but you are benefiting from peeking. Check out this video which explains that more. kzitem.info/news/bejne/xIlmnWangouZdZw
@MinusPlusPlusergibtMinus
Жыл бұрын
good Job! Your focus on Data Literacy and Quality of Data is a huge plus of your Video! Thank you!
@emmydistortion3997
Жыл бұрын
Wooow. Thank you! Really understandable. Very important topic!
@TestingTheory
Жыл бұрын
You're very welcome!
@oliverpaton556
3 жыл бұрын
Variance doesn't need to be consistent. If you have a fairly optimal site already results will tend to be close and you just need more volume.
@TestingTheory
3 жыл бұрын
If larger changes are made, results are less likely to be close. From my experience people running tests will make little tweaks to the site and get results that are very close. The bigger the change the bigger the difference in the result for most tests.
@jennylockwood1020
4 жыл бұрын
Very comprehensive videos #gratitude
@TestingTheory
4 жыл бұрын
Glad it was helpful!
@fancyview
3 жыл бұрын
Really a nice video on A/B Test, thank you!
@TestingTheory
3 жыл бұрын
Glad you liked it!
@maxsteel4590
2 жыл бұрын
Quite useful concepts..not everything is covered by a single number. Noted
@TestingTheory
2 жыл бұрын
Glad it was helpful
@spazgrafficz6113
4 жыл бұрын
Can I run this test over one full day? Great advice by the way.
@TestingTheory
4 жыл бұрын
Are you talking about running the natural variance test? You would want to get more data than just a day, but one day is better than nothing. I guess it depends on your risk tolerance for having an unknown higher or lower variance amount. Me personally, I prefer more data so I can be more confident in the numbers I am using.
@DavidRodriguez7
Жыл бұрын
This is incredible! Really clear, concise and easy to understand. Thank you so much!
@TestingTheory
3 ай бұрын
Glad it was helpful
@RohanGL
4 жыл бұрын
Awesome, thank you!
@TestingTheory
4 жыл бұрын
Glad you like, thanks Rohan.
@peerapongtoi1040
2 жыл бұрын
thank you for your vdo. it's very useful and easy to understand :)
@TestingTheory
2 жыл бұрын
Glad it was helpful!
@HafizShehbazAli
4 жыл бұрын
Well explained.
@TestingTheory
4 жыл бұрын
Thanks Hafiz.
@nigerianprince5389
3 жыл бұрын
Great video. Really helpful mate thanks
@TestingTheory
3 жыл бұрын
Glad you enjoyed it
@saghababa
Жыл бұрын
Loved the video. Very useful.
@TestingTheory
Жыл бұрын
Glad it was helpful!
@khanjandesai2467
3 жыл бұрын
Loved the video
@TestingTheory
3 жыл бұрын
Glad you like it!
@annaroser-dummig8390
5 жыл бұрын
great video! :)
@TestingTheory
5 жыл бұрын
Thanks Anna.
@carlosarturogalvangrajales5365
3 жыл бұрын
Thx a lot!
@TestingTheory
3 жыл бұрын
You're welcome!
@bipashasengupta9417
2 жыл бұрын
Very well explained!
@TestingTheory
2 жыл бұрын
Glad you liked it
@amirfakhim7797
2 жыл бұрын
This is a great video, thank you. Do PMs design, implement and run the A/B testing or get help from data scientists to do it and report the result?
@TestingTheory
2 жыл бұрын
It really depends on your organization. Some organizations have have a cross functional team of experts to support this work. In most smaller organizations a person might wear multiple hats and do many functions.
Пікірлер: 52