Paddy Galloway Discusses Video a/B Testing for Retention Analysis

Paddy spoke about video A/B testing, focusing on how optimizing content performance involves testing thumbnails and intros.

Paddy said that he has put so much emphasis on thumbnail testing and optimization because it remains one of the few things a creator can actually change to impact performance after uploading. The prospect of video A/B testing expands that opportunity further into the video itself.

“We all know how much of a difference an intro can make,” Paddy said.

full video for all of Paddy and Amjad's insights on the Creator Insider channel — Creator Insider and YouTube Creators

“There are some times when I’ll try an intro and realize immediately afterwards that it didn’t resonate. The idea that we’re moving towards video A/B testing is very exciting for me,” Paddy said.

Creators will have a week to select their preferred edit once the upcoming video A/B testing tool runs an evaluation and supplies the outcome. Noting that narrative openings can be developed in numerous ways, Amjad mentioned that conversations with creators lead him to anticipate video A/B testing will primarily be utilized on intros.

The test results will include retention curves for both edits. This capability is particularly valuable when testing different introductions and tells creators far more than just testing thumbnails and following clickthrough rate.

“When you have a sea of metrics, it’s easy to get distracted by something that may not actually be in your interest as a creator. That’s why we really focused on the retention curves, because that is the true insight from the A/B testing,” Amjad said.

Photo of author

Sophie Lin - Technology Editor

Sophie is a tech innovator and acclaimed tech writer recognized by the Online News Association. She translates the fast-paced world of technology, AI, and digital trends into compelling stories for readers of all backgrounds.

Study: RA Linked to Higher Risk of Preterm and Small for Gestational Age Births

Willie Geist Exits Morning Joe After 20 Years