Paddy spoke about video A/B testing, focusing on how optimizing content performance involves testing thumbnails and intros.
Paddy said that he has put so much emphasis on thumbnail testing and optimization because it remains one of the few things a creator can actually change to impact performance after uploading. The prospect of video A/B testing expands that opportunity further into the video itself.
“We all know how much of a difference an intro can make,” Paddy said.
“There are some times when I’ll try an intro and realize immediately afterwards that it didn’t resonate. The idea that we’re moving towards video A/B testing is very exciting for me,” Paddy said.
Creators will have a week to select their preferred edit once the upcoming video A/B testing tool runs an evaluation and supplies the outcome. Noting that narrative openings can be developed in numerous ways, Amjad mentioned that conversations with creators lead him to anticipate video A/B testing will primarily be utilized on intros.
The test results will include retention curves for both edits. This capability is particularly valuable when testing different introductions and tells creators far more than just testing thumbnails and following clickthrough rate.
“When you have a sea of metrics, it’s easy to get distracted by something that may not actually be in your interest as a creator. That’s why we really focused on the retention curves, because that is the true insight from the A/B testing,” Amjad said.