In this episode of "Golden Nuggets for Experimentation," Sander Volbeda discusses the importance of QA in conversion optimization. He covers the key elements that need to be checked during the QA process, as well as how to create a checklist to ensure that all bases are covered. Sander also emphasizes the importance of collaboration and communication during the QA process, as it can help to catch any blind spots and ensure that the experiment is optimized for success.
Checklist:
Variant loaded: This point checks if the intended variant of the experiment has been loaded correctly on the website. Ensuring that the right variant is displayed is crucial to accurately measure its impact on user behavior and conversion rates.
Visual assets: This step verifies if all visual assets, such as images and icons, are being used correctly and are hosted on the client's server. Additionally, it checks if these assets are optimized for various devices, like using smaller sizes for mobile to enhance loading speed and user experience.
Responsive design: This point focuses specifically on the responsiveness of the design across different screen sizes. It ensures that the experiment adapts seamlessly to various devices, enhancing usability and conversion potential.
Copy: This stage evaluates the textual elements of the experiment, including headings, texts, and button labels. It ensures that the copy matches the latest design specifications and is free from spelling errors, maintaining a professional and consistent appearance.
Typography: This point reviews the font-related aspects of the experiment, such as font family, size, and weight. Confirming that the typography aligns to the design specs ensures visual consistency and readability.
Link targets: This check verifies that all link URLs in the experiment are correct. Broken or incorrect links can negatively impact the user experience and undermine the credibility of the experiment.
Interactivity: Here, all interactive elements within the experiment are tested to ensure they function correctly. Whether it's buttons, forms, or other interactive components, they must work smoothly to avoid frustrating users.
Shop functionality: If the experiment involves an online shop, this step ensures that critical functionalities like product options, add-to-cart, cart, and checkout are functioning properly. Any issues in this area could lead to lost sales and dissatisfied customers.
Tracking: This point validates whether all relevant tracking events are firing correctly. Accurate tracking is essential for gathering reliable data to assess the experiment's performance.
Devices tested: This indicates the devices (mobile, tablet, desktop) on which the experiment was tested. Testing on various devices is crucial to ensure a seamless experience for all users.
Browsers tested: This enumerates the browsers (Chrome, Firefox, Safari, and Edge) used during testing. Cross-browser compatibility is vital to reach a broader audience. Keep in mind that the different browsers might also behave differently on different devices like Android and iOS.
Notes: This section allows the QA team to describe any errors or issues encountered during the review process. Detailed notes aid in understanding and resolving potential problems efficiently.
Screenshots: Helpful screenshots are attached to highlight any visual issues encountered during the QA process. Visual cues make it easier for the development team to identify and rectify issues promptly.
