{"id":1286,"date":"2017-06-12T18:48:52","date_gmt":"2017-06-12T18:48:52","guid":{"rendered":"https:\/\/ona17.journalists.org\/sessions\/abtests\/"},"modified":"2018-09-11T05:47:25","modified_gmt":"2018-09-11T05:47:25","slug":"abtests","status":"publish","type":"ona_session","link":"https:\/\/ona17.journalists.org\/sessions\/abtests\/","title":{"rendered":"Thoughtful Testing: How to Ask the Right Questions in A\/B Tests"},"content":{"rendered":"<p>A\/B tests, surveys and other testing tools are critical for getting user *experience* feedback, but thoughtful product development requires asking the right questions before you get started. In this workshop, we\u2019ll use case studies to walk through the difference between quantitative and qualitative data, when you need one or the other and how to test them (e.g., A\/B testing vs. surveys), and deciding what your real indicators are. We\u2019ll discuss how to carefully design the parameters of your test, as well as how to think ahead and identify what roadblocks may exist, such as how different platforms or device traffic can throw off your test results.<\/p>\n<p><b>This session is designed for:<\/b><br \/>\n<li>Product \/ engineering team members who want to talk best practices for user *experience* feedback testing<\/li><br \/>\n<li>Newsroom leaders \/ executives who may want some new ideas for thinking through what newsroom indicators might be useful in your context<\/li><br \/>\n<li>Anyone with a general interest in how to strategically use indicators from testing, surveys and traffic to inform *user experience* decisions<\/li><\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"start_time":1507298400,"end_time":1507302000,"moderators":[[]],"hashtag":["ONA17tests"],"soundcloud":["345731807"],"scribble":["2674794"],"viafoura":[],"youtube":[],"vimeo":[],"facebook":[],"trint":[],"slideshare":[],"livestream":[],"resources":["<ul>\r\n<li>Check out the <a href=\"https:\/\/docs.google.com\/presentation\/d\/1Z-K8JH7f4RctBUvFwfMrbcxHK3PAZgfluidfSlYDapU\/edit?usp=sharing\"> speakers&#39; slide deck<\/a><\/li>\r\n<\/ul>"],"video_embed":[],"first_name":"","last_name":"","title":"","organization":"","website":"","twitter":"","_sponsor_url":"","_sponsor_tagline":"","_sponsor_level":"","spay_email":""},"tags":[],"event":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v15.2 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Thoughtful Testing: How to Ask the Right Questions in A\/B Tests - ONA17<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/ona17.journalists.org\/sessions\/abtests\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Thoughtful Testing: How to Ask the Right Questions in A\/B Tests - ONA17\" \/>\n<meta property=\"og:description\" content=\"A\/B tests, surveys and other testing tools are critical for getting user *experience* feedback, but thoughtful product development requires asking the right questions before you get started. In this workshop, we\u2019ll use case studies to walk through the difference between quantitative and qualitative data, when you need one or the other and how to test&hellip; &nbsp;Read More\" \/>\n<meta property=\"og:url\" content=\"https:\/\/ona17.journalists.org\/sessions\/abtests\/\" \/>\n<meta property=\"og:site_name\" content=\"ONA17\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/onlinenewsassociation\/\" \/>\n<meta property=\"article:modified_time\" content=\"2018-09-11T05:47:25+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/ona17.journalists.org\/wp-content\/uploads\/sites\/14\/2016\/11\/facebook-logo.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"627\" \/>\n<meta name=\"twitter:card\" content=\"summary\" \/>\n<meta name=\"twitter:creator\" content=\"@nekolaweb\" \/>\n<meta name=\"twitter:site\" content=\"@onaconf\" \/>\n<meta name=\"twitter:label1\" value=\"Written by\">\n\t<meta name=\"twitter:data1\" value=\"Adam Nekola\">\n\t<meta name=\"twitter:label2\" value=\"Est. reading time\">\n\t<meta name=\"twitter:data2\" value=\"1 minute\">\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/ona17.journalists.org\/#website\",\"url\":\"https:\/\/ona17.journalists.org\/\",\"name\":\"ONA17\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/ona17.journalists.org\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/ona17.journalists.org\/sessions\/abtests\/#webpage\",\"url\":\"https:\/\/ona17.journalists.org\/sessions\/abtests\/\",\"name\":\"Thoughtful Testing: How to Ask the Right Questions in A\/B Tests - ONA17\",\"isPartOf\":{\"@id\":\"https:\/\/ona17.journalists.org\/#website\"},\"datePublished\":\"2017-06-12T18:48:52+00:00\",\"dateModified\":\"2018-09-11T05:47:25+00:00\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/ona17.journalists.org\/sessions\/abtests\/\"]}]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/ona17.journalists.org\/wp-json\/wp\/v2\/sessions\/1286"}],"collection":[{"href":"https:\/\/ona17.journalists.org\/wp-json\/wp\/v2\/sessions"}],"about":[{"href":"https:\/\/ona17.journalists.org\/wp-json\/wp\/v2\/types\/ona_session"}],"https:\/\/api.journalists.org\/speaker":[{"href":"https:\/\/ona17.journalists.org\/wp-json\/wp\/v2\/speakers\/1370"},{"href":"https:\/\/ona17.journalists.org\/wp-json\/wp\/v2\/speakers\/1371"}],"wp:attachment":[{"href":"https:\/\/ona17.journalists.org\/wp-json\/wp\/v2\/media?parent=1286"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ona17.journalists.org\/wp-json\/wp\/v2\/tags?post=1286"},{"taxonomy":"event","embeddable":true,"href":"https:\/\/ona17.journalists.org\/wp-json\/wp\/v2\/event?post=1286"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}