{"id":44900,"date":"2021-08-04T09:00:06","date_gmt":"2021-08-04T13:00:06","guid":{"rendered":"https:\/\/sdtimes.com\/?p=44900"},"modified":"2021-07-30T15:00:53","modified_gmt":"2021-07-30T19:00:53","slug":"mobile-testing-so-many-devices-so-many-variables","status":"publish","type":"post","link":"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/","title":{"rendered":"Mobile testing: So many devices, so many variables"},"content":{"rendered":"<p><span style=\"font-weight: 400;\">As organizations have shifted to a mobile-first approach, they&#8217;ve found that the main challenge is <a href=\"https:\/\/sdtimes.com\/tag\/test\/\">testing<\/a> for the sheer variety of devices out there. Also, tests need to be run on various telecom providers in different parts of the world. This infinite web of possible combinations has prompted a need for automation and framework consolidation in mobile testing.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Testing for Android devices is more challenging than iOS, according to Shawn Wallace, principal architect at Centric Consulting, a business consulting and technology solutions firm providing full-service management consulting services.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Android sits at the top at 73% market share, and iOS is second at 26%, <\/span><a href=\"https:\/\/gs.statcounter.com\/os-market-share\/mobile\/worldwide\"><span style=\"font-weight: 400;\">a report by statcounter.com<\/span><\/a><span style=\"font-weight: 400;\"> showed. But, what makes testing for Android complex is that there are just so many more types of active devices that use it with various sizes and form factors &#8212; not to mention the many different versions of the Android operating system still in use.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Because of this sheer number of devices, buying out all of the devices to manually test them by rote is no longer a feasible option for most organizations, explained Joachim Herschmann, a senior director analyst at Gartner.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Buying everything is no longer the option for testing mobile web applications that run on a browser, or natively on the phone. &#8220;Organizations no longer can afford to even, let&#8217;s say, buy the top 10 most relevant mobile devices. In the old days, if it&#8217;s an internal application for employees, they could then say, well, there are only two or three mobile devices that are admitted in our organization,&#8221; Herschmann said. &#8220;This will definitely not work if we&#8217;re talking about an application that&#8217;s rolled out to the public because you just don&#8217;t know what people are using.&#8221;<\/span><\/p>\n<p><span style=\"font-weight: 400;\">According to Centric&#8217;s Wallace, the drastic form factor changes are not the most difficult to test for; they can be the subtle changes between devices, such as a bezel taking up a little more space on one device than another.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Sometimes, these subtle changes are the ones that can have a drastic effect on the crucial functionalities of the app.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">&#8220;The classic example is that some elements are partly off-screen like a button or something you could potentially still hit it, or maybe not. But the point is that that is not a good user experience, and in an extreme case, it could prevent you from actually interacting with it. I actually had this yesterday with an app I installed where one of their buttons would settle low at the bottom. But every time I tried to hit it with my finger, I basically hit the return on an Android device,&#8221; Herschmann said.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">One way around this is to develop flexible layouts in apps, and cross-browser testing on laptops and computers can help avoid compatibility and sizing issues during the testing process, according to Artem Minaev, the co-founder of the digital startup platform FirstSiteGuide, a service that provides t<\/span><span style=\"font-weight: 400;\">ools and tutorials for bloggers, webmasters, online entrepreneurs, and more.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Adding to the already crowded device market, IoT devices also factor into conversations around mobile testing. &#8220;There&#8217;s a reason why we see so much news about not only security issues, but simply just bugs, because there is very little thought given about what&#8217;s happening on that device,&#8221; Gartner&#8217;s Herschmann said.<\/span><\/p>\n<h5><strong>Smart devices expanding<\/strong><\/h5>\n<p><span style=\"font-weight: 400;\">With the expansion of smart devices, mobile testing even encompasses testing your car as a mobile device.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">&#8220;You could even consider the Tesla car itself as a mobile device because, at the end of the day, it&#8217;s at the end of this connectivity because it&#8217;s connected to the internet. You can set updates to your Tesla, so if you think about it that way, it becomes clear to ask yourself how are we testing the software on the Tesla,&#8221; Herschmann said.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Another major challenge with mobile app testing is how a mobile app renders while using specific telecom providers and whether that&#8217;s through 5G, 4G or 3G.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">&#8220;I mean &#8230;\u00a0 if you have an iOS phone, how many times do you use Safari and it stops responding per week? It probably does it three or four times a week. Well, let&#8217;s do this at scale. Let&#8217;s run 10,000 tests or 5,000 tests. How many times is our app going to fail? Not because the app is broken too, because Safari just fails for whatever random reason,&#8221; Wallace said.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The sizable mobile app testing providers offer the ability to, for example, access a device in the U.K. through 4G, or access it through an Indian operator with 3G, or to access the same device in the United States through AT&amp;T using 5G, Herschmann explained.\u00a0\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u00a0&#8220;So technically, three times I&#8217;m accessing exactly the same phone, but the difference is how I access it. And I bet you will see differences in the test results because latency is different; the apps may react differently to the kind of network connectivity with latency, jitter and that kind of stuff,&#8221; Herschmann said.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Another tricky aspect of testing is how an application behaves when switching between different providers, a situation prevalent in Europe due to its numerous providers in various countries.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Other things to consider are when signal strength goes down or if the user goes into a room with thick walls.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">These scenarios are where crowdsourcing providers, in which people run software on their mobile phones to inspect for failures, come into play. Their input is then vital for regression testing, feature testing, usability testing, user story testing, cross-browser testing, accessibility testing, performance testing, routine sanity testing and more.\u00a0<\/span><\/p>\n<h5><strong>Solutions to device sprawl<\/strong><\/h5>\n<p><span style=\"font-weight: 400;\">While manual testing is necessary for certain aspects, the difficulty with testing manually is that the number of tests needed to test the codebases increases exponentially whenever a feature is added. &#8220;If you&#8217;re adding a new feature, you need to test all of the old parts as well, which can slow you down,&#8221; Centric&#8217;s Wallace explained.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">&#8220;Two years ago, we were talking about ruthless automation, just automating everything. Now, it&#8217;s about let&#8217;s just automate what we need to automate,&#8221; said Diego Lo Giudice, vice president and principal analyst at Forrester. &#8220;You don&#8217;t want to automate something that just needs to run once. You want to automate things that are repetitive, but if you&#8217;re building Agile and DevOps, anything you build in sprint one becomes kind of a regression test in sprint two. And so if you don&#8217;t want to manually rerun those tests, you&#8217;re better off automating them.&#8221;<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The goal is to minimize the number of tests that have to be run on the user interface on the mobile application and isolate some of the business logic into the APIs or server-side code where there are great patterns for testing at scale and testing in a continuous integration environment, according to Centric\u2019s Wallace.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Giudice said that automation tooling for mobile has reached the same level of maturity as it has for browsers.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For browsers, the standard has been Selenium. Now, the standards that have grown around mobile testing include Appium, Cypress, and the ones maintained by Google and Apple for their applications on Android or iOS.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Still, highly skilled test automation engineers are required to &#8220;write code&#8221; for automation test scripts, which has opened the need for low-code tooling for testing and new advancements in AI.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The future of AI in mobile testing can help teams know which tests to run in a complex environment and do it for them; however, this technology is still in its early stages, according to Herschmann.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">&#8220;The message I always give clients today is look, this AI stuff is not fully worked out, it&#8217;s the early days, but start looking at it today because you will take some time to understand and really comprehend it. And so you can&#8217;t just sit back for another year or two and wait until someone else has figured that out; by that time you&#8217;re lagging.&#8221; Herschmann said.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">While organizations should try to automate as much testing as possible, there is still no way to get away from manual testing completely.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">&#8220;I know of cases where literally, they have manual users that are in a car and they drive from Germany to the Netherlands, and they have to switch from their German network to their Dutch network as they&#8217;re driving and testing, how does my application react to this? So as you can imagine, that&#8217;s not something a developer could test locally on their machine. You would actually have to do something like this,&#8221; Herschmann said.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Another major trend around simplifying mobile testing is consolidating around a framework so that tests don&#8217;t need to be completely rewritten when dealing with new operating systems or devices.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">It can get quite expensive when an organization has to make the decision between native development or using a platform such as React Native. Testing can be much more simplified when using one of the major frameworks by doing a lot of the testing before getting to the device because testing on the device is what&#8217;s painful, Centric&#8217;s Wallace explained.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Another way to do manual testing is by buying virtual machines, putting the emulator on them, and letting testers use a VM rather than using a device. This is effective for testing offshore with people in other countries in instances where they&#8217;re not allowed to install the app on their device or can&#8217;t have the data in their network. Still, they can connect to a VM because there&#8217;s no data transfer, Wallace explained.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">&#8220;The paradigms of how I build an application have changed. There&#8217;s still native-app development, native in the sense that I write specifically with the widgets or elements that exist on iOS and those that exist on Android, but this becomes less frequent,&#8221; Gartner&#8217;s Herschmann said. &#8220;The more frequent approach is now to use one of the common frameworks that would take what you write in one abstract framework layer that gets sort of translated and compiled into the core platform that it&#8217;s actually rendered on.&#8221;<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Also, the shift to using a public device cloud, which contains a couple of thousand devices for anyone to test on, is pervasive now. Whenever the next person wants to run their test, the devices are basically reset so that there&#8217;s no interference with any data.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">To a much lesser extent, some organizations work within a private device cloud. Here the provisioning and administration mechanisms work the same way as in a public cloud, but the devices are still reserved for that organization.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The third and rarest option by far are the cases where there&#8217;s a device rack somewhere in a server room, but the way it&#8217;s accessed is also through the cloud, according to Gartner\u2019s Herschmann.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">&#8220;Over the years, it has shifted to the public cloud because the private option was a lot more popular a couple of years back when people didn&#8217;t trust the cloud so much,&#8221; Herschmann said. &#8220;Let&#8217;s just say if you&#8217;re a consumer application or maybe a retail website. Well, you want to put it out in the open anyhow. So there is no reason why you would want to do it in your closet and not go out.&#8221;<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Cloud device providers often have contracts with various device and telecom providers to have day-one availability or even give developers access to the technology sometime before to run tests before launch day.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Simulators and emulators can also be used for more operating system features, such as Google&#8217;s new API for COVID, which isn&#8217;t very hardware hungry. On the other hand, for non-standard uses of the camera, LiDAR, or other features specific to the hardware, you have to test on the device itself.<\/span><\/p>\n<h5><b>Mobile testing is vital in a mobile-first world<\/b><\/h5>\n<p><span style=\"font-weight: 400;\">Mobile app development has been integrated into mainstream development, which has increased the importance of diligent mobile testing. Now, the same testing scripts can basically be used for desktop or mobile, which has also prompted the need for consolidated testing.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">&#8220;We&#8217;ve gone from a world where people thought we were going to be mobile-first or mobile-only 5 or 6 years ago, but it ended up being mobile-first because mobile-only is not a reality,&#8221; Forrester&#8217;s Lo Giudice said.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">So mobile has to be integrated into a broader omnichannel strategy because these applications that run on mobile also have to run on a desktop or a tablet.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The progress to mobile-only was mostly stifled by the pandemic, since people worked in front of their computers at home. Before, companies tried to push as much as possible onto mobile phones.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">&#8220;I think the assumption that everything would go onto a mobile phone was just wrong,&#8221; Lo Giudice said. &#8220;I mean, the web is still well and healthy, but what changed is that if I have to design an application, I will think that design for the mobile phone, for the smaller screens and then scale it eventually to the bigger ones, rather than five years ago, the apps were thought for a large screen. And then we had to squeeze them onto the mobile phones.&#8221;<\/span><\/p>\n<p><span style=\"font-weight: 400;\">This mobile-first approach has led organizations to hire out specialists that can test for omnichannel applications.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Organizations are no longer just looking to hire specialists that only write tests for the current iOS version, for example, but that write tests against a standard so that new versions don&#8217;t require them to change the test code beyond some compatibility issues, Centric&#8217;s Wallace explained.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">&#8220;I think a lot about what the person that&#8217;s going to maintain this, what their experience is going to be like, and what the shelf life of these tests are going to be because you maintain an app for a much longer time than you spend building it,&#8221; Wallace said.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">&#8220;When we don&#8217;t run tests, it means our clients test our software. Software is always tested. We just like to test it closer to when the code was written,&#8221; Wallace added.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">When establishing a testing strategy, organizations first have to think about the tech stack that they\u2019ll be testing for and who will be doing the testing, whether that\u2019s the developer, the technical side or the business side. There are solutions out there now that can tailor to each type of tester, according to Gartner\u2019s Herschmann.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">&#8220;It&#8217;s no longer that hard to write a mobile app. Anybody can do it basically with no-code tools, but building the right app is all about building an app that is useful for potential consumers,&#8221; said Herschmann. &#8220;So you have to have a very compelling value proposition to even get people interested. And then don&#8217;t screw it by bringing up a choppy version of that app, because that will kill it immediately. I mean, that&#8217;s why I think testing quality is so important because honestly, you&#8217;ve only got one chance today.&#8221;<\/span><\/p>\n<h5><b>Popular open-source testing frameworks for mobile<\/b><\/h5>\n<p><span style=\"font-weight: 400;\">This <\/span><a href=\"https:\/\/bitbar.com\/blog\/mobile-testing-tools-for-test-creation-and-automation\/\"><span style=\"font-weight: 400;\">partial listing<\/span><\/a><span style=\"font-weight: 400;\"> of popular open-source testing frameworks for mobile was taken from a compilation by SmartBear, which also included commercial products. SmartBear is a provider of tools for application performance monitoring (APM), software development, software testing, API testing and API management.<\/span><\/p>\n<ol>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Appium<\/b><span style=\"font-weight: 400;\"> is an open-source test automation framework for use with native, hybrid and mobile web apps. It drives iOS, Android, and Windows apps using the WebDriver protocol. It supports cross-platform testing and code reuse, writing tests with multiple programming languages and offers many integrations.\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Espresso <\/b><span style=\"font-weight: 400;\">is a native open-source testing framework for Android to write UI tests. The tool is a part of the Android SDK and is easy to use for native mobile development. It offers automatic synchronization of UI elements and test actions.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>XCUITest <\/b><span style=\"font-weight: 400;\">is an open-source testing framework for iOS apps that is developed and maintained by Apple and is ideal for iOS-specific U.I. test automation. XCUITest enables developers or QA engineers to test the user interface of native iOS apps using the Swift or Objective C programming languages.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Robot Framework<\/b><span style=\"font-weight: 400;\"> is a generic open-source automation framework that can be used for test automation and robotic process automation (RPA). It has easy syntax, utilizing human-readable keywords. Its capabilities can be extended by libraries implemented with Python or Java. The framework was initially developed at Nokia Networks and open-sourced in 2008.<\/span><\/li>\n<\/ol>\n<h5><b>Real users for real testing results<\/b><\/h5>\n<p><span style=\"font-weight: 400;\">While automation is a vital tool in many aspects of mobile testing, it has to be coupled with manual testing when it comes to applications that rely heavily on location, as in the case of\u00a0<\/span><span style=\"font-weight: 400;\">Bloc,<\/span><span style=\"font-weight: 400;\"> a social events app that rewards people for attending venues.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cWe suggest venues that are local to someone and a lot of the functionality of the app relies on people being in the same area. This makes it extremely difficult to outsource the testing to a third party because their testers will be dotted around the world,\u201d said Josh Wood, the founder and CEO of Bloc.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The company at first set up simulators and faked people\u2019s location but it still wasn\u2019t a comprehensive enough strategy. Then, Bloc had to find and onboard its own testers, which became difficult when trying to scale to thousands of users, according to Wood.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Now, the company relies on internal tests from real users who don\u2019t necessarily know they\u2019re testing the app.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cThe best feedback and log files we&#8217;ve got are from real users using it in real time and that&#8217;s how we&#8217;ve created a pretty decent app today that works well,\u201d Wood added.\u00a0<\/span><\/p>\n<p>&nbsp;<\/p>\n<!-- AddThis Advanced Settings generic via filter on the_content --><!-- AddThis Share Buttons generic via filter on the_content -->","protected":false},"excerpt":{"rendered":"<p>As organizations have shifted to a mobile-first approach, they&#8217;ve found that the main challenge is testing for the sheer variety of devices out there. Also, tests need to be run on various telecom providers in different parts of the world. This infinite web of possible combinations has prompted a need for automation and framework consolidation  &hellip; <a class=\"read-more\" href=\"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/\">continue reading<\/a><!-- AddThis Advanced Settings generic via filter on get_the_excerpt --><!-- AddThis Share Buttons generic via filter on get_the_excerpt --><\/p>\n","protected":false},"author":871,"featured_media":44901,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"om_disable_all_campaigns":false,"cybocfi_hide_featured_image":"","footnotes":"","_links_to":"","_links_to_target":""},"categories":[1],"tags":[51,1058,114,1647],"coauthors":[14818],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.8 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Mobile testing: So many devices, so many variables - SD Times<\/title>\n<meta name=\"description\" content=\"As organizations have shifted to a mobile-first approach, they&#039;ve found that the main challenge is testing for the sheer variety of devices out there.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Mobile testing: So many devices, so many variables - SD Times\" \/>\n<meta property=\"og:description\" content=\"As organizations have shifted to a mobile-first approach, they&#039;ve found that the main challenge is testing for the sheer variety of devices out there.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/\" \/>\n<meta property=\"og:site_name\" content=\"SD Times\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/SDTimesD2\" \/>\n<meta property=\"article:published_time\" content=\"2021-08-04T13:00:06+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-07-30T19:00:53+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/sdtimes.com\/wp-content\/uploads\/2021\/07\/mobile-Testing.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"660\" \/>\n\t<meta property=\"og:image:height\" content=\"371\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Jakub Lewkowicz\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@sdtimes\" \/>\n<meta name=\"twitter:site\" content=\"@sdtimes\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Jakub Lewkowicz\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"14 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/\"},\"author\":{\"name\":\"Jakub Lewkowicz\",\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/person\/0ccf41924f263cbae6638a4df0210f42\"},\"headline\":\"Mobile testing: So many devices, so many variables\",\"datePublished\":\"2021-08-04T13:00:06+00:00\",\"dateModified\":\"2021-07-30T19:00:53+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/\"},\"wordCount\":2901,\"publisher\":{\"@id\":\"https:\/\/sdtimes.com\/#organization\"},\"image\":{\"@id\":\"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2021\/07\/mobile-Testing.jpg\",\"keywords\":[\"Android\",\"automation\",\"iOS\",\"mobile testing\"],\"articleSection\":[\"Latest News\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/\",\"url\":\"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/\",\"name\":\"Mobile testing: So many devices, so many variables - SD Times\",\"isPartOf\":{\"@id\":\"https:\/\/sdtimes.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2021\/07\/mobile-Testing.jpg\",\"datePublished\":\"2021-08-04T13:00:06+00:00\",\"dateModified\":\"2021-07-30T19:00:53+00:00\",\"description\":\"As organizations have shifted to a mobile-first approach, they've found that the main challenge is testing for the sheer variety of devices out there.\",\"breadcrumb\":{\"@id\":\"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/#primaryimage\",\"url\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2021\/07\/mobile-Testing.jpg\",\"contentUrl\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2021\/07\/mobile-Testing.jpg\",\"width\":660,\"height\":371,\"caption\":\"devices top view 3d rendering\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/sdtimes.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Mobile testing: So many devices, so many variables\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/sdtimes.com\/#website\",\"url\":\"https:\/\/sdtimes.com\/\",\"name\":\"SD Times\",\"description\":\"Software Development News\",\"publisher\":{\"@id\":\"https:\/\/sdtimes.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/sdtimes.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/sdtimes.com\/#organization\",\"name\":\"SD Times\",\"url\":\"https:\/\/sdtimes.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2014\/05\/deafaultlogo.png\",\"contentUrl\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2014\/05\/deafaultlogo.png\",\"width\":225,\"height\":90,\"caption\":\"SD Times\"},\"image\":{\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/SDTimesD2\",\"https:\/\/x.com\/sdtimes\",\"https:\/\/www.linkedin.com\/company\/sdtimes\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/person\/0ccf41924f263cbae6638a4df0210f42\",\"name\":\"Jakub Lewkowicz\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/person\/image\/a061823dfc0b893ed859b59dc9554372\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/fec6c7c06cf379ac99029d9c59940dab?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/fec6c7c06cf379ac99029d9c59940dab?s=96&d=mm&r=g\",\"caption\":\"Jakub Lewkowicz\"},\"description\":\"Jakub Lewkowicz is a multimedia journalist who loves all things tech. Polish-born and Long Island-bred, he is an Online and Social Media Editor for SD Times. He is also a Carnegie Hall pianist and music producer.\",\"url\":\"https:\/\/sdtimes.com\/author\/jakub-lewkowicz\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Mobile testing: So many devices, so many variables - SD Times","description":"As organizations have shifted to a mobile-first approach, they've found that the main challenge is testing for the sheer variety of devices out there.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/","og_locale":"en_US","og_type":"article","og_title":"Mobile testing: So many devices, so many variables - SD Times","og_description":"As organizations have shifted to a mobile-first approach, they've found that the main challenge is testing for the sheer variety of devices out there.","og_url":"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/","og_site_name":"SD Times","article_publisher":"https:\/\/www.facebook.com\/SDTimesD2","article_published_time":"2021-08-04T13:00:06+00:00","article_modified_time":"2021-07-30T19:00:53+00:00","og_image":[{"width":660,"height":371,"url":"https:\/\/sdtimes.com\/wp-content\/uploads\/2021\/07\/mobile-Testing.jpg","type":"image\/jpeg"}],"author":"Jakub Lewkowicz","twitter_card":"summary_large_image","twitter_creator":"@sdtimes","twitter_site":"@sdtimes","twitter_misc":{"Written by":"Jakub Lewkowicz","Est. reading time":"14 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/#article","isPartOf":{"@id":"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/"},"author":{"name":"Jakub Lewkowicz","@id":"https:\/\/sdtimes.com\/#\/schema\/person\/0ccf41924f263cbae6638a4df0210f42"},"headline":"Mobile testing: So many devices, so many variables","datePublished":"2021-08-04T13:00:06+00:00","dateModified":"2021-07-30T19:00:53+00:00","mainEntityOfPage":{"@id":"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/"},"wordCount":2901,"publisher":{"@id":"https:\/\/sdtimes.com\/#organization"},"image":{"@id":"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/#primaryimage"},"thumbnailUrl":"https:\/\/sdtimes.com\/wp-content\/uploads\/2021\/07\/mobile-Testing.jpg","keywords":["Android","automation","iOS","mobile testing"],"articleSection":["Latest News"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/","url":"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/","name":"Mobile testing: So many devices, so many variables - SD Times","isPartOf":{"@id":"https:\/\/sdtimes.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/#primaryimage"},"image":{"@id":"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/#primaryimage"},"thumbnailUrl":"https:\/\/sdtimes.com\/wp-content\/uploads\/2021\/07\/mobile-Testing.jpg","datePublished":"2021-08-04T13:00:06+00:00","dateModified":"2021-07-30T19:00:53+00:00","description":"As organizations have shifted to a mobile-first approach, they've found that the main challenge is testing for the sheer variety of devices out there.","breadcrumb":{"@id":"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/#primaryimage","url":"https:\/\/sdtimes.com\/wp-content\/uploads\/2021\/07\/mobile-Testing.jpg","contentUrl":"https:\/\/sdtimes.com\/wp-content\/uploads\/2021\/07\/mobile-Testing.jpg","width":660,"height":371,"caption":"devices top view 3d rendering"},{"@type":"BreadcrumbList","@id":"https:\/\/sdtimes.com\/mobile\/mobile-testing-so-many-devices-so-many-variables\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/sdtimes.com\/"},{"@type":"ListItem","position":2,"name":"Mobile testing: So many devices, so many variables"}]},{"@type":"WebSite","@id":"https:\/\/sdtimes.com\/#website","url":"https:\/\/sdtimes.com\/","name":"SD Times","description":"Software Development News","publisher":{"@id":"https:\/\/sdtimes.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/sdtimes.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/sdtimes.com\/#organization","name":"SD Times","url":"https:\/\/sdtimes.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sdtimes.com\/#\/schema\/logo\/image\/","url":"https:\/\/sdtimes.com\/wp-content\/uploads\/2014\/05\/deafaultlogo.png","contentUrl":"https:\/\/sdtimes.com\/wp-content\/uploads\/2014\/05\/deafaultlogo.png","width":225,"height":90,"caption":"SD Times"},"image":{"@id":"https:\/\/sdtimes.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/SDTimesD2","https:\/\/x.com\/sdtimes","https:\/\/www.linkedin.com\/company\/sdtimes\/"]},{"@type":"Person","@id":"https:\/\/sdtimes.com\/#\/schema\/person\/0ccf41924f263cbae6638a4df0210f42","name":"Jakub Lewkowicz","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sdtimes.com\/#\/schema\/person\/image\/a061823dfc0b893ed859b59dc9554372","url":"https:\/\/secure.gravatar.com\/avatar\/fec6c7c06cf379ac99029d9c59940dab?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/fec6c7c06cf379ac99029d9c59940dab?s=96&d=mm&r=g","caption":"Jakub Lewkowicz"},"description":"Jakub Lewkowicz is a multimedia journalist who loves all things tech. Polish-born and Long Island-bred, he is an Online and Social Media Editor for SD Times. He is also a Carnegie Hall pianist and music producer.","url":"https:\/\/sdtimes.com\/author\/jakub-lewkowicz\/"}]}},"_links":{"self":[{"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/posts\/44900"}],"collection":[{"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/users\/871"}],"replies":[{"embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/comments?post=44900"}],"version-history":[{"count":1,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/posts\/44900\/revisions"}],"predecessor-version":[{"id":44902,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/posts\/44900\/revisions\/44902"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/media\/44901"}],"wp:attachment":[{"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/media?parent=44900"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/categories?post=44900"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/tags?post=44900"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/coauthors?post=44900"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}