Parallel Automation for Cross-Browser and Cross-Device Validation in OTT Systems
Main Article Content
Abstract
The over-the-top solutions need a smooth distribution of high-quality content on the wide variety of devices and
browsers. As devices are becoming more and more diverse, it has become an urgent problem to guarantee affective and
performance continuity. The paper gives an account of a parallel automation framework capable of extensive scalability and
robustness through the combination of Selenium Grid, Appium, and cloud-based device farms that can be effectively used to
perform cross-browser and cross-device validation. Our system has the potential to save a lot of execution time through
dynamic test orchestration and parallel execution of tests, retaining preservation of accuracy and play back integrity of the
visual elements. Experimental results of more than 300 test cases in multiple platforms, including Android and iOS, Smart
TVs, and the latest versions of various web browsers, show improvement in the average time of feedback by more than 70
percent, 90 percent improvement in throughput, and an improvement in defect coverage detection. Other measurable key
performance indicators include, pixel drift and adaptive bitrate (ABR) switching delays. We designed our framework to
facilitate continuous integration processes, and it has been useful especially with regards to testing of the consistency of user
interface and video streaming quality. The results present parallel automation as a cost efficient and scalable option of
validating OTT platforms that will support quicker releases at the same time as maintaining a high level of ensured quality.
The provided architecture is modular and extendable, so it can be flexibly applied to OTT-ecosystems and test technology
development in the future.
Article Details
Section
How to Cite
References
Xie, M., Ye, J., Xing, Z., & Ma, L. (2023).
NICRO: Purely vision-based, non-intrusive
Cross-Device
and
testing. arXiv
Cross-Platform
GUI
(Cornell
University). https://doi.org/10.48550/arxiv.2305.1
4611
[2] Mariani, L., Pezzè, M., Terragni, V., & Zuddas,
D. (2021). An evolutionary approach to adapt
tests
across mobile apps. arXiv (Cornell
University). https://doi.org/10.48550/arxiv.2104.0
5233
[3] Menegassi, A. A., & Endo, A. T. (2019).
Automated tests for cross‐platform mobile apps in
multiple configurations. IET Software, 14(1), 27–
38. https://doi.org/10.1049/iet-sen.2018.5445
[4] Vasquez, M. L., Moran, K., & Poshyvanyk, D.
(2018). Continuous, Evolutionary and Large-
Scale: A new perspective for Automated mobile
app
testing. arXiv
(Cornell
University). https://doi.org/10.48550/arxiv.1801.0
6267
[5] Fallahzadeh, E., Bavand, A. H., & Rigby, P. C.
(2023). Accelerating Continuous Integration with
Parallel Batch Testing. Accelerating Continuous Integration With Parallel Batch Testing, 55–
67. https://doi.org/10.1145/3611643.3616255
[6] Mathew, S. (2024). An Overview on Testing
using Selanium. An Overview on Testing Using
Selanium. https://doi.org/10.20944/preprints2024
04.0911.v1
[7] Yu, S., Fang, C., Du, M., Ling, Y., Chen, Z., &
Su, Z. (2023). Practical Non-Intrusive GUI
Exploration Testing with Visual-based Robotic
Arms. arXiv
(Cornell
University). https://doi.org/10.48550/arxiv.2312.1
0655
[8] García, B., Kloos, C. D., Alario-Hoyos, C., &
Munoz-Organero, M. (2022). Selenium-Jupiter: A
JUnit
5
extension
WebDriver. Journal
of
for
Selenium
Systems
and
Software, 189,
111298. https://doi.org/10.1016/j.jss.2022.111298
[9] García, B., Gallego, M., Gortázar, F., & Munoz-
Organero, M. (2020). A survey of the Selenium
ecosystem. Electronics, 9(7),
1067. https://doi.org/10.3390/electronics9071067
[10] Kuutila, M., Mäntylä, M., & Raulamo-Jurvanen,
P. (2016). Benchmarking Web-testing - Selenium
versus Watir and the Choice of Programming
Language
and Browser. arXiv (Cornell
University). https://doi.org/10.48550/arxiv.1611.00578