Publication Type : Journal Article
Publisher : Journal of Systems and Software
Source : Journal of Systems and Software, Volume 156, p.232 - 245 (2019)
Url : https://www.sciencedirect.com/science/article/abs/pii/S016412121930144X
Keywords : Benchmark, Cross-platform, Modeling, Multi-tier, performance, prediction
Campus : Amritapuri
School : Department of Computer Science and Engineering, School of Computing
Center : AI (Artificial Intelligence) and Distributed Systems
Department : Computer Science
Year : 2019
Abstract : Predicting performance of CPU intensive applications for a target platform is of significant importance to IT industries. However, the target hardware platform for which we want to predict the performance is often different from the testbed on which the application performance measurements are done, and may not be unavailable for deployment for various practical reasons. This paper presents M3, a Measure-Measure-Model method, which uses a pipeline of three steps to address this problem. The methodology starts with measuring CPU service demands of the application on the testbed. Then, it builds clones that mimic the application code in terms of the type of operations, the number and size of network calls with external servers and API calls made at different layers of the technology stack. The clones are simple and easy to deploy, yet demonstrate the same speedup factor between the source and the target as the original application. The clones are then deployed on the testbed and on the target to estimate the application CPU service demand under light load generation. In the final step, this estimated CPU service demand is fed into specific performance modeling tools that are capable of predicting application performance on the target under arbitrary higher workload. Predictions made using this approach are validated against direct measurements made on five applications in Java and PHP, and on a number of combinations of testbed and target platforms (Intel and AMD servers) and the prediction error is always less than 20%.
Cite this Research Publication : Subhasri Duttagupta, Apte, V., and Gawali, D., “M3 - A hybrid measurement-modeling approach for CPU-bound applications on cross-platform architectures”, Journal of Systems and Software, vol. 156, pp. 232 - 245, 2019.