Abstract
Many applications running on high-performance computing systems share limited resources such as the last-level cache, often resulting in lower performance. Intel recently introduced a new control mechanism, called cache allocation technology (CAT), which controls the cache size used by each application. To intelligently utilize this technology for automated management, it is essential to accurately identify application performance behavior for different cache allocation scenarios. In this work, we show a novel approach which automatically builds a prediction model for application performance changes with CAT. We profile the workload characteristics based on Intel Top-down Microarchitecture Analysis Method (TMAM), and train the model using machine learning. The model predicts instructions per cycle (IPC) across available cache sizes allocated for the applications. We also design a dynamic cache management technique which utilizes the prediction model and intelligently partitions the cache resource to improve application throughput. We implemented and evaluated the proposed framework in Intel PMU profiling tool running on Xeon Platinum 8186 Skylake processor. In our evaluation, we show that the proposed model accurately predicts the IPC changes of applications with 4.7% error on average for different cache allocation scenarios. Our predictive online cache managements achieves improvements on application performance of up to 25% as compared to a prediction-agnostic policy.
Original language | English |
---|---|
Title of host publication | Proceedings of the 2019 Design, Automation and Test in Europe Conference and Exhibition, DATE 2019 |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 1285-1288 |
Number of pages | 4 |
ISBN (Electronic) | 9783981926323 |
DOIs | |
State | Published - 14 May 2019 |
Event | 22nd Design, Automation and Test in Europe Conference and Exhibition, DATE 2019 - Florence, Italy Duration: 25 Mar 2019 → 29 Mar 2019 |
Publication series
Name | Proceedings of the 2019 Design, Automation and Test in Europe Conference and Exhibition, DATE 2019 |
---|
Conference
Conference | 22nd Design, Automation and Test in Europe Conference and Exhibition, DATE 2019 |
---|---|
Country/Territory | Italy |
City | Florence |
Period | 25/03/19 → 29/03/19 |
Bibliographical note
Publisher Copyright:© 2019 EDAA.
Keywords
- Performance prediction
- cache allocation technology
- top-down analysis methodology