2nd Generation Intel® Xeon® Scalable Processors, formerly Cascade Lake, with Intel® C620 Series Chipsets (Purley refresh), features built-in Intel® Deep Learning Boost and delivers high-performance inference and vision for AI workloads. It consolidates diverse IoT workloads, handles massive datasets and enables near-real-time transactions. Now you can get even better built-in deep learning capabilities, speed deployment, and lower total cost of ownership (TCO) with CPU-optimized software toolkits and frameworks such as Intel® Distribution of OpenVINO™ Toolkit.
Intel® Resource Director Technology (Intel® RDT) brings new levels of visibility and control over how shared resources such as last-level cache (LLC) and memory bandwidth are used by applications, virtual machines (VMs), and containers. It’s the next evolutionary leap in workload consolidation density, performance consistency, and dynamic service delivery, helping to drive efficiency and flexibility across the data center while reducing overall total cost of ownership (TCO). As software-defined infrastructure and advanced resource-aware orchestration technologies increasingly transform the industry, Intel® RDT is a key feature set to optimize application performance and enhance the capabilities of orchestration and virtualization management server systems using Intel® Xeon® processors.
Intel® Resource Director Technology (Intel® RDT) Framework
Intel® RDT provides a framework with several component features for cache and memory monitoring and allocation capabilities, including CMT, CAT, CDP, MBM, and MBA. These technologies enable tracking and control of shared resources, such as the Last Level Cache (LLC) and main memory (DRAM) bandwidth, in use by many applications, containers or VMs running on the platform concurrently. RDT may aid “noisy neighbor” detection and help to reduce performance interference, ensuring the performance of key workloads in complex environments.
Cache Monitoring Technology (CMT)
Providing new insight by monitoring the last-level cache (LLC) utilization by individual threads, applications, or VMs, CMT improves workload characterization, enables advanced resource-aware scheduling decisions, aids “noisy neighbor“ detection and improves performance debugging.
Cache Allocation Technology (CAT)
Software-guided redistribution of cache capacity is enabled by CAT, enabling important data center VMs, containers or applications to benefit from improved cache capacity and reduced cache contention. CAT may be used to enhance runtime determinism and prioritize important applications such as virtual switches or Data Plane Development Kit (DPDK) packet processing apps from resource contention across various priority classes of workloads.
Code and Data Prioritization (CDP)
As a specialized extension of CAT, Code and Data Prioritization (CDP) enables separate control over code and data placement in the last-level (L3) cache. Certain specialized types of workloads may benefit with increased runtime determinism, enabling greater predictability in application performance.