#key-value storage

HierarchicalKV, an integral component of NVIDIA Merlin, provides a hierarchical key-value storage system designed for recommender system applications. It optimizes the management of feature embeddings on GPU and host memory, addressing issues such as single GPU memory limitations and complex inter-CPU communication. By avoiding CPU use and employing advanced eviction strategies, HierarchicalKV improves the performance of substantial recommendation models, offering high load efficiency and customizable management strategies for constructing, evaluating, and deploying recommendation models.