# How to handle the cache system properly?

**URL:** <https://discuss.huggingface.co/t/how-to-handle-the-cache-system-properly/165186>\
**Category:** 🤗Datasets\
**Created:** [July 31, 2025, 2:20pm UTC](https://discuss.huggingface.co/t/how-to-handle-the-cache-system-properly/165186 "2025-07-31T14:20:56Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [July 31, 2025, 3:29pm UTC](https://discuss.huggingface.co/t/how-to-handle-the-cache-system-properly/165186/2 "2025-07-31T15:29:46Z")

</div>

Some resources for now:

> **[Cache management](https://huggingface.co/docs/datasets/en/cache)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

> [@Best way to access the cached transformation arrow file](https://discuss.huggingface.co/t/best-way-to-access-the-cached-transformation-arrow-file/29422):
>
> I was experimenting with the cached arrow dataset but ran into an error The steps followed Loaded the dataset from HF using load\_dataset() I created a simple transformation by shuffling the data dataset = dataset["test"].shuffle(seed=42) This step produced a new cache file in the hugging face cache directory - ~/.cache/huggingface/datasets/bt-tech\_\_\_ofac/dataset/1.0.0/aa542ed919df55cc5d3347f42dd4521d05ca68751f50dbc32bae2a7f1e167559/cache-c7f4daa392c5ed6a.arrow After I restart the sessio…

> [@Load dataset from a specific cache file](https://discuss.huggingface.co/t/load-dataset-from-a-specific-cache-file/24994):
>
> Dear community, Does anyone know if there is a way to load dataset from a specific cached file? I applied very costly transformations using a map function to do some data augmentation and finally, I had my dataset. However, now in my main script, I would like to use the cached file built from another script. Is there any way to call a specific cache file from ~/.cache/huggingface/datasets/ ?

---

_[View the full topic](https://discuss.huggingface.co/t/how-to-handle-the-cache-system-properly/165186)._