How to load large dataset from s3 using load_from_disk?

[zotroneneis]

Hi there,

I have trouble loading a large dataset from s3. The dataset was saved there using save_from_disk but when I run the load_from_disk function I get an error (botocore.exceptions.ClientError: An error occurred (RequestTimeTooSkewed) when calling the GetObject operation: The difference between the request time and the current time is too large.). The usual problem for this error is that the time on my local machine is out of sync with the current time. However, this is not the case here. I checked the time and even reset it with no success

I already created an issue for this last week (#6611) but didn't get any response yet.

Maybe someone has experienced the same error?

Thanks in advance!