Dataset Cleanup Manager Job Failure
Affected Versions: 2.6
Fix Version: 2.6.1
Root cause(s)
As part of the code refactoring, we replaced all instances of utcnow() with now(). In the Dataset Cleanup Manager Lambda, we were using datetime.now(timezone.utc), which returns an offset-aware datetime, but the code was expecting an offset-naive datetime.
Impact
After upgrading to 2.6, Dataset Cleanup Manager Job will fail with error - can't subtract offset-naive and offset-aware datetimes if there are datasets with 'Dataset Cleanup Enabled'(IsDataCleanupEnabled) and the dataset contains temporarily deleted files.
Mitigation
Fix available
Fix is available in Amorphic version 2.6.1. Please upgrade to the latest version to resolve this issue.
Timeline
- 2024-07-25: Bug reported/identified (CLOUD-5030)
- 2024-07-25: Bug triaged
- 2024-07-25: Bug fixed
- 2024-07-25: Testing of fix is completed
- 2024-08-01: Amorphic version 2.6.1 released with the bugfix