Skip to main content
print this page

Data metric collector job is failing for custom proxy customers.

· 2 min read
Fix Available

Scheduled backend job data metric collection is failing with error 'some pip modules could not be installed'.

Affected Versions: 2.6, 2.6.1

Fix Version: 2.7

Root cause(s)​

Sqlpares module import is failed in the data resource metric job for the customers using a custom proxy. Enhancement of adding SQL query based data ingestion in version 2.6 resulted in this error. Sqlparse package is added as --additional-python-modules in glue job arguments. Glue job will try to download the package from internet(pypi domain) and customers with custom proxy may not whitelist this domain. Since the custom proxy is blocking this domain, the data metric collector job will fail while running the glue script.

Impact​

The data metric collector job will fail for customers with custom proxy enabled who doesn't whitelisted the domain https://pypi.org/

Mitigation​

Fix available

Fix will be available in Amorphic version 2.7.

Timeline​

  • 2024-08-21: Bug reported/identified (CLOUD-4903)
  • 2024-08-22: Bug triaged
  • 2024-08-23: Bug fixed
  • 2024-09-27: Testing of fix is completed
  • 2024-10-14: Amorphic version 2.7 released with the bugfix