Datasources

The datasource serves as the central collection point for catalog asset data. It acts as a logical entity that connects to the metadata source, ensuring seamless integration and comprehensive data management. Currently, the supported source is the default Amorphic, which includes 'Datasets' and 'Views'. Users can search for this data using Discover and all users have access to this default datasource.

Datasources are available under the catalog section.

Sync Jobs

Datasource sync jobs are used to extract data from the datasource and populate the assets data. To get results when searching in the catalog for that datasource, the datasource sync job needs to be triggered. Users can obtain details of the sync, such as JobStatus, total size of data indexed, number of items indexed, execution time, and more.

Note

For the default Amorphic, new datasets and views, as well as updates to existing datasets and views, are automatically captured and made available for search.

Following GIF shows how to run sync jobs and see the results of the job.

Additionally, users can download the job logs for further debugging if necessary.

Activity logs

Users can view activity logs for each datasource, which include details such as who triggered the sync job.