Product Updates

📋Changelog

Improvements

• Workflow Automation: Enabled "Updated By," "Synonyms," "Related Terms," and "Status" fields in workflow check conditions.
• Ingestion UI: Added search functionality in the ingestion runner dropdown and added fallback logic to select Collate SaaS Runner by default during service configuration.
• Unity Catalog: Optimized lineage retrieval by using system tables instead of the API.
• Pipeline API: Added bulk APIs for checking pipeline status.
• Import/Export: General improvements to import/export functionality.

Fixes

• Databricks:
  • Fixed view definition extraction.
  • Resolved circular lineage issues and extra lineage generation for self-referencing table columns.
• Ingestion & Connectors:
  • BigQuery: Fixed project ID input handling in the ingestion class.
  • Trino: Fixed shadowing of the http_scheme argument.
  • Airflow: Added DriveService to the entity class map.
  • Stability: Fixed source hash instability during ingestion runs to prevent unnecessary updates.
• CSV & Import:
  • Fixed CSV parsing logic for escape characters (handling /" -> ").
  • Resolved timeout issues during CSV imports.
  • Fixed column tag insertion and removal during Database Service imports.
• UI & User Experience:
  • Fixed issue where nested columns were not updating in real-time.
  • Added auto-scroll to form errors when they occur.
  • Fixed translation for "most-viewed-data-assets."
  • Fixed filters for Impact Analysis.
• Notifications: Fixed issue where sourceHash-only changes were generating unwanted notification emails.
• Search & Indexing: Fixed aggregation incident re-indexing.
• SDK: Added missing Data Quality parameters.