Ascend.io, the leader in data pipeline automation, announced that it has deepened the integration of its Data Pipeline Automation platform with Databricks, the data and AI company, to further enable transparency, collaboration, and productivity.
With this integration, joint customers can now take full advantage of Databricks as a cloud data compute platform in Ascend’s new second-generation remote data plane architecture, which allows users to leverage Ascend’s DataAware control plane within their Databricks lakehouse. In addition, Ascend has released a new free, full-featured developer tier for Databricks so that Ascend customers can take advantage of the latest Databricks capabilities.
Ascend’s Data Pipeline Automation Platform is a single platform with intelligence to detect and propagate change across a company’s ecosystem—ensuring data accuracy and eliminating wasteful spend on data reprocessing. Pipelines powered by Ascend seamlessly ingest, transform, orchestrate, and share data for the business, across the entire end-to-end journey.
Also Read: B2B Digital Marketing Agency Minds On Adopts Intero Digital Brand
Key enhancements powered by the Databricks partnership include:
- Full push-down support for the Databricks SQL compute platform—developers can more easily leverage the powerful compute available in their lakehouse and benefit from an automatic catalog of all the data assets they create. Now available to Ascend customers.
- High-performance data ingestion, and automatic cataloging of all datasets created in Ascend to the Databricks Unity Catalog—data consumers can now search the entire list of all silver and gold datasets in their lakehouse on the unity catalog to significantly improve the amount of data available to their projects. Best of all, this happens automatically without the developer needing to do additional documentation. Now available to Ascend customers.
- The ability to use powerful Databricks transformation capabilities like merge and job batching—giving developers access to the full power of Databricks within the Ascend pipeline builder experience. Now available to Ascend customers.
The integration of Databricks’ powerful data and analytics capabilities with Ascend’s platform increases accessibility, ease of use, and transparency while making it easier to scale support and collaboration across more data teams and business units.
“We’re already seeing many customers that are dramatically accelerating their time to value with Databricks by leveraging Ascend’s data pipeline automation,” said Sean Knapp, Founder and CEO of Ascend.io. “We’re excited to bring these advanced Databricks capabilities to more of our customers to increase engineering velocity, deliver quality data, guarantee data lineage, and troubleshoot faster.”
Through Ascend’s existing partnership with Databricks, developers are able to build intelligent data pipelines within minutes on their data lakehouse architecture, harnessing the most recent Databricks services and endpoints.
“Data-driven organizations are looking for ways to scale their data pipelines as they make a data lakehouse available across their organization,” said Roger Muff, VP ISV Partnerships at Databricks. “With Ascend monitoring changes and propagating them across the system, we see faster and more reliable updates. With the use of the Databricks platform for the underlying compute, it centralizes the management and makes it even more scalable.”
SOURCE: PRNewswire