Historically, analytics engineers have managed and orchestrated dozens of separate individual SQL scripts, which are often difficult to point to different schemas and run in different environments. Development is done against production data, resulting in errors and delayed deliverables to stakeholders. Without a standard way to write data tests, errors can go unnoticed.
dbt solves these problems for analytics engineers, by consolidating these functions into a single data build tool pipeline. dbt is an open-source, SQL-based transformation tool, which allows for collaborative development and deployment of analytics code. It follows top software engineering practices like modular design, portability, consistent testing, and robust documentation. Its use has become industry standard for data teams, including many Civis customers and our own in-house data engineers.
Our new dbt capability continues to expand Civis Analytics as the all-in-one enterprise data warehousing solution. By bringing the power of dbt into Platform, our users can now seamlessly orchestrate all stages of ELT pipelines, combining imports, dbt pipelines, and enhancement scripts, all in a single platform.
dbt is run securely in the user’s own Civis environment, without requiring additional subscription services. Users can implement trusted industry standards on how to build and manage their data by using dbt pipelines all through the Civis Analytics Platform.
The dbt job type provides the following benefits:
xxx
Indented note