What is Looker CI?

Key Concepts:

• Continuous Integration (CI)
• Content Validator
• SQL Validation
• Assert Validator
• Data Accuracy
• Dashboard Integrity
• Database Schema Changes

Dashboard Integrity and Continuous Integration

The primary concern raised is the potential for code changes to inadvertently break existing dashboards, a problem experienced previously. The solution introduced is "Looker CI," a continuous integration tool designed to prevent such issues.

Content Validation

Looker CI's first function is content validation. This process automatically checks if newly committed code changes will cause any existing dashboards to break. The specific mechanism of this validation isn't detailed, but the implication is that it analyzes the code for potential conflicts or errors that would affect dashboard functionality.

SQL Validation

A key challenge identified is that dashboard breakage can occur due to changes outside the code itself, specifically modifications to the database schema (e.g., a column name change). Looker CI addresses this with SQL validation. This feature checks the SQL code within all dimensions to ensure it still aligns with the current database structure. This proactive check helps prevent errors arising from external database alterations.

Data Accuracy with Assert Validation

The tool's capabilities extend beyond structural integrity to data accuracy. Looker CI includes an assert validator. This validator allows users to write "assert tests" that define expected values for data. The system then checks the actual data against these assertions, ensuring the accuracy of the data flowing through the system. This is particularly useful for verifying historical data or critical metrics.

Example Scenario

The example given is checking if "last year's data is correct." This illustrates how assert validation can be used to maintain data integrity over time, even as the underlying data or calculations evolve.

Conclusion

Looker CI provides a comprehensive solution for maintaining the integrity and accuracy of dashboards and data. By combining content validation, SQL validation, and assert validation, it addresses both code-related and external factors that can lead to errors. The tool empowers users to confidently commit changes, knowing that potential issues will be automatically detected and prevented.