Browse Skills

Monitor data pipeline health with anomaly detection, freshness SLAs, and volume tracking dashboards

Track column-level data lineage across pipelines with OpenLineage integration and impact analysis

Implement thorough dbt test coverage with generic tests, singular tests, and freshness checks

Build comprehensive data validation suites with Great Expectations including custom expectations and docs

Plan and execute data warehouse migrations between Redshift, Snowflake, and BigQuery with validation

Tune Amazon Redshift clusters with distribution keys, sort keys, compression, and workload management

Reduce BigQuery costs with slot reservations, partition pruning, materialized views, and BI Engine

Optimize Snowflake virtual warehouse sizing, auto-scaling policies, and resource monitor configuration

Design and deploy Prefect flows with task concurrency, caching, retries, and deployment patterns

Build software-defined asset pipelines in Dagster with materialization policies and IO managers

Configure Airflow with KubernetesExecutor for dynamic task scaling and resource-isolated execution

Generate production-ready Airflow DAGs with proper dependency management, retries, and SLA alerting