Platform Pricing Docs Trust Sign in Get started — $5

See what your agents can do

Browse capabilities by topic. Prompts power your agents automatically.

← All topics/Data Engineering

Metrics Layer Architecture
Architect a centralized metrics layer providing consistent metric definitions, dimensional modeling, and governed self-service access.
Produces a metrics layer architecture with semantic modeling, governance, and consumption patterns.
Data Engineering
by a21e
Experimentation Platform Design
Design an experimentation and A/B testing platform covering assignment, statistical rigor, feature flags integration, and result analysis.
Delivers an experimentation platform design with assignment logic, statistical methods, and analysis workflows.
Data Engineering
by a21e
Analytics Dashboard Architecture
Architect analytics dashboards covering data modeling, visualization design, performance optimization, and self-service access patterns.
Produces a dashboard architecture with data modeling, visualization patterns, performance tuning, and access design.
Data Engineering
by a21e
Analytics Event Tracking Design

Page 1 of 2

Design a structured analytics event tracking plan covering naming conventions, event schemas, instrumentation, and data quality validation.

Delivers a complete event tracking plan with taxonomy, schemas, instrumentation patterns, and validation.

Data Engineering

by a21e

Real-Time Analytics Architecture

Design real-time analytics systems enabling sub-second query responses on streaming data for dashboards and applications.

Produces a real-time analytics architecture with streaming ingestion, OLAP engine selection, and query optimization patterns.

Data Engineering

by a21e

DBT Project Architecture

Design a production dbt project structure with modeling layers, testing strategies, and CI/CD for analytics engineering.

Delivers a dbt project architecture with layer conventions, testing patterns, and deployment pipeline for scalable analytics.

Data Engineering

by a21e

Data Vault Modeling

Design Data Vault 2.0 models with hubs, links, and satellites for enterprise data warehousing with full auditability.

Delivers a Data Vault architecture with hub/link/satellite patterns, hash key strategies, and loading patterns for auditable warehousing.

Data Engineering

by a21e

Dimensional Modeling

Design dimensional models (star and snowflake schemas) for analytics workloads with proper fact and dimension tables.

Produces dimensional model designs with fact table granularity, slowly changing dimension strategies, and query optimization patterns.

Data Engineering

by a21e

Data Governance Framework

Design a data governance framework covering classification, access control, privacy compliance, and stewardship processes.

Delivers a data governance framework with classification taxonomy, policy automation, and compliance monitoring strategies.

Data Engineering

by a21e

Data Catalog & Discovery

Design a data catalog and discovery platform enabling teams to find, understand, and trust organizational data assets.

Produces a data catalog architecture with metadata ingestion, search optimization, and data lineage visualization strategies.

Data Engineering

by a21e

Data Mesh Architecture

Design a data mesh architecture with domain-oriented ownership, self-serve platform, and federated governance for scalable data.

Delivers a data mesh implementation plan with domain boundaries, data product specs, and self-serve platform architecture.

Data Engineering

by a21e

Lakehouse Architecture

Design a lakehouse architecture combining data lake flexibility with warehouse reliability using Delta Lake, Iceberg, or Hudi.

Produces a lakehouse architecture with table format selection, zone design, and query performance optimization strategies.

Data Engineering

by a21e

Data Quality Gate Design

Design automated data quality gates that validate data at pipeline boundaries before it reaches downstream consumers.

Delivers a data quality gate framework with validation rules, threshold tuning, and automated remediation workflows.

Data Engineering

by a21e

Change Data Capture Pipeline

Design CDC pipelines using Debezium, Kafka Connect, or similar tools for real-time database replication and event sourcing.

Produces a CDC pipeline architecture with connector configuration, schema evolution handling, and consistency guarantees.

Data Engineering

by a21e

Data Pipeline Monitoring

Design observability and monitoring systems for data pipelines covering freshness, quality, volume, and lineage tracking.

Delivers a pipeline monitoring architecture with SLA tracking, anomaly detection, and incident response runbooks.

Data Engineering

by a21e

Data Pipeline Testing

Build comprehensive testing strategies for data pipelines covering unit, integration, data quality, and end-to-end validation.

Produces a data pipeline testing framework with fixture generation, contract testing, and regression detection strategies.

Data Engineering

by a21e

Streaming Pipeline Design

Architect real-time streaming pipelines with Kafka, Flink, or Spark Streaming for low-latency data processing at scale.

Delivers a streaming pipeline architecture with exactly-once semantics, backpressure handling, and state management patterns.

Data Engineering

by a21e

Batch Processing Pipeline

Design high-throughput batch processing pipelines with Spark or similar frameworks for large-scale data transformation.

Produces a batch processing architecture with partitioning strategy, resource tuning, and cost optimization for petabyte-scale workloads.

Data Engineering

by a21e

Pipeline Orchestration (Airflow)

Design Airflow-based pipeline orchestration with proper DAG patterns, dependency management, and operational excellence.

Delivers a production Airflow orchestration design with DAG patterns, retry logic, alerting, and scaling strategies.

Data Engineering

by a21e

Data Pipeline Architecture

Design robust, scalable data pipelines with proper error handling, backfill support, and lineage tracking for production workloads.

Produces a complete data pipeline architecture with idempotency guarantees, schema evolution strategy, and failure recovery patterns.

Data Engineering

by a21e

Build Data Quality Framework

Validation rules per dataset, freshness monitoring, anomaly detection, schema tracking, data lineage, quality scorecards, alerting, and quarantine.

Your AI will build data quality: validation rules per dataset, freshness monitoring, anomaly detection, schema evolution tracking, lineage, quality scorecards, alerting, and quarantine workflow.

Data Engineering

by a21e

Design Streaming Data Architecture

Kafka/Kinesis topics, partitioning, consumer groups, exactly-once semantics, stream processing, dead letter queues, schema registry, and backpressure.

Your AI will design streaming architecture: topic design, partitioning strategy, consumer groups, exactly-once semantics, stream processing (window/join), DLQ, schema registry, and backpressure.

Data Engineering

by a21e

Design A/B Testing Framework

Experiment design: hypothesis, randomization, sample size, duration, metrics, statistical tests, significance threshold, and analysis template.

Your AI will design A/B tests: hypothesis formulation, randomization unit, sample size calculation, duration, primary/guardrail metrics, statistical test selection, and analysis template.

Data Engineering

by a21e

Build ML Model Serving Pipeline

Model packaging, inference API, A/B routing, feature preprocessing, latency optimization, versioning, canary deployment, and monitoring.

Your AI will build ML serving: model packaging, inference API, A/B model routing, feature preprocessing, latency optimization, model versioning, canary deployment, and drift monitoring.

Data Engineering

by a21e