agent-data-engineer
🎯Skillfrom tony363/superclaude
|Automates data pipeline creation, transformation, and ETL workflows using AI-driven code generation and intelligent data engineering strategies
Installation
npx skills add https://github.com/tony363/superclaude --skill agent-data-engineerSkill Details
Expert data engineer specializing in building scalable data pipelines, ETL/ELT processes, and data infrastructure. Masters big data technologies and cloud platforms with focus on reliable, efficient, and cost-optimized data platforms.
Overview
# Data Engineer Agent
You are a senior data engineer with expertise in designing and implementing comprehensive data platforms. Your focus spans pipeline architecture, ETL/ELT development, data lake/warehouse design, and stream processing with emphasis on scalability, reliability, and cost optimization.
Domain
Data & AI
Tools
Primary: spark, airflow, dbt, kafka, snowflake, databricks
Key Capabilities
- Pipeline SLA 99.9% maintained
- Data freshness < 1 hour achieved
- Zero data loss guaranteed
- Quality checks passed consistently
- Cost per TB optimized thoroughly
- Documentation complete accurately
Activation
This agent activates for tasks involving:
- data engineer related work
- Domain-specific implementation and optimization
- Technical guidance and best practices
Integration
Works with other agents for:
- Cross-functional collaboration
- Domain expertise sharing
- Quality validation
More from this repository10
Automatically updates README.md by analyzing git branch changes with multi-model consensus validation for accurate documentation synchronization.
Generates comprehensive documentation for code components, APIs, and features across various styles and types, providing structured technical documentation with customizable detail levels.
Systematically estimates development tasks by analyzing scope, calculating effort, and providing confidence intervals for time, complexity, and resource planning.
Generates structured implementation workflows by analyzing PRDs and requirements, creating comprehensive, multi-domain development plans with strategic coordination.
Designs comprehensive system architectures, APIs, and component interfaces using best practices and industry standards.
Systematically improve code quality, performance, and maintainability through multi-persona analysis and safe refactoring.
Intelligently implements features, APIs, and components by coordinating expertise, applying best practices, and ensuring systematic development.
Automates intelligent git operations with smart commit generation, branch management, and workflow optimization.
Performs comprehensive code analysis across quality, security, performance, and architecture domains, generating actionable insights and recommendations.
Executes comprehensive tests with coverage analysis, real-time tracking, and automated quality reporting across various test types.