spark-optimization
๐ฏSkillfrom wshobson/agents
|A production-ready plugin system with 112 AI agents, 146 skills, 16 workflow orchestrators, and 79 development tools organized into 73 focused plugins for Claude Code.
Overview
A specialized skill from the wshobson/agents plugin marketplace that provides Apache Spark optimization expertise as part of a comprehensive production-ready system for Claude Code. It is one of 146 agent skills within a collection of 73 focused plugins combining 112 specialized AI agents with deep knowledge across data/AI, infrastructure, and performance domains.
Key Features
- Progressive Disclosure - Spark optimization knowledge loads only when activated, keeping token usage minimal
- Isolated Plugin Architecture - Installs only the specific data engineering agents and skills needed without loading unrelated resources
- Composable Workflows - Can be combined with other data/AI plugins for comprehensive ML pipeline and data processing operations
- Multi-Agent Orchestration - Part of a system including 16 workflow orchestrators for complex ML pipeline operations
- Single-Purpose Design - Follows the focused plugin pattern with clear boundaries and minimal context overhead
Who is this for?
This skill is designed for data engineers, data scientists, and backend developers who work with Apache Spark and need AI-assisted guidance for performance tuning and optimization. It is especially useful for teams running large-scale data processing or ML pipelines who want to optimize Spark job configurations through Claude Code.
Part of
wshobson-agents
Installation
npx vibeindex add wshobson/agents --skill spark-optimizationnpx skills add wshobson/agents --skill spark-optimization~/.claude/skills/spark-optimization/SKILL.mdSKILL.md
More from this repository10
The data-validation-suite plugin is part of the wshobson/agents marketplace for Claude Code. It falls under the Data category, which includes two data-focused plugins: data engineering and data validation.
The ui-design plugin is part of the wshobson/agents marketplace for Claude Code, providing specialized AI agents for UI/UX design assistance within development workflows.
A Claude Code plugin from the wshobson/agents marketplace for deployment validation, providing specialized AI agents and tools to ensure reliable production deployments within a 73-plugin ecosystem.
An MLOps plugin from the wshobson/agents ecosystem providing Claude Code with specialized agents and skills for ML pipeline management, model deployment, experiment tracking, and production monitoring.
Shell Scripting is a Claude Code plugin from the wshobson/agents marketplace that provides AI-powered assistance for writing and maintaining shell scripts.
A Claude Code plugin with specialized AI agents for accessibility compliance auditing, WCAG standards verification, and remediation guidance in web and mobile applications.
The reverse-engineering plugin is part of the wshobson/agents marketplace for Claude Code, providing specialized AI agents for code analysis, binary examination, and system reverse engineering tasks.
A Claude Code plugin for CI/CD automation with 4 specialized skills covering pipeline design, GitHub Actions, GitLab CI, and secrets management, part of the wshobson/agents marketplace.
The functional-programming plugin is part of the wshobson/agents marketplace for Claude Code. It falls under the Languages category, which includes seven language-focused plugins covering Python, JavaScript/TypeScript, systems programming, JVM, sc...
Comprehensive Review is a Claude Code plugin from the wshobson/agents marketplace that provides multi-perspective code analysis covering architecture, security, and best practices.