spark-declarative-pipelines
π―Skillfrom databricks-solutions/ai-dev-kit
|Simplifies Spark data pipeline development with declarative configuration, enabling rapid, maintainable ETL workflows across complex data transformations.
Part of
databricks-solutions/ai-dev-kit(9 items)
Installation
npx skills add https://github.com/databricks-solutions/ai-dev-kit --skill spark-declarative-pipelinesNeed more details? View full documentation on GitHub β
More from this repository8
Streamlines asset management and versioning for machine learning models, enabling efficient packaging, distribution, and deployment of AI artifacts.
Generates comprehensive documentation and code samples for Databricks projects, streamlining technical writing and knowledge sharing across data engineering workflows.
Simplifies Databricks API interactions with Python, enabling seamless cluster management, job scheduling, and workspace resource operations.
Automate, manage, and monitor Databricks job workflows with advanced scheduling, error handling, and performance tracking capabilities
Automates Databricks lakehouse infrastructure provisioning with standardized configurations, security settings, and resource management.
Automates Databricks workspace configuration, managing clusters, secrets, and infrastructure-as-code for consistent and reproducible data environments.
Streamlines machine learning model evaluation and tracking using MLflow, enabling comprehensive performance metrics and experiment management.
Streamlines Databricks application development with automated provisioning, configuration management, and deployment workflows for complex AI and data projects.