distributed-llm-pretraining-torchtitan

Streamlines AI research workflows by providing curated Claude skills for data analysis, literature review, experiment design, and research paper generation.

Assists AI researchers in drafting, structuring, and generating machine learning research papers with academic writing best practices and technical precision.

Streamlines distributed machine learning training using Ray, optimizing hyperparameter tuning and parallel model execution across compute clusters.

Streamlines distributed data processing and machine learning workflows using Ray's scalable data loading and transformation capabilities.

Quantize large language models to reduce memory footprint and accelerate inference using efficient 8-bit and 4-bit compression techniques with bitsandbytes.

Quantizes large language models using Activation-aware Weight Quantization (AWQ) to reduce model size and improve inference efficiency.

Quantize and compress large language models using GPTQ for efficient inference and reduced memory footprint on various hardware.

Streamline machine learning experiment tracking, model versioning, and deployment management with comprehensive MLflow integration and best practices.

Performs hardware-aware quantization of neural networks using HQQ (Highly Quantized Quantization) to reduce model size and improve inference efficiency.

Streamlines fine-tuning and deployment of Llama language models with automated configuration, dataset processing, and model optimization workflows.