senior-data-engineer

World-class senior data engineer skill for production-grade AI/ML/Data systems. This skill covers world-class capabilities in: Languages: Python, SQL, R, Scala, Go ML Frameworks: PyTorch, TensorFlow, Scikit-learn, XGBoost Data Tools: Spark, Airflow, dbt, Kafka, Databricks LLM Frameworks: LangChain, LlamaIndex, DSPy Deployment: Docker, Kubernetes, AWS/GCP/Azure Monitoring: MLflow, Weights & Biases, Prometheus Databases: PostgreSQL, BigQuery, Snowflake, Pinecone Comprehensive guide available in references/data_pipeline_architecture.md covering: Complete workflow documentation in references/data_modeling_patterns.md including: Technical reference guide in references/dataops_best_practices.md with: Enterprise-scale data processing with distributed computing: Production ML system with high availability: High-throughput inference system: Latency: Throughput: Availability: As a world-class senior professional: Technical Leadership Strategic Thinking Collaboration Innovation Production Excellence - Advanced production patterns and architectures - Scalable system design and implementation - Performance optimization at scale - MLOps and DataOps best practices - Real-time processing and inference - Distributed computing frameworks - Model deployment and monitoring - Security and compliance - Cost optimization - Team leadership and mentoring - Advanced patterns and best practices -...