DevOps/MLOps Specialist

Company Description

Bosch Global Software Technologies Private Limited is a 100% owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of technology and services, offering end-to-end Engineering, IT and Business Solutions. With over 27,000+ associates, it’s the largest software development center of Bosch, outside Germany, indicating that it is the Technology Powerhouse of Bosch in India with a global footprint and presence in the US, Europe and the Asia Pacific region.

Job Description

Education and Work Experience Requirements: Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field.5+ years of experience in MLOps with at least 2 years working specifically with LLMOps pipelines for large language models.Proven experience in deploying, managing, and optimizing machine learning models in cloud environments at scale.Experience with AI and Generative AI technologies is a plus.

• Strong problem-solving abilities and a passion for building scalable, production-grade AI systems.

• Lead the design and implementation of end-to-end MLOps and LLMOps pipelines, from model development and training to deployment and continuous monitoring in production environments.

• Develop automation for model deployment and management, ensuring scalability, efficiency, and cost-effectiveness, particularly for large language models (LLMs) in cloud environments.

• Implement and manage CI/CD pipelines for both ML and LLM models, integrating them seamlessly into the production environment.

• Collaborate with data scientists, ML engineers, and software developers to ensure the integration of LLMs and ML models into scalable, production-ready systems.

• Build data pipelines and workflows for training and serving models, ensuring efficient data processing and pipeline orchestration using tools like Kubeflow, Airflow, or MLflow.

• Create robust monitoring systems for tracking model performance, diagnosing issues, and ensuring the reliability and health of both traditional ML and LLM-based systems.

• Optimize the performance of deployed models, focusing on cost optimization, speed, and accuracy, including hardware acceleration (GPUs, TPUs).

• Maintain version control, governance, and model lifecycle management for both ML and LLM models using industry-standard tools.

• Stay up-to-date with the latest advancements in MLOps, LLMOps, and Generative AI, implementing best practices and innovative approaches to improve the deployment lifecycle.

Mandatory Skills:

• MLOps & LLMOps Expertise: Solid understanding of MLOps best practices and LLMOps workflows for large language models, ensuring seamless integration of AI systems into production environments.

• Cloud Infrastructure & Deployment: Extensive experience with cloud platforms (AWS, GCP, Azure) for deploying and scaling ML/LLM solutions. Expertise in containerization (Docker, Kubernetes) for model deployment and orchestration.

• CI/CD Pipelines & Automation: Proficiency in developing and managing CI/CD pipelines for machine learning models using tools like Jenkins, GitLab CI, or CircleCI, and automation tools like Terraform or Ansible.

• Model Serving & Monitoring: Hands-on experience deploying models using frameworks such as TensorFlow Serving, TorchServe, Kubeflow, or MLflow. Strong understanding of model monitoring and alerting (e.g., Prometheus, Grafana).

• Machine Learning Frameworks: Strong knowledge of popular machine learning frameworks like TensorFlow, PyTorch, Hugging Face, and others, with a particular focus on deploying and fine-tuning large language models (e.g., GPT, BERT).

• Data Engineering & Pipelines: Expertise in building and managing robust data pipelines using tools like Apache Kafka, Apache Airflow, or Apache Beam to support ML and LLM workflows.

• Performance Optimization: Ability to optimize the performance of AI models, including working with distributed systems, model compression, and hardware acceleration (GPUs, TPUs).

• Security & Governance: Deep understanding of security and governance best practices for AI systems, including model versioning, compliance with privacy regulations (GDPR), and ethical AI frameworks.

• Programming & Scripting: Strong programming skills in Pyth

Qualifications

BE, MCA, MTech , BTech

Additional Information

6+