Senior Software Engineer, AI/ML Backend Developer (Python, Linux)

Filled
January 13, 2026

Job Description

Job Details

  • Company Name: Red Hat India Private Limited
  • Employment type: Full time
  • Experience: Fresher
  • Salary: $10 to $15 Hourly
  • Location : Remote Option Available

Work schedule : 5 days a week

Job Overview

Red Hat’s Customer Experience & Engagement (CEE) organization is seeking a Senior Software Engineer (AI/ML Backend) to join the Business Intelligence team. In this role, you will design, build, and deploy scalable AI/ML platforms and agentic AI applications using open-source technologies, with a strong focus on Python, Kubernetes, and Red Hat OpenShift AI.

You will collaborate closely with data scientists, research teams, and product stakeholders while contributing to upstream open-source communities. This role may involve handling confidential customer information in compliance with Red Hat policies and applicable privacy laws.

Key Responsibilities

Platform & AI/ML Development

  • Design, architect, document, and lead the development of AI/ML platform components and agentic AI applications.
  • Implement and optimize production-grade AI/ML systems using Python (and optionally Go, C, C++, or Rust).
  • Build and integrate model inference and serving pipelines using technologies such as vLLM and TGI.

AI-Assisted Engineering

  • Proactively leverage AI-assisted development tools (e.g., GitHub Copilot, Cursor, Claude Code) to accelerate development and improve code quality.

Deployment & MLOps

  • Build and deploy containerized applications using Docker and Kubernetes.
  • Deploy and operate workloads on Red Hat OpenShift, as well as public cloud platforms (AWS, GCP, Azure).
  • Apply CI/CD and MLOps best practices to ensure reliable, scalable deployments.

Open Source Contribution

  • Contribute to upstream communities such as Kubeflow, vLLM, TGI, and PyTorch.
  • Ensure upstream technologies integrate effectively with Red Hat enterprise products.

Collaboration & Mentorship

  • Work closely with data scientists, research engineers, product teams, and stakeholders.
  • Mentor junior engineers and promote knowledge sharing and open collaboration.

Innovation & Problem Solving

  • Stay current with advancements in Generative AI and AI infrastructure.
  • Perform root cause analysis and solve complex technical challenges in dynamic environments.

Required Qualifications

  • 5+ years of professional software development experience in a technical field.
  • Strong proficiency in Python for backend and AI/ML development.
  • Experience with AI/ML frameworks and tools such as PyTorch, LangChain, or LangGraph.
  • Solid experience with containerization and orchestration (Docker, Kubernetes).
  • Hands-on experience with Red Hat OpenShift or similar PaaS platforms.
  • Experience deploying applications to public cloud environments (AWS, GCP, Azure).
  • Familiarity with CI/CD pipelines (Jenkins, GitLab CI).
  • Understanding of REST APIs, HTTP, and web application infrastructure.
  • Strong problem-solving skills and excellent written and verbal communication in English.