Senior AI Infrastructure Engineer

IO TECH SOLUTIONS LIMITED

  • Beijing
  • Permanent
  • Full-time
  • 14 days ago
  • Apply easily
Responsibilities1. Full-Stack AI Infrastructure Architecture & Development:
  • Build a full-stack AI infrastructure system for quantitative scenarios based on Kubernetes, unifying the management of heterogeneous computing resources (e.g., GPU pooling).
  • Integrate high-performance communication layers (e.g., RDMA) and drive the unified development of AI training/inference platforms and GPU operation/maintenance platforms.
  • Streamline the end-to-end workflow from resource scheduling to model deployment, enhancing system efficiency and stability.
2. Intelligent Computing Power Scheduling System Design:
  • Design a global scheduling mechanism supporting multi-task types and priority strategies, leveraging Volcano scheduler capabilities.
  • Lead the customization and maintenance of Volcano and core Operators, optimizing elastic scaling and resource utilization based on dynamic demands of quantitative tasks.
3. Hardware-Software Co-Optimization & System Reliability:
  • Develop an intermediate layer bridging underlying hardware (GPU/networking/storage) and AI frameworks (PyTorch/TensorFlow).
  • Build GPU elastic resource pools, fault self-healing mechanisms, and unified observability platforms (e.g., monitoring dashboards).
  • Ensure high-efficiency iteration and high availability of large-scale model training through performance tuning and automated operations.
4. Technical Foresight & Architecture Evolution:
  • Drive long-term AI Infra roadmap planning, anticipating quantitative business needs in computing scale, training efficiency, and cost control.
  • Explore and validate cutting-edge architectures (e.g., heterogeneous computing fusion, compute-storage separation, Serverless AI) to enhance infrastructure capabilities and technical barriers.
Qualifications1. Bachelors/Masters in Computer Science or related fields, 5-10 years of experience, with strong self-motivation and execution ability to identify and resolve technical bottlenecks.2. Deep expertise in AI infrastructure: Kubernetes, GPU resource management, RDMA/high-performance networking, and large-scale distributed AI system design/deployment.3. Proficient in *Golang/Python* with solid system programming and automation skills. Priority given to candidates with experience in *Volcano/Kueue schedulers, K8s Operator development, or open-source contributions*.4. Familiar with core resource scheduling principles, GPU lifecycle management (allocation, isolation, elasticity, fault tolerance), and designing high-availability, low-latency strategies for quantitative tasks.5. Knowledge of mainstream AI frameworks (PyTorch/TensorFlow), with experience in training/inference performance optimization and cross-team collaboration for framework-infra co-optimization.6. Preferred: Experience in **FinTech/quantitative AI infrastructure*, understanding of business-critical computing demands, and ability to drive cross-team collaboration and value delivery.

IO TECH SOLUTIONS LIMITED