Building a High-Performance, Resource-Efficient Translation Service with Rust Microservices

By Ganeshamurthi Ramasamy of Bosch Global Software Technologies
Time: 05:30 PM - 05.50 PM IST Room: 230

Abstract

This talk presents a high-performance, resource-efficient translation service built with Rust microservices, delivering human-level translation quality across all European languages. By leveraging Rust's performance, safety, and concurrency, we developed a modular system using seven microservices, deployed on Azure Kubernetes Service (AKS). Key technical highlights include the use of the Axum web framework, SQLx for asynchronous database interactions, and Azure Entra for Single Sign-On (SSO) integration. The system is optimized for efficiency, with low-load microservices running on as little as 200 millicores of CPU and 256 MB of memory, achieving significant resource savings compared to other language implementations. We also share insights on building custom shared libraries to streamline development and improve maintainability. This work showcases the potential of Rust for building scalable, secure, and highly efficient microservices in production environments, contributing valuable lessons for the Rust community and cloud-native development.

Biography

Development Lead @ BGSW
Ganesh is an experienced full-stack developer with over 9 years of expertise in building scalable software solutions across various domains. His background encompasses a wide range of technologies, including Java, Scala, Big Data, Apache Spark, Angular, Docker, AWS, and Azure. Currently, he is focused on creating Rust-based solutions for customers, specializing in integrating Rust into production environments to leverage its performance and safety features. Ganesh has contributed to developing solutions using Large Language Models (LLMs) with Rust as the backend, enhancing AI-driven applications. He has played a key role in developing the next-generation semantic layer using AI and Cognitive Services for multi-modal translation, virtual assistants, and search. He is experienced in using Azure Kubernetes Service (AKS) and managing Azure infrastructure and CI/CD pipelines with GitOps and Docker. His work highlights his expertise in building robust applications while leveraging Rust's capabilities to deliver high-performance and safe software solutions. Ganesh continues to drive innovation by integrating cutting-edge technologies and methodologies to meet evolving industry demands.