Microservice Deployment Based on Multiple Controllers for User Response Time Reduction in Edge-Native Computing.

Abstract

Microservice deployment methods in edge-native computing environments hold great potential for minimizing user application response time. However, most existing studies overlook the communication overhead between microservices and controllers, as well as the impact of microservice pull time on user response time. To address these issues, this paper proposes a multi-controller service mesh architecture to reduce data transfer overhead between microservices and controllers. Furthermore, we formulate the microservice deployment problem as an optimization problem aimed at minimizing both system communication overhead and microservice deployment cost. To achieve this, we introduce a novel RIME optimization algorithm and enhanced Adaptive Crested Porcupine Optimizer (RIME-ACPO) algorithm that optimizes microservice placement decisions. Notably, this algorithm incorporates a real-time resource monitoring-based load balancing algorithm, dynamically adjusting microservice deployment according to edge server resource utilization to enhance the execution performance of user applications. Finally, extensive simulation experiments were conducted to validate the effectiveness of the proposed algorithm. The experimental results demonstrate that, compared with other algorithms, our algorithm significantly improves user response time, optimizes resource utilization, and reduces the total cost.