Towards a Characterization of Microservice Architectures Generated by Large Language Models

RESUMO

Large Language Models (LLMs) are increasingly used for software design tasks, yet little is known about the structure and coherence of the architectures they produce. In particular, how LLMs behave in Architecture-to-Architecture transformations remains insufficiently understood. This study empirically characterizes how LLMs generate microservice architectures from natural language descriptions of modular monoliths, focusing on structural and descriptive properties rather than architectural correctness. We conduct controlled experiments on two modular monolith systems, comparing zero-shot and few-shot prompting strategies using GPT-based models from OpenAI and models from DeepSeek. Generated architectures are represented in a standardized CSV format and evaluated using normalized metrics capturing service granularity, inter-service communication patterns, communication density, service isolation, and responsibility descriptiveness. The results reveal systematic differences driven primarily by prompting strategy rather than model provider. Few-shot prompting consistently produces finer-grained decompositions with lower communication density and more detailed responsibility descriptions, whereas zero-shot prompting favors coarser and more tightly connected architectures. Rather than assessing architectural quality, this study provides an empirical baseline for understanding LLM behavior in text-driven Architecture-to-Architecture transformations, informing future research on generative design workflows and hybrid architectural reasoning in early-stage software modernization.