Architecture pattern: applications and APIs

Microservices architecture: containers, registry and delivery pipeline

Microservices split an application into small services that you build, release and scale on their own. Here is how the pieces fit, which service plays each part on AWS, Azure and Google Cloud, and what to settle before you split anything.

Quick answer

A microservices architecture runs each service as a container on a managed Kubernetes cluster or a serverless container platform, behind a load balancer. A pipeline builds images into a container registry and deploys them, and monitoring, logs and a secrets service support every service, each owning its own data.

The Microservices on containers pattern at a glance
Best forLarge products with several teams that must release and scale parts independently
Less suited whenSmall teams and simple apps, where one well-organised application is faster to build and run
Start withSplit one clear service out of a working application, with a pipeline and monitoring
Main services on AWSAWS CodePipeline + CodeBuild, Amazon ECR, Amazon CloudWatch, AWS Secrets Manager, Elastic Load Balancing, Amazon EKS
Main services on AzureAzure Pipelines, Azure Container Registry, Azure Monitor, Azure Key Vault, Azure Application Gateway, Azure Kubernetes Service
Main services on Google CloudCloud Build, Artifact Registry, Cloud Monitoring, Secret Manager, Cloud Load Balancing, Google Kubernetes Engine

The idea in plain words

In a monolith, the whole application is one unit: you build, release and scale it together. In microservices, you split it into small services, each owning one business job and its own data, that talk to each other over the network.

That lets teams release independently and scale only the busy parts. In return you take on more moving parts: networking between services, many pipelines, shared monitoring and data that is spread out.

Run the services as containers. A managed Kubernetes cluster gives the most control, and serverless container platforms remove the cluster work. A registry stores the images and a pipeline ships them.

The architecture

Boxes show the job each part does. Pick a cloud to see the service for each job.

Microservices on containers: architecture diagramTwo rows of boxes. The numbered steps below describe the same flow in words.images are pulledmetrics and alertskeys and passwordsresponses1. Build, ship and supportCI/CD pipelineTests, builds anddeploysAWS CodePipeline +CodeBuildAzure PipelinesCloud BuildImage registryStores containerimagesAmazon ECRAzure ContainerRegistryArtifact RegistryMonitoringMetrics and alertsAmazon CloudWatchAzure MonitorCloud MonitoringSecretsKeys and passwordsAWS SecretsManagerAzure Key VaultSecret Manager2. Run and serveClientA browser, app orpartnerLoad balancerSpreads traffic acrosscopiesElastic LoadBalancingAzure ApplicationGatewayCloud LoadBalancingManaged clusterRuns your services ascontainersAmazon EKSAzure KubernetesServiceGoogle KubernetesEngineService dataEach service's owndatabase or queueMicroservices on containers: architecture diagramBoxes from top to bottom. The numbered steps below describe the same flow in words.images are pulledmetrics and alertskeys and passwords1. Build, ship and supportCI/CD pipelineTests, builds and deploysAWS CodePipeline + CodeBuildAzure PipelinesCloud BuildImage registryStores container imagesAmazon ECRAzure Container RegistryArtifact RegistryMonitoringMetrics and alertsAmazon CloudWatchAzure MonitorCloud MonitoringSecretsKeys and passwordsAWS Secrets ManagerAzure Key VaultSecret Manager2. Run and serveClientA browser, app or partnerLoad balancerSpreads traffic across copiesElastic Load BalancingAzure Application GatewayCloud Load BalancingManaged clusterRuns your services as containersAmazon EKSAzure Kubernetes ServiceGoogle Kubernetes EngineService dataEach service's own database orqueue↩ responses, back to client
Arrows show the direction of the flow, and dashed lines connect the rows. Each box names the main service for that job, taken from CloudBrum's service suggester.

Step by step

  1. Developers push codeA change to one service starts its own pipeline, which runs tests.
  2. The pipeline builds an imageIt packages the service as a container image and scans it for known vulnerabilities.
  3. The image goes to a registryA private registry stores versioned images, so every environment runs exactly the same build.
  4. The platform runs itA managed Kubernetes cluster or serverless container platform pulls the image and runs several copies.
  5. Traffic is sharedA load balancer or ingress sends requests to healthy copies and routes each path to the right service.
  6. Services use their own dataEach service keeps its own database or queue and talks to others through APIs or events, not by sharing tables.
  7. Everything is watched togetherCentral metrics, logs and traces show how requests move across services. Secrets come from a secrets service, never from images.

Services side by side

The main service for each job on each cloud, with a second option where one exists. Names checked on 23 October 2026.

Services for each job in this architecture on AWS, Azure and Google Cloud
JobAWSAzureGoogle Cloud
CI/CD pipelines
  • AWS CodePipeline + CodeBuildManaged pipeline and build service; CodeDeploy handles deployments
  • Azure Pipelines (Azure DevOps)CI/CD for any language and platform
  • GitHub Actions
  • Cloud BuildServerless CI/CD builds
  • Cloud Deploy
Container image registry
  • Amazon ECRPrivate registry for container images, with vulnerability scanning
  • Azure Container RegistryPrivate registry for container images and Helm charts
  • Artifact RegistryStores container images and language packages (replaced Container Registry)
Monitoring, metrics and alerts
  • Amazon CloudWatchMetrics, alarms, dashboards and logs for AWS resources and apps
  • Azure MonitorMetrics, alerts, logs and Application Insights in one service
  • Cloud Monitoring (Google Cloud Observability)Metrics, dashboards and alerting, with Managed Service for Prometheus
Store secrets (passwords, API keys)
  • AWS Secrets ManagerStores, rotates and retrieves secrets such as database passwords
  • Azure Key VaultSecrets, keys and certificates in one managed vault
  • Secret ManagerStores and versions API keys, passwords and certificates
Load balancing
  • Elastic Load BalancingApplication, Network and Gateway load balancers
  • Azure Application GatewayHTTP/S (layer 7) load balancing with an optional web application firewall
  • Azure Load Balancer
  • Cloud Load BalancingGlobal and regional load balancing behind a single anycast IP
Managed Kubernetes
  • Amazon EKSManaged Kubernetes; Auto Mode can also manage the worker nodes
  • Red Hat OpenShift Service on AWS (ROSA)
  • Azure Kubernetes Service (AKS)Managed Kubernetes with a free control-plane tier
  • Azure Red Hat OpenShift
  • Google Kubernetes Engine (GKE)Managed Kubernetes; Autopilot mode manages the nodes for you
  • GKE Enterprise
Central logs and log analyticsOptional
  • Amazon CloudWatch LogsCollects, searches and analyses logs; OpenSearch for deeper search
  • Azure Monitor Logs (Log Analytics)Collects logs and queries them with KQL
  • Cloud LoggingCentral logs, with Log Analytics on BigQuery

Common variations

  • Services must call each other reliably. Add retries, timeouts and a message queue between services, and consider a service mesh only when you really need one.
  • Releases must be very safe. Use blue-green or canary releases, so a bad version reaches few users and can be rolled back quickly.
  • Traffic is spiky. Scale services automatically on load, using serverless containers or event-driven scaling.
  • Teams already run virtual servers. Move one service at a time and keep the rest where it is, linking them with APIs.

Try this in the service suggester

Kubernetes cluster or serverless containers?

You can run containers on a managed Kubernetes cluster, which gives the most control, or on a serverless container platform that hides the cluster, shown in the table.

Services for this choice on each cloud
 AWSAzureGoogle Cloud
Run containers without managing servers
  • AWS Fargate with Amazon ECSRuns containers without managing servers; ECS is the simplest AWS orchestrator
  • Amazon ECS Express Mode
  • Azure Container AppsServerless containers with scale to zero, built on Kubernetes
  • Azure Container Instances
  • Cloud RunRuns any container; scales to zero and bills per request

Managed Kubernetes

Good

  • Most control and the widest tool ecosystem
  • The same approach on every cloud
  • Handles many services and complex setups

Watch out

  • Cluster upgrades, networking and security to manage
  • Needs Kubernetes skills
  • Costs while nodes run, even when idle

Serverless containers

Good

  • No cluster to run or patch
  • Scales to zero and up on demand
  • Quicker to start for a small team

Watch out

  • Less control of networking and scheduling
  • Platform limits on size and features
  • Moving to Kubernetes later takes work
A common path. Most teams should start with serverless containers and move to Kubernetes when they need its control or already have the skills.

Keep in mind

  • Do you need microservices?. A well-structured single application is simpler and faster for small teams. Split only when team size, release speed or scaling really demand it.
  • Own your data. Each service should own its data. Sharing one database across services brings back the problems you were trying to avoid.
  • Observability. Use correlation IDs, central logs, metrics and traces from day one. Without them, finding a fault across services is slow.
  • Security. Scan images, run containers with least privilege, restrict service-to-service traffic and keep secrets out of images.
  • Cost. Many small services add idle capacity and tooling cost. Right-size containers, scale to demand and remove unused services.
  • Delivery pipeline. Give each service its own pipeline and versioned releases, with automated tests and fast rollbacks.
  • Team skills. Running distributed systems needs skills in networking, containers and monitoring. Plan training or use managed platforms.
A starting point, not a design review. This is a general pattern. Your documents, users, rules and budget decide the real design. Confirm features, limits, pricing and regions on each provider's own pages. CloudBrum is independent of AWS, Microsoft and Google.

Words used on this page

Services in this pattern that have changed

Cloud providers rename and retire services often. These affect the parts above. Checked on 23 October 2026.

  • AWS Closed to new customers AWS App Runner stopped accepting new customers on 30 April 2026. AWS recommends Amazon ECS Express Mode for new container web apps. Details
  • Google Cloud Shut down Google Container Registry was shut down on 18 March 2025. Use Artifact Registry. Details

Sources and further reading

Check details such as features, limits, prices and regions in the providers' own documentation.

Announcements about the changed services above

Frequently asked questions

What are microservices?

Microservices split an application into small, independent services, each handling one business job and owning its data. Teams build, release and scale each service separately.

Do I need Kubernetes for microservices?

No. Serverless container platforms and plain managed container services can run microservices without a cluster. Kubernetes helps when you need its control or tooling.

When should I not use microservices?

Avoid them for small teams, early products and simple apps. A single well-organised application is faster to build, test and run, and can be split later.

How do microservices communicate?

Services call each other through APIs when they need an immediate answer, or exchange messages and events through queues and buses when they do not need to wait. Each choice has trade-offs.

How do I manage many microservices?

Use one pipeline pattern for all services, central monitoring and logs, versioned APIs, clear ownership and automation for deployment and scaling.

Want this reviewed for your case?

CloudBrum architects can adapt this pattern to your documents, users, rules and budget, and estimate the cost. Nothing is sent until you choose.

Building something else?

Describe it in plain words and get matching services on all three clouds.

Service suggester → Cloud consulting →