Scaling Services

Introduction

docker compose up --scale worker=5 runs five copies of a worker behind the same Compose network. Great for local load tests; prod scaling lives in Swarm or Kubernetes.

Purpose of this lesson

This lesson teaches Scaling Services as an engineering decision: what problem it solves, when to use it, how to implement it safely, and what signals tell you it is failing.

Understanding the topic

Use this when a project has more than one runtime dependency and the team needs a repeatable local, CI, or small-production environment. Compose is most valuable when it replaces tribal setup notes with executable infrastructure.

Core concepts to understand:

• Can't scale services that publish a fixed host port (collision).
• Compose load-balances internally via DNS round-robin.
• For real scale: Swarm (built-in) or Kubernetes.

Visual explanation

Architecture or command flow to keep in mind:

docker compose up -d --scale worker=5
docker compose ps   # 5 worker_N containers
docker compose logs -f worker

Step-by-step explanation

1. Model each service with its own image, ports, environment, healthcheck, networks, and volumes.
2. Keep internal service-to-service traffic on the Compose network and publish only the edge service to the host.
3. Use named volumes for state, bind mounts for local source code, and profiles for optional developer tools.
4. Bring the stack up, read health status and logs, then restart one dependency to see whether the app recovers.
5. Create a production override file with pinned images, restart policies, resource limits, logging, backup, and rollback guidance.

Informative example

Use the example below as a working baseline, then verify the runtime behavior instead of assuming the command or file is correct.

docker compose up -d --scale worker=5
docker compose ps   # 5 worker_N containers
docker compose logs -f worker

A production-minded check usually includes docker ps, docker logs, docker inspect, and one validation from outside the container such as curl, a database connection, or a registry pull.

# Verification loop for Scaling Services
docker ps -a
docker logs --tail=100 <container-name>
docker inspect <container-or-image-name>
docker system df

Real-world use

Useful for stress-testing a queue consumer or testing leader election in a small cluster on your laptop.

Enterprise use cases

In a mature engineering organization, Scaling Services is documented as a repeatable pattern with approved base images, ownership labels, CI checks, security expectations, rollback notes, and troubleshooting commands. The difference between a tutorial and production practice is that every container decision must be observable, reviewable, and reversible.

Best practices

• Don't publish host ports on services you'll scale.
• Put a reverse proxy (traefik) in front for L7 load balancing.

Debugging tips

• Read logs before restarting; a restart often removes the timing context you need for root cause analysis.
• Use docker inspect to compare configured state with actual runtime state.
• Check daemon health, disk usage, image tags, exit code, and port mappings before blaming application code.

Optimization strategies

• Use profiles to keep optional developer tools out of the default startup path.
• Give long-running services healthchecks and restart policies so failures are visible and recoverable.
• Separate dev and prod overrides instead of stretching one Compose file with fragile conditionals.

Advanced interview questions

Hands-on exercise

Create a small lab for Scaling Services: run the example, inspect the created Docker object, intentionally introduce one mistake, and record the command that reveals the failure. The goal is not just to make the happy path work; it is to build operational reflexes.

# Hands-on lab scaffold
mkdir -p docker-scaling-services-lab
cd docker-scaling-services-lab

# Add the Dockerfile, compose.yml, or command from this lesson.
# Then run one happy-path test and one broken-path test.
docker version
docker info
docker system df

Summary

Scaling Services matters because Docker is not only a packaging tool; it is a runtime, build, networking, storage, and delivery workflow. Treat each lesson as a production habit: make it repeatable, inspectable, secure, and easy to debug.