Howto deploy services with ants on DigitalOcean

Table of Contents

External Link #

Visit this.

Introduction to ants #

Library ants implements a goroutine pool with fixed capacity, managing and recycling a massive number of goroutines, allowing developers to limit the number of goroutines in your concurrent programs. Services that need to conserve the system resources while handling a mass of requests/tasks can really use some help from ants.

This is how ants works under the hood:

Visit this for more details.

Random image API service #

I’ve created a project gallery that responds with random images via HTTP protocol, which makes use of ants to process concurrency tasks. In this tutorial, I’ll walk you through how to deploy this API service using docker on DigitalOcean’s droplet, so that you can use this service everywhere.

Creating droplet #

First of all, let’s navigate to the Droplets menu on your DigitalOcean console and click on the Create Droplet button in the upper right corner.

Secondly, either you switch to the Marketplace tab and pick the Docker on Ubuntu 22.04 when you choose an image to be installed on your droplet or you choose any image you prefer and install the docker engine later by following these docs.

Lastly, choose your preferred region, size, and other additional configurations for your droplet before clicking the button Create Droplet.

Now that we’ve created the droplet, you may want to initialize your server with the help of this official tutorial.

Using Docker #

If you make it here, you should be able to use docker on the droplet to pull any images hosted on Docker Hub and deploy them on your droplet. The Docker Engine normally doesn’t come with Docker Compose, so you have to install it manually. We’re going to deploy the gallery service using docker compose with this docker-compose.yml:

version: "3.8"

services:
  nginx:
    image: nginx:1.27.0-alpine
    container_name: nginx
    restart: always
    networks:
      - gallery_network
    ports:
      - "80:80"
      - "443:443"
    volumes:
      - /etc/nginx:/etc/nginx:ro
      - /usr/share/nginx/html:/usr/share/nginx/html:ro
      - /your/images/location:/your/images/location:ro
      - /var/log/nginx:/var/log/nginx
      - /var/cache/nginx:/var/cache/nginx
  gallery:
    image: panjf2000/gallery:v1.1.0
    container_name: gallery
    restart: on-failure:3
    networks:
      - gallery_network
    ports:
      - "7000:7000"
    volumes:
      # Specify the location where you put the images for displaying via
      # API service.
      - /your/images/location/:/your/images/location/:ro
    environment:
      - PORT=7000
      - DIR=/your/images/location/
      # The actual backend that serves static content.
      - URL=https://api.your-domain.com/images/random
      # Set the maximum requests per second per remote IP.
      - RATE_LIMIT_MAX=10
      # Set the expiration time in minutes for the token bucket of
      # the HTTP rate limiter.
      - RATE_LIMIT_TTL=30
      # Set the time window in seconds of caching the response for
      # the requests with the same URI.
      - CACHE_TTL=3
      # Set URL query key for lazy loading.
      - LOADING_KEY=thumb
      # Specify the placeholder image for lazy loading.
      - LOADING_PAGE=wallpaper-loading.gif
      # Determine whether the service should serve content itself
      # or redirect requests to the backend server like nginx.
      - SERVE_CONTENT=false

networks:
  gallery_network:

Before v1.1.0 (such as v1.0.0), you must deploy the gallery service in conjunction with a static content server, that way the gallery service can redirect the requests to the backend that serves static content. There are many open-source reverse proxies that can be used as static content servers, such as nginx or caddy. For what it is worth, this blog post may help you decide.

In this tutorial, I’ll go with nginx but other reverse proxies should also be as eminent static content servers as nginx. Therefore, just choose whichever reverse proxy you like. Here is a sample configuration of nginx as a static content server:

server {

        ...

        location ^~ /your/uri/path/ {
          # gzip_static on;
          # gzip_comp_level 5;

          sendfile on;
          sendfile_max_chunk 1m;

          tcp_nopush on;
          tcp_nodelay on;
          keepalive_timeout 65;

          access_log off;
          expires 7d;
          client_max_body_size 128M;

          valid_referers none blocked server_names
            127.0.0.1
            ~.*google\.
            ~.*baidu\.
            ~.*bing\.
            ~.*yahoo\.
            ~.*your-domain\.com\/?$;

          if ($invalid_referer) {
            return 403;
          }

          root /your/images/location/;
        }
}

In v1.1.0, gallery is able to serve content itself by replying to the request with a random image directly. This feature is enabled by default, but you can turn it off by adding the environment variable of - SERVE_CONTENT=false to the dcoker-compse.yml. As of v1.2.0, SERVE_CONTENT is deprecated, and gallery starts to use query parameter proxy_mode to toggle between the mode A of serving content itself and the mode B of forwarding requests to the backend: https://api.your-domain.com/images/random —— mode A, https://api.your-domain.com/images/random?proxy_mode —— mode B.

Before you go ahead and start deploying the services, you may want to hand-pick some pictures and stuff them in the location where nginx will serve static content. This directory containing those pictures is monitored by gallery, so any updates to the directory will be automatically reloaded inside gallery, which means that you can add, delete or modify pictures at any time without worrying about data synchronisation.

After all preliminary procedures are done, we now can deploy the gallery service using docker compose: go to wherever the docker-compose.yml is located and run the following command:

docker compose up -d

If no errors are reported from running the above command, we then should have had this service up and running.

At this point, an API service should be ready to accept requests. You can configure your DNS to translate your custom domain to the droplet IP along with proxying the requests from nginx to the gallery service. The simplest way to manage your DNS records with custom domains for your droplets is to do it on DigitalOcean. Or you can just do it using your own DNS provider from which you bought your domains, like CloudFlare or AWS.

Usage of gallery #

There are a few tips you should know when requesting random images from the gallery API service:

Append a query parameter thumb=128 (or whatever you specified for LOADING_KEY in docker-compose.yml) if you’re only getting a placeholder image for lazy loading, the value of the query paramter must be less than or equal to 640. The placeholder image must be placed in the location where your random images are, its name should be specified via LOADING_PAGE in docker-compose.yml.
Generate some random query parameters and append them to the request URL each time if you intend to get different images from each response because the gallery service will cache the response for requests with the same URI to make the API idempotent in a given time window (controlled by CACHE_TTL in docker-compose.yml).
You should configure the HTTP rate limiter of the gallery service to protect your API service from attackers abusing the API. It enables you to clamp the QPS per remote IP using expirable token buckets. Set RATE_LIMIT_MAX and RATE_LIMIT_TTL in docker-compose.yml properly.