Add nomad with containerd example

[afbjorklund]

The more, the merrier...

Similar to the vagrant from Hashicorp tutorial,
but uses deb packages and the containerd driver.

https://learn.hashicorp.com/collections/nomad/get-started

https://www.nomadproject.io/docs/drivers/external/containerd

---

example.nomad

job "example" {
  datacenters = ["dc1"]

  group "cache" {
    network {
      mode = "bridge"
      port "db" {
        to = 6379
      }
    }

    task "redis" {
      driver = "containerd-driver"

      config {
        image = "docker.io/library/redis:alpine"
      }

      resources {
        cpu    = 500
        memory = 256
      }
    }
  }
}

limactl shell nomad nomad job run example.nomad

---

UI: http://localhost:4646

[AkihiroSuda]

Thanks, but the example seems lacking network. I guess this result is not expected?

# nerdctl -n nomad exec redis-c6718e ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever

[AkihiroSuda]

Could you add an example nomad job with networking and port forwarding to ./examples/nomad.yaml.d?
(Or put it to another repo, and insert a link to there in nomad.yaml)

[afbjorklund]

Thanks, but the example seems lacking network. I guess this result is not expected?

More like "bad example", I think the original docker version did add a network too...

https://learn.hashicorp.com/tutorials/nomad/get-started-run?in=nomad/get-started

anders@lima-nomad:~$ nomad job init -short
Example job file written to example.nomad
anders@lima-nomad:~$ cat example.nomad 
job "example" {
  datacenters = ["dc1"]

  group "cache" {
    network {
      port "db" {
        to = 6379
      }
    }

    task "redis" {
      driver = "docker"

      config {
        image = "redis:3.2"

        ports = ["db"]
      }

      resources {
        cpu    = 500
        memory = 256
      }
    }
  }
}

Was mostly showing the "driver" and "image" differences...

Also, you need to use sudo nerdctl -n nomad (if needed)

[afbjorklund]

The link is https://github.com/Roblox/nomad-driver-containerd/tree/master/example

[AkihiroSuda]

The link is https://github.com/Roblox/nomad-driver-containerd/tree/master/example

Could you add the link in nomad.yaml, LGTM then

[afbjorklund]

Missed the fine print:

You need to install CNI plugins on Nomad client nodes under /opt/cni/bin before you can use bridge networks.

[afbjorklund]

Now it has network:

$ sudo nerdctl -n nomad exec redis-f150f8 ip a
1: lo: <LOOPBACK> mtu 65536 qdisc noop state DOWN qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
3: eth0@if9: <BROADCAST,MULTICAST,UP,LOWER_UP,M-DOWN> mtu 1500 qdisc noqueue state UP 
    link/ether 86:ee:f8:54:0c:b8 brd ff:ff:ff:ff:ff:ff
    inet 172.26.64.7/20 brd 172.26.79.255 scope global eth0
       valid_lft forever preferred_lft forever
    inet6 fe80::84ee:f8ff:fe54:cb8/64 scope link 
       valid_lft forever preferred_lft forever

But no mapped ports (like docker and qemu):

Oct 20 18:44:36 lima-nomad nomad[3167]:         * failed to parse config:
Oct 20 18:44:36 lima-nomad nomad[3167]:         * Invalid label: No argument or block type is named "ports".

[afbjorklund]

Can use https://www.nomadproject.io/docs/configuration/client#cni_path instead

[AkihiroSuda]

Thanks