Compare commits

..
29 Commits
Author SHA1 Message Date
ElevenNotes 13257cb2d4 multi arch 2024-10-18 11:45:47 +02:00
ElevenNotes 53c4b3b57c drop versions 2024-10-18 11:45:24 +02:00
ElevenNotes f383b448bd add switch for dropping dns records 2024-10-18 11:35:35 +02:00
ElevenNotes c2f6f641a4 add worker node info 2024-02-02 11:36:57 +01:00
ElevenNotes 1670f1d94f 0.3.0 2024-02-02 11:19:10 +01:00
ElevenNotes 2120d6b8b7 main/worker model for better scalability 2024-02-02 11:10:15 +01:00
ElevenNotes 2b98936893 add node timeout 2024-02-01 11:35:39 +01:00
ElevenNotes 16ceb5a17a remove stale nodes 2024-02-01 11:29:08 +01:00
ElevenNotes b18b3f67be interval: 60 2024-02-01 11:23:26 +01:00
ElevenNotes 68d4b66972 dynamic node reloading 2024-02-01 11:20:14 +01:00
ElevenNotes 3c0c04abe5 add yaml node reload 2024-02-01 11:14:33 +01:00
ElevenNotes 53d0fb843d add poll info 2024-02-01 11:02:49 +01:00
ElevenNotes b09f41e04f add initial poll 2024-02-01 10:52:09 +01:00
ElevenNotes c9ca96a547 switch qemu 2024-02-01 10:30:24 +01:00
ElevenNotes 71f5dce8f7 add version and latest 2024-02-01 10:26:28 +01:00
ElevenNotes 9fabbcd86c 0.2.1 2024-02-01 10:23:43 +01:00
ElevenNotes 2e3aa6ea57 exception handling 2024-01-25 14:54:14 +01:00
ElevenNotes 962cd22f26 0.2.0 > latest 2024-01-25 09:19:13 +01:00
ElevenNotes 9f24499f6f verbosity 2024-01-25 09:18:26 +01:00
ElevenNotes 33cf74e52a verbosity 2024-01-24 23:36:32 +01:00
ElevenNotes 543a19f5f0 js-yaml 2024-01-24 22:52:48 +01:00
ElevenNotes 5ad1a0d355 client > server 2024-01-24 22:28:19 +01:00
ElevenNotes 307e7101f8 add TLS defaults 2024-01-23 22:52:36 +01:00
ElevenNotes 6752ebee1a 0.1.10 2024-01-23 22:08:09 +01:00
ElevenNotes 3c2ab08ba9 0.1.9 2024-01-23 22:07:09 +01:00
ElevenNotes 498c0988e5 0.1.10 2024-01-23 22:01:53 +01:00
ElevenNotes 49801cd521 0.1.10 2024-01-23 22:01:10 +01:00
ElevenNotes 66b5bab4ae add TLS auth 2024-01-23 21:58:09 +01:00
ElevenNotes 070f45fae5 add TLS authentication 2024-01-23 15:34:43 +01:00
11 changed files with 578 additions and 221 deletions
+2 -1
View File
@@ -1 +1,2 @@
maintain/
maintain/
project*
+121 -38
View File
@@ -1,33 +1,99 @@
# Alpine :: Traefik Labels
![size](https://img.shields.io/docker/image-size/11notes/traefik-labels/amd64-0.1.9?color=0eb305) ![version](https://img.shields.io/docker/v/11notes/traefik-labels/amd64-0.1.9?color=eb7a09) ![pulls](https://img.shields.io/docker/pulls/11notes/traefik-labels?color=2b75d6) ![activity](https://img.shields.io/github/commit-activity/m/11notes/docker-traefik-labels?color=c91cb8) ![commit-last](https://img.shields.io/github/last-commit/11notes/docker-traefik-labels?color=c91cb8)
![Banner](https://github.com/11notes/defaults/blob/main/static/img/banner.png?raw=true)
Run Traefik Labels based on Alpine Linux. Small, lightweight, secure and fast 🏔️
# 🏔️ Alpine - Traefik Labels
![size](https://img.shields.io/docker/image-size/11notes/traefik-labels/latest?color=0eb305) ![version](https://img.shields.io/docker/v/11notes/traefik-labels/latest?color=eb7a09) ![pulls](https://img.shields.io/docker/pulls/11notes/traefik-labels?color=2b75d6)
## Description
What can I do with this? Simply put: It will export any traefik labels on a container on the same host as this image runs to a Redis instance. This makes it possible for a centralized Traefik load balancer to update endpoints dynamically by utilizing the docker labels, just like you would on a local installation of Traefik with labels. It is meant as an alternative and simple way to proxy requests from a Traefik load balancer to multiple docker nodes running in different networks and locations. The image has the ability to use nsupdate with labels too, so that not only you can add a dynamic proxy to your Traefik, but add DNS entries to your internal or external NS servers. It uses split DNS as WAN and LAN in your labels, so you can update external as well as internal DNS entries on the fly. If a container is removed the image will automatically reverse any `nsupdate update add` to `nsupdate update delete` so entrie are removed too.
**Export Traefik labels from any Docker node to a central location**
In order to use this image, you need to setup Traefik with a Redis provider and then point this image via REDIS_URL to the same Redis instance. Each entry will have an expire timer set in Redis, so that if a container is removed by a server crashing, Redis will automatically remove stale entries as well. Entries are refreshed every 300 seconds or on all docker container events (create, run, kill, stop, restart, ...). As for nsupdate, you need to setup tsig authentication in your NS servers and add the keys to the zones you want to be able to update, you can restrict the keys by using update-policy if you use BIND.
# SYNOPSIS
What can I do with this? This image will connect to all your Docker nodes and read their labels. It will then use the labels to update your Traefik configuration in Redis automatically and dynamically on each container start, stop or timeout. It also supports updating your internal and external DNS servers too, so you can use labels for everything. If a container is removed the image will automatically reverse any `nsupdate update add` to `nsupdate update delete` so entries are removed too.
In order to use this image, you need to setup Traefik with a Redis provider and then point this image via redis.url to the same Redis instance. Each entry will have an expire timer set in Redis, so that if a container is removed by a server crashing, Redis will automatically remove stale entries as well. Entries are refreshed every 300 seconds or on all docker container events (create, run, kill, stop, restart, ...). As for nsupdate, you need to setup tsig authentication in your NS servers and add the keys to the zones you want to be able to update, you can restrict the keys by using update-policy if you use Bind from ISC.
This image provides the ability to call a webhook for each container for each event or poll after the data was updates in Redis and or nsupdate.
## Run
```shell
docker run --name traefik-labels \
-v /run/docker.sock:/run/docker.sock \
-e LABELS_REDIS_URL="rediss://foo:bar@10.127.198.254:6379/0" \
-d 11notes/traefik-labels:[tag]
Each node gets its own worker thread for better scalability. If you have 10 nodes, you will have 10 worker processes inside the container forked from the main process. Forks die when their node disconnects and use the `ping.interval` to fork new processes indefinitely. As soon as the node is back online, it will always execute a poll on all containers of that node.
# VOLUMES
* **/labels/etc** - Directory of config.yaml
* **/labels/ssl** - Directory of ssl certificates for TLS<sup>1</sup>
# COMPOSE
```yaml
name: "traefik-labels"
services:
redis:
image: "11notes/redis:7.2.5"
container_name: "redis"
environment:
REDIS_PASSWORD: "**************"
TZ: Europe/Zurich
volumes:
- "redis.etc:/redis/etc"
- "redis.var:/redis/var"
networks:
- redis
restart: always
labels:
image: "11notes/traefik-labels:0.3.0"
container_name: "labels"
environment:
TZ: Europe/Zurich
volumes:
- "labels.etc:/labels/etc"
networks:
- redis
- nodes
restart: always
volumes:
redis.etc:
redis.var:
labels:etc:
networks:
redis:
internal: true
nodes:
```
```shell
docker run --name traefik-labels \
-v /run/docker.sock:/run/docker.sock \
-e LABELS_REDIS_URL="rediss://foo:bar@10.127.198.254:6379/0" \
-e LABELS_WEBHOOK="https://domain.com/traefik/labels" \
-e LABELS_WEBHOOK_AUTH_BASIC="foo:bar" \
-d 11notes/traefik-labels:[tag]
# EXAMPLES
## config /labels/etc/config.yaml
```yaml
labels:
redis:
url: rediss://foo:bar@10.127.198.254:6379/0
webhook:
url: https://my.cool.webhook/v1
# optional
auth:
# supports basic authentication
basic: labels:*****
nodes:
# use FQDN and add the FQDN to your certificates SAN list (or IP)
- 192.168.18.12
- 10.14.120.1
# reload labels.nodes every {n} seconds (0 = disabled)
interval: 0
# timeout in seconds for the connection to a Docker node
timeout: 2.5
rfc2136:
# only nsupdate on entries which are different (do not update same data)
verify: false
# remove DNS entry if container is unreachable
remove: false
poll:
# polling all containers on a node every {n} seconds
interval: 300
ping:
# ping all nodes every {n} seconds to see if they are still online
interval: 10
tls:
# path for TLS certificates
ca: /labels/ssl/ca.crt
crt: /labels/ssl/server.crt
key: /labels/ssl/server.key
```
## Examples
## container on a node with Traefik routes
```shell
docker run --name traefik-demo \
-p 8080:8080 \
@@ -39,6 +105,7 @@ docker run --name traefik-demo \
-d 11notes/nginx:stable
```
## container on a node with Traefik routes and rfc2136 DNS
```shell
docker run --name traefik-rfc2136-demo \
-p 8080:8080 \
@@ -57,37 +124,53 @@ docker run --name traefik-rfc2136-demo \
-d 11notes/nginx:stable
```
## Defaults
# DEFAULT SETTINGS
| Parameter | Value | Description |
| --- | --- | --- |
| `user` | docker | user docker |
| `uid` | 1000 | user id 1000 |
| `gid` | 1000 | group id 1000 |
| `home` | /labels | home directory of user docker |
| `api` | https://${IP}:5000 | HTTPS endpoint of Docker registry |
| `config` | /labels/etc/config.yaml | config (nodes can be updated dynamically) |
| `ca.crt` | /labels/ssl/ca.crt | Certificate of CA for TLS<sup>1</sup> |
| `labels.crt` | /labels/ssl/labels.crt | Certificate of client for TLS<sup>1</sup> |
| `labels.key` | /labels/ssl/labels.key | Private key of client for TLS<sup>1</sup> |
## Environment
# ENVIRONMENT
| Parameter | Value | Default |
| --- | --- | --- |
| `TZ` | [Time Zone](https://en.wikipedia.org/wiki/List_of_tz_database_time_zones) | null |
| `DEBUG` | Show debug information | null |
| `LABELS_REDIS_URL` | the redis URL to connect, use rediss:// for SSL | rediss://localhost:6379/0 |
| `LABELS_INTERVAL` | in what interval container information is pulled in seconds | 300 |
| `LABELS_TIMEOUT` | how many seconds after an interval the keys should stay till they expire in seconds | 30 |
| `LABELS_WEBHOOK` | URL to call on each event or poll for each container | |
| `LABELS_WEBHOOK_AUTH_BASIC` | Basic authentication to use in the form of "username:password" for the webhook | |
| `LABELS_RFC2136_ONLY_UPDATE_ON_CHANGE` | Only update DNS entries if they are new or changed (will use dig on each call to the set server) | false |
| `TZ` | [Time Zone](https://en.wikipedia.org/wiki/List_of_tz_database_time_zones) | |
| `DEBUG` | Show debug information | |
## Parent image
# SOURCE
* [11notes/traefik-labels:latest](https://github.com/11notes/docker-traefik-labels/tree/latest)
# PARENT IMAGE
* [11notes/node:stable](https://hub.docker.com/r/11notes/node)
## Built with (thanks to)
# BUILT WITH
* [npm::redis](https://www.npmjs.com/package/redis)
* [npm::dockerode](https://www.npmjs.com/package/dockerode)
* [nodejs](https://nodejs.org/en)
* [Alpine Linux](https://alpinelinux.org)
* [alpine](https://alpinelinux.org)
## Tips
* Only use rootless container runtime (podman, rootless docker)
* Don't bind to ports < 1024 (requires root), use NAT/reverse proxy (haproxy, traefik, nginx)
* Do not access docker.sock as root
# TIPS
* Use a reverse proxy like Traefik, Nginx to terminate TLS with a valid certificate
* Use Let’s Encrypt certificates to protect your SSL endpoints
# DISCLAIMERS
* <sup>1</sup> For TLS to work you need proper certificates in place for your dockerd and your clients. The CN in the certificate needs to match the FQDN or IP you have set on the docker node, you can set multiple by using SAN. See an example of a daemon.json configuration to enable TLS.
```json
{
"tls": true,
"tlsverify": true,
"tlscacert": "/etc/docker/ca.crt",
"tlscert": "/etc/docker/server.crt",
"tlskey": "/etc/docker/server.key",
"hosts": ["unix:///var/run/docker.sock", "tcp://0.0.0.0:2376"]
}
```
# ElevenNotes<sup>™️</sup>
This image is provided to you at your own risk. Always make backups before updating an image to a new version. Check the changelog for breaking changes. You can find all my repositories on [github](https://github.com/11notes).
+1
View File
@@ -27,6 +27,7 @@
cd ${APP_ROOT}; \
npm --save install \
redis@4.6.11 \
js-yaml@4.1.0 \
dockerode@4.0.0;
# :: update image
+5 -6
View File
@@ -6,14 +6,12 @@
git; \
git clone https://github.com/11notes/util.git;
# :: Builder
FROM alpine AS qemu
ENV QEMU_URL https://github.com/balena-io/qemu/releases/download/v3.0.0%2Bresin/qemu-3.0.0+resin-aarch64.tar.gz
RUN apk add curl && curl -L ${QEMU_URL} | tar zxvf - -C . && mv qemu-3.0.0+resin-aarch64/qemu-aarch64-static .
# :: QEMU
FROM multiarch/qemu-user-static:x86_64-aarch64 as qemu
# :: Header
FROM arm64v8/node:20.10.0-alpine3.19
COPY --from=qemu qemu-aarch64-static /usr/bin
FROM --platform=linux/arm64 11notes/node:stable
COPY --from=qemu /usr/bin/qemu-aarch64-static /usr/bin
ENV APP_ROOT=/labels
# :: Run
@@ -33,6 +31,7 @@
cd ${APP_ROOT}; \
npm --save install \
redis@4.6.11 \
js-yaml@4.1.0 \
dockerode@4.0.0;
# :: update image
+33
View File
@@ -0,0 +1,33 @@
name: "traefik-labels"
services:
redis:
image: "11notes/redis:7.2.5"
container_name: "redis"
environment:
REDIS_PASSWORD: "**************"
TZ: Europe/Zurich
volumes:
- "redis.etc:/redis/etc"
- "redis.var:/redis/var"
networks:
- redis
restart: always
labels:
image: "11notes/traefik-labels:latest"
container_name: "labels"
environment:
TZ: Europe/Zurich
volumes:
- "labels.etc:/labels/etc"
networks:
- redis
- nodes
restart: always
volumes:
redis.etc:
redis.var:
labels:etc:
networks:
redis:
internal: true
nodes:
-4
View File
@@ -1,4 +0,0 @@
#!/bin/bash
curl -Lo manifest-tool https://github.com/estesp/manifest-tool/releases/download/v0.9.0/manifest-tool-linux-amd64
chmod +x manifest-tool
./manifest-tool push from-spec multi-arch-manifest.yaml
-2
View File
@@ -1,2 +0,0 @@
#!/bin/bash
docker run --rm --privileged multiarch/qemu-user-static:register --reset
@@ -1,10 +1,10 @@
image: 11notes/traefik-labels:latest
manifests:
- image: 11notes/traefik-labels:amd64-0.1.9
- image: 11notes/traefik-labels:amd64-latest
platform:
architecture: amd64
os: linux
- image: 11notes/traefik-labels:arm64v8-0.1.9
- image: 11notes/traefik-labels:arm64v8-latest
platform:
architecture: arm64
os: linux
+33
View File
@@ -0,0 +1,33 @@
labels:
redis:
url: rediss://foo:bar@10.127.198.254:6379/0
webhook:
url: https://my.cool.webhook/v1
# optional
auth:
# supports basic authentication
basic: labels:*****
nodes:
# use FQDN and add the FQDN to your certificates SAN list (or IP)
- 192.168.18.12
- 10.14.120.1
# reload labels.nodes every {n} seconds (0 = disabled)
interval: 0
# timeout in seconds for the connection to a Docker node
timeout: 2.5
rfc2136:
# only nsupdate on entries which are different (do not update same data)
verify: false
# remove DNS entry if container is unreachable
remove: false
poll:
# polling all containers on a node every {n} seconds
interval: 300
ping:
# ping all nodes every {n} seconds to see if they are still online
interval: 10
tls:
# path for TLS certificates
ca: /labels/ssl/ca.crt
crt: /labels/ssl/server.crt
key: /labels/ssl/server.key
+232 -168
View File
@@ -1,212 +1,276 @@
process.once('SIGTERM', () => process.exit(0));
process.once('SIGINT', () => process.exit(0));
const Docker = require('dockerode');
const { fork } = require('node:child_process');
const fs = require('fs');
const yaml = require('js-yaml');
const redis = require('redis');
const { nsupdate } = require('./nsupdate');
const { dig } = require('./dig');
const { elevenLogJSON } = require('/labels/lib/util.js');
const ENV_REDIS_INTERVAL = parseInt(process.env?.LABELS_INTERVAL || 300);
const ENV_REDIS_TIMEOUT = parseInt(process.env?.LABELS_TIMEOUT|| 30);
const ENV_LABELS_WEBHOOK = process.env?.LABELS_WEBHOOK;
const ENV_LABELS_WEBHOOK_AUTH_BASIC = process.env?.LABELS_WEBHOOK_AUTH_BASIC;
const ENV_LABELS_RFC2136_ONLY_UPDATE_ON_CHANGE = process.env?.LABELS_RFC2136_ONLY_UPDATE_ON_CHANGE || false;
process
.on('unhandledRejection', (e, p) => {
elevenLogJSON('error', {unhandledRejection:e.toString()});
})
.on('uncaughtException', e => {
elevenLogJSON('error', {uncaughtException:e.toString()});
});
elevenLogJSON('info', {config:{
LABELS_INTERVAL :ENV_REDIS_INTERVAL,
LABELS_TIMEOUT:ENV_REDIS_TIMEOUT,
LABELS_WEBHOOK:ENV_LABELS_WEBHOOK,
LABELS_WEBHOOK_AUTH_BASIC:((ENV_LABELS_WEBHOOK_AUTH_BASIC) ? true: false),
LABELS_RFC2136_ONLY_UPDATE_ON_CHANGE:ENV_LABELS_RFC2136_ONLY_UPDATE_ON_CHANGE
}});
class Labels{
#docker;
#config = {webhook:{headers:{'Content-Type':'application/json'}}};
#workers = {};
#interval = {run:false, fok:false};
#redis;
#poll = false;
#webhook = {
headers:{'Content-Type':'application/json'}
};
constructor(){
this.#docker = new Docker({socketPath:'/run/docker.sock'});
if(ENV_LABELS_WEBHOOK_AUTH_BASIC){
this.#webhook.headers['Authorization'] = 'Basic ' + Buffer.from(ENV_LABELS_WEBHOOK_AUTH_BASIC).toString('base64')
const config = yaml.load(fs.readFileSync(`${process.env.APP_ROOT}/etc/config.yaml`, 'utf8'))?.labels;
this.#config.redis = {url:(config?.redis?.url || 'rediss://localhost:6379/0')};
this.#config.webhook.url = (config?.webhook?.url || null);
if(this.#config.webhook.url && config?.webhook?.auth?.basic){
this.#config.webhook.headers['Authorization'] = 'Basic ' + Buffer.from(config.webhook.auth.basic).toString('base64');
elevenLogJSON('info', `using webhook ${this.#config.webhook.url} with basic authentication`);
}
this.#config.rfc2136 = {verify:(config?.rfc2136?.verify || false), remove:(config?.rfc2136?.remove || false)};
this.#config.poll = {interval:(config?.poll?.interval || 300)};
this.#config.ping = {interval:(config?.ping?.interval || 2.5)};
this.#config.port = (config?.port || 2376);
this.#config.timeout = (config?.timeout || 5);
this.#config.interval = (config?.interval || 0);
this.#config.tls = {
ca:(config?.tls?.ca || `${process.env.APP_ROOT}/ssl/ca.crt`),
crt:(config?.tls?.crt || `${process.env.APP_ROOT}/ssl/labels.crt`),
key:(config?.tls?.key || `${process.env.APP_ROOT}/ssl/labels.key`),
};
if(this.#config.interval > 0){
elevenLogJSON('info', `${process.env.APP_ROOT}/etc/config.yaml will reload labels.nodes every ${this.#config.interval}s`);
}
}
async watch(){
async run(){
this.#redis = await redis.createClient({
url:process.env.LABELS_REDIS_URL,
url:this.#config.redis.url,
pingInterval:30000,
socket:{
rejectUnauthorized: false,
}
rejectUnauthorized:false,
},
disableOfflineQueue:false,
commandsQueueMaxLength:1024
});
this.#redis.connect();
this.#redis.on('ready', ()=>{
(async() => {
await this.dockerPoll();
})();
this.dockerEvents();
this.#redis.on('ready', async()=>{
elevenLogJSON('info', `connected to redis`);
this.#run();
if(this.#config.interval > 0){
setInterval(async ()=>{
if(!this.#interval.run){
this.#interval.run = true;
try{
await this.#run();
}catch(e){
elevenLogJSON('error', {error:e});
}finally{
this.#interval.run = false;
}
}
}, this.#config.interval*1000);
}
setInterval(async()=>{
if(!this.#interval.fork){
this.#interval.fork = true;
try{
await this.#fork();
}catch(e){
elevenLogJSON('error', {error:e});
}finally{
this.#interval.fork = false;
}
}
}, this.#config.ping.interval*1000);
});
this.#redis.on('error', error =>{
elevenLogJSON('error', error);
elevenLogJSON('error', {redis:error.toString()});
});
setInterval(async() => {
await this.dockerPoll();
}, ENV_REDIS_INTERVAL*1000);
this.#redis.connect();
}
dockerEvents(){
this.#docker.getEvents({}, (error, data) => {
if(error){
elevenLogJSON('error', error);
}else{
data.on('data', async(chunk) => {
const event = JSON.parse(chunk.toString('utf8'));
if(/Container/i.test(event?.Type) && /^(start|kill)$/i.test(event?.status)){
await this.dockerInspect(event.id, event.status);
}
});
}
});
}
async dockerPoll(){
if(!this.#poll){
try{
this.#poll = true;
this.#docker.listContainers((error, containers) => {
if(!error){
containers.forEach(async(container) => {
await this.dockerInspect(container.Id, 'poll');
});
}
});
}catch(e){
elevenLogJSON('error', e);
}finally{
this.#poll = false;
#run(){
const nodes = yaml.load(fs.readFileSync(`${process.env.APP_ROOT}/etc/config.yaml`, 'utf8'))?.labels?.nodes;
for(const node of nodes){
if(!this.#workers[node]){
this.#workers[node] = new Worker(this.#config, node, this);
this.#workers[node].fork();
elevenLogJSON('info', `created new worker for node [${node}]`);
}
}
}
async dockerInspect(id, status = null){
return(new Promise((resolve, reject) => {
const container = this.#docker.getContainer(id);
container.inspect(async(error, data) => {
if(!error){
const update = (/start|poll/i.test(status)) ? true : false;
const container = {
name:(data?.Name || data?.id).replace(/^\//i, ''),
event:status,
labels:{
traefik:[],
rfc2136:[],
},
};
const rfc2136 = {
WAN:{server:'', key:'', commands:[]},
LAN:{server:'', key:'', commands:[]},
}
elevenLogJSON('info', {container:container.name, event:status, method:'inspect'});
for(const label in data?.Config?.Labels){
switch(true){
case /traefik\//i.test(label):
if(update){
await this.#redis.set(label, data.Config.Labels[label], {EX:ENV_REDIS_INTERVAL + ENV_REDIS_TIMEOUT});
}else{
await this.#redis.del(label);
}
container.labels.traefik[label] = data.Config.Labels[label];
break;
case /rfc2136\//i.test(label):
container.labels.rfc2136[label] = data.Config.Labels[label];
const type = ((label.match(/rfc2136\/WAN\//i)) ? 'WAN' : 'LAN');
switch(true){
case /rfc2136\/\S+\/server/i.test(label):
rfc2136[type].server = data.Config.Labels[label];
break;
case /rfc2136\/\S+\/key/i.test(label):
rfc2136[type].key = data.Config.Labels[label];
break;
default:
if(!update){
data.Config.Labels[label] = data.Config.Labels[label].replace(/update add/i, 'update delete');
}
rfc2136[type].commands.push(data.Config.Labels[label]);
}
break;
}
}
for(const type in rfc2136){
if(rfc2136[type].commands.length > 0 && rfc2136[type].server && rfc2136[type].key){
if(ENV_LABELS_RFC2136_ONLY_UPDATE_ON_CHANGE){
for(let i=0; i<rfc2136[type].commands.length; i++){
if(await this.rfc2136KnownRecord(rfc2136[type].server, rfc2136[type].commands[i])){
rfc2136[type].commands.splice(i, 1);
}
}
}
try{
if(rfc2136[type].commands.length > 0){
elevenLogJSON('info', {container:container.name, event:status, method:`nsupdate ${rfc2136[type].server}`});
await nsupdate(rfc2136[type].server, rfc2136[type].key, rfc2136[type].commands);
}else{
if(ENV_LABELS_RFC2136_ONLY_UPDATE_ON_CHANGE){
elevenLogJSON('info', {container:container.name, event:status, method:`nsupdate ${rfc2136[type].server} skipped due to same record data`});
}
}
}catch(e){
elevenLogJSON('error', e);
}
}
}
if(ENV_LABELS_WEBHOOK){
try{
await fetch(ENV_LABELS_WEBHOOK, {method:(
(update) ? 'PUT' : 'DELETE'
), body:JSON.stringify(container), headers:this.#webhook.headers, signal:AbortSignal.timeout(2500)});
}catch(e){
elevenLogJSON('error', {method:'fetch(webhook)', error:e});
}
}
resolve(true);
async #fork(){
for(const node in this.#workers){
if(!this.#workers[node].run){
await this.#workers[node].fork();
if(!this.#workers[node].log.disconnect){
this.#workers[node].log.disconnect = true;
elevenLogJSON('info', `trying to fork existing worker for node [${node}] after disconnect`);
}
});
}));
}
}
}
async rfc2136KnownRecord(server, nsupdate){
async inspect(container){
try{
const counter = {
add:0,
del:0,
};
const rfc2136 = {
WAN:{server:'', key:'', commands:[]},
LAN:{server:'', key:'', commands:[]},
}
for(const label in container.labels){
switch(true){
case /traefik\//i.test(label):
if(container.start){
counter.add++;
await this.#redis.set(label, container.labels[label], {EX:this.#config.poll.interval + 30});
}else{
counter.del++;
await this.#redis.del(label);
}
break;
case /rfc2136\//i.test(label):
const type = ((label.match(/rfc2136\/WAN\//i)) ? 'WAN' : 'LAN');
switch(true){
case /rfc2136\/\S+\/server/i.test(label):
rfc2136[type].server = container.labels[label];
break;
case /rfc2136\/\S+\/key/i.test(label):
rfc2136[type].key = container.labels[label];
break;
default:
if(!container.start && this.#config.rfc2136.remove){
container.labels[label] = container.labels[label].replace(/update add/i, 'update delete');
}
rfc2136[type].commands.push(container.labels[label]);
}
break;
}
}
if(rfc2136.LAN.commands.length > 0 || rfc2136.WAN.commands.length){
await this.#rfc2136(rfc2136);
}
if(this.#config?.webhook?.url){
await this.#webhook(container);
}
}catch(e){
elevenLogJSON('error', {inspect:e.toString(), exception:e});
}
}
async #rfc2136(rfc2136){
for(const type in rfc2136){
if(rfc2136[type].commands.length > 0 && rfc2136[type].server && rfc2136[type].key){
if(this.#config.rfc2136.verify){
for(let i=0; i<rfc2136[type].commands.length; i++){
if(await this.#rfc2136knownRecord(rfc2136[type].server, rfc2136[type].commands[i])){
rfc2136[type].commands.splice(i, 1);
}
}
}
try{
if(rfc2136[type].commands.length > 0){
await nsupdate(rfc2136[type].server, rfc2136[type].key, rfc2136[type].commands);
}
}catch(e){
elevenLogJSON('error', {nsupdate:{exception:e.toString()}});
}
}
}
}
async #rfc2136knownRecord(server, nsupdate){
const matches = nsupdate.match(/update add (\S+) \d+ (\S+) (\S+)/i);
if(matches && matches.length >= 4){
try{
const record = await dig(server, matches[2], matches[1]);
const match = (
(record.match(new RegExp(matches[3], 'ig'))) ? true : false
);
elevenLogJSON('debug', {method:'rfc2136KnownRecord()', params:{server:server, nsupdate:nsupdate}, match:{A:record, B:matches[3], match:match}});
return(match);
return((record.match(new RegExp(matches[3], 'ig'))));
}catch(e){
elevenLogJSON('error', e);
return(false);
}
}
}
async #webhook(container){
try{
await fetch(this.#config.webhook.url, {method:(
(container.start) ? 'PUT' : 'DELETE'
), body:JSON.stringify(container), headers:this.#config.webhook.headers, signal:AbortSignal.timeout(2500)});
}catch(e){
elevenLogJSON('error', {webhook:{exception:e.toString()}});
}
}
}
new Labels().watch();
class Worker{
run = false;
#fork;
#config;
#parent;
log = {
disconnect:false,
}
constructor(config, node, parent){
this.#config = {
tls:config.tls,
poll:config.poll.interval,
ping:config.ping.interval,
port:config.port,
node:node,
};
this.#parent = parent;
}
async fork(){
return(new Promise((resolve, reject) => {
this.#fork = fork(`${process.env.APP_ROOT}/worker.js`, [JSON.stringify(this.#config)], {stdio: 'inherit'});
this.#fork.on('spawn', () =>{
this.run = true;
resolve();
});
this.#fork.on('error', () =>{
this.run = false;
reject();
});
this.#fork.on('close', (code) =>{
this.run = false;
});
this.#fork.on('message', (message) =>{
if(message.error){
if(!this.log.disconnect){
elevenLogJSON('error', {fork:message.error});
}
}else{
this.run = true;
this.log.disconnect = false;
if(message?.labels){
this.#parent.inspect.apply(this.#parent, [message]);
}
}
});
}));
}
}
new Labels().run();
+149
View File
@@ -0,0 +1,149 @@
const fs = require('fs');
const Docker = require('dockerode');
const args = process.argv.slice(2);
process
.on('unhandledRejection', (e, p) => {
console.error(e, p);
process.send({error:e.toString()});
})
.on('uncaughtException', e => {
console.error(e);
process.send({error:e.toString()});
});
class Worker{
#config;
#docker;
#interval = {poll:false, ping:false};
constructor(config){
this.#config = config;
this.#docker = new Docker({
protocol:'https',
host:this.#config.node,
port:this.#config.port,
ca:fs.readFileSync(this.#config.tls.ca),
cert:fs.readFileSync(this.#config.tls.crt),
key:fs.readFileSync(this.#config.tls.key),
timeout:parseInt(this.#config.timeout*1000)
});
}
async run(){
try{
this.#docker.getEvents({}, (error, data) => {
if(!error){
data.on('data', async(chunk) =>{
const response = chunk.toString('utf8').replace(',"ti"', '');
try{
const event = JSON.parse(response);
if(/Container/i.test(event?.Type) && /^(start|die)$/i.test(event?.status)){
this.#labels(event.id, event.status);
}
}catch(e){
//JSON parse error
}
});
}else{
process.send({error:error.toString()});
}
});
setInterval(async()=>{
if(!this.#interval.poll){
this.#interval.poll = true;
try{
await this.#poll();
}catch(e){
process.send({error:e.toString()});
}finally{
this.#interval.poll = false;
}
}
}, this.#config.poll*1000);
setInterval(async()=>{
if(!this.#interval.ping){
this.#interval.ping = true;
try{
await this.#ping();
}catch(e){
process.send({error:e.toString()});
}finally{
this.#interval.ping = false;
}
}
}, this.#config.ping*1000);
await this.#ping();
await this.#poll();
}catch(e){
process.send({error:e.toString()});
}
}
async #poll(){
try{
await this.#docker.listContainers((error, containers) => {
if(!error){
containers.forEach(async(container) => {
this.#labels(container.Id, 'poll');
});
}else{
process.send({error:e.toString()});
}
});
}catch(e){
process.send({error:e.toString()});
}
}
async #ping(){
try{
await this.#docker.ping();
}catch(e){
process.exit(1);
}
}
async #labels(id, event){
try{
const container = this.#docker.getContainer(id);
container.inspect(async(error, data) => {
if(!error){
const result = {
name:(data?.Name || data?.id).replace(/^\//i, ''),
event:event,
labels:{},
start:(/start|poll/i.test(event)) ? true : false,
worker:{
node:this.#config.node,
port:this.#config.port
},
};
for(const label in data?.Config?.Labels){
if(/traefik\/|rfc2136\//i.test(label)){
result.labels[label] = data.Config.Labels[label];
}
}
process.send(result);
}else{
throw(error);
}
});
}catch(e){
process.send({error:e.toString()});
}
}
}
if(Array.isArray(args) && args.length > 0){
try{
new Worker(JSON.parse(args)).run();
}catch(e){
process.send({error:e.toString()});
process.exit(1);
}
}