Skip to main content

Microservice Registry and Catalog Management

During the Quickstart and the tutorial, we specified images to be used for each microservice, for each type of Agent.

That was nice and easy, but what if we need to deploy the same code on a lot of Agents? We would need to specify the images for each Microservice. Wouldn't it be nice to have a way to specify the images to be used for each type of Agent once and then reuse this configuration? That's where the Controller Microservice catalog comes into play!

Each ioFog Controller comes with a built-in microservice catalog. You can see the list of preconfigured Microservices images using potctl:

potctl get catalog
NAMESPACE
default

ID NAME DESCRIPTION REGISTRY X86 ARM
4 Diagnostics 0 remote iofog/diagnostics iofog/diagnostics-arm
5 Hello Web Demo A simple web server to test Eclipse ioFog. remote iofog/hello-web iofog/hello-web-arm
6 Open Weather Map Data A stream of data from the Open Weather Map API in JSON format remote iofog/open-weather-map iofog/open-weather-map-arm
7 JSON REST API A configurable REST API that gives JSON output remote iofog/json-rest-api iofog/json-rest-api-arm
8 Temperature Converter A simple temperature format converter remote iofog/temperature-conversion iofog/temperature-conversion-arm
9 JSON Sub-Select Performs sub-selection and transform operations on any JSON messages remote iofog/json-subselect iofog/json-subselect-arm
10 Humidity Sensor Simulator Humidity Sensor Simulator for Eclipse ioFog remote iofog/humidity-sensor-simulator iofog/humidity-sensor-simulator-arm
11 Seismic Sensor Simulator Seismic Sensor Simulator for Eclipse ioFog remote iofog/seismic-sensor-simulator iofog/seismic-sensor-simulator-arm
12 Temperature Sensor Simulator Temperature Sensor Simulator for Eclipse ioFog remote iofog/temperature-sensor-simulator iofog/temperature-sensor-simulator-arm
13 Common Logging Container which gathers logs and provides REST API for adding and querying logs from containers remote iofog/common-logging iofog/common-logging-arm
14 JSON Generator Container generates ioMessages with contentdata as complex JSON object. remote iofog/json-generator iofog/json-generator-arm

Instead of specifying the images for each Agent type, we can refer to catalog ID in your Microservice specification. We can see that there is a Hello Web Demo catalog item that is configured with the iofog/hello-web image for x86 Agents, and iofog/hello-web-arm for ARM Agents. So, to deploy a Microservice running those images, we can use the following YAML:

echo "---
apiVersion: 'datasance.com/v3'
kind: Application
metadata:
name: hello-web
spec:
---
apiVersion: 'datasance.com/v3'
kind: Microservice # Or application, as application uses the same spec for its microservices
metadata:
name: hello-web
spec:
agent:
name: my-agent-name
config: {}
images:
catalogId: 5
container:
env: []
ports: []
rootHostAccess: true
volumes: []
commands: []
config: {}
application: hello-web
" > /tmp/hello-web-catalog.yaml
potctl deploy microservice -f /tmp/hello-web-catalog.yaml

Note that this YAML snippet assumes we have a running ECN in the current Namespace with an Agent called my-agent-name.

We can check that the expected images have been used by describing our Microservice with iofogct:

potctl describe microservice hello-web
apiVersion: datasance.com/v3
kind: Microservice
metadata:
name: hello-web
namespace: default
spec:
uuid: KrbbKDg7bFdzFtBkBgZX8jDWnvFZbbZD
name: hello-web
agent:
name: staging-caas-edgeworx-io-lkrcal023
config:
dockerUrl: unix:///var/run/docker.sock
diskLimit: 50
diskDirectory: /var/lib/iofog-agent/
memoryLimit: 4096
cpuLimit: 80
logLimit: 10
logDirectory: /var/log/iofog-agent/
logFileCount: 10
statusFrequency: 10
changeFrequency: 10
deviceScanFrequency: 60
bluetoothEnabled: false
watchdogEnabled: false
abstractedHardwareEnabled: false
images:
catalogId: 5
x86: iofog/hello-web
arm: iofog/hello-web-arm
registry: remote
container:
volumes: []
env: []
ports: []
rootHostAccess: true
config: {}
application: hello-web

Create our own Catalog Items

We can also use potctl to create our own Catalog Items. The YAML spec reference can be found here.

echo "---
apiVersion: 'datasance.com/v3'
kind: CatalogItem
metadata:
name: 'my-multiplatform-microservice'
spec:
description: 'Alpine Linux'
x86: 'amd64/alpine:latest'
arm: 'arm32v6/alpine:latest'
registry: 'remote'

" > /tmp/my-catalog-item.yaml
potctl deploy -f /tmp/my-catalog-item.yaml

We can verify that our new Catalog Item was added to the Catalog:

potctl get catalog | grep my-multiplatform-microservice
17		my-multiplatform-microservice	Alpine Linux											remote		amd64/alpine:latest			arm32v6/alpine:latest

We used grep to filter the ouput, but the columns are the same as above. You can now use the spec.images.catalogId field on Microservice kind set to 17 in order to deploy you microservice.

Registries

During the tutorial, we saw that the images are being pulled from a repository specified in the YAML. The two values we have used so far are remote (public docker hub) and local (image locally present on the Agent). There is a third value available, which is a repository ID.

NB: remote and local are aliases for values 1 and 2, which are the repository seeded in your Controller database.

We can list our current registries using potctl get registries

ID              URL                     USERNAME        PRIVATE         SECURE
1 registry.hub.docker.com false true
2 from_cache false true

We can add a new registry using the Registry deploy kind

echo "---
apiVersion: datasance.com/v3
kind: Registry
spec:
url: registry.hub.docker.com # This will create a registry that can download your private docker hub images
username: john
password: q1u45ic9kst563art
email: user@domain.com
" > /tmp/my-private-registry.yaml
potctl deploy -f /tmp/my-private-registry.yaml

After running this, you should now have 3 registries and you can use the ID in the microservice images registry field