CI/CD / Development / Kubernetes / Sponsored / Contributed

How to Use InfluxDB with Its Python Client on Kubernetes

22 Dec 2020 12:00pm, by

InfluxData sponsored this post.

Saiyam Pathak
Saiyam is the Director of Technical Evangelism at Civo.

In this tutorial, we will discuss InfluxDB and its Python client. We will deploy InfluxDB inside a Kubernetes cluster and then use the InfluxDB Python client to send data to InfluxDB.

What you will learn?

  • How to deploy InfluxDB to a Kubernetes cluster (quickstart way).
  • How to use the InfluxDB Python client.

Prerequisites

  • A Kubernetes cluster you control. We’ll take advantage of Civo’s super-fast managed K3s service to experiment with this quickly. If you don’t yet have an account, sign up for the beta now to take advantage of quick deployment times and $70 free credit per month. Alternatively, you could also use any other Kubernetes cluster.
  • Install and set up kubectl, and have the kubeconfig file for your cluster downloaded.

Make sure you can connect to your Kubernetes cluster by running:

You should see the names of the nodes in your cluster displayed.

Getting Up and Running with InfluxDB

Clone the repository: https://github.com/saiyam1814/pyconf.git

The above script creates the Namespace, StatefulSet and service for InfluxDB version 2.0.1.

Now we will create the ingress, and for that, we will modify the ing.yaml file and input the DNS name of the created cluster. You can get the DNS name from the dashboard.

In the host section of ing.yaml, point to influx.{DNS NAME}.

Navigate to the HOST ADDRESS:

Now, in the Advanced section from the Token, select and copy the generated token — as that would be required for connecting to InfluxDB via the Python client.

Next Steps

Create Kubernetes Secret from the Token 

Create Config Map for the Ingress HOST Address

Create the Daemonset from the Deploy Folder

Viewing from InfluxDB UI

Understanding the Connection and Writing Points to InfluxDB via Its Python Client

  • Import influxdb-client.
  • Org: Corresponds to the org where data has to be pushed.
  • Bucket: Corresponds to the bucket where data has to be pushed.
  • Client: The connection created by proving the host and the token.
  • Freemem: To get free memory of the host in Gb.
  • client.write_api for writing to InfluxDB.
  • Point: The actual point that will be creating measurement free_mem, tag host and field free_mem_Gb.
  • write_api.write(bucket,org,point)for the insertion to the Db.
  • Last section makes it run every 5 seconds.

Use Cases

You might have certain scripts that would capture some data, or do some level of processing and then create the data, which can then be sent via the Python client to InfluxDB (for this particular use case). There are a lot of client libraries that are supported and can be used to send the data.

Summary

We have seen how to deploy InfluxDB on an existing K3s Kubernetes cluster. Use the Python client to write data to InfluxDB, and then view the data from InfluxDB UI.

Feature image via Pixabay.

A newsletter digest of the week’s most important stories & analyses.