Create a working IoT Project – Apache Kafka, Python, GridDB

This course aims to teach you about building an IoT platform with a real-life, hands-on project!

We will begin by utilizing GridDB to create an IoT project which will simulate data from IoT Sensors, stream that data through Kafka, sent to GridDB, and then utilized in a variety of ways, including a real-time data visualizer. The data visualizer will be made up from node.js.

In the first parts of the course, we will delve into what Docker is and how it ties into this project; in our case, we have containerized all different aspects of the project to be able to easily share everything, with the added benefit of teaching more about using docker in conjunction with Kafka, GridDB, Jupyter Notebook, etc.

Next, we will talk about Kafka (outside of the context of Docker), what it is, what it does, and how it ties into ours and other IoT projects’ workflows. In our case, Kafka handles data streaming from sensors to GridDB, adding reliability, stability, and robustness. From there, we talk about how to build a small python script to be simulate an IoT gateway, which teaches how to send data from somewhere, through Kafka and finally through to GridDB.

After that, we go through and discuss using java to code an bill report-generation application which pulls all data from our database. Next up is data visualization: we will introduce the GERN stack and show you how to query data from GridDB using nodejs to create real-time data charts.

And lastly we will showcase using Python and jupyter to do some data analysis of your GridDB data.