Data Mediation

One key feature provided by CemTore is early Device Data Mediation.
Low-Power Wide-Area Network (LPWAN) imposes devices to send data in a way that save bandwidth as much as possible. Most of the time, device’s data payloads are a flow of bytes that are not understandable unless a first pass processing is done.

Classical IOT platform use to store device payload as is into data lakes. In order to extract value from those data, the data warehouse must process it first by executing decoding tasks on each entry before being able to propose consolidated data for analytics. The way device data is decoded is left to the warehouse manager, which has to select which decoder to use according to many parameters:

• Device firmware version
• Sensors plugged into device
• Sensor location

Data lakes stores Terabytes of incomprehensible data which is useless in one point.

CemTore proposes to ease this workflow by doing early Data Mediation before storing data to data lake or even store data directly in the data warehouse.

CemTore has a catalog of supported devices profiles which allow it’s internal engines to decode device data on the fly and propose plain text document that are easy to read and integrate into any data warehouse, saving computing resources in next parts of the workflow.

Device Profiles acts as containers that encapsulates a description of the device, a data decoder for uplink message direction, a data encoder for transmitting data to devices (downlink) and a list of sensors plugged into it.

When user provision a device using CemTore, he must select it from a device profile catalog and choose if CemTore will decode every message before forwarding to the storage server of its choice (Applications).

CemTore Application is developped with simplicity as a main guideline. It’s very easy to provision a LoRaWAN device, fill in the form some ids and keys and select application such as MQTT, MongoDB or AWS DynamoDB where data will be forwarded in a human readable format that’s very close to the device purpose.