Data Driven Systems and IoT solutions

IMA needed software capable of handling a high-speed binary data stream from a line optical sensor. The system had to process data in real-time, provide analysis and filtering, trigger alert mechanisms, and transmit information to a web dashboard for visualization and configuration. The measurements, amounting to approximately 10,000 samples per second, required an infrastructure capable of managing large amounts of data quickly and reliably, while ensuring an effective and customizable user interface.

A data-driven software solution was developed to perform measurements, analysis, and alerts tailored to the data obtained from the laser sensor. The sensor measures the distance of material on a conveyor belt, generating a list of numerical values processed in real-time. The server, implemented in Go, handles data ingestion, sensor control via TCP, communication with a web dashboard through REST APIs and WebSockets, and a configurable alerting system. The dashboard allows real-time graph visualization and settings adjustments, providing an intuitive and responsive user experience.

The software leverages Go for the backend and data analysis, with concurrent data flow management using synchronized channels. MongoDB is used for storing samples and user settings. The web frontend is developed with Svelte, while Prometheus and Grafana are employed for internal telemetry and monitoring. This combination of technologies ensures high performance, scalability, and ease of use for the system.