Coordinate Mapping Between Optical and Thermal Sensor Arrays with NumPy
Back in 2022 I worked on a project with an ESP32 board with two sensors - an OV2640 optical camera and an MLX90640 low-resolution thermal sensor. The camera will give an MJPEG stream, and the thermal sensor returned a 32 x 24 array of temperatures on every HTTP request. On the server side, a Python app read the stream with OpenCV, ran a TensorFlow Lite object detection model on each frame, and showed the result in a small Flask UI. See the YouTube video i uploaded ...