Currently, I'm engaged in a project involving my Raspberry Pi that focuses on a sensor collecting data continuously. My objective is to save this data in a specific format such as SQL, CSV, JSON, or any other suitable option, and then present it visually on a basic page using D3.js.
I've considered several approaches, including utilizing SQLite or MySQL to develop a database and retain the data. Subsequently, I may convert this SQL database into a JSON or CSV file for displaying purposes. However, I'm still seeking an effective solution for storing, converting (if required), and presenting the data dynamically without consuming excessive resources or time.
Could someone point me in the right direction?