Use Node-RED to fetch JSON or CSV data and store it in InfluxDB

Question

Use Node-RED to fetch JSON or CSV data and store it in InfluxDB

Versions

Node-RED v0.16.2
InfluxDB v1.2.2
Grafana v4.2.0
Ubuntu 16.04.2

I'm looking to access weather data from a local official weather station. The options available are in either csv or JSON format.

I am attempting to retrieve the JSON feed using Node-RED.
Using an HTTP request node, I managed to obtain parsed JSON data.

The retrieved data is structured as follows:

object

observations: object
- notice: array[1]
- 0: object
  - copyright: "Copyright Commonwealth of Australia 2017, Bureau of Meteorology. For more information see: urlhere urlhere"
  - copyright_url: "urlhere"
  - disclaimer_url: "urlhere"
  - feedback_url: "urlhere"
- header: array[1]
- 0: object
  - refresh_message: "Issued at 9:32 pm EST Tuesday 2 May 2017"
  - ID: "IDV60801"
  - main_ID: "IDV60800"
  - name: "Moorabbin Airport"
  - state_time_zone: "VIC"
  - time_zone: "EST"
  - product_name: "Weather Observations"
  - state: "Victoria"
- data: array[155]
- [0 … 9]
  - 0: object

To isolate and extract only the data: array, I used a function node called "Extract Value" containing the following code:


msg.payload = msg.payload.observations.data[0]
return msg;

The output object generated by this function contains relevant weather data fields.

Upon attempting to store this data into InfluxDB, an error occurred due to invalid number parsing.

Inserting a JSON node before saving to InfluxDB yielded successful debug output but resulted in no values being visible within Grafana charts or tables.

Your assistance is needed on the best approach to fetch data from the specified website and effectively display it graphically via Grafana after storing it in InfluxDB.

javascript json csv node-red

Answer 1

Answer №1

Here is a suggestion for you to consider:

try implementing the following code snippet:
  return {
    payload: {
      info : message.payload.list.item[0]
    }
  };

Answer 2

Here is a suggestion for you to consider:

try implementing the following code snippet:
  return {
    payload: {
      info : message.payload.list.item[0]
    }
  };

Use Node-RED to fetch JSON or CSV data and store it in InfluxDB

Answer №1

Similar questions

Can you clarify the concept of closures and how they bind the loop counter to the function scope?

Serializing a JsonElement field using JAXB in a POJO

Stop Browsers from Saving the Current Page in the History Log

javascript: extracting class name from HTML elements

Minimize the number of HTTP requests by including CSS and JS files in PHP

What is the return value of the .pipe() method in gulp?

Importing ReactDOM alone does not result in the rendering of anything

Ensuring the cookie remains active throughout various subdomains

Loop through each object and add them to an array in a file using NodeJS

How to isolate a function in React when mapping data

The process of retrieving keys and values from localStorage in html5

Transform the terraform resource data, which is in the form of a map containing keys of type string

What methods can be used to test included content in Angular?

Make Fomantic-UI (Angular-JS) sidebar scroll independently

What causes the "node: bad option" error to occur when I include a custom flag in the nodejs command line within an Angular 9 application?

Dealing with functions that may not consistently return a promise

"Enhance your Material-UI ListItems with dynamic ripple colors when using React-Router NavLink

Ensuring the accuracy of nested objects through class validator in combination with nestjs

Retrieving data arrays from response.json

Can you create a while loop that continuously asks for user input, stores the responses, and then makes them accessible in an array?