Is there a way to access and read all JSON files within a directory in a Meteor application?

Question

Is there a way to access and read all JSON files within a directory in a Meteor application?

Is there a way to read all JSON files within a folder in my Meteor application?

This is the structure I currently have:

/server  
-- /methods  
-- -- file1.json  
-- -- file2.json

I've attempted to read all JSON files using this code snippet:

var fs = Npm.require('fs');
var path = Npm.require('path');
var base = path.resolve('.');

try {
    var files = fs.readdirSync(base + '/methods/*.json');
    console.log(files);
} catch (e) {
    console.dir(e)
}

However, I am encountering an error stating that the directory or file does not exist.

Am I missing something here? Or perhaps there is an alternative method to achieve this task? Any guidance would be appreciated.

javascript json meteor npm fs

Answer 1

Answer №1

Before proceeding, it's important to exercise caution when determining the root of Meteor's project, as the results yielded by path.resolve('.') or process.env.PWD can vary across different deployment configurations.

Additionally, when using the path argument in fs.readdirSync(path), it must specify a directory. Therefore, a correct invocation would be

var files = fs.readdirSync(base + '/server/methods/');

.

Nevertheless, I suggest utilizing Assets. Simply relocate your JSON files to the private directory and access them on the server through

Assets.getText(assetPath, [asyncCallback])

or

Assets.getBinary(assetPath, [asyncCallback])

.

For instance:

if (Meteor.isServer) {
    Meteor.startup(function() {
        var example1 = JSON.parse(Assets.getText('methods/example1.json'));
        var example2 = JSON.parse(Assets.getText('methods/example2.json'));
        console.log(example1);
        console.log(example2);
    });
}

...and so forth... Assuming that your project structure resembles:

project-root
├── .meteor
├── server
├── private
│   └── methods
│       └── example1.json
│       └── example2.json
└── …

Answer 2

Before proceeding, it's important to exercise caution when determining the root of Meteor's project, as the results yielded by path.resolve('.') or process.env.PWD can vary across different deployment configurations.

Additionally, when using the path argument in fs.readdirSync(path), it must specify a directory. Therefore, a correct invocation would be

var files = fs.readdirSync(base + '/server/methods/');

.

Nevertheless, I suggest utilizing Assets. Simply relocate your JSON files to the private directory and access them on the server through

Assets.getText(assetPath, [asyncCallback])

or

Assets.getBinary(assetPath, [asyncCallback])

.

For instance:

if (Meteor.isServer) {
    Meteor.startup(function() {
        var example1 = JSON.parse(Assets.getText('methods/example1.json'));
        var example2 = JSON.parse(Assets.getText('methods/example2.json'));
        console.log(example1);
        console.log(example2);
    });
}

...and so forth... Assuming that your project structure resembles:

project-root
├── .meteor
├── server
├── private
│   └── methods
│       └── example1.json
│       └── example2.json
└── …

Answer 3

Answer №2

After referring to Matthias Eckhart's answer, I created a method that reads and converts all csv files within a specified folder into JSON format. This method then returns the data as an object with a child object representing each csv file. Sharing it here in case it proves helpful to others: encountering some challenges while handling Assets and methods, especially during csv to JSON conversion.

import CSVToJSON from 'csvtojson';

if (Meteor.isServer) {
    const retrieveFilenames = (options, callback) => {
        // accessing contents of the 'private/parameters' directory
        const { exec } = Npm.require('child_process');

        // filtering out directories from the results of "ls -m" command before loading files
        exec('ls -m assets/app/parameters | tr -d \' \n\' ', Meteor.bindEnvironment((error, stdout, stderr) => {
            if (error !== null) {
                console.log(`Error in retrieveFilenames: ${error}`);
            }
            const filenames = stdout.split(',');
            callback(null, filenames);
        }));
    };

    Meteor.methods({
        'loadParameters'() {
            const syncFunc = Meteor.wrapAsync(retrieveFilenames);
            const filenames = syncFunc({});

            const promises = [];
            const filesData = [];

            filenames.forEach((filename) => {
                if (filename.split('.').pop() === 'csv') {
                    filesData.push(Assets.getText(`parameters/${filename}`));
                }
            });

            filesData.forEach((data) => {
                promises.push(CSVToJSON().fromString(data));
            });

            return Promise.all(promises)
                .then((results) => {
                    const parameters = {};

                    results.forEach((result) => {
                        const data = result[0];
                        const parameter = { ...data };
                        delete parameter.propertyName;
                        parameters[data.propertyName] = parameter;
                    });

                    return parameters;
                });
        },
    });
}

Answer 4

After referring to Matthias Eckhart's answer, I created a method that reads and converts all csv files within a specified folder into JSON format. This method then returns the data as an object with a child object representing each csv file. Sharing it here in case it proves helpful to others: encountering some challenges while handling Assets and methods, especially during csv to JSON conversion.

import CSVToJSON from 'csvtojson';

if (Meteor.isServer) {
    const retrieveFilenames = (options, callback) => {
        // accessing contents of the 'private/parameters' directory
        const { exec } = Npm.require('child_process');

        // filtering out directories from the results of "ls -m" command before loading files
        exec('ls -m assets/app/parameters | tr -d \' \n\' ', Meteor.bindEnvironment((error, stdout, stderr) => {
            if (error !== null) {
                console.log(`Error in retrieveFilenames: ${error}`);
            }
            const filenames = stdout.split(',');
            callback(null, filenames);
        }));
    };

    Meteor.methods({
        'loadParameters'() {
            const syncFunc = Meteor.wrapAsync(retrieveFilenames);
            const filenames = syncFunc({});

            const promises = [];
            const filesData = [];

            filenames.forEach((filename) => {
                if (filename.split('.').pop() === 'csv') {
                    filesData.push(Assets.getText(`parameters/${filename}`));
                }
            });

            filesData.forEach((data) => {
                promises.push(CSVToJSON().fromString(data));
            });

            return Promise.all(promises)
                .then((results) => {
                    const parameters = {};

                    results.forEach((result) => {
                        const data = result[0];
                        const parameter = { ...data };
                        delete parameter.propertyName;
                        parameters[data.propertyName] = parameter;
                    });

                    return parameters;
                });
        },
    });
}

Is there a way to access and read all JSON files within a directory in a Meteor application?

Answer №1

Answer №2

Similar questions

The process of querying two MySQL tables simultaneously in a Node.js environment using Express

Troubleshooting Problems with Google Maps and Javascript/JSON in Internet Explorer

Generate a random 8-digit number with a specific range in JavaScript

What is the process for locating the src value of an image that has been uploaded utilizing fileReader?

A recursive approach for constructing a tree structure in Angular

Troubleshooting issue with C# Ajax success response not triggering alert

What is the best way to pass a bind value in an Angular function controller?

Exploring Angular controllers, promises, and testing

exchange the class using only JavaScript

Encountering issues while creating a basic digital clock webpage using React

Is a 'Virtual DOM' included in React Native's architecture?

Constructing a basic electrical circuit with the help of Three.JS

What are some tactics for avoiding movement in the presence of a border setting?

Angular renders HTML elements

Angular 12: Running ng test shows code coverage error - TypeError: Unable to access 'initialize' property as undefined

Create a CSS menu that centers the links

Utilize Python to search and substitute text in numerous CSV files

How to Convert Blob/Varbinary to an Image on Android devices

Responsive menu not collapsing properly and appearing funky in Drupal

Run Javascript code if a specific CSS class is present on an element