Extract certain attributes from a Json file and create a new Json dataset

Question

Extract certain attributes from a Json file and create a new Json dataset

My WordPress website has an API that exports posts as a Json file. I am working on a new website that will use this data, but I need to reformat the Json file with my custom property names and exclude some properties. Here is an example of the Json output from a post:

{
  "status": "ok",
  "post": {
    "id": 2335,
    "type": "post",
    "slug": "litoral-awards14-no-jornal-diario-porto-canal",
    "url": "https:\/\/litoralmagazine.com\/litoral-awards14-no-jornal-diario-porto-canal\/",
    ...
   }
}

I want to create a script that transforms this Json into a new format like below:

{
  "status": "ok",
  "slug": "litoral-com-teste-noticia-url",
  "title": "Titulo de teste",
  "type": "post",
  ...
   }
}

For instance: originalJson.status = newJson.status, originalJson.author.id = newJson.author, originalJson.thumbnail.url = newJson.images.thumbnail_image.

In the original Json, the 'content' property contains HTML code which I want to remove when creating the new Json. How can I achieve this?

I have searched for solutions but haven't found any. Is there a JavaScript script that can take the old Json input and output a new Json file with customized properties as described above?

Any help or suggestions would be greatly appreciated. Thank you!

javascript json web-scraping

Answer 1

Answer №1

When dealing with a valid HTML string, you have the option to utilize this specific function for text extraction:

function extractText(selector, html) {
  const elem = document.createElement('div');
  elem.innerHTML = html;

  return elem.querySelector(selector).innerText;
}

To implement this function, follow these steps:

const extractedText = extractText('p.some-selector', "<div id=\"some_id\">...");
// The extracted text will now be available for further use

It is important to note that if the selector does not locate any elements within the HTML, an error will occur. It is advisable to manage this scenario appropriately.

Answer 2

When dealing with a valid HTML string, you have the option to utilize this specific function for text extraction:

function extractText(selector, html) {
  const elem = document.createElement('div');
  elem.innerHTML = html;

  return elem.querySelector(selector).innerText;
}

To implement this function, follow these steps:

const extractedText = extractText('p.some-selector', "<div id=\"some_id\">...");
// The extracted text will now be available for further use

It is important to note that if the selector does not locate any elements within the HTML, an error will occur. It is advisable to manage this scenario appropriately.

Answer 3

Answer №2

When tackling your initial inquiry without specifying the dynamically desired fields, you can enhance readability with this approach:

newJson = { 
    status: oldJson.status,
    author: oldJson.author
}

In response to your second question: To eliminate the div elements, consider these methods:

Utilize the replace function to substitute <div and ></div with an empty string
Iterate through the string to locate the first-next occurrence of index of <div and the subsequent index of >, then utilize substring to extract the string in between.

Exploring alternate avenues for fetching the html data before resorting to string manipulation is advisable from my standpoint.

Answer 4

When tackling your initial inquiry without specifying the dynamically desired fields, you can enhance readability with this approach:

newJson = { 
    status: oldJson.status,
    author: oldJson.author
}

In response to your second question: To eliminate the div elements, consider these methods:

Utilize the replace function to substitute <div and ></div with an empty string
Iterate through the string to locate the first-next occurrence of index of <div and the subsequent index of >, then utilize substring to extract the string in between.

Exploring alternate avenues for fetching the html data before resorting to string manipulation is advisable from my standpoint.

Answer 5

Answer №3

give it a go:

const textString = { "status": "ok", "post": { "id": 2335, "categories": [ { "id": 299, "slug": "litoral-awards", "title": "Litoral Awards", "description": "", "parent": 0, "post_count": 91 }, ], }, "previous_url": "", "next_url": "" };

let statusValue = textString.status;
let postContent = textString.post;
let previousLink = textString.previous_url;
let nextLink = textString.next_url;
console.log('info:', textString.post.categories[0]);

Answer 6

give it a go:

const textString = { "status": "ok", "post": { "id": 2335, "categories": [ { "id": 299, "slug": "litoral-awards", "title": "Litoral Awards", "description": "", "parent": 0, "post_count": 91 }, ], }, "previous_url": "", "next_url": "" };

let statusValue = textString.status;
let postContent = textString.post;
let previousLink = textString.previous_url;
let nextLink = textString.next_url;
console.log('info:', textString.post.categories[0]);

Extract certain attributes from a Json file and create a new Json dataset

Answer №1

Answer №2

Answer №3

Similar questions

Easily adding multiple field data with the same field name into a database can be achieved using Mongoose and Node.js (specifically Express

What is the best way for Selenium to efficiently handle multiple calls to isElementDisplayed()?

Safari 15.6.1 does not support background video playback in Next.js

Error: Incompatibility - The variable is not functioning properly in node.js or express.js

Tips for displaying boolean fields in Web API responses

Modifying JSON Values within a File Using Jansson

What might be causing the issue in the build process of my next.js project?

Utilizing a range input (slider) to extract data of importance

Exploring Unanchored Substring Queries in Loopback API

Retrieve JavaScript functions as JSON or text in AngularJS and execute them

What could be the reason my Minecraft location_check predicate isn't executing?

Unable to display arrow D3 graph on SVG

What is the best way to test a component that does not properly handle a rejected promise using `wait` in the react-testing-library?

Adjust the object size to match the Viewport dimensions

Tips for effectively closing div elements

Exploring and extracting nested JSON data within Snowflake

Unable to transfer Vue.js components in and out of the project

Exploring the Possibilities with NodeJS and Socket.IO

Controlling Development, Production, and Staging App Settings in Azure Functions

Decoding JSON string List<string> data in a JsonResult MVC