Is it possible to retrieve HTML content using YQL?

Question

Is it possible to retrieve HTML content using YQL?

Imagine the scenario where you need to retrieve information from a web page structured like this:

<table>
  <tr>
    <td><a href="Link 1">Column 1 Text</a></td>
    <td>Column 2 Text</td>
    <td>Column 3 Text</td>
  </tr>
  <tr>
    <td><a href="Link 2">Column 1 Text</a></td>
    <td>Column 2 Text</td>
    <td>Column 3 Text</td>
  </tr>
  ...
</table>

transforming it into JSON format :

[
  {
    link: 'Link 1',
    text: 'Column 1 Text',
    data: 'Column 3 Text'
  },
  {
    link: 'Link 2',
    text: 'Column 1 Text',
    data: 'Column 3 Text'
  }
]

Is it possible to achieve this using YQL? If so, could you provide an example query?

Any assistance on this matter would be greatly appreciated!

javascript json yahoo yql

Answer 1

Answer №1

Take a look at this initial query as a strong foundation, utilizing the HTML table coupled with XPath query (refer to Extracting HTML Content With XPath for more insights into this method):

select * from html where url="http://cantoni.org/test/table.html" and xpath='//table/tr'

This query generates JSON results similar to the following structure:

{
 "query": {
  "count": 2,
  "created": "2012-01-06T20:16:46Z",
  "lang": "en-US",
  "results": {
   "tr": [
    {
     "td": [
      {
       "a": {
        "href": "Link%201",
        "content": "Column 1 Text"
       }
      },
      {
       "p": "Column 2 Text"
      },
      {
       "p": "Column 3 Text"
      }
     ]
    },
    {
     "td": [
      {
       "a": {
        "href": "Link%202",
        "content": "Column 1 Text"
       }
      },
      {
       "p": "Column 2 Text"
      },
      {
       "p": "Column 3 Text"
      }
     ]
    }
   ]
  }
 }
}

Answer 2

Take a look at this initial query as a strong foundation, utilizing the HTML table coupled with XPath query (refer to Extracting HTML Content With XPath for more insights into this method):

select * from html where url="http://cantoni.org/test/table.html" and xpath='//table/tr'

This query generates JSON results similar to the following structure:

{
 "query": {
  "count": 2,
  "created": "2012-01-06T20:16:46Z",
  "lang": "en-US",
  "results": {
   "tr": [
    {
     "td": [
      {
       "a": {
        "href": "Link%201",
        "content": "Column 1 Text"
       }
      },
      {
       "p": "Column 2 Text"
      },
      {
       "p": "Column 3 Text"
      }
     ]
    },
    {
     "td": [
      {
       "a": {
        "href": "Link%202",
        "content": "Column 1 Text"
       }
      },
      {
       "p": "Column 2 Text"
      },
      {
       "p": "Column 3 Text"
      }
     ]
    }
   ]
  }
 }
}

Is it possible to retrieve HTML content using YQL?

Answer №1

Similar questions

Cherrypy/Chrome: Issue with jquery ajax request remaining pending after several successful requests

Accessing state in Vuex modules is crucial for managing and manipulating data effectively

Nodejs and express authentication feature enables users to securely access their accounts by verifying their identity before they

Is it achievable to dynamically generate new pages on initial load in NextJS?

Why is it that using e.preventDefault() does not prevent the link from being followed?

Do you think it's essential to have a collection of items stored within a specifically named entity?

Why is my Ajax utilizing PHP _POST not functioning as expected?

Utilize ramda.js to pair an identifier key with values from a nested array of objects

When using LWP::Simple::get, the URL that typically functions in a browser may not yield the desired

What are some ways to ensure that the promise from postgres is fulfilled before moving forward with my code execution?

Encountered a CSS error while trying to compile the project with npm build

Tips for resolving Vue.js static asset URLs in a production environment

Exploring the isolate scope within a compiled directive

Unable to select image inside linked container

concealed highcharts data labels

Storing various duplicates of items in local storage

ERROR: Running out of memory in JavaScript heap while executing a command with "npm"

"Troubleshooting the issue of nested jQuery Ajax requests failing to execute properly

"Returning undefined: The outcome of using jQuery's .html() method on

Shading THREE.js Color with Textures