A guide on how to iterate through elements with a designated class name using Selenium in JavaScript

Question

A guide on how to iterate through elements with a designated class name using Selenium in JavaScript

I have encountered a challenge with looping through multiple div containers on the page that all have the same class name 'sponge'. My goal is to retrieve details from each of these containers, but I am struggling to figure out the right approach. Here is my current attempt...

const containers = await driver.findElements(By.className(`sponge`))

for(let i = 0; i < containers.length; i++){
  let details = await containers[i].findElement(By.xpath(`//div[2]/div[1]/div/p`)).getText()
  console.log(details)
}

Unfortunately, when I run the code snippet above, it retrieves the same 'details' from the first 'sponge' container repeatedly for the total number of 'containers'. It seems to be unable to locate the specific 'details' in each individual container as intended.

javascript selenium xpath webdriver

Answer 1

Answer №1

If you want to access the direct child element of a parent element, you can do so by using .. Give it a try now.

const elements = await driver.findElements(By.className("sponge"))

for(let i = 0; i < elements.length; i++){
  let result = await elements[i].findElement(By.xpath(".//div[2]/div[1]/div/p")).getText()
  console.log(result)
}

Answer 2

If you want to access the direct child element of a parent element, you can do so by using .. Give it a try now.

const elements = await driver.findElements(By.className("sponge"))

for(let i = 0; i < elements.length; i++){
  let result = await elements[i].findElement(By.xpath(".//div[2]/div[1]/div/p")).getText()
  console.log(result)
}

Answer 3

Answer №2

If you're looking to scrape this website, I recommend considering alternative methods such as using modules like request, got, axios, node-fetch. These modules can send an HTTP request to the page and retrieve the HTML content for further processing. You can then utilize a module like jquery-jsdom to access the DOM elements of the response and extract the desired information using jQuery selectors.
When extracting data through scraping, utilizing HTTP requests can be more effective.

Answer 4

If you're looking to scrape this website, I recommend considering alternative methods such as using modules like request, got, axios, node-fetch. These modules can send an HTTP request to the page and retrieve the HTML content for further processing. You can then utilize a module like jquery-jsdom to access the DOM elements of the response and extract the desired information using jQuery selectors.
When extracting data through scraping, utilizing HTTP requests can be more effective.

A guide on how to iterate through elements with a designated class name using Selenium in JavaScript

Answer №1

Answer №2

Similar questions

Using the outer ng-repeat's object property to filter nested ng-repeat items

Setting a Value?

Is there a more efficient method for streamlining the Express-Validator middleware in a separate file

What is the best way to incorporate alternating classes into a dynamic feed of thumbnail images?

What issues can be identified in this ajax.js script?

To enable Android permissions while testing with BrowserStack Automate using Selenium and Appium, simply click on the permission prompts

How to handle redirects based on status codes in AngularJS $http requests

Header Blocks that are Fixed While Scrolling in fullPage.js Sections Using the "scrollOverflow: true" Feature

Remove a row from X-editable after confirming (AngularJS)

How can you transfer data from a jQuery function to a designated div element?

The behavior of CSS position: sticky varies depending on whether the user is scrolling up or scrolling down

What is the best method for communicating between windows in an electron application?

The function fails to trigger the ajax request upon clicking the button

What is the best way to create an XPath that can target specific data in an HTML table column that might change its position?

If the final page is reached, the Python Selenium Script will proceed without waiting indefinitely

Is there a way to retrieve the name of a JSON or obtain the file path using NodeJS Express Router?

Getting real-time comments after they have been submitted in ReactJS

Having trouble adding the selenium ide extension to webdriver

Using Selenium with Python, input text into a field by sending keys

Arrow function returns itself, not the function