I am facing a challenge in retrieving dynamic information automatically from a website using a C# application. Despite trying to inspect the page source code using F12 on my browser, I am unable to identify the required information.
My attempt to obtain the information using the Nuget Selenium package has also been unsuccessful. Since the information is dynamic and lacks specific IDs for selection, I'm unable to extract it from the body content or by using a select statement.
For example: I need to retrieve the name and link of each object on this page and navigate to page 2 appropriately, as the direct link leads back to page 1.
On this page, I require information on recent sales and price history for the past few days.
Despite various attempts, I have not been successful in extracting the necessary data. The code snippet below retrieves the page source but does not meet my requirements.
private void TestReadPage()
{
IWebDriver driver = new ChromeDriver();
driver.Navigate().GoToUrl("https://web.idle-mmo.com/wiki/items/mystic-sword/ZjlPA8v9NMaXNEyMe2Oa?same_window=true");
// Attempting to get the body content, which proves futile
var body = driver.FindElement(By.TagName("body")).Text;
// Unable to retrieve the average sold price from the graphic
var lastsold = driver.FindElements(By.ClassName("!border-t-0"));
driver.Quit();
}