Can WebDriver (HtmlUnit, Ruby bindings) be configured to bypass JavaScript exceptions?

Question

Can WebDriver (HtmlUnit, Ruby bindings) be configured to bypass JavaScript exceptions?

When attempting to load the page, HtmlUnit throws an exception and crashes my test.

caps = Selenium::WebDriver::Remote::Capabilities.htmlunit(:javascript_enabled => true)
driver = Selenium::WebDriver.for(:remote, :desired_capabilities => caps)
driver.navigate.то url

ReferenceError: "x" is not defined. (net.sourceforge.htmlunit.corejs.javascript.EcmaError)

No errors occur when using a Firefox driver.

caps = Selenium::WebDriver::Remote::Capabilities.firefox

You can also resolve this issue by disabling JavaScript for the HtmlUnit driver.

caps = Selenium::WebDriver::Remote::Capabilities.htmlunit(:javascript_enabled => false)

If you are unable to modify the code on the test page to fix the problem, you may need to either ignore it or find a way to utilize the Firefox JavaScript Engine instead of the default HtmlUnit JavaScript Engine.

Is there a solution that does not involve changing the test page's code?

Update: I attempted using Capybara + WebKit as an alternative to Selenium + HtmlUnit, which worked fine without any errors. However, I still prefer to address the issue without switching frameworks.

javascript ruby selenium webdriver htmlunit

Answer 1

Answer №1

Java Specific: The most recent update of the WebClient library (which is encapsulated by HTMLUnitDriver) has rendered the method

client.setThrowExceptionOnScriptError(false)

deprecated. If you are extending HTMLUnitDriver, you will now need to override the modifyWebClient method like so:

public class MyHtmlUnitDriver extends HtmlUnitDriver {

...

 @Override
    protected WebClient modifyWebClient(WebClient client) {
        //currently does nothing, but may be changed in future versions
        WebClient modifiedClient = super.modifyWebClient(client);

        modifiedClient.getOptions().setThrowExceptionOnScriptError(false);
        return modifiedClient;
    }
}

Answer 2

Java Specific: The most recent update of the WebClient library (which is encapsulated by HTMLUnitDriver) has rendered the method

client.setThrowExceptionOnScriptError(false)

deprecated. If you are extending HTMLUnitDriver, you will now need to override the modifyWebClient method like so:

public class MyHtmlUnitDriver extends HtmlUnitDriver {

...

 @Override
    protected WebClient modifyWebClient(WebClient client) {
        //currently does nothing, but may be changed in future versions
        WebClient modifiedClient = super.modifyWebClient(client);

        modifiedClient.getOptions().setThrowExceptionOnScriptError(false);
        return modifiedClient;
    }
}

Answer 3

Answer №2

Upon examining the source code of the HtmlUnitDriver, it appears that there is no straightforward way to customize the specific behavior you are looking to modify. One potential solution would involve making changes to the Selenium server by patching and recompiling it, although this may not be a viable option for everyone. The following line can be added:

--- HtmlUnitDriver.java 2012-01-05 17:45:22.779579136 +0100
+++ HtmlUnitDriver.java 2012-01-05 18:14:51.415106195 +0100
@@ -255,6 +255,7 @@
     WebClient client = newWebClient(version);
     client.setHomePage(WebClient.URL_ABOUT_BLANK.toString());
     client.setThrowExceptionOnFailingStatusCode(false);
+    client.setThrowExceptionOnScriptError(false);
     client.setPrintContentOnFailingStatusCode(false);
     client.setJavaScriptEnabled(enableJavascript);
     client.setRedirectEnabled(true);

Answer 4

Upon examining the source code of the HtmlUnitDriver, it appears that there is no straightforward way to customize the specific behavior you are looking to modify. One potential solution would involve making changes to the Selenium server by patching and recompiling it, although this may not be a viable option for everyone. The following line can be added:

--- HtmlUnitDriver.java 2012-01-05 17:45:22.779579136 +0100
+++ HtmlUnitDriver.java 2012-01-05 18:14:51.415106195 +0100
@@ -255,6 +255,7 @@
     WebClient client = newWebClient(version);
     client.setHomePage(WebClient.URL_ABOUT_BLANK.toString());
     client.setThrowExceptionOnFailingStatusCode(false);
+    client.setThrowExceptionOnScriptError(false);
     client.setPrintContentOnFailingStatusCode(false);
     client.setJavaScriptEnabled(enableJavascript);
     client.setRedirectEnabled(true);

Answer 5

Answer №3

After some experimentation, I managed to find a solution using the

HPUnit_Extensions_Selenium2TestCase

v1.4.0. Here is how I achieved it:

class TestConfiguration extends PHPUnit_Extensions_Selenium2TestCase
{
    public function setUp()
    {
        $this->setHost(<your-host>);
        $this->setPort(<your-port>);
        $this->setDesiredCapabilities(Array("javascriptEnabled"=>"false"));

Answer 6

After some experimentation, I managed to find a solution using the

HPUnit_Extensions_Selenium2TestCase

v1.4.0. Here is how I achieved it:

class TestConfiguration extends PHPUnit_Extensions_Selenium2TestCase
{
    public function setUp()
    {
        $this->setHost(<your-host>);
        $this->setPort(<your-port>);
        $this->setDesiredCapabilities(Array("javascriptEnabled"=>"false"));

Answer 7

Answer №4

Answer provided by @Vitaly

    import org.openqa.selenium.htmlunit.HtmlUnitDriver;
    import com.gargoylesoftware.htmlunit.WebClient;
    import java.util.logging.Logger;
    import java.util.logging.Level;

    public class CustomHtmlUnitDriver extends HtmlUnitDriver {
        protected void customizeWebClient() {
            /* Disabling annoying htmlunit warnings */
            Logger.getLogger("com.gargoylesoftware").setLevel(Level.OFF);
            WebClient newWebClient = getWebClient();
            newWebClient.getOptions().setThrowExceptionOnScriptError(false);
            newWebClient.getOptions().setThrowExceptionOnFailingStatusCode(false);
            newWebClient.getOptions().setPrintContentOnFailingStatusCode(false);
            customizeWebClient(newWebClient);
        }
    }

Answer 8

Answer provided by @Vitaly

    import org.openqa.selenium.htmlunit.HtmlUnitDriver;
    import com.gargoylesoftware.htmlunit.WebClient;
    import java.util.logging.Logger;
    import java.util.logging.Level;

    public class CustomHtmlUnitDriver extends HtmlUnitDriver {
        protected void customizeWebClient() {
            /* Disabling annoying htmlunit warnings */
            Logger.getLogger("com.gargoylesoftware").setLevel(Level.OFF);
            WebClient newWebClient = getWebClient();
            newWebClient.getOptions().setThrowExceptionOnScriptError(false);
            newWebClient.getOptions().setThrowExceptionOnFailingStatusCode(false);
            newWebClient.getOptions().setPrintContentOnFailingStatusCode(false);
            customizeWebClient(newWebClient);
        }
    }

Answer 9

Answer №5

In my experience in the .NET environment, I encountered a similar issue.

To work around this problem in C#, I utilized reflection and crafted an extension method:

public static void HandleScriptErrors(this HtmlUnitDriver driver, 
                                        bool handleErrors)
{
    object webClient =  driver.GetType().InvokeMember("_webClient",
                                    BindingFlags.GetField | 
                                    BindingFlags.NonPublic | 
                                    BindingFlags.Instance, null,
                                    driver, new object[0]);

    webClient.GetType().InvokeMember("handleErrorScripts_",
                                        BindingFlags.SetField | 
                                        BindingFlags.NonPublic | 
                                        BindingFlags.Instance,
                                        null, webClient, 
                                        new object[] {handleErrors});
}

Answer 10

In my experience in the .NET environment, I encountered a similar issue.

To work around this problem in C#, I utilized reflection and crafted an extension method:

public static void HandleScriptErrors(this HtmlUnitDriver driver, 
                                        bool handleErrors)
{
    object webClient =  driver.GetType().InvokeMember("_webClient",
                                    BindingFlags.GetField | 
                                    BindingFlags.NonPublic | 
                                    BindingFlags.Instance, null,
                                    driver, new object[0]);

    webClient.GetType().InvokeMember("handleErrorScripts_",
                                        BindingFlags.SetField | 
                                        BindingFlags.NonPublic | 
                                        BindingFlags.Instance,
                                        null, webClient, 
                                        new object[] {handleErrors});
}

Answer 11

Answer №6

This technique will silence any logging mechanism permanently!

static void setFinalStatic(Field fld, Object newVal) throws Exception {
        fld.setAccessible(true);

        Field modifiersFld = Field.class.getDeclaredField("modifiers");
        modifiersFld.setAccessible(true);
        modifiersFld.setInt(fld, fld.getModifiers() & ~Modifier.FINAL);

        fld.set(null, newVal);
    }


setFinalStatic(com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.class.getDeclaredField("LOG"), new org.apache.commons.logging.Log() {

            });

Answer 12

This technique will silence any logging mechanism permanently!

static void setFinalStatic(Field fld, Object newVal) throws Exception {
        fld.setAccessible(true);

        Field modifiersFld = Field.class.getDeclaredField("modifiers");
        modifiersFld.setAccessible(true);
        modifiersFld.setInt(fld, fld.getModifiers() & ~Modifier.FINAL);

        fld.set(null, newVal);
    }


setFinalStatic(com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.class.getDeclaredField("LOG"), new org.apache.commons.logging.Log() {

            });

Can WebDriver (HtmlUnit, Ruby bindings) be configured to bypass JavaScript exceptions?

Answer №1

Answer №2

Answer №3

Answer №4

Answer №5

Answer №6

Similar questions

Assigning arbitrary hidden form data from dropdown selection

How to position items at specific coordinates in a dropdown using JavaScript

Identify input elements that specifically contain an onclick event

I'm experiencing issues with my code involving HTML, CSS, and jQuery

How to add an item to an array in JavaScript without specifying a key

Choose the Nth option in the dropdown list using programming

Troubleshooting: Issues with Jquery's replaceWith function

"Learn the steps to dynamically update the ng-bind value of a single element within an ng-repeat loop by

Experiencing an inexplicable blurring effect on the modal window

Manipulating Data in TypeScript: Creating a Mutated Copy of a List of Dictionaries

Save and showcase SQL, PHP, HTML, and JS code exactly as it is preserved in MYSQL database

Strategies for Resolving Table Alignment Problems using HTML and JavaScript

What are the limitations preventing me from utilizing the Selenium Chrome Driver?

Guide on sending a request to an API and displaying the retrieved information within the same Express application

I am attempting to transfer information from one page to another in Next.js, but unfortunately, I am experiencing difficulties in

Can someone guide me on how to retrieve data from a MUI table within a React project

Changing the `$location.path` updates the URL without triggering a redirect

Troubleshooting AngularJS $q Promise Not Being Returned

Pass the identical event to multiple functions in Angular 2

Using Vue and Vuex to wait for asynchronous dispatch in the created hook