Can WebDriver (HtmlUnit, Ruby bindings) be configured to bypass JavaScript exceptions?

Question

Can WebDriver (HtmlUnit, Ruby bindings) be configured to bypass JavaScript exceptions?

When attempting to load the page, HtmlUnit throws an exception and crashes my test.

caps = Selenium::WebDriver::Remote::Capabilities.htmlunit(:javascript_enabled => true)
driver = Selenium::WebDriver.for(:remote, :desired_capabilities => caps)
driver.navigate.то url

ReferenceError: "x" is not defined. (net.sourceforge.htmlunit.corejs.javascript.EcmaError)

No errors occur when using a Firefox driver.

caps = Selenium::WebDriver::Remote::Capabilities.firefox

You can also resolve this issue by disabling JavaScript for the HtmlUnit driver.

caps = Selenium::WebDriver::Remote::Capabilities.htmlunit(:javascript_enabled => false)

If you are unable to modify the code on the test page to fix the problem, you may need to either ignore it or find a way to utilize the Firefox JavaScript Engine instead of the default HtmlUnit JavaScript Engine.

Is there a solution that does not involve changing the test page's code?

Update: I attempted using Capybara + WebKit as an alternative to Selenium + HtmlUnit, which worked fine without any errors. However, I still prefer to address the issue without switching frameworks.

javascript ruby selenium webdriver htmlunit

Answer 1

Answer №1

Java Specific: The most recent update of the WebClient library (which is encapsulated by HTMLUnitDriver) has rendered the method

client.setThrowExceptionOnScriptError(false)

deprecated. If you are extending HTMLUnitDriver, you will now need to override the modifyWebClient method like so:

public class MyHtmlUnitDriver extends HtmlUnitDriver {

...

 @Override
    protected WebClient modifyWebClient(WebClient client) {
        //currently does nothing, but may be changed in future versions
        WebClient modifiedClient = super.modifyWebClient(client);

        modifiedClient.getOptions().setThrowExceptionOnScriptError(false);
        return modifiedClient;
    }
}

Answer 2

Java Specific: The most recent update of the WebClient library (which is encapsulated by HTMLUnitDriver) has rendered the method

client.setThrowExceptionOnScriptError(false)

deprecated. If you are extending HTMLUnitDriver, you will now need to override the modifyWebClient method like so:

public class MyHtmlUnitDriver extends HtmlUnitDriver {

...

 @Override
    protected WebClient modifyWebClient(WebClient client) {
        //currently does nothing, but may be changed in future versions
        WebClient modifiedClient = super.modifyWebClient(client);

        modifiedClient.getOptions().setThrowExceptionOnScriptError(false);
        return modifiedClient;
    }
}

Answer 3

Answer №2

Upon examining the source code of the HtmlUnitDriver, it appears that there is no straightforward way to customize the specific behavior you are looking to modify. One potential solution would involve making changes to the Selenium server by patching and recompiling it, although this may not be a viable option for everyone. The following line can be added:

--- HtmlUnitDriver.java 2012-01-05 17:45:22.779579136 +0100
+++ HtmlUnitDriver.java 2012-01-05 18:14:51.415106195 +0100
@@ -255,6 +255,7 @@
     WebClient client = newWebClient(version);
     client.setHomePage(WebClient.URL_ABOUT_BLANK.toString());
     client.setThrowExceptionOnFailingStatusCode(false);
+    client.setThrowExceptionOnScriptError(false);
     client.setPrintContentOnFailingStatusCode(false);
     client.setJavaScriptEnabled(enableJavascript);
     client.setRedirectEnabled(true);

Answer 4

Upon examining the source code of the HtmlUnitDriver, it appears that there is no straightforward way to customize the specific behavior you are looking to modify. One potential solution would involve making changes to the Selenium server by patching and recompiling it, although this may not be a viable option for everyone. The following line can be added:

--- HtmlUnitDriver.java 2012-01-05 17:45:22.779579136 +0100
+++ HtmlUnitDriver.java 2012-01-05 18:14:51.415106195 +0100
@@ -255,6 +255,7 @@
     WebClient client = newWebClient(version);
     client.setHomePage(WebClient.URL_ABOUT_BLANK.toString());
     client.setThrowExceptionOnFailingStatusCode(false);
+    client.setThrowExceptionOnScriptError(false);
     client.setPrintContentOnFailingStatusCode(false);
     client.setJavaScriptEnabled(enableJavascript);
     client.setRedirectEnabled(true);

Answer 5

Answer №3

After some experimentation, I managed to find a solution using the

HPUnit_Extensions_Selenium2TestCase

v1.4.0. Here is how I achieved it:

class TestConfiguration extends PHPUnit_Extensions_Selenium2TestCase
{
    public function setUp()
    {
        $this->setHost(<your-host>);
        $this->setPort(<your-port>);
        $this->setDesiredCapabilities(Array("javascriptEnabled"=>"false"));

Answer 6

After some experimentation, I managed to find a solution using the

HPUnit_Extensions_Selenium2TestCase

v1.4.0. Here is how I achieved it:

class TestConfiguration extends PHPUnit_Extensions_Selenium2TestCase
{
    public function setUp()
    {
        $this->setHost(<your-host>);
        $this->setPort(<your-port>);
        $this->setDesiredCapabilities(Array("javascriptEnabled"=>"false"));

Answer 7

Answer №4

Answer provided by @Vitaly

    import org.openqa.selenium.htmlunit.HtmlUnitDriver;
    import com.gargoylesoftware.htmlunit.WebClient;
    import java.util.logging.Logger;
    import java.util.logging.Level;

    public class CustomHtmlUnitDriver extends HtmlUnitDriver {
        protected void customizeWebClient() {
            /* Disabling annoying htmlunit warnings */
            Logger.getLogger("com.gargoylesoftware").setLevel(Level.OFF);
            WebClient newWebClient = getWebClient();
            newWebClient.getOptions().setThrowExceptionOnScriptError(false);
            newWebClient.getOptions().setThrowExceptionOnFailingStatusCode(false);
            newWebClient.getOptions().setPrintContentOnFailingStatusCode(false);
            customizeWebClient(newWebClient);
        }
    }

Answer 8

Answer provided by @Vitaly

    import org.openqa.selenium.htmlunit.HtmlUnitDriver;
    import com.gargoylesoftware.htmlunit.WebClient;
    import java.util.logging.Logger;
    import java.util.logging.Level;

    public class CustomHtmlUnitDriver extends HtmlUnitDriver {
        protected void customizeWebClient() {
            /* Disabling annoying htmlunit warnings */
            Logger.getLogger("com.gargoylesoftware").setLevel(Level.OFF);
            WebClient newWebClient = getWebClient();
            newWebClient.getOptions().setThrowExceptionOnScriptError(false);
            newWebClient.getOptions().setThrowExceptionOnFailingStatusCode(false);
            newWebClient.getOptions().setPrintContentOnFailingStatusCode(false);
            customizeWebClient(newWebClient);
        }
    }

Answer 9

Answer №5

In my experience in the .NET environment, I encountered a similar issue.

To work around this problem in C#, I utilized reflection and crafted an extension method:

public static void HandleScriptErrors(this HtmlUnitDriver driver, 
                                        bool handleErrors)
{
    object webClient =  driver.GetType().InvokeMember("_webClient",
                                    BindingFlags.GetField | 
                                    BindingFlags.NonPublic | 
                                    BindingFlags.Instance, null,
                                    driver, new object[0]);

    webClient.GetType().InvokeMember("handleErrorScripts_",
                                        BindingFlags.SetField | 
                                        BindingFlags.NonPublic | 
                                        BindingFlags.Instance,
                                        null, webClient, 
                                        new object[] {handleErrors});
}

Answer 10

In my experience in the .NET environment, I encountered a similar issue.

To work around this problem in C#, I utilized reflection and crafted an extension method:

public static void HandleScriptErrors(this HtmlUnitDriver driver, 
                                        bool handleErrors)
{
    object webClient =  driver.GetType().InvokeMember("_webClient",
                                    BindingFlags.GetField | 
                                    BindingFlags.NonPublic | 
                                    BindingFlags.Instance, null,
                                    driver, new object[0]);

    webClient.GetType().InvokeMember("handleErrorScripts_",
                                        BindingFlags.SetField | 
                                        BindingFlags.NonPublic | 
                                        BindingFlags.Instance,
                                        null, webClient, 
                                        new object[] {handleErrors});
}

Answer 11

Answer №6

This technique will silence any logging mechanism permanently!

static void setFinalStatic(Field fld, Object newVal) throws Exception {
        fld.setAccessible(true);

        Field modifiersFld = Field.class.getDeclaredField("modifiers");
        modifiersFld.setAccessible(true);
        modifiersFld.setInt(fld, fld.getModifiers() & ~Modifier.FINAL);

        fld.set(null, newVal);
    }


setFinalStatic(com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.class.getDeclaredField("LOG"), new org.apache.commons.logging.Log() {

            });

Answer 12

This technique will silence any logging mechanism permanently!

static void setFinalStatic(Field fld, Object newVal) throws Exception {
        fld.setAccessible(true);

        Field modifiersFld = Field.class.getDeclaredField("modifiers");
        modifiersFld.setAccessible(true);
        modifiersFld.setInt(fld, fld.getModifiers() & ~Modifier.FINAL);

        fld.set(null, newVal);
    }


setFinalStatic(com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.class.getDeclaredField("LOG"), new org.apache.commons.logging.Log() {

            });

Can WebDriver (HtmlUnit, Ruby bindings) be configured to bypass JavaScript exceptions?

Answer №1

Answer №2

Answer №3

Answer №4

Answer №5

Answer №6

Similar questions

What could be the reason for the error I am experiencing?

"Can you provide guidance on displaying a form for a specific element based on its unique ID

Trouble with Vue.js: Failure to render data

The timer is malfunctioning

Issue with Java Selenium where the text entered in a textbox is not

Adjusting ng-required in AngularJS for both empty values and -1

parsing a TypeScript query

AJAX File Upload: Sequentially Queuing Multiple Files

The background image shifts dynamically with a parallax effect as the page is scrolled

Use JavaScript to illuminate individual words on a webpage in sequence

Identify Safari browser and redirect visitors

The password reset feature using bcrypt is malfunctioning, as headers cannot be modified once they have been sent to the client

Leveraging Angular 2 and RxJs 5 beta observables to continuously stream data from a while loop

Searching for an image using Xpath in Python

"Using version 4.2.6 of NodeJS, create a constructor that takes a literal object as a

Using checkboxes in an Express application

Implement a feature in JSP that allows users to dynamically add or remove fields before submitting the data to the database

Tips for integrating Tornado authentication with AngularJS

Uncover the hidden href link that has been obscured using the code javascript:void(0)

Javascript - Issue with Ajax causing additional commas in JSON responses