Basic calculation of movement yields inaccurate outcome

Question

Basic calculation of movement yields inaccurate outcome

I am encountering an issue with this specific function implementation.

    Calculations.add(this, //CONTEXT
        function () { //CALUCATE
            this.position.x += (this.movementSpeed.x / 10);
        }, 
        function () { //HAVE CALCULATED
            return (this.position.x === (tempX + this.movementSpeed.x));
        }
    );

The problem arises when running the result as sometimes it produces incorrect outcomes. I expect that after 10 calculations, the HAVE CALCULATED condition should be true.

However, there are instances where this is not the case and it negatively impacts my application functionality.

For example, if the expected result is 138, sometimes the calculation yields 138.000000000006 which causes the HAVE CALCULATED check to fail.

I am struggling to find a solution to ensure accurate results. Using rounding functions is not an option as the output needs to reflect decimal values accurately.

Your assistance in solving this problem would be greatly appreciated.

javascript numbers

Answer 1

Answer №1

When performing floating point comparisons, it is recommended to use the following method:

Math.abs( a - b ) < 1e-6

Choose an arbitrary error threshold, such as 1e-6, before comparing the values

Answer 2

When performing floating point comparisons, it is recommended to use the following method:

Math.abs( a - b ) < 1e-6

Choose an arbitrary error threshold, such as 1e-6, before comparing the values

Answer 3

Answer №2

It's important to avoid comparing floating point values in this manner. (For further information, refer to the link provided by Waleed Khan in the comments)

A better approach is to use the following method to determine if a and b are equal:

if (a < b + 0.0001 && a > b - 0.0001) {
  // The values are considered "equal"
}

Answer 4

It's important to avoid comparing floating point values in this manner. (For further information, refer to the link provided by Waleed Khan in the comments)

A better approach is to use the following method to determine if a and b are equal:

if (a < b + 0.0001 && a > b - 0.0001) {
  // The values are considered "equal"
}

Answer 5

Answer №3

If you're looking to round a number to a specific decimal place, you can use the following method as suggested in this solution on Stack Overflow:

function customRound(num, decimals) {
  var factor = Math.pow(10, decimals);
  return Math.round(num * factor) / factor;
}

This approach eliminates the need for complex comparisons and provides an efficient way to round numbers.

Answer 6

If you're looking to round a number to a specific decimal place, you can use the following method as suggested in this solution on Stack Overflow:

function customRound(num, decimals) {
  var factor = Math.pow(10, decimals);
  return Math.round(num * factor) / factor;
}

This approach eliminates the need for complex comparisons and provides an efficient way to round numbers.

Basic calculation of movement yields inaccurate outcome

Answer №1

Answer №2

Answer №3

Similar questions

Connecting a Database with NestJS and TypeORM: A step-by-step guide to establish a connection with TypeORM and ensure easy access to

Using JavaScript to organize and reformat JSON data into grouped structures

Modify the value of a variable every 250 milliseconds

Managing embedded URLs in Next.js applications

Step-by-step guide on creating a login functionality in Node using the Mean.io stack

JQuery not properly validating inputs with required attributes after creation

Loading a gallery dynamically using AJAX in a CakePHP application

How to successfully transfer input data from a dialog to a controller using jQuery and Grails

Using Lodash library to iterate through a collection using the _.forEach method

Is it possible for JavaScript to be cached when it is located within the body tag of an HTML document?

Error in Typescript index: iterating over properties of a typed object

Modifying Bracket Shell Name leads to WebSocket Connection Failure

Is there a way to reset back to the default CSS styles?

Understanding the behavior of the enter key in Angular and Material forms

I am attempting to incorporate a List View within a Scroll View, but they are simply not cooperating. My goal is to display a collection of items with additional text placed at the bottom

Swapping out one variable for another

Are there any cross-platform inter-process communication APIs available in both C++ and Javascript?

Add an element to the parent body from an iframe with this easy tutorial!

PHP JSON array conversion

Conceal the ::before pseudo-element when the active item is hovered over