Basic calculation of movement yields inaccurate outcome

Question

Basic calculation of movement yields inaccurate outcome

I am encountering an issue with this specific function implementation.

    Calculations.add(this, //CONTEXT
        function () { //CALUCATE
            this.position.x += (this.movementSpeed.x / 10);
        }, 
        function () { //HAVE CALCULATED
            return (this.position.x === (tempX + this.movementSpeed.x));
        }
    );

The problem arises when running the result as sometimes it produces incorrect outcomes. I expect that after 10 calculations, the HAVE CALCULATED condition should be true.

However, there are instances where this is not the case and it negatively impacts my application functionality.

For example, if the expected result is 138, sometimes the calculation yields 138.000000000006 which causes the HAVE CALCULATED check to fail.

I am struggling to find a solution to ensure accurate results. Using rounding functions is not an option as the output needs to reflect decimal values accurately.

Your assistance in solving this problem would be greatly appreciated.

javascript numbers

Answer 1

Answer №1

When performing floating point comparisons, it is recommended to use the following method:

Math.abs( a - b ) < 1e-6

Choose an arbitrary error threshold, such as 1e-6, before comparing the values

Answer 2

When performing floating point comparisons, it is recommended to use the following method:

Math.abs( a - b ) < 1e-6

Choose an arbitrary error threshold, such as 1e-6, before comparing the values

Answer 3

Answer №2

It's important to avoid comparing floating point values in this manner. (For further information, refer to the link provided by Waleed Khan in the comments)

A better approach is to use the following method to determine if a and b are equal:

if (a < b + 0.0001 && a > b - 0.0001) {
  // The values are considered "equal"
}

Answer 4

It's important to avoid comparing floating point values in this manner. (For further information, refer to the link provided by Waleed Khan in the comments)

A better approach is to use the following method to determine if a and b are equal:

if (a < b + 0.0001 && a > b - 0.0001) {
  // The values are considered "equal"
}

Answer 5

Answer №3

If you're looking to round a number to a specific decimal place, you can use the following method as suggested in this solution on Stack Overflow:

function customRound(num, decimals) {
  var factor = Math.pow(10, decimals);
  return Math.round(num * factor) / factor;
}

This approach eliminates the need for complex comparisons and provides an efficient way to round numbers.

Answer 6

If you're looking to round a number to a specific decimal place, you can use the following method as suggested in this solution on Stack Overflow:

function customRound(num, decimals) {
  var factor = Math.pow(10, decimals);
  return Math.round(num * factor) / factor;
}

This approach eliminates the need for complex comparisons and provides an efficient way to round numbers.

Basic calculation of movement yields inaccurate outcome

Answer №1

Answer №2

Answer №3

Similar questions

Is it possible to retrieve JSON data from an external URL using JavaScript or jQuery?

Troubleshooting a problem with jQuery child items

A guide on extracting keywords from the tynt API using JavaScript

Execute identical task using a for loop in JavaScript

Setting null for HttpParams during the call

Error: The window object is not found in this context when initializing the Commerce module from the commerce.export.js file located in the node_modules folder within the @chec

Resizing nested elements while maintaining consistent padding dimensions

The menu isn't displaying properly and the onclick function seems to be malfunctioning

Tips for resolving this unhandled error in React TypeScript

A JavaScript object featuring a predefined value

What is the best way to set the active class on the initial tab that is determined dynamically rather than a static tab in Angular?

Combine a string and integer in JavaScript without using quotation marks between them

Tips for effortlessly moving content by dragging and dropping it into a text box

Using jQuery to reference my custom attribute---"How to Use jQuery to reference My

Multi-line input in ExtJs

Leveraging Async/Await to track error counts across three distinct loops, each invoking an asynchronous function in every iteration

Various successful functions in Ajax

Configuring IP Whitelisting for Firebase Cloud Functions with MongoDB Cluster

Video player on website experiencing issues with playing VAST ads

Implementing SweetAlert2 in Vue.js to create a modal prompt for confirmation prior to deleting an item