math decis dont coope with the editor?

alexho

New Member
Reaction score
0
i have a simple problem with we when i want to convert numbers with large decimal places, i simply cannot.
for example
123456789/24
=ans*24 should equal 123456789 but it ends up just being 12345678 in the editor.

i am using real number variable, but it seems to me that it only goes to 2 or 3 decimal places.

i just hope there is a work around for this or not :(?
how can i get my values to be more precise? is there a math function that can convert large values accurately int he editor?
 
Reaction score
333
I find it unlikely that 123456789 is becoming 12345678, but otherwise this isn't a bug. The "real" type is not precise.
 

alexho

New Member
Reaction score
0
which variable type is precise i only see real and integer for variables? is there another math function that can compute larger numbers exactly?;)

i do have proof:
wbp2co.gif

i have tried it with 12345 a five digit number and it seems to work, i just think large values come out not to compute to the right number in the editor its the restriction of decimals so the accuracy is off. o well..
 
Reaction score
333
which variable type is precise i only see real and integer for variables? is there another math function that can compute larger numbers exactly?;)

Integers are fine as long as values are between -2147483648 and 2147483648. Reals are a little trickier. Generally, you will get an acceptable level of precision if you avoid large numbers with long fractional parts.

Good: 294200.0
Good: 0.4033
Bad: 294200.4033
 
General chit-chat
Help Users
  • No one is chatting at the moment.
  • WildTurkey WildTurkey:
    is there a stephen green in the house?
    +1
  • The Helper The Helper:
    What is up WildTurkey?
  • The Helper The Helper:
    Looks like Google fixed whatever mistake that made the recipes on the site go crazy and we are no longer trending towards a recipe site lol - I don't care though because it motivated me to spend alot of time on the site improving it and at least now the content people are looking at is not stupid and embarrassing like it was when I first got back into this like 5 years ago.
  • The Helper The Helper:
    Plus - I have a pretty bad ass recipe collection now! That section of the site is 10 thousand times better than it was before
  • The Helper The Helper:
    We now have a web designer at my job. A legit talented professional! I am going to get him to redesign the site theme. It is time.
  • Varine Varine:
    I got one more day of community service and then I'm free from this nonsense! I polished a cop car today for a funeral or something I guess
  • Varine Varine:
    They also were digging threw old shit at the sheriff's office and I tried to get them to give me the old electronic stuff, but they said no. They can't give it to people because they might use it to impersonate a cop or break into their network or some shit? idk but it was a shame to see them take a whole bunch of radios and shit to get shredded and landfilled
  • The Helper The Helper:
    whatever at least you are free
  • Monovertex Monovertex:
    How are you all? :D
    +1
  • Ghan Ghan:
    Howdy
  • Ghan Ghan:
    Still lurking
    +3
  • The Helper The Helper:
    I am great and it is fantastic to see you my friend!
    +1
  • The Helper The Helper:
    If you are new to the site please check out the Recipe and Food Forum https://www.thehelper.net/forums/recipes-and-food.220/
  • Monovertex Monovertex:
    How come you're so into recipes lately? Never saw this much interest in this topic in the old days of TH.net
  • Monovertex Monovertex:
    Hmm, how do I change my signature?
  • tom_mai78101 tom_mai78101:
    Signatures can be edit in your account profile. As for the old stuffs, I'm thinking it's because Blizzard is now under Microsoft, and because of Microsoft Xbox going the way it is, it's dreadful.
  • The Helper The Helper:
    I am not big on the recipes I am just promoting them - I use the site as a practice place promoting stuff
    +2
  • Monovertex Monovertex:
    @tom_mai78101 I must be blind. If I go on my profile I don't see any area to edit the signature; If I go to account details (settings) I don't see any signature area either.
  • The Helper The Helper:
    You can get there if you click the bell icon (alerts) and choose preferences from the bottom, signature will be in the menu on the left there https://www.thehelper.net/account/preferences
  • The Helper The Helper:
    I think I need to split the Sci/Tech news forum into 2 one for Science and one for Tech but I am hating all the moving of posts I would have to do
  • The Helper The Helper:
    What is up Old Mountain Shadow?

      The Helper Discord

      Staff online

      Members online

      Affiliates

      Hive Workshop NUON Dome World Editor Tutorials

      Network Sponsors

      Apex Steel Pipe - Buys and sells Steel Pipe.
      Top