visible floating point issue
- kinsa
- Topic Author
- Visitor
14 years 5 months ago #4991
by kinsa
visible floating point issue was created by kinsa
I have a process control system running on 6.2 using the latest version of FreeAxp.
This system has some UI where values between 0.0 to 100.0 are entered. Whenever a 100.0 (%) is entered, an error comes up informing the user that an invalid value was entered; that is, the value is outside the 0.0 - 100.0 range. 99.99 has to be entered which is then coverted to 100.0 when the dialog is re-opened.
This might be a minor issue but from the user's point of view this is a big problem.
Note that this doesn't happen with PA.
This system has some UI where values between 0.0 to 100.0 are entered. Whenever a 100.0 (%) is entered, an error comes up informing the user that an invalid value was entered; that is, the value is outside the 0.0 - 100.0 range. 99.99 has to be entered which is then coverted to 100.0 when the dialog is re-opened.
This might be a minor issue but from the user's point of view this is a big problem.
Note that this doesn't happen with PA.
Please Log in or Create an account to join the conversation.
- Bruce Claremont
- Topic Author
- Visitor
14 years 5 months ago #4992
by Bruce Claremont
Replied by Bruce Claremont on topic RE: visible floating point issue
Just to confirm, you are running 1.0.8.283, correct?
Would it be possible to supply the code or a sample program demonstrating the problem?
Would it be possible to supply the code or a sample program demonstrating the problem?
Please Log in or Create an account to join the conversation.
- kinsa
- Topic Author
- Visitor
14 years 5 months ago #4993
by kinsa
Replied by kinsa on topic RE: visible floating point issue
i'm on 288.
i'll try to recreate the issue as i don't have access to the source code.
i'll try to recreate the issue as i don't have access to the source code.
Please Log in or Create an account to join the conversation.
- kinsa
- Topic Author
- Visitor
14 years 5 months ago #4994
by kinsa
Replied by kinsa on topic RE: visible floating point issue
Hello Bruce,
The original program was created using fortran and this sample fortran code mimics what the UI response is when a value of 100.0 is entered.
This is the output from PA:
< class='quote'>
( 9.900000 ) 99.00000 is ok
( 10.00000 ) 100.0000 is ok
And this is the output from FreeAXP:
< class='quote'>
( 0.900001 ) 99.00001 is ok
( 10.000000 ) 100.0000 > 100.0
This example gives a weird result.
PA output:
< class='quote'>
100.0000 , 10.00000
99.99000 , 9.999000
99.99990 , 9.999990
FreeAXP output:
< class='quote'>
100.00000 , 10.000000
00.99000 , 0.999000
00.99990 , 0.999990
BTW, I'm using 6.2-1H2.<hr>
The original program was created using fortran and this sample fortran code mimics what the UI response is when a value of 100.0 is entered.
This is the output from PA:
< class='quote'>
( 9.900000 ) 99.00000 is ok
( 10.00000 ) 100.0000 is ok
And this is the output from FreeAXP:
< class='quote'>
( 0.900001 ) 99.00001 is ok
( 10.000000 ) 100.0000 > 100.0
This example gives a weird result.
PA output:
< class='quote'>
100.0000 , 10.00000
99.99000 , 9.999000
99.99990 , 9.999990
FreeAXP output:
< class='quote'>
100.00000 , 10.000000
00.99000 , 0.999000
00.99990 , 0.999990
BTW, I'm using 6.2-1H2.<hr>
Please Log in or Create an account to join the conversation.
- Bruce Claremont
- Topic Author
- Visitor
14 years 5 months ago #4995
by Bruce Claremont
Replied by Bruce Claremont on topic RE: visible floating point issue
Thank you. We will check into this.
Please Log in or Create an account to join the conversation.
- Bruce Claremont
- Topic Author
- Visitor
14 years 5 months ago #4996
by Bruce Claremont
Replied by Bruce Claremont on topic RE: visible floating point issue
Your contribution allowed us to isolate the floating point issue. Thank you! We will issue an updated kit soon.
Please Log in or Create an account to join the conversation.
Moderators: iamcamiel
Time to create page: 0.182 seconds