justin = { main feed , music , code , askjf , pubkey };
Ask Justin Frankel
No reasonable question unanswered since 2009!

Suggested topics: programming, music, sleep, coffee, etc.

Note: please do not ask questions about REAPER features, bugs or scheduling, use the forums instead.


Name: Ask: Human (enter yes):
[back to index] | [unreplied] | [replied] | [recent comments] | [all]

Question: As an expert programmer please give your take on the errors (rounding/truncating) in digital summing vs electrical summing.
Asked by Isaac (76.4.180.x) on June 15 2012, 3:30am
Reply on June 17 2012, 1:50am:
    64 bit FP is really quite accurate provided you're not accumulating millions of small numbers and expecting them to sum up to something exact... I can't say much for the electrical side, though.

Comment:
    Your Name:   -- Site Owner's Name:  (for human-verification)

    Comment:    

    
  
[back to index] | [unreplied] | [replied] | [recent comments] | [all]
Copyright 2024 Justin Frankel. | RSS