<html><body><html><head><meta name="viewport" content="width=device-width" /><meta http-equiv="Content-Type" content="text/vnd.ui.insecure+html;charset=utf-8" /></head><body style="overflow-wrap:break-word; word-break: break-word;"><div class="mail_android_message" style="line-height: 1; padding: 0.5em">Or use the arbitrary precision GNU/Linux tool "bc". Also available as a compiled binary for windows platforms. <br>
<br>
Justin <br>
</div><div class="mail_android_quote" style="line-height: 1; padding: 0.3em">On 07/13/2018, 1:53 PM Jason Proctor <jason@redfish.net> wrote:<blockquote class="gmail_quote" style="margin: 0.8ex 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<div dir="ltr">ftr, Java has BigDecimal for arbitrary precision numeric stuff<div><br /></div><div>i usually use Java for tools and generators and the like.</div><div><br /></div><div><br /></div></div><div class="gmail_extra"><br /><div class="gmail_quote">On Fri, Jul 13, 2018 at 11:44 AM, Pete Hartman <span dir="ltr"><<a href="mailto:pete.hartman@gmail.com" target="_blank">pete.hartman@gmail.com</a>></span> wrote:<br /><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="auto">Is there a way to ruin it using fixed point math instead?</div><div class="HOEnZb"><div class="h5"><br /><div class="gmail_quote"><div dir="ltr">On Fri, Jul 13, 2018, 1:35 PM Tim Ressel <<a href="mailto:timr@circuitabbey.com" target="_blank">timr@circuitabbey.com</a>> wrote:<br /></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">If you must pry... ;-)<br />
<br />
I am playing with using a 64 bit accumulator in a DCO (NCO?) to fix the <br />
top jitter problem. The notion is that increased resolution in the <br />
increment value will cause less top jitter.<br />
<br />
--tr<br />
<br />
<br />
On 7/13/2018 11:30 AM, Richie Burnett wrote:<br />
> Out of interest, what application requires table lookup of values to a resolution of better than 1 part in 10 to the 19 !?!?!?<br />
><br />
> -Richie,<br />
><br />
> Sent from my Xperia SP on O2<br />
><br />
> ---- Tim Ressel wrote ----<br />
><br />
>> Verified. I don't relish (or other condiment...) doing that calc<br />
>> manually 4096 times. But it does tell us that a windoze machine can do<br />
>> the deed. I wonder if its a matter of floats versus doubles?<br />
>><br />
>> --timmers<br />
>><br />
>><br />
>> On 7/13/2018 9:59 AM, Ben Bradley wrote:<br />
>>> Windows Calculator does about twice that ("In Scientific mode,<br />
>>> Calculator is precise to 32 significant digits."), though of course<br />
>>> using it is tedious. If it helps, you can copy-paste operations into<br />
>>> it. Copy and paste this:<br />
>>> 2y2r=<br />
>>> (two to the power of 2 reciprocal - this calculates the square root of<br />
>>> two) gives:<br />
>>> 1.<wbr />414213562373095048801688724209<wbr />7<br />
>>> There's a list of keyboard shortcuts somewhere.<br />
>>><br />
>>> If you're using integers, I recall that Python, rather than<br />
>>> overflowing, will handle arbitrarily large integer values.<br />
>>><br />
>>><br />
>>> On Fri, Jul 13, 2018 at 12:42 PM, Tim Ressel <<a href="mailto:timr@circuitabbey.com" rel="noreferrer" target="_blank">timr@circuitabbey.com</a>> wrote:<br />
>>>> Hey'all,<br />
>>>><br />
>>>> I need to generate a lookup table with 64 bit values. Usually I use Excel<br />
>>>> but there is a problem: It only does 14 decimal places. I don't think this<br />
>>>> is enough. Any suggestions?<br />
>>>><br />
>>>> --<br />
>>>> --Tim Ressel<br />
>>>> Circuit Abbey<br />
>>>> <a href="mailto:timr@circuitabbey.com" rel="noreferrer" target="_blank">timr@circuitabbey.com</a><br />
>>>><br />
>>>> ______________________________<wbr />_________________<br />
>>>> Synth-diy mailing list<br />
>>>> <a href="mailto:Synth-diy@synth-diy.org" rel="noreferrer" target="_blank">Synth-diy@synth-diy.org</a><br />
>>>> <a href="http://synth-diy.org/mailman/listinfo/synth-diy" rel="noreferrer noreferrer" target="_blank">http://synth-diy.org/mailman/<wbr />listinfo/synth-diy</a><br />
>>> ______________________________<wbr />_________________<br />
>>> Synth-diy mailing list<br />
>>> <a href="mailto:Synth-diy@synth-diy.org" rel="noreferrer" target="_blank">Synth-diy@synth-diy.org</a><br />
>>> <a href="http://synth-diy.org/mailman/listinfo/synth-diy" rel="noreferrer noreferrer" target="_blank">http://synth-diy.org/mailman/<wbr />listinfo/synth-diy</a><br />
>>><br />
>> -- <br />
>> --Tim Ressel<br />
>> Circuit Abbey<br />
>> <a href="mailto:timr@circuitabbey.com" rel="noreferrer" target="_blank">timr@circuitabbey.com</a><br />
>><br />
>> ______________________________<wbr />_________________<br />
>> Synth-diy mailing list<br />
>> <a href="mailto:Synth-diy@synth-diy.org" rel="noreferrer" target="_blank">Synth-diy@synth-diy.org</a><br />
>> <a href="http://synth-diy.org/mailman/listinfo/synth-diy" rel="noreferrer noreferrer" target="_blank">http://synth-diy.org/mailman/<wbr />listinfo/synth-diy</a><br />
<br />
-- <br />
--Tim Ressel<br />
Circuit Abbey<br />
<a href="mailto:timr@circuitabbey.com" rel="noreferrer" target="_blank">timr@circuitabbey.com</a><br />
<br />
______________________________<wbr />_________________<br />
Synth-diy mailing list<br />
<a href="mailto:Synth-diy@synth-diy.org" rel="noreferrer" target="_blank">Synth-diy@synth-diy.org</a><br />
<a href="http://synth-diy.org/mailman/listinfo/synth-diy" rel="noreferrer noreferrer" target="_blank">http://synth-diy.org/mailman/<wbr />listinfo/synth-diy</a><br />
</blockquote></div>
</div></div><br />______________________________<wbr />_________________<br />
Synth-diy mailing list<br />
<a href="mailto:Synth-diy@synth-diy.org">Synth-diy@synth-diy.org</a><br />
<a href="http://synth-diy.org/mailman/listinfo/synth-diy" rel="noreferrer" target="_blank">http://synth-diy.org/mailman/<wbr />listinfo/synth-diy</a><br />
<br /></blockquote></div><br /></div>
_______________________________________________
Synth-diy mailing list
Synth-diy@synth-diy.org
http://synth-diy.org/mailman/listinfo/synth-diy
</blockquote></div></body></html></body></html>