Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel

explain_precision.rst_ 724 B

You have to be logged in to leave a comment. Sign In
1
2
3
4
5
6
7
8
9
10
11
12
13
  1. ASCII Format Precision
  2. ----------------------
  3. The ASCII output formats of numerical data are controlled by parameters
  4. in your :doc:`gmt.conf` file. Longitude and latitude are formatted
  5. according to :term:`FORMAT_GEO_OUT`, absolute time is
  6. under the control of :term:`FORMAT_DATE_OUT` and
  7. :term:`FORMAT_CLOCK_OUT`, whereas general floating point values are formatted
  8. according to :term:`FORMAT_FLOAT_OUT`. Be aware that the format in effect
  9. can lead to loss of precision in ASCII output, which can lead to various
  10. problems downstream. If you find the output is not written with enough
  11. precision, consider switching to binary output (**-bo** if available) or
  12. specify more decimals using the :term:`FORMAT_FLOAT_OUT` setting.
Tip!

Press p or to see the previous file or, n or to see the next file

Comments

Loading...