adam
New Member
Posts: 6
|
Post by adam on Mar 8, 2022 11:33:22 GMT -5
I wonder what is the max precision in digits I can achieve with CX-1050-SD-HT-1.4L temperature sensor and Model 224.
I see only 3 digits and there is no way I can increase it.
|
|
|
|
Post by Lake Shore Jeff M on Mar 8, 2022 15:20:53 GMT -5
The display resolution is a fixed value depending on the temperature range as follows:
Temperature display resolution 0.0001° from 0° to 99.9999°, 0.001° from 100° to 999.999°, 0.01° above 1000° which is the same resolution provided by the temperature query commands.
There is no way to change this resolution as it is hard coded in the firmware.
|
|
adam
New Member
Posts: 6
|
Post by adam on Mar 9, 2022 3:52:44 GMT -5
Hello Jeff,
Thanks. These ranges are in Kelvin or Celsius?
|
|
|
|
Post by Lake Shore Jeff M on Mar 9, 2022 9:12:38 GMT -5
It is the same for both Kelvin or Celsius
|
|
adam
New Member
Posts: 6
|
Post by adam on Mar 10, 2022 17:18:26 GMT -5
Then I would expect that the following command
CRDG? C2
+021.830
would return 4 digits after decimal point, since you mentioned 0.0001° from 0° to 99.9999° and 21 is within that range.
|
|
|
|
Post by Lake Shore Jeff M on Mar 21, 2022 16:37:42 GMT -5
That is correct so if you are not seeing that resolution, let me know the serial number of your 224 so I can investigate.
|
|
