CMorph ds502.1 - Revision history

Admin: /* Java Daily Accumulation */

2017-02-13T13:37:47Z

Java Daily Accumulation

← Older revision		Revision as of 15:37, 13 February 2017
Line 43:		Line 43:
	for (int record=1; record<=8; record++) {		for (int record=1; record<=8; record++) {
	for (int i=0; i<691200; i++) // Ignore -9999 (no data) - and 3.0* is for 3-hrly mm/hr		for (int i=0; i<691200; i++) // Ignore -9999 (no data) - and 3.0* is for 3-hrly mm/hr
	data[i]+=(3.0*Math.max(0,~~dis.readFloat()~~));		float d = dis.readFloat();
			d = Float.intBitsToFloat(Integer.reverseBytes(Float.floatToRawIntBits(d)));
			data[i]+=(3.0*Math.max(0,d));
	}		}
	dis.close();		dis.close();

Admin: /* File Format */

2017-02-13T13:37:14Z

File Format

← Older revision		Revision as of 15:37, 13 February 2017
Line 30:		Line 30:
	\|}		\|}

	According to the readme, these files are compressed, however, I found that not to be true; they were all uncompressed, same-length files. The binary files are ordered in blocks for each 3-hourly reading. Each block is a 1440x480 grid of 4-byte floats, ~~MSB-first (i.e. it reads trivially into Java, but you'll need to flip the byte order for~~ LSB-first ~~languages like C)~~. The ordering of the grid starts at the Northern-Western most point, and then moves East first, repeating for each latitude.		According to the readme, these files are compressed, however, I found that not to be true; they were all uncompressed, same-length files. The binary files are ordered in blocks for each 3-hourly reading. It also appears that with this .1 version, bytes are now LSB-first, so we have to transform them in Java.

			Each block is a 1440x480 grid of 4-byte floats, LSB-first. The ordering of the grid starts at the Northern-Western most point, and then moves East first, repeating for each latitude.

	== Example Code ==		== Example Code ==

Admin: /* File Format */

2017-02-09T15:03:55Z

File Format

← Older revision		Revision as of 17:03, 9 February 2017
Line 23:		Line 23:
	\| style="text-align:left;" \| 59.75ºN - 60.0ºN		\| style="text-align:left;" \| 59.75ºN - 60.0ºN
	\|-		\|-
	! style="text-align:right;" scope="col"\| Data 1 / units:		! style="text-align:right;" scope="col"\| Data / units:
	\| style="text-align:left;" \| ~~CPC -~~ Estimated precipitation (mm per hour)		\| style="text-align:left;" \| Estimated precipitation (mm per hour)
	\|-		\|-
	! style="text-align:right;" scope="col"\| No Data Value:		! style="text-align:right;" scope="col"\| No Data Value:
Line 31:		Line 31:

	According to the readme, these files are compressed, however, I found that not to be true; they were all uncompressed, same-length files. The binary files are ordered in blocks for each 3-hourly reading. Each block is a 1440x480 grid of 4-byte floats, MSB-first (i.e. it reads trivially into Java, but you'll need to flip the byte order for LSB-first languages like C). The ordering of the grid starts at the Northern-Western most point, and then moves East first, repeating for each latitude.		According to the readme, these files are compressed, however, I found that not to be true; they were all uncompressed, same-length files. The binary files are ordered in blocks for each 3-hourly reading. Each block is a 1440x480 grid of 4-byte floats, MSB-first (i.e. it reads trivially into Java, but you'll need to flip the byte order for LSB-first languages like C). The ordering of the grid starts at the Northern-Western most point, and then moves East first, repeating for each latitude.

	~~{\| class="wikitable"~~
	\|-
	~~! style="text-align:right;" scope="col" \| Record 1~~
	~~\| style="text-align:left;" \| DATA~~
	~~\| style="text-align:left;" \| 0000-0300hrs~~
	\|-
	~~! style="text-align:right;" scope="col"\| Record 2~~
	~~\| style="text-align:left;" \| DATA~~
	~~\| style="text-align:left;" \| 0000-0300hrs~~
	\|-
	~~! style="text-align:right;" scope="col"\| Record 8~~
	~~\| style="text-align:left;" \| DATA~~
	~~\| style="text-align:left;" \| 2100-2400hrs~~
	\|}

	== Example Code ==		== Example Code ==

Admin: Created page with "== About == What's the difference between this and the ds502.0 version? Not very sure. It seems to only contain one value per pixel instead of two, labelled just as "Precipit..."

2017-02-09T15:03:10Z

Created page with "== About == What's the difference between this and the ds502.0 version? Not very sure. It seems to only contain one value per pixel instead of two, labelled just as "Precipit..."

New page

== About ==

What's the difference between this and the ds502.0 version? Not very sure. It seems to only contain one value per pixel instead of two, labelled just as "Precipitation estimate". Further details may follow. Anyway. Details below, which will be very similar.

== Getting Access ==

Sign up at http://rda.ucar.edu for free user account. You can then browse through all their data, tick boxes for what you want, and download a perl script that will then download your data. Edit the perl script so that it knows your password, and run it with something like '''perl download.pl'''. I use Strawberry Perl. You'll also need wget.exe in the same folder. Note that on 2015/10/28, the filename convention changed.

== File Format ==

{| class="wikitable"
|-
! style="text-align:right;" scope="col" | Pixel resolution
| style="text-align:left;" | 1440 x 480
|-
! style="text-align:right;" scope="col"| Geographical resolution
| style="text-align:left;" | 0.25º x 0.25º
|-
! style="text-align:right;" scope="col"| Longitude range of first pixel
| style="text-align:left;" | 0.0ºE - 0.25ºE
|-
! style="text-align:right;" scope="col"| Latitude range of first pixel
| style="text-align:left;" | 59.75ºN - 60.0ºN
|-
! style="text-align:right;" scope="col"| Data 1 / units:
| style="text-align:left;" | CPC - Estimated precipitation (mm per hour)
|-
! style="text-align:right;" scope="col"| No Data Value:
| style="text-align:left;" | -9999
|}

According to the readme, these files are compressed, however, I found that not to be true; they were all uncompressed, same-length files. The binary files are ordered in blocks for each 3-hourly reading. Each block is a 1440x480 grid of 4-byte floats, MSB-first (i.e. it reads trivially into Java, but you'll need to flip the byte order for LSB-first languages like C). The ordering of the grid starts at the Northern-Western most point, and then moves East first, repeating for each latitude.

{| class="wikitable"
|-
! style="text-align:right;" scope="col" | Record 1
| style="text-align:left;" | DATA
| style="text-align:left;" | 0000-0300hrs
|-
! style="text-align:right;" scope="col"| Record 2
| style="text-align:left;" | DATA
| style="text-align:left;" | 0000-0300hrs
|-
! style="text-align:right;" scope="col"| Record 8
| style="text-align:left;" | DATA
| style="text-align:left;" | 2100-2400hrs
|}

== Example Code ==
=== Java Daily Accumulation ===
Here's Java code to calculate daily precipitation, by summing the CPCs.
<nowiki>
DataInputStream dis = new DataInputStream(new BufferedInputStream(new FileInputStream(new File(infile))));
float[] data = new float[691200];

for (int record=1; record<=8; record++) {
for (int i=0; i<691200; i++) // Ignore -9999 (no data) - and 3.0* is for 3-hrly mm/hr
data[i]+=(3.0*Math.max(0,dis.readFloat()));
}
dis.close();
</nowiki>

== Citation ==

Climate Prediction Center/National Centers for Environmental Prediction/National Weather Service/NOAA/U.S. Department of Commerce. 2015, updated daily. NOAA CPC Morphing Technique (CMORPH) Global Precipitation Analyses Version 0.x. Research Data Archive at the National Center for Atmospheric Research, Computational and Information Systems Laboratory. https://doi.org/10.5065/D60R9MF6. Accessed† dd mmm yyyy.