Weather data analysis and visualization - Big data tutorial Part 2/9 - Dataset

Tutorial big data analysis: Weather changes in the Carpathian-Basin from 1900 to 2014 - Part 2/9

Preparation - Dataset

Weather data from NOAA — National Climatic Center — is accessible using a great toolset that lets you select your area of interest on a map interactively. Custom dataset is downloadable via the NOAA map tool.

The detailed experiment dataset used in this tutorial is downloadable here: Weather.zip.

The experiment weather dataset covers:

Weather stations and their location of the Carpathian Basin, daily historical data from 01.01.1900 to 14.02.2014.

Station IDLocation
GHCND:UPM00033397SAMBOR, UP
GHCND:UPM00033631UZHHOROD, UP
GHCND:ROM00015085BISTRITA, RO
GHCND:UPM00033634BEREGOVO, UP
GHCND:LOE00105562HURBANOVO, LO
GHCND:UPM00033398DROHOBYCH, UP
GHCND:UPM00033633MEJGOR E, UP
GHCND:ROM00015280VARFU OMUL, RO
GHCND:ROE00100898BAIA MARE, RO
GHCND:UPM00033638KHUST, UP
GHCND:SIE00115196MURSKA SOBOTA RAKICAN, SI
GHCND:ROE00108890CARANSEBES, RO
GHCND:ROE00108891CEAHLAU TOACA, RO
GHCND:UPM00033524DOLINA, UP
GHCND:SIE00115096VELIKI DOLENCI, SI
GHCND:ROE00100903DROBETA TURNU S., RO
GHCND:ROE00100902CLUJ NAPOCA, RO
GHCND:LO000011934POPRAD TATRY, LO
GHCND:ROE00100904TG JIU, RO
GHCND:UPM00033645YAREMCHA, UP
GHCND:RIE00111909NOVI SAD, RB
GHCND:AUW00034165VIENNA, AU
GHCND:HU000012942PECS POGANY, HU
GHCND:ROE00108899RAMNICU VALCEA, RO
GHCND:ROE00100829ARAD, RO
GHCND:ROE00108898OCNA SUGATAG, RO
GHCND:HRE00105203OSIJEK, HR
GHCND:ROE00108894DEVA, RO
GHCND:UPM00033647RAKHOV, UP
GHCND:ROE00108897MIERCUREA CIUC, RO
GHCND:UPM00033646POGEGEVSKAYA, UP
GHCND:UPM00033518NIGNIY STUDENIY, UP
GHCND:ROE00108901SIBIU, RO
GHCND:UPM00033514VELIKIY BEREZNY, UP
GHCND:LOE00116344KOSICE, LO
GHCND:UPM00033515PLAY, UP
GHCND:UPM00033516SLAVSKO, UP
GHCND:UPM00033657SELIATYN, UP
GHCND:UPM00033517NIGNIE VOROTA, UP
GHCND:AU000005901WIEN, AU
GHCND:UPM00033511TURKA, UP
GHCND:RIE00100818BELGRADE OBSERVATORY, RB
GHCND:UPM00033513STPIY, UP
GHCND:UPM00033651KOLOMYIA, UP
GHCND:LOE00116364ORAVSKA LESNA, LO

The data format of the rows of the experiment dataset: STATION,STATION_NAME,ELEVATION,LATITUDE,LONGITUDE,DATE,PRCP,SNWD,SNOW,TMAX,TMIN,WESD Where:

  • WESD - Water equivalent of snow on the ground (tenths of mm)
  • TMAX - Maximum temperature (tenths of degrees C)
  • SNWD - Snow depth (mm)
  • SNOW - Snowfall (mm)
  • PRCP - Precipitation (tenths of mm)
  • TMIN - Minimum temperature (tenths of degrees C)

Example from the CSV: Remark: -9999 marks no measurement data is available, rows with all -9999 measurement data are not in the CSV

GHCND:ROE00108901,SIBIU RO,444,45.8,24.15,19610101,0,-9999,-9999,24,-14,-9999
GHCND:ROE00108901,SIBIU RO,444,45.8,24.15,19610102,0,-9999,-9999,53,-21,-9999
GHCND:ROE00108901,SIBIU RO,444,45.8,24.15,19610103,0,-9999,-9999,102,-20,-9999
GHCND:ROE00108901,SIBIU RO,444,45.8,24.15,19610104,0,-9999,-9999,124,-18,-9999
GHCND:ROE00108901,SIBIU RO,444,45.8,24.15,19610105,0,-9999,-9999,132,44,-9999
GHCND:ROE00108901,SIBIU RO,444,45.8,24.15,19610106,0,-9999,-9999,60,-13,-9999
GHCND:ROE00108901,SIBIU RO,444,45.8,24.15,19610107,0,-9999,-9999,67,-16,-9999
GHCND:ROE00108901,SIBIU RO,444,45.8,24.15,19610108,0,-9999,-9999,8,-46,-9999
GHCND:ROE00108901,SIBIU RO,444,45.8,24.15,19610109,0,-9999,-9999,-8,-55,-9999
GHCND:ROE00108901,SIBIU RO,444,45.8,24.15,19610110,15,-9999,-9999,6,-18,-9999
visualizinghadoopinteractive visualization