https://dataprd.com/tags/performance/ Recent content in Performance on Dataprd.Com Hugo en-us Mon, 09 Jan 2017 20:24:45 +0000 https://dataprd.com/posts/evaluation-of-apache-kylin-1-5-4-1-with-hdp-2-5-performance-comparison-w-hive/ Mon, 09 Jan 2017 20:24:45 +0000 https://dataprd.com/posts/evaluation-of-apache-kylin-1-5-4-1-with-hdp-2-5-performance-comparison-w-hive/ <p><strong>Apache Kylin</strong> is a data cube solution on top of Hadoop providing an ODBC interface for BI tools. OLAP cubes boost performance for analytics via using a subset of data, enriched with pre-calculations on specific dimensions of interest. It enables loading dimensions from a Hive data source, therefore accelerating BI tool access via pre-calculating data and adding it to HBase. In our example we have a large dataset of flight information:</p> https://dataprd.com/posts/performance-test-pig-vs-hive-code-examples/ Fri, 08 Aug 2014 17:40:07 +0000 https://dataprd.com/posts/performance-test-pig-vs-hive-code-examples/ <p>Performance testing high level Hadoop query languages with <strong>example scripts.</strong> Analysis of NOAA weather data: Western-European weather stations from 1980 to 2014, daily dataset of temperature (tmin and tmax) and precipitation data (prcp). Dataset is a structured table, non-existent measurement cells are filled with <em>-9999</em>. <strong>Example:</strong> STATION,STATION_NAME,DATE,PRCP,TMAX,TMIN GHCND:NLE00109300,STAVENISSE NL,19800101,53,-9999,-9999 GHCND:NLE00109300,STAVENISSE NL,19800102,21,-9999,-9999 GHCND:NLE00109300,STAVENISSE NL,19800103,133,-9999,-9999 &hellip; GHCND:NLE00109202,MARUM NL,20080602,0,-9999,-9999 GHCND:NLE00109202,MARUM NL,20080603,36,-9999,-9999 GHCND:NLE00109202,MARUM NL,20080604,4,-9999,-9999 &hellip; Data size: <strong>1 Gb / 4 Gb / 8 Gb</strong> <a href="https://dataprd.com/files/2014/08/w_333_mb.csv.zip">(the same 333 Mb data file replicated 3 / 12 / 24 times)</a> HDFS block size: <strong>128 Mb</strong> Platform:</p>