Apache Ranger Overview

Apache ranger meetup from nvvrajesh

How to avoid passwords in your Sqoop scripts

For all those who use Sqoop and are looking at ways to manage the password issue... here is a good article on use of JCEKS https://www.mapr.com/blog/key-tips-managing-passwords-sqoop

SQL on Hadoop options

SQL on Hadoop from nvvrajesh

Amazon QuickSight now can be used to analyze your billing data

AWS now is using the new QuickSight product to allow customers to analyze their data usage. Here is the latest article from AWS. https://aws.amazon.com/about-aws/whats-new/2016/08/aws-cost-and-usage-report-data-is-now-easy-to-upload-directly-into-amazon-redshift-and-amazon-quicksight/

CASK 3.5 released

This seems to be a good Data Lake tool and is open source. Slides: http://www.slideshare.net/caskdata/webinar-whats-new-in-cdap-35

Big Data Roles and Responsibilities

Here is a good list of Roles of Responsibilities for Big Data: http://www.kdnuggets.com/2015/11/different-data-science-roles-industry.html

SQL on Hadoop - Trafodion

http://trafodion.apache.org/quickstart.html http://trafodion.apache.org/architecture-overview.html

My Kafka Blog

https://datafloq.com/read/realize-real-time-analytics-iot-monetization-kafka/1930

PL/SQL

This is great addition to Hive...now you can get data from Hive and RDBMS at same time. http://www.hplsql.org/home

Kafka and Spotify

https://labs.spotify.com/2016/02/25/spotifys-event-delivery-the-road-to-the-cloud-part-i/

Apache NiFi aka DataFlow

http://www.infoworld.com/article/2975833/hadoop/hortonworks-buys-better-hadoop-data-flow-management.html

Hive Streaming

https://cwiki.apache.org/confluence/display/Hive/Streaming+Data+Ingest This leverages Hive transaction capability but is limited to tables with ORC format. Only supports Storm and Flume.

Spark Streaming vs Flink

Hortonworks HDP

http://hortonworks.com/hdf/use-cases/

Workflow Design and Execution Engines - Luigi Airflow Pinball

http://bytepawn.com/luigi-airflow-pinball.html

Streamsets - Open Source flume interface

https://streamsets.com

azkaban open source workflow

this has become better now... check this out https://azkaban.github.io

ClickStream Data Analytics end-to-end

http://hortonworks.com/hadoop-tutorial/how-to-visualize-website-clickstream-data/

Coursera Big Data Training

Affordable training... online from a reputed university. https://www.coursera.org/specializations/big-data?utm_medium=onlineads&utm_campaign=Big+Data&utm_source=fb&nan_pid=1846868993