Microsoft expands Azure Data Lake

Key addition... The store in Azure Data Lake is HDFS compatible so Hadoop distributions like Cloudera, Hortonworks®, and MapR can readily access the data for processing and analytics. http://blogs.technet.com/b/dataplatforminsider/archive/2015/09/28/microsoft-expands-azure-data-lake-to-unleash-big-data-productivity.aspx

Managing CDC using Sqoop and Hive

http://hortonworks.com/blog/four-step-strategy-incremental-updates-hive/

Full SQL on Hadoop? Splice machine

http://www.zdnet.com/article/full-sql-on-hadoop-splice-machine-opens-up-its-database-for-trials/

Hive Authorization Model

Hive 13 onwards has an Oracle style User - Role - Privileges model for authorization https://hadooptutorial.info/hive-authorization-models-and-hive-security/

Hadoop Summit 2015 San Jose Key Notes

Excellent kick off and very informative key notes. Key takeaways

• Hadoop data platform is next generation "Data Operating System"
• Atlas from Hortonworks is the “metadata
• Real-time was last year, today it is about “predictive”.  Can we anticipate violations and prevent it.
• Data Scientist = Explore data and build model

Hadoop Data Lake for Healthcare

Good article from Hortonworks on Data Lake and Healthcare http://hortonworks.com/blog/hdp-for-healthcare-providers-common-data-challenges/?mkt_tok=3RkMMJWWfF9wsRonuazKdu%2FhmjTEU5z17%2BwoUKe0hIkz2EFye%2BLIHETpodcMTcNlMr7YDBceEJhqyQJxPr3AKNkNy9RxRhHqDg%3D%3D

HDFS permissions explained

http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HdfsPermissionsGuide.html In several scenarios, you might want to change the default behavior. The key property to change in hdfs-site.xml fs.permissions.umask-mode = 022 (note there is a bug in Apache that it does not like 4 digit as advertised, so use 3 bits)