HDInsight － 1，简介

标签：

最近工作需要，要看HDInsight部分，这里要做笔记。自然是官网资料最权威，所以内容都从这里搬过来：https://azure.microsoft.com/en-us/documentation/articles/hdinsight-hadoop-introduction/ 

Hadoop on HDInsight 

搞大数据，都知道Hadoop，那么HDInsight和Hadoop啥关系呢？HDInsight是M$基于Azure的一个软件架构，主要做大数据分析、管理用的，它使用了HDP（Hortonworks Data Platform）的Hadoop发行版。然后有点要注意，我们讲的Hadoop 一般指的是Hadoop的生态系统，包括Storm／Hbase等，而不单单是那个小大象。

HDInsight可以理解为是Apache Hadoop在微软Azure上的一个实现，里面包含了对应的Storm, HBase, Pig, Hive, Sqoop, Oozie, Ambari等等，当然，也捆绑了自家的Excel，SSAS，SSRS。

HDInsight支持两种类型操作系统，Linux和M$自己的Windows，区别主要在这里：

一些基本概念及定义

• Hadoop (the "Query" workload): Provides reliable data storage with HDFS, and a simple MapReduce programming model to process and analyze data in parallel.

• HBase (the "NoSQL" workload): A NoSQL database built on Hadoop that provides random access and strong consistency for large amounts of unstructured and semi-structured data - potentially billions of rows times millions of columns. See Overview of HBase on HDInsight.

• Apache Storm (the "Stream" workload): A distributed, real-time computation system for processing large streams of data fast. Storm is offered as a managed cluster in HDInsight. See Analyze real-time sensor data using Storm and Hadoop.

• Ambari: Cluster provisioning, management, and monitoring.

• Avro (Microsoft .NET Library for Avro): Data serialization for the Microsoft .NET environment.

• Hive & HCatalog: Structured Query Language (SQL)-like querying, and a table and storage management layer.

• Mahout: Machine learning.

• MapReduce and YARN: Distributed processing and resource management.

• Oozie: Workflow management.

• Phoenix: Relational database layer over HBase.

• Pig: Simpler scripting for MapReduce transformations.

• Sqoop: Data import and export.

• Tez: Allows data-intensive processes to run efficiently at scale.

• ZooKeeper: Coordination of processes in distributed systems.

HBase

aaa

HDInsight － 1，简介

标签：

原文地址：http://www.cnblogs.com/juqiang/p/4735605.html