# big-data

**Repository Path**: jack6/big-data

## Basic Information

- **Project Name**: big-data
- **Description**: 大数据治理环境
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 1
- **Created**: 2022-03-22
- **Last Updated**: 2022-03-28

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# 大数据处理工具集--顾杰
:information_source: **此 docker-compose 文件配置为运行多个节点。**


这是一个 Hadoop 集群，其中包含可在 BigData 域中使用的必要工具，它是 docker 容器的集合，您可以直接使用这些容器来拥有最多的工具，例如:


* **Hive** 
* **Hue**
* **MySql**
* **Zookeeper**
* **Kafka**
* **Hbase**
* **Mongo**
* **Metabase**
* **Streamsets**
* **Sqoop**
* **Storm**
* **NiFi**



## 使用的 Docker 镜像
- **namenode** : [fjardim/namenode_sqoop ](https://hub.docker.com/r/fjardim/namenode_sqoop)
- **datanode** : [fjardim/datanode ](https://hub.docker.com/r/fjardim/datanode)
- **hive-server** : [fjardim/hive](https://hub.docker.com/r/fjardim/hive)
- **hive-metastore** : [fjardim/hive](https://hub.docker.com/r/fjardim/hive)
- **hive-metastore-postgresql** : [fjardim/hive-metastore](https://hub.docker.com/r/fjardim/hive-metastore)
- **hue** : [fjardim/hue](https://hub.docker.com/r/fjardim/hue)
- **mysql** : [fjardim/mysql](https://hub.docker.com/r/fjardim/mysql/)
- **zookeeper** : [fjardim/zookeeper](https://hub.docker.com/r/fjardim/zookeeper)
- **kafka** : [fjardim/kafka](https://hub.docker.com/r/fjardim/kafka)
- **presto-coordinator** : [fjardim/prestodb](https://hub.docker.com/r/fjardim/prestodb)
- **hbase-master** : [fjardim/hbase-master](https://hub.docker.com/r/fjardim/hbase-master)
- **mongo** : [fjardim/mongo](https://hub.docker.com/r/fjardim/mongo)
- **mongo-express** : [fjardim/mongo-express](https://hub.docker.com/r/fjardim/mongo-express)
- **kafkamanager** : [fjardim/kafkamanager](https://hub.docker.com/r/fjardim/kafkamanager)
- **metabase** : [fjardim/metabase](https://hub.docker.com/r/fjardim/metabase)
- **streamsets** : [streamsets/datacollector:3.13.0-latest](https://hub.docker.com/layers/streamsets/datacollector/3.13.0-latest/)
- **storm** : [fmantuano/apache-storm:develop](https://hub.docker.com/layers/fmantuano/apache-storm/develop/)
- **jupyter-spark** : [fjardim/jupyter-spark](https://hub.docker.com/r/fjardim/jupyter-spark)
- **Apache-NiFi** : [apache/nifi:latest](https://hub.docker.com/r/apache/nifi)
---

## 安装
```bash=

cd docker-bigdata-tools

sudo docker-compose up -d
```

### **节点**
- **URL** : http://localhost:50070/

> 👁️ 你可以在这里看到 3 个节点**

### **节点 1**
- **URL** : http://localhost:50075/

### **节点 2**
- **URL** : http://localhost:50080/

### **节点 3**
- **URL** : http://localhost:50085/

### **Hue**
- **URL** : http://localhost:8888/

**Username : admin**
**Password : admin**

**点击登录后**

**现在您可以使用 Hive**

 - 简单的测试执行语句
```sql=
CREATE TABLE IF NOT EXISTS users(id INT, name VARCHAR(45), website VARCHAR(45));

INSERT INTO users VALUES(1,"mahmoud zakaria","www.mahmoud.ma");
```
- 插入数据后，您可以执行选择查询。

```sql=
SELECT *FROM users;
```
* Hue Dashboard


## kafka Manager
- **URL** : http://localhost:9000/


## Cluster Overview
- **URL** : http://localhost:8080/

## Hbase
- **URL** : http://localhost:16010/

## Storm UI
- **URL** : http://localhost:8090/

## Jupyter
- **URL** : http://localhost:8889/

## Mongo Express
- **URL** : http://localhost:8081/

## StreamSets
- **URL** : http://localhost:18630/

**Username : admin**
**Password : admin**

## Nifi
- **URL** : http://localhost:9090/nifi/