阿里云
>
大数据
>
大数据编程开发
大数据编程开发
《Hadoop与
大
数据挖掘》一2.4 Hadoop
编程开发
2.4 Hadoop
编程开发
Hadoop框架最核心的设计就是HDFS和MapReduce。HDFS为海量的数据提供了存储，则MapReduce为海量的数据提供了计算。本节就MapReduce开发相关内容进行分析，包括HDFS Java API操作、MapReduce原理、MapReduce相关流程组件...
《Hadoop与
大
数据挖掘》——2.4 Hadoop
编程开发
2.4 Hadoop
编程开发
Hadoop框架最核心的设计就是HDFS和MapReduce。HDFS为海量的数据提供了存储，则MapReduce为海量的数据提供了计算。本节就MapReduce开发相关内容进行分析，包括HDFS Java API操作、MapReduce原理、MapReduce相关流程组件...
《深入理解
大数据
：
大
数据处理与
编程
实践》一一2.4 Hadoop MapReduce程序
开发
过程
本节书摘来自华章计算机《深入理解
大数据
：
大
数据处理与
编程
实践》一书中的第2章，第2.4节,作者 主
编
：黄宜华（南京大学）副主编：苗凯翔（英特尔公司），更多章节内容可以访问云栖社区“华章计算机”公众号查看。2.4 Hadoop MapReduce...
Spark修炼之道（基础篇）——Linux
大数据开发
基础：第九节：Shell
编程
入门(一)
本节主要内容 shell
编程
简介 变量定义 常用特殊变量 1.shell
编程
简介 学习linux操作系统最让人着迷的事情莫过于shell脚本
编程
，这是因为如果要完成某些复杂的功能，单纯地通过GUI操作不可能达到，shell脚本可以直接与操作系统内核打交道，...
BigData：
大数据开发
的简介、核心知识(linux基础+Java/Python
编程
语言+Hadoop{HDFS、...
以Hadoop生态系统为基础带你了解
大数据
必须掌握的那些知识
大数据
技术应用场景
大数据
技术可以应用在各个领域，比如公安
大数据
、交通
大数据
、医疗
大数据
、就业
大数据
、环境
大数据
、图像
大数据
、视频
大数据
等等，应用范围非常广泛，
大数据
...
Spark修炼之道（基础篇）——Linux
大数据开发
基础：第十二节：Shell
编程
入门（四)
如果代码量比较
大
或者脚本
开发
人员知道代码出错的大致位置，则可以使用set-x;set+x；命令进行局部调试，如#!bin/bash#Filename:debug2.sh for i in {1.6} do set-x/set-x表示跟在该命令后的脚本输出调试信息 echo$i/set+x表示从此处禁用...
Spark修炼之道（基础篇）——Linux
大数据开发
基础：第十节：Shell
编程
入门（二)
参考书目：linux shell scripting cookbook 本节主要内容 shell命令行中的基本运算 文件描述符与文件重定向 1.shell命令行中的基本运算 通过上一节我们知道，Linux Bash shell 命令行的变量都被解析成字符串，如/变量被解析为字符串 root@...
Spark修炼之道（基础篇）——Linux
大数据开发
基础：第十四节：Shell
编程
入门（六)
本文主要内容 case控制结构 read命令 管道 1.case控制结构 参考：http://blog.csdn.net/dreamtdp/article/details/8048720 case控制结构语法格式：case expression in pattern1)statements;pattern2)statements;esac case控制结构较之于if...
Spark修炼之道（基础篇）——Linux
大数据开发
基础：第十一节：Shell
编程
入门（三)
本节主要内容 shell数组 shell命令别名 时间操作 1.Shell数组 同C、C++等语言一样，shell脚本也提供了数组这样一个重要的数据结构，shell中的数组有两种，一种为普通数组，另外的一种称为关联数组。普通数据的存取通过整数进行，关联数组的...
Spark修炼之道（基础篇）——Linux
大数据开发
基础：第十三节：Shell
编程
入门（五)
本节主要内容 while循环控制结构 if条件判断 until循环控制结构 1.while循环控制结构 本节例子来源：http://blog.chinaunix.net/uid-25880122-id-2901409.html 语法格式：while expression do command command done（1）计数器格式 适用于...
1
您可能感兴趣
.
大数据问题
.
大数据是什么
.
ide大数据
.
物联网大数据
.
大数据数据挖掘
.
什么是大数据
.
大数据nan
.
idc大数据
{"optioninfo":{"dynamic":"ture","static":"true"},"simplifiedDisplay":"newEdition","newCard":[{"ifIcon":"icon","link":"","icon":"","iconImg":"","contentLink":"https://www.aliyun.com/product/bigdata/apsarabigdata","title":"大数据","des":"阿里云大数据是简单、易用、全托管的云原生大数据服务。企业级安全，极致弹性，开放兼容，更快速地解决海量数据计算问题，有效降低企业成本，并保障数据安全。明星产品MaxCompute、Hologres、DataWorks。","link1":"https://www.aliyun.com/product/bigdata/apsarabigdata","btn1":"了解详情","link2":"https://survey.aliyun.com/apps/zhiliao/UfVBgCs4","btn2":"方案咨询","btn3":"大数据体验馆","link3":"https://workbench.data.aliyun.com/experience.htm?spm=a2c0j.14041929.1399591.2.74733097H2MUxa#/","infoGroup":[{"infoName":"大数据计算","infoContent":{"firstContentName":"MaxCompute","lastContentName":"E-MapReduce","lastContentLink":"https://www.aliyun.com/product/emapreduce","firstContentLink":"https://www.aliyun.com/product/odps?spm=5176.19720258.J_8058803260.193.66022c4afTTWaa"}},{"infoName":"数据开发","infoContent":{"firstContentName":"DataWorks","lastContentName":"数据总线DataHub","firstContentLink":"https://www.aliyun.com/product/bigdata/ide?spm=5176.19720258.J_8058803260.204.66022c4afTTWaa","lastContentLink":"https://www.aliyun.com/product/datahub"}},{"infoName":"实时计算","infoContent":{"firstContentName":"实时数仓Hologres","lastContentName":"实时计算 Flink 版","firstContentLink":"https://www.aliyun.com/product/bigdata/hologram","lastContentLink":"https://www.aliyun.com/product/bigdata/sc"}},{"infoName":"大数据应用","infoContent":{"firstContentName":"DataV 数据可视化","lastContentName":"Quick Audience","firstContentLink":"https://www.aliyun.com/product/bigdata/datav?spm=5176.19720258.J_8058803260.208.66022c4afTTWaa","lastContentLink":"https://www.aliyun.com/product/retailadvqa?spm=5176.19720258.J_8058803260.210.66022c4afTTWaa"}}]}],"card":[],"search":[],"infoCard":[{"bannerTitle":"阿里云大数据","bannerUrl":"https://img.alicdn.com/imgextra/i1/O1CN01Ijdmbv24KsvapQk1n_!!6000000007373-0-tps-3840-740.jpg","bannerContent":"阿里云大数据包含MaxCompute、Hologres、DataWorks等。企业级安全，极致弹性，开放兼容，更快速地解决海量数据计算问题，有效降低企业成本，并保障数据安全。","liveButtonName":"了解详情","liveButtonLink":"https://www.aliyun.com/product/bigdata/apsarabigdata","homePageName":"方案咨询","homePageLink":"https://survey.aliyun.com/apps/zhiliao/UfVBgCs4"}],"title":{"mainTitle":"mPaaS","subtitle":"源自于支付宝小程序框架，亿级线上业务体量的锤炼，安全性媲美支付宝原生能力。不仅面向自有 App 投放小程序，更可快速构建打包，覆盖支付宝、淘宝、钉钉等应用。","linkUrl":"https://www.aliyun.com/product/mobilepaas/mpaas-miniprogram","btnText":"查看详情"},"visual":{"topbg":"https://img.alicdn.com/tfs/TB1bQuBIYH1gK0jSZFwXXc7aXXa-3840-740.gif","icon":"","textColor":"dark"},"dataList":[{"summary":"啦啦啦","author":"wuwu","linksUrl":"#"}],"sceneCard":[],"txt":[]}
{"$env":{"JSON":{}},"$page":{"env":"production"},"$context":{"optioninfo":{"dynamic":"ture","static":"true"},"simplifiedDisplay":"newEdition","newCard":[{"ifIcon":"icon","link":"","icon":"","iconImg":"","contentLink":"https://www.aliyun.com/product/bigdata/apsarabigdata","title":"大数据","des":"阿里云大数据是简单、易用、全托管的云原生大数据服务。企业级安全，极致弹性，开放兼容，更快速地解决海量数据计算问题，有效降低企业成本，并保障数据安全。明星产品MaxCompute、Hologres、DataWorks。","link1":"https://www.aliyun.com/product/bigdata/apsarabigdata","btn1":"了解详情","link2":"https://survey.aliyun.com/apps/zhiliao/UfVBgCs4","btn2":"方案咨询","btn3":"大数据体验馆","link3":"https://workbench.data.aliyun.com/experience.htm?spm=a2c0j.14041929.1399591.2.74733097H2MUxa#/","infoGroup":[{"infoName":"大数据计算","infoContent":{"firstContentName":"MaxCompute","lastContentName":"E-MapReduce","lastContentLink":"https://www.aliyun.com/product/emapreduce","firstContentLink":"https://www.aliyun.com/product/odps?spm=5176.19720258.J_8058803260.193.66022c4afTTWaa"}},{"infoName":"数据开发","infoContent":{"firstContentName":"DataWorks","lastContentName":"数据总线DataHub","firstContentLink":"https://www.aliyun.com/product/bigdata/ide?spm=5176.19720258.J_8058803260.204.66022c4afTTWaa","lastContentLink":"https://www.aliyun.com/product/datahub"}},{"infoName":"实时计算","infoContent":{"firstContentName":"实时数仓Hologres","lastContentName":"实时计算 Flink 版","firstContentLink":"https://www.aliyun.com/product/bigdata/hologram","lastContentLink":"https://www.aliyun.com/product/bigdata/sc"}},{"infoName":"大数据应用","infoContent":{"firstContentName":"DataV 数据可视化","lastContentName":"Quick Audience","firstContentLink":"https://www.aliyun.com/product/bigdata/datav?spm=5176.19720258.J_8058803260.208.66022c4afTTWaa","lastContentLink":"https://www.aliyun.com/product/retailadvqa?spm=5176.19720258.J_8058803260.210.66022c4afTTWaa"}}]}],"card":[],"search":[],"infoCard":[{"bannerTitle":"阿里云大数据","bannerUrl":"https://img.alicdn.com/imgextra/i1/O1CN01Ijdmbv24KsvapQk1n_!!6000000007373-0-tps-3840-740.jpg","bannerContent":"阿里云大数据包含MaxCompute、Hologres、DataWorks等。企业级安全，极致弹性，开放兼容，更快速地解决海量数据计算问题，有效降低企业成本，并保障数据安全。","liveButtonName":"了解详情","liveButtonLink":"https://www.aliyun.com/product/bigdata/apsarabigdata","homePageName":"方案咨询","homePageLink":"https://survey.aliyun.com/apps/zhiliao/UfVBgCs4"}],"title":{"mainTitle":"mPaaS","subtitle":"源自于支付宝小程序框架，亿级线上业务体量的锤炼，安全性媲美支付宝原生能力。不仅面向自有 App 投放小程序，更可快速构建打包，覆盖支付宝、淘宝、钉钉等应用。","linkUrl":"https://www.aliyun.com/product/mobilepaas/mpaas-miniprogram","btnText":"查看详情"},"visual":{"topbg":"https://img.alicdn.com/tfs/TB1bQuBIYH1gK0jSZFwXXc7aXXa-3840-740.gif","icon":"","textColor":"dark"},"dataList":[{"summary":"啦啦啦","author":"wuwu","linksUrl":"#"}],"sceneCard":[],"txt":[]}}
大数据
阿里云大数据是简单、易用、全托管的云原生大数据服务。企业级安全，极致弹性，开放兼容，更快速地解决海量数据计算问题，有效降低企业成本，并保障数据安全。明星产品MaxCompute、Hologres、DataWorks。
了解详情
方案咨询
大数据体验馆
大数据计算
MaxCompute
E-MapReduce
数据开发
DataWorks
数据总线DataHub
实时计算
实时数仓Hologres
实时计算 Flink 版
大数据应用
DataV 数据可视化
Quick Audience
{"optioninfo":{"dynamic":"ture","static":"true"},"simplifiedDisplay":"newEdition","newCard":[{"ifIcon":"icon","link":"","icon":"","iconImg":"","contentLink":"https://www.aliyun.com/product/bigdata/apsarabigdata","title":"大数据","des":"阿里云大数据是简单、易用、全托管的云原生大数据服务。企业级安全，极致弹性，开放兼容，更快速地解决海量数据计算问题，有效降低企业成本，并保障数据安全。明星产品MaxCompute、Hologres、DataWorks。","link1":"https://www.aliyun.com/product/bigdata/apsarabigdata","btn1":"了解详情","link2":"https://survey.aliyun.com/apps/zhiliao/UfVBgCs4","btn2":"方案咨询","btn3":"大数据体验馆","link3":"https://workbench.data.aliyun.com/experience.htm?spm=a2c0j.14041929.1399591.2.74733097H2MUxa#/","infoGroup":[{"infoName":"大数据计算","infoContent":{"firstContentName":"MaxCompute","lastContentName":"E-MapReduce","lastContentLink":"https://www.aliyun.com/product/emapreduce","firstContentLink":"https://www.aliyun.com/product/odps?spm=5176.19720258.J_8058803260.193.66022c4afTTWaa"}},{"infoName":"数据开发","infoContent":{"firstContentName":"DataWorks","lastContentName":"数据总线DataHub","firstContentLink":"https://www.aliyun.com/product/bigdata/ide?spm=5176.19720258.J_8058803260.204.66022c4afTTWaa","lastContentLink":"https://www.aliyun.com/product/datahub"}},{"infoName":"实时计算","infoContent":{"firstContentName":"实时数仓Hologres","lastContentName":"实时计算 Flink 版","firstContentLink":"https://www.aliyun.com/product/bigdata/hologram","lastContentLink":"https://www.aliyun.com/product/bigdata/sc"}},{"infoName":"大数据应用","infoContent":{"firstContentName":"DataV 数据可视化","lastContentName":"Quick Audience","firstContentLink":"https://www.aliyun.com/product/bigdata/datav?spm=5176.19720258.J_8058803260.208.66022c4afTTWaa","lastContentLink":"https://www.aliyun.com/product/retailadvqa?spm=5176.19720258.J_8058803260.210.66022c4afTTWaa"}}]}],"card":[],"search":[],"infoCard":[{"bannerTitle":"阿里云大数据","bannerUrl":"https://img.alicdn.com/imgextra/i1/O1CN01Ijdmbv24KsvapQk1n_!!6000000007373-0-tps-3840-740.jpg","bannerContent":"阿里云大数据包含MaxCompute、Hologres、DataWorks等。企业级安全，极致弹性，开放兼容，更快速地解决海量数据计算问题，有效降低企业成本，并保障数据安全。","liveButtonName":"了解详情","liveButtonLink":"https://www.aliyun.com/product/bigdata/apsarabigdata","homePageName":"方案咨询","homePageLink":"https://survey.aliyun.com/apps/zhiliao/UfVBgCs4"}],"title":{"mainTitle":"mPaaS","subtitle":"源自于支付宝小程序框架，亿级线上业务体量的锤炼，安全性媲美支付宝原生能力。不仅面向自有 App 投放小程序，更可快速构建打包，覆盖支付宝、淘宝、钉钉等应用。","linkUrl":"https://www.aliyun.com/product/mobilepaas/mpaas-miniprogram","btnText":"查看详情"},"visual":{"topbg":"https://img.alicdn.com/tfs/TB1bQuBIYH1gK0jSZFwXXc7aXXa-3840-740.gif","icon":"","textColor":"dark"},"dataList":[{"summary":"啦啦啦","author":"wuwu","linksUrl":"#"}],"sceneCard":[],"txt":[]}
{"$env":{"JSON":{}},"$page":{"env":"production"},"$context":{"optioninfo":{"dynamic":"ture","static":"true"},"simplifiedDisplay":"newEdition","newCard":[{"ifIcon":"icon","link":"","icon":"","iconImg":"","contentLink":"https://www.aliyun.com/product/bigdata/apsarabigdata","title":"大数据","des":"阿里云大数据是简单、易用、全托管的云原生大数据服务。企业级安全，极致弹性，开放兼容，更快速地解决海量数据计算问题，有效降低企业成本，并保障数据安全。明星产品MaxCompute、Hologres、DataWorks。","link1":"https://www.aliyun.com/product/bigdata/apsarabigdata","btn1":"了解详情","link2":"https://survey.aliyun.com/apps/zhiliao/UfVBgCs4","btn2":"方案咨询","btn3":"大数据体验馆","link3":"https://workbench.data.aliyun.com/experience.htm?spm=a2c0j.14041929.1399591.2.74733097H2MUxa#/","infoGroup":[{"infoName":"大数据计算","infoContent":{"firstContentName":"MaxCompute","lastContentName":"E-MapReduce","lastContentLink":"https://www.aliyun.com/product/emapreduce","firstContentLink":"https://www.aliyun.com/product/odps?spm=5176.19720258.J_8058803260.193.66022c4afTTWaa"}},{"infoName":"数据开发","infoContent":{"firstContentName":"DataWorks","lastContentName":"数据总线DataHub","firstContentLink":"https://www.aliyun.com/product/bigdata/ide?spm=5176.19720258.J_8058803260.204.66022c4afTTWaa","lastContentLink":"https://www.aliyun.com/product/datahub"}},{"infoName":"实时计算","infoContent":{"firstContentName":"实时数仓Hologres","lastContentName":"实时计算 Flink 版","firstContentLink":"https://www.aliyun.com/product/bigdata/hologram","lastContentLink":"https://www.aliyun.com/product/bigdata/sc"}},{"infoName":"大数据应用","infoContent":{"firstContentName":"DataV 数据可视化","lastContentName":"Quick Audience","firstContentLink":"https://www.aliyun.com/product/bigdata/datav?spm=5176.19720258.J_8058803260.208.66022c4afTTWaa","lastContentLink":"https://www.aliyun.com/product/retailadvqa?spm=5176.19720258.J_8058803260.210.66022c4afTTWaa"}}]}],"card":[],"search":[],"infoCard":[{"bannerTitle":"阿里云大数据","bannerUrl":"https://img.alicdn.com/imgextra/i1/O1CN01Ijdmbv24KsvapQk1n_!!6000000007373-0-tps-3840-740.jpg","bannerContent":"阿里云大数据包含MaxCompute、Hologres、DataWorks等。企业级安全，极致弹性，开放兼容，更快速地解决海量数据计算问题，有效降低企业成本，并保障数据安全。","liveButtonName":"了解详情","liveButtonLink":"https://www.aliyun.com/product/bigdata/apsarabigdata","homePageName":"方案咨询","homePageLink":"https://survey.aliyun.com/apps/zhiliao/UfVBgCs4"}],"title":{"mainTitle":"mPaaS","subtitle":"源自于支付宝小程序框架，亿级线上业务体量的锤炼，安全性媲美支付宝原生能力。不仅面向自有 App 投放小程序，更可快速构建打包，覆盖支付宝、淘宝、钉钉等应用。","linkUrl":"https://www.aliyun.com/product/mobilepaas/mpaas-miniprogram","btnText":"查看详情"},"visual":{"topbg":"https://img.alicdn.com/tfs/TB1bQuBIYH1gK0jSZFwXXc7aXXa-3840-740.gif","icon":"","textColor":"dark"},"dataList":[{"summary":"啦啦啦","author":"wuwu","linksUrl":"#"}],"sceneCard":[],"txt":[]}}
大数据
阿里云大数据是简单、易用、全托管的云原生大数据服务。企业级安全，极致弹性，开放兼容，更快速地解决海量数据计算问题，有效降低企业成本，并保障数据安全。明星产品MaxCompute、Hologres、DataWorks。
了解详情
方案咨询
大数据体验馆
大数据计算
MaxCompute
E-MapReduce
数据开发
DataWorks
数据总线DataHub
实时计算
实时数仓Hologres
实时计算 Flink 版
大数据应用
DataV 数据可视化
Quick Audience
