Cloud Academy – Introduction to Google Cloud Dataproc

Google Cloud Dataproc 是一种用于运行 Apache Hadoop 和 Spark 作业的托管服务。它可用于大数据处理和机器学习。

但是您可以在 Compute Engine 实例上运行这些数据处理框架，那么 Dataproc 能为您做什么？Dataproc 实际上在幕后使用 Compute Engine 实例，但它会为您处理管理细节。它是顶部的一层，可以根据需要轻松上下旋转集群。

MP4 | Video: h264, 1920×1080 | Audio: AAC, 44.1 KHz, 2 Ch
Difficulty: Intermediate | Genre: eLearning | Language: English | Duration: 8 Lectures (49m) | Size: 757 MB

What you’ll learn:
Explain the relationship between Dataproc, key components of the Hadoop ecosystem, and related GCP services
Create, customize, monitor, and scale Dataproc clusters
Run data processing jobs on Dataproc
Apply access control to Dataproc

Requirements
Hadoop or Spark experience (recommended)
Google Cloud Platform account (sign up for free trial at https://cloud.google.com/free if you don’t have an account)

Description
Google Cloud Dataproc is a managed service for running Apache Hadoop and Spark jobs. It can be used for big data processing and machine learning.

But you could run these data processing frameworks on Compute Engine instances, so what does Dataproc do for you? Dataproc actually uses Compute Engine instances under the hood, but it takes care of the management details for you. It’s a layer on top that makes it easy to spin up and down clusters as you need them.

Who this course is for
Data professionals
People studying for the Google Professional Data Engineer exam