Cloudera Hadoop管理员（CCAH）＆开发者（CCA）认证大纲

souwin

Cloudera Certified Administrator forApache Hadoop (CCA-500)
Number of Questions: 60 questions
Time Limit: 90 minutes
Passing Score: 70%
Language: English, Japanese

Exam Sections and Blueprint

1. HDFS (17%)

• Describe the function of HDFS daemons
  
• Describe the normal operation of an Apache     Hadoop cluster, both in data storage and in data processing
  
• Identify current features of computing systems     that motivate a system like Apache Hadoop
  
• Classify major goals of HDFS Design
  
• Given a scenario, identify appropriate use     case for HDFS Federation
  
• Identify components and daemon of an HDFS     HA-Quorum cluster
  
• Analyze the role of HDFS security (Kerberos)
  
• Determine the best data serialization choice     for a given scenario
  
• Describe file read and write paths
  
• Identify the commands to manipulate files in     the Hadoop File System Shell
  

2. YARN and MapReduce version 2 (MRv2)(17%)

• Understand how upgrading a cluster from Hadoop     1 to Hadoop 2 affects cluster settings
  
• Understand how to deploy MapReduce v2 (MRv2 /     YARN), including all YARN daemons
  
• Understand basic design strategy for MapReduce     v2 (MRv2)
  
• Determine how YARN handles resource     allocations
  
• Identify the workflow of MapReduce job running     on YARN
  
• Determine which files you must change and how     in order to migrate a cluster from MapReduce version 1 (MRv1) to MapReduce     version 2 (MRv2) running on YARN
  

3. Hadoop Cluster Planning (16%)

• Principal points to consider in choosing the     hardware and operating systems to host an Apache Hadoop cluster
  
• Analyze the choices in selecting an OS
  
• Understand kernel tuning and disk swapping
  
• Given a scenario and workload pattern,     identify a hardware configuration appropriate to the scenario
  
• Given a scenario, determine the ecosystem     components your cluster needs to run in order to fulfill the SLA
  
• Cluster sizing: given a scenario and frequency     of execution, identify the specifics for the workload, including CPU,     memory, storage, disk I/O
  
• Disk Sizing and Configuration, including JBOD     versus RAID, SANs, virtualization, and disk sizing requirements in a     cluster
  
• Network Topologies: understand network usage     in Hadoop (for both HDFS and MapReduce) and propose or identify key     network design components for a given scenario
  

4. Hadoop Cluster Installation andAdministration (25%)

• Given a scenario, identify how the cluster     will handle disk and machine failures
  
• Analyze a logging configuration and logging     configuration file format
  
• Understand the basics of Hadoop metrics and     cluster health monitoring
  
• Identify the function and purpose of available     tools for cluster monitoring
  
• Be able to install all the ecoystme components     in CDH 5, including (but not limited to): Impala, Flume, Oozie, Hue,     Cloudera Manager, Sqoop, Hive, and Pig
  
• Identify the function and purpose of available     tools for managing the Apache Hadoop file system
  

5. Resource Management (10%)

• Understand the overall design goals of each of     Hadoop schedulers
  
• Given a scenario, determine how the FIFO     Scheduler allocates cluster resources
  
• Given a scenario, determine how the Fair     Scheduler allocates cluster resources under YARN
  
• Given a scenario, determine how the Capacity     Scheduler allocates cluster resources
  

6. Monitoring and Logging (15%)

• Understand the functions and features of     Hadoop’s metric collection abilities
  
• Analyze the NameNode and JobTracker Web UIs
  
• Understand how to monitor cluster daemons
  
• Identify and monitor CPU usage on master nodes
  
• Describe how to monitor swap and memory     allocation on all nodes
  
• Identify how to view and manage Hadoop’s log     files
  
• Interpret a log files
• --------------------------------------------------------
  

CCA Spark and Hadoop Developer Exam(CCA175)

Number of Questions: 10–12performance-based (hands-on) tasks on CDH5 cluster. See below for full clusterconfiguration

Time Limit: 120 minutes

Passing Score: 70%

Language: English, Japanese (forthcoming)

Required Skills

Data Ingest

The skills to transfer data between external systemsand your cluster. This includes the following:

• Import data from a MySQL database into HDFS     using Sqoop
  
• Export data to a MySQL database from HDFS     using Sqoop
  
• Change the delimiter and file format of data     during import using Sqoop
  
• Ingest real-time and near-real time (NRT)     streaming data into HDFS using Flume
  
• Load data into and out of HDFS using the     Hadoop File System (FS) commands
  

Transform, Stage, Store

Convert a set of data values in a given format storedin HDFS into new data values and/or a new data format and write them into HDFS.This includes writing Spark applications in both Scala and Python:

• Load data from HDFS and store results back to     HDFS using Spark
  
• Join disparate datasets together using Spark
  
• Calculate aggregate statistics (e.g., average     or sum) using Spark
  
• Filter data into a smaller dataset using Spark
  
• Write a query that produces ranked or sorted     data using Spark
  

Data Analysis

Use Data Definition Language (DDL) to create tables inthe Hive metastore for use by Hive and Impala.

• Read and/or create a table in the Hive     metastore in a given schema
  
• Extract an Avro schema from a set of datafiles     using avro-tools
  
• Create a table in the Hive metastore using the     Avro file format and an external schema file
  
• Improve query performance by creating     partitioned tables in the Hive metastore
  
• Evolve an Avro schema by changing JSON files
  

以上，有疑问可加Q1438118790询问