Practice Free H13-723_V2.0 HCIP-Big Data Developer V2.0 Exam Questions Answers With Explanation

ProducerResponsible for production data,Consumerresponsible for consuming data,ProducerandConsumerneed to be established betweenSocket

connect

Producercan either send data toBroker, and can send data toConsumersuperior

ProducerAs a message producer, you can directly write data toZooKeeper

Producerconnect any normalBrokerInstances can produce data

True

False

C

Scala

Java

Python

Attribute values with high access weight are placed inRowKeyFront

Attribute values with high access weight are placed inRowkeysecond half

Attribute values with good dispersion are placed inRowkeyfirst half

Attribute values with good dispersion are placed inRowkeysecond half

hdfs dfs

yarn jar

yarn application

After creating,

writing and closing,

do not modify it again.

right or wrong

KafkaofProducerWhen sending a message, you can specify which message is sent byConsumerConsumption.

while creatingTopc, the number of replicas must not be greater than the currently survivingBrokerThe number of instances, otherwise createTopicWill will fail.

KafkaAfter the installation is complete, you can no longer configure the data storage directory.

KafkaMetadata information will be stored inZooKeepersuperior.

True

False

Spark

Streaming

MapReduce

HDFS

suspend

getJobInfo

submit

Run

Create a normal table by default

The essence of the external table is that it will already existHDFSThe file path above is associated with the table

When deleting a normal table, both metadata and data are deleted at the same time

When deleting an external table, only the external table data is deleted without the metadata

val counts=textFile.map(line=>line.split(" ')).map(-rd=>(word,1)).reduceByKey(_+_)

val counts=textFile.flatMap(line=>line.split(" ")).map(word=>(word,1)).reduceByKey(_+_)

val counts=textFile.map(line=>line.split(" ")).map(word=>(word,1)).groupByKey()

val counts=textFile.flatmap(line=>line.split(" ")).map(-rd=>(word,1)).reduceByKey()

Hivefinally store the data inHDFSmiddle

HQLable to passMapReduceperform tasks

HiveYesHadoopThe platform's data warehouse tools

HiverightHBasehave strong dependencies

eachDataNodemaximum storage1copies.

Support multiple users to write to the same file at the same time.

The first copy of the data block is placed preferentially on the node where the client writing the data block is located.

Copied file blocks all exist on the same rack by default.

submitcommand to change the status of the job toPREP

startcommand allowsPREPThe status of the job changes toRUNNING

runcommand to change the job status toRUNNING

killCommands can act onPREP/SUSPEND/RUNNINGstatus job

clickClouddownTree,CheckSolr CloudmiddleCollections, a configuration set, andlive_nodesequivalence information

clickCloud, see eachCollectionunder eachShardofReplicadistribution and status

enter aCollectionofShard ReplicaofCore Overviewinterface, you can view theRepicaSow

Quoting the actual number of documents, storage size and location information

Solruser group,Solr adminrole andSuper groupof users have access toSolr Admin UI

32MB

64MB

128MB

256MB

KafkaIt is a high-throughput, distributed, publish-subscribe-based messaging system

KafkaPersistence of messages

KafkaApplicable to offline and online message consumption scenarios

Kafkaguarantee eachPartitionmessages in order

True

False

used to filter data

Used to optimize random performance

will increase storage consumption

Can accurately determine that a certain data does not exist

Table Name

Table names and column families(or table name andfamily)

table names and columns

can be empty

low latency

Rich data structures

Support data persistence

supportSQLquery interface

Flume

Loader

HBase

MapReduce

easy to program

good scalability

real-time computing

High fault tolerance

128M

100M

64M

50M

name-node

source

mapred.mapper.class

job-tracker

usehashstructure, and a table uses ahash key, a row in the table records forhash keyone offield.

usehashstructure, each row record of each table uses onehash key,hash keyoffieldThe fields of the corresponding table records,

and designKEYEach table adds a different prefix to distinguish it.

usestringstructure, each field of each row record of each table uses oneKEY.

usestringstructure, each row record of each table uses oneKEY,valueAll fields recorded for a row in a table? ?back value of .

True

False

easy to program

good scalability

real-time computing

High fault tolerance

True

False

True

False

Build queuing systems, such as message queues

uniqOperations, such as getting the ranking value of all data in a certain period of time

get latestNdata operations: for example, for a certain microblog, get the latest10comments

Simulate stack operations

Nimbus

Supervisor

Broker

quorumpeer

True

False

True

False

suspend

getJoblnfo

submit

run

Active and standbyNameNodeThe disk space where the metadata is located is insufficient.

The number of missing blocks exceeds the threshold.

Lost replicas exceed the threshold.

The corrupted replica exceeds the threshold.

available fromHDFSdirectly into thehivesurface

available fromHiveServerThe local hard disk of the node is directly loaded into thehivesurface

It can be directly loaded from the local hard disk of the node where the client is located.hivesurface

HiveThe data loading process will not parse the specific file content, mainly the process of file transfer

hive.exec.compress.intermediate

hive.intermediate.compression.codec

hive.exec.compress.output

twenty three

hive.intermediate.compression.type

supportCSVandJSON

supportCSV,JSONandHTML

supportCSV,JSONandXML

True

False

eachDataNodemaximum storage1copy.

Support multiple users to write to the same file at the same time.

The first copy of the data block is placed preferentially on the node where the client writing the data block is located.

Copied file blocks all exist on the same rack by default.

mergemapThe result of the stage has the samekeyvalue key-value pair

put allmapThe results of the stages are merged to get the final result

rightmapThe results of the stages are sorted and merged

Divide the input data into one by one. and split this further into pairs, then asmapfunction input of

Put

HTable

HBaseAdmin

PutList

In a network isolation environment,ZooKeeperofIPCan be configured as a businessIP, can also be configured to manageIP.

HiveUnlike traditional databases, soJDB, CThe established connection does not need to be closed.

In a secure cluster environment, establish andHiveBefore connecting, you need to use unified authentication to log in.

useJDB, CsubmitSQL, you canSQLA semicolon ";" is added after the statement.

True

False

HBaseIt can store massive data and support dynamic expansion, which can fulfill the storage requirements of logistics and sales data.

HbaseIt supports efficient random reading, and can complete real-time analysis and command of the logistics situation through reasonable design.

Logistics data is very sparse,HBaseCan handle sparse data efficiently.

HBaseIt can be built on ordinary commercial servers, and the construction cost is relatively low.

In the application configuration filespark-defaults.confconfigure in

When submitting your application, pass--confmake settings

In the application code, passSparkContextofsetPropertymethod to set

In the application code, passSparkConfobject to set

Attribute values with high access weight are placed inRowKeyFront

Attribute values with high access weight are placed inRowkeysecond half

Attribute values with good dispersion are placed inRowkeyfirst half

Attribute values with good dispersion are placed inRowkeysecond half

True

False

Create an input stream

Create output stream

Business action statements (such asSELECT,INSERT,JIONWait)

Apply commit statement

ConsumerMainly for data consumption

ConsumerNeed to specify when consuming dataTopic

multipleConsumerconfigure the samegroup.idwhen theseConsumerConsumed data will not be duplicated

newConsumerAPIConsumption data does not need to be specifiedZooKeeperaddress

Flume

Loader

HBase

MapReduce

True

False

True

False

yarm.scheduler.capacity.rot.QueueA. user-limit-factor

yam.scheduler.capacity.root.QueueA. minimum-userlimit-percent

yarm.scheduler.capacity.root.QueueA. capacity yarm.scheduler.capacity.rot.QueueA

Easy to program.

Good scalability

Calculate in real time

High fault tolerance

krb5.confconfiguration file

existFusionInsight ManagerUser account applied on

user accountkeytabdocument

jaas.confconfiguration file

True

False

Put

HTable

HBaseAdmin

Puttist

Attribute values with high port access weights are placed inRowKeyFront

Attribute values with high port access weights are placed inRowkeysecond half

The attribute value with good dispersion is placed inRowkeyfirst half

The attribute value with good dispersion is placed inRowkeysecond half

index name

index column

Index column type (and index column length)

the name of the column family to which the indexed column belongs,

If ZooKeeperIf there is an interruption in the process of synchronizing the message, after the failure is recovered, the transmission status before the failure can be adjusted according to the the state continues to synchronize, that is, support for resuming transmission from a breakpoint.

ZooKeeperUse a custom atomic message protocol to ensure the consistency of node data in the entire system.

ZooKeeperThe cluster is elected at startupLeaderRole.

LeaderAfter a node receives a data change request, it first writes to disk and then writes to memory.

ORC(High-performance column store)

Parquetcolumn store

RCFileRow-column storage

TextFile

Produceris a message producer

ProducerProduction data needs to be specifiedTopic

Can play multiple at the same timeProducerprocess to the sameTopicsend data

ProducerNeed to connect first when producing dataZooKeeper, and then connectBroker

INCR(increment the stored digital value by one)

HINCRBY(for the hash tablekeydomain infieldvalue plus incrementincrement)

LPUSH(for linked listspushoperate)

All of the above

The port preferentially downloads data from the nearest DataNode.

The port file data is first returned from the DataNode to the NameNode, and then downloaded from the NameNode to the client.

If the client and the connected DataNode fail while reading, the client will abandon the failure

node, to connect to the node where its replica is located.

The port supports multiple clients reading the same file data from the DataNode at the same time.

Active and standbyNameNodeThe disk space where the metadata is located is insufficient.

The number of missing blocks on the port exceeds the threshold.

The missing copies of the port exceed the threshold.

The corrupted copy exceeds the threshold.

In a network isolation environment,ZooKeeperofIPCan be configured as a businessIP, can also be configured to manageIP.

hiveUnlike traditional databases, soJDB, CThe established connection does not need to be closed.

In a secure cluster environment, establish andHiveBefore connecting, you need to use unified authentication to log in.

useJDB, CsubmitSQL, you canSQLPut a semicolon after the statement";"

Support for REST-based query requests

The returned data format of WebHCat is XML

WebHCat provides external services based on HTTP and HTTPS protocols

You can create tables, query and other operations through WebHCat

rval counts = textFile.map(line => line.split("")).map(word =>(word,

1)).reduceByKey(+)

val counts = textFile.flatMap(line => line.split(")).map(word =>(word,

1)).reduceByKey(+)

vrval counts = textFie.map(line => line.split(")).map(word =>(word,

1)).groupByKey( )

vrval counts = textFile.flatMap(line => line.split("")).map(word =>(word,

1)).groupByKey( )

True

False

supportCSVandJSON

supportCSV,JSONandHTML

supportCSV,JSONandXML

Key

Value

timeStamp

KeyType

sent in order.

True

False

True

False

mouthkill

mouthrun

mouthresume(wake)

mouthsubmit

3

4

5

6

Nimbus

Supervisor

Broker

quorumpeer

enabledAckerLater,StreamingIt will identify the failure to sendTupleAnd automatically resend, no need for human intervention pre.

AckerThe message that will identify the processing timeout or processing failure isfail.

fromspoutstarted, formedTupleFailure of any link in the tree will mark the entire tree as failed.

The application needs to be inspoutoffail() interface method to implement message resend logic.

True

False

True

False

mouth broadcast variable in eachTasksave a copy

mouth broadcast variable in eachExecutorsave a copy

Port broadcast variables are read-only

port broadcast variable viaSparkContext.broadcast) method to generate

NodeManager

ResourceManager

DataNode

NameNode

The disk configuration (such as the number of disks, disk size, etc.) used to store Kafka data cannot meet the current industry requirements.

service data traffic, causing the disk usage to reach the upper limit

The data storage time is configured too long, and the accumulated data reaches the upper limit of the disk usage.

Unreasonable business planning results in uneven data distribution and some disks reach the upper limit of usage

Broker node failure caused

Flume

Loader

HBase

MapReduce

FusionInsight ManagerofWebinterface

Loader Webinterface

Solr Webinterface

Yarn Webinterface

Support based onRESTquery request

WebHCatThe return data format isXML

WebHCatbased onHTTPandHTTPSAgreement to provide services to the outside world

able to passWebHCatCreate tables, query, etc.

HIVE

HBASE

HDFS

DB

True

False

True

False

True

False

Producer

Broker

Consumer

ZooKeeper

True

False

True

False

True

False

lob

Context

FileSystem

Configuration

Shuffle Grouping

Field Grouping

Local Grouping

Direct Grouping

ShellOrder

Java API

Hue UI

Rest API

list

set

hash

sorted set

Produceris a message producer

ProducerProduction data needs to be specifiedTopic

Can play multiple at the same timeProducerprocess to the sameTopicsend data

ProducerNeed to connect first when producing dataZooKeeper, and then connectBroker

Real-time real-time online data analysis

Data mining (user behavior analysis, interest division, regional display)

Data Aggregation (Daily/Weekly user clicks, click ranking)

Non-real-time analysis (log analysis, statistical analysis)

priority from the nearestDataNodeDownload data.

file data fromDataNodeback toNameNode, then fromNameNodeDown to the client.

If the client and the connectedDataNodeIf there is a failure in reading, then the client will give up the applause node and connect the node where other replicas are located.

Supports multiple clients fromDataNoderead the same file data.

SupervisorAfter the process exits, it can beNimbusAutomatically identify and pull up without affecting running business.

WorkerCan be used after abnormal exitSupervisorPulls up automatically without manual intervention.

When a node fails, the tasks on the node will be reassigned to other normal nodes without manual intervention.

NimbusAfter the failure, the backupNimbusIt will take over automatically without affecting the running business.

Partition Table

bucket table

Tilt table

partition+bucket table

HBase

Spark

MapReduce

Streaming

True

False

True

False

to emit

execute

open

nextTuple

Create an input stream

Create output stream

Business action statements (such asSELECT,INSERT,JIONWait)

Apply commit statement

in the application configuration filespark-defaults.confconfigure in

When submitting your application, by-confmake settings

In the application code, passSparkContextofsetPropertymethod to set

In the application code, passSparkConfobject to set

compromise method (rowkeyDesign takes into accountAandBbusiness needs)

Redundancy method (use space for time factory efficiency)

Create secondary index

pre-scoreregion

Krb5.conf

TGT

ST

jaas.conf

read only

partition

fault tolerance

efficient

In a network isolation environment,ZooKeeperofIPCan be configured as a businessIP, can also be configured to manageIP.

HiveUnlike traditional databases, soJDB, CThe established connection does not need to be closed.

In a secure cluster environment, establish andHiveBefore connecting, you need to use unified authentication to log in.

useJDB, CsubmitSQL, you canSQLA semicolon ";" is added after the statement.

List

Set

Hash

Sorted set

stream processing

high performance

Scalable

High fault tolerance

CheckOozieofJava APIWhether the returned result is as expected

pass throughHueofworkflowDashboard to view program running results

pass throughHue's file browser to see ifHDFSThe specified directory produces the expected file

Oozieself-containedWebThe interface can also view the job execution results

128M

100M

64M

50M

storm jar example jar wcTest om huawei example WordCount

storm jar example jar wcTest WrodCount

storm jar example jar om huawei example WordCount wcTest

storm jar example jar WorkCount wcTest

KafkaadminGroup

KakfaGroup

kafkasuperuserGroup

True

False

storage

Resource management

search

data transmission

Streaming data monitoring

Real-time visit statistics of the website

Offline log analysis

Traffic flow analysis

kill

run

resume

submit

XCompareYhigher performance

XCompareYlower performance

XandYsame as performance

UncertaintyXandYdifference in performance

True

False

available fromHDFSdirectly into thehivesurface

available fromHiveServerThe local hard disk of the node is directly loaded into thehivesurface

It can be directly loaded from the local hard disk of the node where the client is located.hivesurface

HiveThe data loading process will not parse the specific file content, mainly the process of file transfer

Storm.jar example.jar wcTest om.huawei..example.wordcount

Storm.jar example.jar wcTest wordcount

Storm.jar example.jar om.huawei..example.wordcount wcTest

Storm.jar example.jar wordcount wcTest

split

combine

partition

sort

True

False

split

combine

partition

sort

mergemapThe result of the stage has the samekeyvalue key-value pair

put allmapThe results of the stages are merged to get the final result

rightmapThe results of the stages are sorted and merged

Split the input data into individualsplit, and willsplitfurther split intoyes, then asmapletter input of numbers

Spark Streaming

Streaming

MapReduce

HDFS

JDB, C

spark-beeline

spark-sql

True

False

SupervisorAfter the process exits, it can beNimbusAutomatically identify and pull up without affecting running business.

WorkerCan be used after abnormal exitSupervisorPulls up automatically without manual intervention.

When a node fails, the tasks on the node will be reassigned to other normal nodes without manual intervention.

NimbusAfter the failure, the backupNimbusIt will take over automatically without affecting the running business.

(1) data fromsourcearrivechannel;(2)sinkfromchannelfetch data

(1) data fromchannelarrivesource;(2)sinkfromsourcefetch data

(1) data fromsinkarrivechannel;(2)sourcefromchannelfetch data

(1) data fromchannelarrivesource;(2)sinkfromsourcefetch data

Create an input stream

Create output stream

Business action statements (such asSELECT,INSERT,JIONWait)

Apply commit statement

to emit

execute

open

nextTuple

in the application configuration filespark-defaults.confconfigure in

When submitting your application, pass—confmake settings

In the application code, passSparkContextofsetPropertymethod to set

In the application code, passSparkConfobject to set

hive.exec.reducers.bytes.per.reducer

hive.exec-ducers.max

hive.exec.max.dynamic.partitions

hive.exec.max.dynamic.partitions.pernode

Partition fields are defined when the table is created

There can only be one partition field, and multi-level partitions cannot be created

Using partitions can reduce the data scan range of some queries, thereby improving query efficiency

Partition fields can be used aswherecondition of the sentence

5

10

20

30

CRC

Parquet

RCFile

TextFile

HDFS

HBase

Kafka

Redis

pre-scoreregion,MakeregionEvenly distributed, improve concurrency

Query frequent attributes are placed inrowkeyThe front part

Use secondary indexes to adapt to more query scenarios

Data read at the same time are stored in the samecellmiddle

True

False

True

False

existSolrCreate an index and save the data, and return all the data during full-text search.

existHBasestore data on theHBaseThe filtering characteristics of , satisfy fuzzy matching query.

When storing data, inSolrindex on theHBaseStore complete data? ?when, throughSolrFull-text search to obtain and record

record key information, through the key information inHBasefor the full record.

True

False

True

False