Databricks Databricks-Certified-Data-Engineer-Professional 실제 시험문제 및 답변

문제1
A junior data engineer has been asked to develop a streaming data pipeline with a grouped aggregation using DataFrame df. The pipeline needs to calculate the average humidity and average temperature for each non-overlapping five-minute interval. Events are recorded once per minute per device.
Streaming DataFrame df has the following schema:
"device_id INT, event_time TIMESTAMP, temp FLOAT, humidity FLOAT"
Code block:
Get Latest & Actual Certified-Data-Engineer-Professional Exam's Question and Answers from

Choose the response that correctly fills in the blank within the code block to complete this task.

A. window("event_time", "10 minutes").alias("time")

B. "event_time"

C. lag("event_time", "10 minutes").alias("time")

D. window("event_time", "5 minutes").alias("time")

E. to_interval("event_time", "5 minutes").alias("time")

정답: D

설명: (ExamPassdump 회원만 볼 수 있음)

문제2
The data engineering team maintains the following code:
Get Latest & Actual Certified-Data-Engineer-Professional Exam's Question and Answers from

Assuming that this code produces logically correct results and the data in the source table has been de-duplicated and validated, which statement describes what will occur when this code is executed?

A. The gold_customer_lifetime_sales_summary table will be overwritten by aggregated values calculated from all records in the silver_customer_sales table as a batch job.

B. The silver_customer_sales table will be overwritten by aggregated values calculated from all records in the gold_customer_lifetime_sales_summary table as a batch job.

C. An incremental job will detect if new rows have been written to the silver_customer_sales table; if new rows are detected, all aggregates will be recalculated and used to overwrite the gold_customer_lifetime_sales_summary table.

D. An incremental job will leverage running information in the state store to update aggregate values in the gold_customer_lifetime_sales_summary table.

E. A batch job will update the gold_customer_lifetime_sales_summary table, replacing only those rows that have different values than the current version of the table, using customer_id as the primary key.

정답: A

설명: (ExamPassdump 회원만 볼 수 있음)

문제3
The downstream consumers of a Delta Lake table have been complaining about data quality issues impacting performance in their applications. Specifically, they have complained that invalid latitude and longitude values in the activity_details table have been breaking their ability to use other geolocation processes.
A junior engineer has written the following code to add CHECK constraints to the Delta Lake table:

A senior engineer has confirmed the above logic is correct and the valid ranges for latitude and longitude are provided, but the code fails when executed.
Which statement explains the cause of this failure?

A. The activity details table already contains records; CHECK constraints can only be added prior to inserting values into a table.

B. Because another team uses this table to support a frequently running application, two-phase locking is preventing the operation from committing.

C. The activity details table already contains records that violate the constraints; all existing data must pass CHECK constraints in order to add them to an existing table.

D. The activity details table already exists; CHECK constraints can only be added during initial table creation.

E. The current table schema does not contain the field valid coordinates; schema evolution will need Get Latest & Actual Certified-Data-Engineer-Professional Exam's Question and Answers from to be enabled before altering the table to add a constraint.

정답: C

설명: (ExamPassdump 회원만 볼 수 있음)

문제4
A junior data engineer on your team has implemented the following code block.

The view new_events contains a batch of records with the same schema as the events Delta table. The event_id field serves as a unique key for this table.
When this query is executed, what will happen with new records that have the same event_id as an existing record?

A. They are updated.

B. They are ignored.

C. They are deleted.

D. They are merged.

E. They are inserted.

정답: B

설명: (ExamPassdump 회원만 볼 수 있음)

문제5
A Structured Streaming job deployed to production has been resulting in higher than expected cloud storage costs. At present, during normal execution, each microbatch of data is processed in less than 3s; at least 12 times per minute, a microbatch is processed that contains 0 records. The streaming write was configured using the default trigger settings. The production job is currently scheduled alongside many other Databricks jobs in a workspace with instance pools provisioned to reduce start-up time for jobs with batch execution.
Holding all other variables constant and assuming records need to be processed in less than 10 minutes, which adjustment will meet the requirement?

A. Set the trigger interval to 10 minutes; each batch calls APIs in the source storage account, so decreasing trigger frequency to maximum allowable threshold should minimize this cost.

B. Use the trigger once option and configure a Databricks job to execute the query every 10 minutes; this approach minimizes costs for both compute and storage.

C. Increase the number of shuffle partitions to maximize parallelism, since the trigger interval cannot be modified without modifying the checkpoint directory.

D. Set the trigger interval to 3 seconds; the default trigger interval is consuming too many records per batch, resulting in spill to disk that can increase volume costs.

E. Set the trigger interval to 500 milliseconds; setting a small but non-zero trigger interval ensures that the source is not queried too frequently.

정답: A

문제6
What is the first of a Databricks Python notebook when viewed in a text editor?

A. %python

B. // Databricks notebook source

C. -- Databricks notebook source

D. # MAGIC %python

E. # Databricks notebook source

정답: E

설명: (ExamPassdump 회원만 볼 수 있음)

문제7
Which of the following technologies can be used to identify key areas of text when parsing Spark Driver log4j output?

A. Scala Datasets

B. pyspsark.ml.feature

C. Regex

D. Julia

E. C++

정답: C

설명: (ExamPassdump 회원만 볼 수 있음)

문제8
A task orchestrator has been configured to run two hourly tasks. First, an outside system writes Parquet data to a directory mounted at /mnt/raw_orders/. After this data is written, a Databricks job containing the following code is executed:
Get Latest & Actual Certified-Data-Engineer-Professional Exam's Question and Answers from

Assume that the fields customer_id and order_id serve as a composite key to uniquely identify each order, and that the time field indicates when the record was queued in the source system.
If the upstream system is known to occasionally enqueue duplicate entries for a single order hours apart, which statement is correct?

A. All records will be held in the state store for 2 hours before being deduplicated and committed to the orders table.

B. The orders table will not contain duplicates, but records arriving more than 2 hours late will be ignored and missing from the table.

C. Duplicate records enqueued more than 2 hours apart may be retained and the orders table may contain duplicate records with the same customer_id and order_id.

D. The orders table will contain only the most recent 2 hours of records and no duplicates will be present.

E. Duplicate records arriving more than 2 hours apart will be dropped, but duplicates that arrive in the same batch may both be written to the orders table.

정답: C

문제9
A junior member of the data engineering team is exploring the language interoperability of Databricks notebooks. The intended outcome of the below code is to register a view of all sales that occurred in countries on the continent of Africa that appear in the geo_lookup table.
Before executing the code, running SHOW TABLES on the current database indicates the database contains only two tables: geo_lookup and sales.
Get Latest & Actual Certified-Data-Engineer-Professional Exam's Question and Answers from

Which statement correctly describes the outcome of executing these command cells in order in an interactive notebook?

A. Cmd 1 will succeed and Cmd 2 will fail, countries at will be a Python variable representing a PySpark DataFrame.

B. Cmd 1 will succeed. Cmd 2 will search all accessible databases for a table or view named countries af: if this entity exists, Cmd 2 will succeed.

C. Cmd 1 will succeed and Cmd 2 will fail, countries at will be a Python variable containing a list of strings.

D. Both commands will succeed. Executing show tables will show that countries at and sales at have been registered as views.

E. Both commands will fail. No new variables, tables, or views will be created.

정답: C

설명: (ExamPassdump 회원만 볼 수 있음)

문제10
Which statement characterizes the general programming model used by Spark Structured Streaming?

A. Structured Streaming models new data arriving in a data stream as new rows appended to an unbounded table.

B. Structured Streaming is implemented as a messaging bus and is derived from Apache Kafka.

C. Structured Streaming relies on a distributed network of nodes that hold incremental state values for cached stages.

D. Structured Streaming leverages the parallel processing of GPUs to achieve highly parallel data throughput.

E. Structured Streaming uses specialized hardware and I/O streams to achieve sub-second latency for data transfer.

정답: A

설명: (ExamPassdump 회원만 볼 수 있음)

최신Databricks Certified Data Engineer Professional - Databricks-Certified-Data-Engineer-Professional무료샘플문제

자격증의 중요성:

ExamPassdump 제품의 가치:

무료샘플 받아보기:

완벽한 서비스 제공: