CertKeen

Databricks Data Engineer Professional · Free practice question 12 of 12

Serverless environment dependencies

A Python task at Burwell Logistics is moving from classic job compute to serverless compute for jobs. On classic compute, it installed a private wheel and two PyPI packages with a cluster init script. How should the dependencies be provided on serverless?

  1. A.Keep the init script, because serverless runs it at start-up
  2. B.Install the packages with an apt-get command in the first notebook cell
  3. C.Ask a workspace admin to install the packages on the serverless control plane
  4. D.Declare the wheel and packages as dependencies in the job's serverless environment
Show answer and explanation

Correct answer: D. Declare the wheel and packages as dependencies in the job's serverless environment

Why: Serverless compute for jobs does not support init scripts; Python dependencies are declared in the task's environment, which specifies an environment version and a dependency list such as PyPI packages and wheel files in volumes or workspace files, and Databricks installs them when the environment is created. System-level installs such as apt-get are not a supported way to provide dependencies on serverless, and admins do not install packages on serverless infrastructure.

More free Databricks Data Engineer Professional questions