alibabacloud-emr-spark-manage

You can manage EMR Serverless Spark workspaces end-to-end by automating workspace creation, submitting Spark jobs, querying statuses, scaling resource queues, and managing Kyuubi services using Alibaba Cloud CLI or SDK with REST ROA APIs.

To submit a Spark job to an EMR Serverless workspace, you need Alibaba Cloud CLI or SDK, REST ROA API version 2023-08-08, prerequisite execution roles, and configured OSS or DLF access for job execution.

Yes, you can run interactive SQL queries using Kyuubi with EMR Serverless Spark. The service allows you to manage Kyuubi interactive SQL services, tokens, and applications across both production and staging environments.

You scale resource queues for EMR Serverless Spark to handle peak workloads by adjusting resource allocations through the REST ROA APIs, optimizing usage and managing capacity across your production or staging environments.

You can submit JAR, PYTHON, and SQL Spark jobs to an EMR Serverless workspace. Once submitted, you can monitor job statuses, view execution logs, and retrieve results directly through the automated workflow.

Yes, executing EMR Serverless Spark jobs requires specific access permissions. You must enforce prerequisite roles and configure OSS or DLF access to ensure successful job execution within your workspaces.