databricks-connect - Databricks Connect Guide for PySpark Development
Guide for writing code with Databricks Connect and debugging connection issues
Tags
Updated: 2026-03-09Capabilities
Typical Inputs
Typical Outputs
What this skill does
- create DatabricksSession
- read data from tables
- write data to tables
- debug connection issues
- set environment variables
- choose compute type
Inputs
- environment variables
- Databricks config profile
- cluster ID
- serverless compute ID
- Unity Catalog tables
Outputs
- PySpark code
- connected Spark session
- DataFrame operations
- data read/write operations
- connection debug logs
Requirements
- databricks-connect package
- environment variables configured
- Databricks authentication
- Python environment
- Databricks workspace access