Databricks Development Tools

Databricks development tools with CLI, SDK, Connect, PySpark, and Delta Lake support.

databrickssparkpysparkdeltalakedataengineering

Overview

Complete Databricks development environment including Databricks CLI, Python SDK, Databricks Connect for remote development, PySpark and Delta Lake for data processing, and VS Code extensions for Asset Bundles development and workspace integration.

Script ID:tool-databricks

Script:install-tool-databricks.sh

Website:https://www.databricks.com

Python Packages (pip)

Package	Description
databricks-sdk
databricks-connect
pyspark
delta-spark
pyarrow
sqlparse

VS Code Extensions

Extension	Description
Databricks	Databricks workspace integration and Asset Bundles
Jupyter	Notebook support for Databricks notebooks
Python	Python language support
Pylance	Python language server
YAML	YAML support for databricks.yml
REST Client	Test Databricks REST APIs

Installation

Install via the interactive menu:

dev-setup

Or install directly:

.devcontainer/additions/install-tool-databricks.sh

Full installation options (click to expand)

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
📋 Databricks Development Tools
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

ID:           tool-databricks
Name:         Databricks Development Tools
Script version: 0.0.1
Category:     DATA_ANALYTICS, Data & Analytics Tools
Description:  Installs Databricks CLI, Python SDK, Connect, and related tooling for Asset Bundles development

Usage:

  Action:
      install-tool-databricks.sh        # Install Databricks development tools
      install-tool-databricks.sh --uninstall # Uninstall Databricks development tools

  Info:
      install-tool-databricks.sh --help # Show help and usage information

Python Packages (pip):
  - databricks-sdk
  - databricks-connect
  - pyspark
  - delta-spark
  - pyarrow
  - sqlparse

VS Code Extensions:
  - Databricks (databricks.databricks) - Databricks workspace integration and Asset Bundles
  - Jupyter (ms-toolsai.jupyter) - Notebook support for Databricks notebooks
  - Python (ms-python.python) - Python language support
  - Pylance (ms-python.vscode-pylance) - Python language server
  - YAML (redhat.vscode-yaml) - YAML support for databricks.yml
  - REST Client (humao.rest-client) - Test Databricks REST APIs

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

Related Tools

Related Tools

Data & Analytics ToolsData analytics stack with Jupyter, pandas, numpy, matplotlib, scikit-learn, and dbt.

Python Development ToolsPython development environment with ipython, pytest-cov, and python-dotenv for enhanced coding and testing.