I'm trying to connect to DataBricks workspace from my local machine using DataBricks-Connect v2. I have configured the DataBricks workspace with unity catalog and configured my local machine with DataBricks connect v2 using Access token authentication. I'm getting below error when I tried running the application I'm getting below error.
Error:
from databricks.connect import DatabricksSession as SparkSession
from databricks.sdk.core import Config
config = Config(profile="DEFAULT", cluster_id="xxxxx-yyyyyy-0987654321")
spark = SparkSession.builder.sdkConfig(config=config).getOrCreate()
spark.range(10).collect()