1. Set Up Azure Databricks
 

• Log into your Azure portal.
• Search for "Azure Databricks" in the search bar and create a new Databricks service.
• Fill in the required details such as workspace name, subscription, resource group, and location. Click "Review+Create" and then "Create".
• Once the deployment is complete, navigate to the Databricks workspace by clicking on "Go to Resource".
• Set up your Databricks Cluster by selecting "Clusters" in the left-hand panel and clicking "Create Cluster". Fill in the necessary details and click "Create Cluster". Wait for the cluster to be ready.

 
2. Generate Access Token in Azure Databricks
 

• Go to your Databricks workspace.
• Click on the user profile icon on the top right corner and select "User Settings".
• Navigate to the "Access Tokens" tab.
• Click on "Generate New Token". Provide a name for the token and click "Generate".
• Copy the generated token and save it in a secure location as it will not be displayed again.

 
3. Install Necessary Plugins in Bubble
 

• Log into your Bubble application.
• Navigate to the Plugins tab in the Bubble editor.
• Click on "Add Plugins" and search for "API Connector".
• Install the API Connector plugin.

 
4. Configure API Connector in Bubble
 

• In the Bubble editor, go to the Plugins tab and open the API Connector you installed.
• Click on "Add another API" to start configuring the API connection for Azure Databricks.
• Name your API (e.g., "Azure Databricks").
• Click on "Add another call" to add a new API call definition.
• For authentication, select "Private Key in Header".
• Set the key name as "Authorization" and the value as "Bearer YOUR_ACCESS_TOKEN" (replace YOUR_ACCESS_TOKEN with the token you generated from Azure Databricks).
• Define the API call details. For instance, if you want to submit a Spark job, you'll set it up as follows:
  • Name: Submit Spark Job
  • Use as: Action
  • Method: POST
  • URL: https://#/api/2.0/jobs/run-now
  • Add the required parameters for the job as JSON in the body section.

 
5. Test the API Connection
 

• Once you have configured your API call, click on the "Initialize Call" button to test the API connection.
• If successful, save the changes.

 
6. Utilize Databricks Integration in Bubble
 

• You can now use the API calls you defined in your Bubble workflows.
• For example, you can set up a workflow to trigger the Databricks job submission when a user performs an action such as clicking a button.
• In the workflow editor, add an action and select your "Submit Spark Job" API call configured earlier.
• Map any necessary parameters and save your workflow configuration.

 
7. Monitor and Debug
 

• Monitor the job execution in your Azure Databricks workspace under the "Jobs" section.
• If any issues occur, check the API request and response for troubleshooting inside Bubble's API Connector plugin.