Alexander abij
abij
/ 1_databricks_scim_account_groups.tf
Last active
February 27, 2025 15:27
All in one terraform example to manage Azure SCIM-app and Account-level groups.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| terraform { | |
| required_providers { | |
| azuread = { | |
| source = "hashicorp/azuread" | |
| # Latest version selected | |
| } | |
| databricks = { | |
| source = "databricks/databricks" | |
| # Latest version selected | |
| } |
abij
/ fileformats_spark_duckdb.ipynb
Last active
January 23, 2025 21:44
Compare impact of file formats using Spark and DuckDB
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
abij
/ datadog-install-agent.sh
Created
February 25, 2021 10:50
Databricks init script to install Datadog agent and configure for Structured Streaming metrics
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash | |
| # Inspiration based on: https://docs.databricks.com/_static/notebooks/datadog-init-script.html | |
| # Improvements: | |
| # - Use 'spark_url' in config (instead of resourcemanager_uri) | |
| # - Use Databricks Secrets to store and retrieve datadog-api-key | |
| # - Works with SingleNode-clusters | |
| # - Update datadog-spark integration (when needed), to support Structured Streaming metrics. |