As a Data Engineer we need to monitor usage and costs of our data solutions.
That was not so when working with on-premise servers. The server was pre-bought, and we could use it with no extra costs. But now, with cloud services, we usually pay as we go, and need to pay attention to costs.
Databricks lately released tools to help use do that:
The Account Usage Dashboard
Budgets
The "Billing" system schema
Read more on how to use these tools on my blog - https://chenhirsh.com/monitor-databricks-costs-with-the-new-dashboard-and-budgets/
Comentários