Publish PySpark Streaming Query Metrics to Azure Log Analytics using the Data Collector REST API
Full content for Blog Post 6 on PySpark Metrics. This article would provide a detailed walkthrough of the workaround, including the necessary scripts, API calls