Today when we've tried running our notebooks defined in synapse, we've received constantly error: 'LIBRARY_MANAGEMENT_FAILED'. We are using approach from: https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-manage-python-packages#storage-account to manage custom libraries, and it was working fine up until this point. Additionally, we've tried separate method of providing spark pool with custom library and tried to use workspace packages, but after 10 minutes of loading custom package, it timesouts with failure.
When we are removing python folder completely from storage, sparkpools run notebooks normally.
Yesterday everything was working properly. The problem also could not be in custom library, because it does not work even with empty python folder.
There were issues on Microsoft side, which were resolved and it started working next day.