We are suddenly experiencing slow transfer rate while transferring data from Hive database to SQL server. This behavior is inconsistent and transfer rate drops to 1,211 rows/second on bad days.
The rows highlighted with red are good days where we experience a good transfer rate.
The job layout is as below the marked component is where we experience slow transfer rate.
part -1
part-2
The staging table metrics is as below.
