I am using GoogleCloudStorageToBigQueryOperator in Airflow v1 to load data from GCS Bucket files to GBQ tables. Previously we were using bq load command to perform this operation. The operator loads data in considerably less time. I would like to know what will be the cost involved in using this operator. bq load or GoogleCloudStorageToBigQueryOperator which will be a better option?
The amount of data that I am loading on a daily basis is around 2 to 3 TB.
Any help is appreciated!