Skip to content

Commit

Permalink
fp update8
Browse files Browse the repository at this point in the history
  • Loading branch information
Brem090 committed Jan 29, 2025
1 parent 86dad6f commit 875caa9
Show file tree
Hide file tree
Showing 6 changed files with 3 additions and 3 deletions.
Binary file modified encrypted_file/eugene_etl_pipeline.tar_encrypted.tar.gz
Binary file not shown.
File renamed without changes.
Binary file added eugene/eugene_etl_pipeline.tar.gz
Binary file not shown.
File renamed without changes.
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@

# Landing to bronze
landing_to_bronze_all = SparkSubmitOperator(
application='/root/airflow-docker/dags/landing_to_bronze.py', # Шлях до скрипту
application='./landing_to_bronze.py', # Шлях до скрипту
task_id='landing_to_bronze_all_tables', # Унікальний ідентифікатор завдання
conn_id='spark-default', # Ідентифікатор з'єднання Spark
verbose=1, # Рівень деталізації логів
Expand All @@ -30,7 +30,7 @@

# Bronze to silver
bronze_to_silver_all = SparkSubmitOperator(
application='/root/airflow-docker/dags/bronze_to_silver.py',
application='./bronze_to_silver.py',
task_id='bronze_to_silver_all_tables',
conn_id='spark-default',
verbose=1,
Expand All @@ -39,7 +39,7 @@

# Silver to gold (агрегація)
silver_to_gold_avg_stats = SparkSubmitOperator(
application='/root/airflow-docker/dags/silver_to_gold.py',
application='./silver_to_gold.py',
task_id='silver_to_gold_avg_stats',
conn_id='spark-default',
verbose=1,
Expand Down
File renamed without changes.

0 comments on commit 875caa9

Please sign in to comment.