Talend: Updating parameters after the configuration is finalized
Apache Airflow gives us possibility to create dynamic DAG. This feature is very useful when we would like to achieve flexibility in Airflow, to do not create many DAGs for…
Problem At the beginning of your journey with Airflow I suppose that you encountered situation when you created multiple DAGs with some tasks inside and when you run all workflows…
In this short tutorial I will show how you can easily create Fernet key. Install cryptography if is missing pip install cryptography Create new fernet key: python -c "from cryptography.fernet…
Full tutorial how to install MySQL
In this tutorial I will show you how you can create simple DAG in Apache Airflow.
In this tutorial I will show you how you can easily install Apache Spark in CentOs
Simple short tip how to check if table exists int Hive using Spark
In this tutorial I will show you what is the best apporach to convert the data from one format (CSV, Parquet, Avro, ORC) to another.
Like in the title :)