Overview

The main idea of the project is to implement ETL using Apache Spark.
The project incorporates all the data transformation capabilities of Apache Spark.
Additionally, it provides the ability to create your own custom data processing procedures. This allows business logic to be implemented using standard ETL tools.
Connection parameters for data sources and destinations of loaded and modified data are described in configuration files.