We are looking for a Senior Data Engineer (Spark Developer) who can translate our current Python ETL Pipeline to Spark to deal with an increasing amount of transactional data from our streaming platform and create dimensional data models from events in our data warehouse.
You will clean, transform, and analyse vast amounts of raw data from Kafka using Spark to provide ready-to-use data models in Redshift to feed our developers and business analysts.
This involves both ad-hoc requests as well as data pipelines that are embedded in our production environment and feed our BI tool (Qlik Sense Saas)
As a Senior Data Engineer you take ownership of the data technology stack, its development and operation at Livespins. You’ll coordinate with developers and business analysts to maintain and develop data models in our data warehouse and feed our business intelligence application. In particular some of the tasks you will be responsible for: