Senior Data Engineer
AppsFlyer, a global leader in mobile attribution and marketing analytics, processes over 150 billion events daily. The Web Attribution team is central to extending this capability beyond mobile, developing products that enable advertisers to identify effective web campaigns. The Senior Data Engineer will play a pivotal role in shaping the technical direction of data pipelines, serving as the team's primary expert in Spark, data modeling, and complex pipeline challenges. This position involves close collaboration with team leads on planning and technical priorities, directly impacting products relied upon by advertisers and marketers.
The Senior Data Engineer will be responsible for building and enhancing end-to-end pipelines that process billions of web events, ensuring strict freshness and accuracy SLAs. This includes overseeing the technical design of pipelines from specification to production, writing and reviewing design documents, and making critical decisions regarding the use of SQL versus Spark. The role also involves collaborating with architects on cross-team designs, working with team leads on roadmaps and priorities, and managing production incidents to implement lasting solutions.
Candidates should have over six years of experience in Data or Big Data Engineering, with a proven track record in building and operating large-scale production systems. A B.Sc. in Computer Science or a related field is required. Expertise in Apache Spark, including understanding execution plans, partitioning, and memory management, is essential. Experience with cloud analytical warehouses such as BigQuery, Snowflake, Redshift, or Databricks SQL is necessary, with a preference for BigQuery. Proficiency in workflow orchestration tools like Airflow and cloud environments at production scale, preferably GCP, is also important. Strong programming skills in Scala and Python for orchestration are expected, along with a keen attention to data quality and experience with AI tools in engineering work.
While not mandatory, experience in building or maintaining attribution or AdTech data systems, advanced Scala or functional programming skills, familiarity with attribution models, and experience with SQL-based transformation frameworks or data-mesh platforms are advantageous. Additional beneficial skills include experience with Kafka or streaming systems, running LLMs or ML pipelines in production, and a referral from an AppsFlyer team member.
As a global company operating from 25 offices across 19 countries, AppsFlyer values diversity and inclusion, ensuring equal opportunities for all employees. The company promotes a culture of curiosity, diversity, and innovation, encouraging employees to bring their unique perspectives to the team.