Especialista de Engenharia de Dados II – Tech Lead

The Data Platform & MLOps Directorate at Serasa Experian is responsible for building and evolving the platform that supports large-scale data products and solutions, offering modern, secure, and highly reliable infrastructure. We work with a Lakehouse architecture, supported by Databricks and AWS, operating in a Data Mesh model that enables autonomy and distributed governance for data products.

We are seeking a Data Engineering Specialist with strong experience as a Tech Lead and Architect, capable of technically leading the evolution of our Lakehouse, disseminating engineering practices, and supporting various business units in building scalable and resilient data products.

**Responsibilities:**

**Platform Architecture and Evolution:**

- Define and evolve the corporate Lakehouse architecture, ensuring scalability, security, governance, and high performance.

- Create standards, models, and best practices for Data Mesh, supporting domains in building data products.

- Promote solid technical choices involving Databricks, Delta Lake, Spark, AWS, and modern data ecosystems.

- Define architectural references for batch and streaming pipelines, including best practices for orchestration, versioning, monitoring, resilience, and optimization.

**Technical Leadership:**

- Guide and mentor data engineers, influencing critical decisions and elevating the organization's technical level.

- Conduct technical reviews (architecture, code, standards, pipeline design).

- Act as an internal consultant for business units, ensuring a better understanding of solutions and promoting technological consistency among teams.

**Construction and Maintenance:**

- Design and develop robust and scalable pipelines in Python, Scala, SQL, or Java within the Databricks and/or AWS ecosystem.

- Build real-time ingestion solutions using Spark Structured Streaming, Delta Live Tables, Kafka/Kinesis, or similar tools.

- Ensure observability (monitoring, alerts, and metrics) and data quality at all stages of the pipeline.

- Work with governance and security tools, such as AWS Lake Formation, Unity Catalog, and corporate IAM standards.

**Multidisciplinary Interaction:**

- Interact with business units, partners, suppliers, and third parties, ensuring technical alignment, architectural clarity, and assertive execution.

- Facilitate discovery, design, and support processes in implementing data products within the Data Mesh strategy.

- Translate business needs into scalable and sustainable technical solutions.

**Evangelization and Dissemination:**

- Disseminate knowledge about Lakehouse, Data Mesh, batch and streaming pipelines.

- Conduct workshops, reference guides, mentoring, and internal technical communities.

- Promote a modern data culture and best engineering practices throughout the organization.

**Mandatory Requirements:**

- Advanced English for contact with teams from other countries within the Experian group.

- Solid experience as a data engineer, architect, or tech lead in large-scale environments.

- Proficiency in Databricks (Spark, Delta Lake, workflows, cluster management).

- Practical experience with AWS (S3, IAM, Glue, Lambda, Lake Formation, among others).

- Strong knowledge in Python, SQL, Scala, and/or Java.

- Experience in building batch and streaming pipelines.

- Experience with Data Mesh models, Lakehouse, distributed governance, and data products.

- Ability for technical leadership, influence, and clear communication.

- Experience with CI/CD, versioning, data architecture, and best engineering practices.

**Differentials:**

- Databricks or AWS certifications.

- Knowledge of Unity Catalog, Lake Formation, or other data governance tools.

- Experience with event-driven architectures (Kafka, Kinesis).

- Experience with optimization and performance frameworks in Spark.

**Behavioral Profile:**

- Proactive and solution-oriented mindset.

- Ability to lead and influence multiple teams in complex environments.

- Collaborative approach and good communication with technical and business areas.

- Curiosity, autonomy, and attitude to disseminate best practices.

- Strategic vision with a focus on delivery and innovation.

Serasa Experian is much more than you imagine. With the purpose of creating a better future by expanding opportunities for people and companies, in Brazil, we are more than 4,000 people working in various teams and specialties. Here, each knowledge and diversity complement each other, and you can work on what you love most. We are committed to building an inclusive culture and an environment where people can balance their careers with their personal commitments and interests, prioritizing well-being.

We are dedicated to being one of the best and most innovative companies to work for in the country, enabling incredible experiences and careers for our people. Our strong people-first approach is externally recognized through various market certifications: we were awarded by Great Place To Work™ in 24 countries and by the international Top Employers certification, in addition to being recognized as one of the best companies for young professionals and having a 4.6 rating on Glassdoor. Each recognition indicates that we are on the right path, providing an increasingly better work environment for our talents.