Especialista de Engenharia de Dados - Afirmativa para pessoas com deficiência
Experian is seeking a Data Engineering Specialist to enhance its data platform and MLOps capabilities, aiming to elevate its status to that of leading global companies. This role is designed for individuals driven by innovation and eager to collaborate across various departments within the organization.
The primary responsibilities include developing a data platform capable of consuming multiple sources in both batch and real-time modes, creating APIs for data access and consumption, and disseminating best practices in data usage, such as data contracts and federated governance. The specialist will ensure that the architecture meets the technical requirements of execution teams by working closely with IT departments and business areas, demonstrating autonomy and initiative in problem-solving.
Daily activities involve ensuring squad deliveries align with client area projects, interacting with business units and external partners to facilitate optimal data and architecture implementation, participating in data-driven discussions to support key decisions, and interfacing with technology and product teams to define best practices for data storage and consumption, including testing and implementing new technologies.
Required qualifications include proficiency in Spark (both batch and streaming), programming languages like Python, data pipeline orchestration tools such as Airflow, and familiarity with AWS data stack components like DynamoDB, S3, Lambda, EMR, MSK, Glue, Athena, Lake Formation, and RDS. Experience with data lake or lakehouse architectures (e.g., Iceberg or Delta), data architecture principles, software engineering best practices, automated testing, and CI/CD processes is also essential. Desired soft skills encompass a willingness to learn, teamwork and collaborative profile, and strong communication and interpersonal relationships.
Experian offers a dynamic and inclusive work environment where diversity is valued, providing opportunities for professional growth and development. Employees have access to a range of benefits and are encouraged to balance their careers with personal commitments, emphasizing overall well-being.