Data Engineer

Summary: The Data Engineer will focus on backend data engineering tasks, developing and maintaining extract, transform, load (ETL) processes to integrate data from various sources into the firm’s data systems. This role will work extensively with Microsoft Fabric and collaborate with data architects, other engineers, and analysts to ensure data pipelines are efficient and reliable. The Data Engineer will also support teams delivering data dashboards and reporting, ensuring the provision of necessary information to the organization. This role is essential for developing and maintaining our overall data taxonomy and ensuring its consistency across multiple systems and platforms.

Key Responsibilities:

- Design, construct, and maintain data pipelines (ETL processes) to integrate large volumes of legal data efficiently and securely from various sources.

- Develop data lake and data warehouse solutions, implementing best practices for data ingestion, storage, and retrieval.

- Establish and deploy comprehensive data governance and security frameworks including data access controls, compliance measures, and data classification.

- Collaborate with cross-functional teams, including analysts, attorneys, and IT professionals, to understand data requirements and design backend solutions that meet their needs.

- Assess and prioritize data initiatives based on business objectives, best practices, and partner/practice need to ensure alignment with strategic goals.

- Design and implement testing strategies for data pipelines, validating data integrity, accuracy, and performance throughout the workflow.

- Create and maintain thorough documentation for data architectures, pipelines, and transformations, and processes to ensure transparency and knowledge sharing.

- Build and optimize automated data workflows to streamline ingestion, transformation, and processing, reducing manual effort and improving efficiency.

- Optimize data storage and retrieval processes to i...