Data Engineer II
Chainalysis, Inc. has an opening for a Data Engineer in New York, NY. Details are as follows:
JOB DUTIES
Scale systems and redesigning existing systems to handle large scale data. Build ETL Data pipelines by developing software and a suite of analytics databases for internal and external customer insight, business analytics and intelligence using Databricks, EMR, Athena and Glue. Work with product managers to understand requirements and define the system. Work with UX to understand how to expose the metrics. Scale large systems by writing solid code to build a 100% cloud-deployed infrastructure that scales to billions of daily requests, calculates tens of terra bytes of data, and is capable of self-healing. Work with data scientists to allow for scalable querying of the data asset. Build integration with various data vendors that allows growth of data assets and products. Develop frameworks that make similar integrations easier in future. Develop frameworks to test quality of the ingested data. Continuous quality assessment of various vendors. Participate in design review and code review processes. Work with other engineers to solve issues in developing large-scale applications. Improve and simplify quality assurance processes. Handle product critical bugs and issues and support the team during off hours.
POSITION REQUIREMENTS:
Bachelor’s degree in Computer Science, Mathematics, Engineering, Information Management, Information Technology, or related discipline, or foreign equivalent, and five (5) years of experience in the job offered or in a closely related position. Alternatively, will accept a Master’s degree in Computer Science, Mathematics, Engineering, Information Management, Information Technology, or related discipline and three (3) years of experience in the job offered or in a closely related position.
*Any suitable combination of education, training or experience would be acceptable
Special Requirements: Experience must include three (3) years wi...