Data Engineer with ETL and Python

Computer Task Group, Inc

New York, NY, USA

Published: 6/14/2022

Technology

Full Time

Job Description

Overview

CTG is seeking to fill a Data Engineer opening for our client in New York, NY.

Location: New York, NY
Duration: Ongoing contract

Duties:

Design, develop, and maintain robust ETL pipelines using Python.
Build and support scalable data solutions to ingest, transform, and load data from various sources.
Develop and maintain data models, ensuring efficient storage and access to structured data.
Design, implement, and monitor workflows using Apache Airflow.
Collaborate with cross-functional teams to gather requirements and deliver high-quality data products.
Manage data governance, quality, and compliance within cloud-based data platforms.
Perform complex SQL-based data analysis and create optimized queries across various database systems.
Stay current on emerging data technologies and actively learn new tools and platforms.

Skills:

Strong expertise in Python for data engineering and ETL development.
Deep understanding of object-oriented programming (OOP) principles.
Ability to independently design and develop reusable, efficient ETL code.
Expertise in data modeling, schema design, and entity relationships.
Proficiency with SQL across multiple dialects (SQL Server, DB2, Oracle).
Experience working with data warehouse platforms such as BigQuery and Databricks Deltalakehouse.
Familiarity with Airflow for workflow orchestration and DAG development.
Exposure to Spark and willingness to learn additional cloud-based tools.
Knowledge of IBM Apptio is a plus.

Experience:

5+ years of experience in data engineering or related field.
Proven track record of building and maintaining complex ETL pipelines.
Experience working in cloud-based environments and handling large-scale data sets.

Education:

Bachelor’s degree in Computer Science, Engineering, Information Systems, or related field.

Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required.

CTG does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services for this role.

To Apply:
To be considered, please apply directly to this requisition using the link provided. For additional information, please contact Anisha Muralidhar at Anisha.Muralidhar@ctg.com. Kindly forward this to any other interested parties. Thank you!