Role Summary
A senior data engineer is responsible for designing, building, and optimizing large-scale, high-reliability data pipelines and lakehouse architectures. This senior-level position involves making key architectural decisions and implementing end-to-end data ingestion, transformation, and delivery solutions. The role requires a strong foundation in both data engineering and software engineering principles to deliver scalable, modular, and testable data systems that support analytics and business objectives.
Responsibilities
- Design, develop, and maintain ELT pipelines for data ingestion, transformation, modeling, and delivery across multiple layers (bronze, silver, gold).
- Implement incremental data loads, change-data-capture (CDC), merge/upsert, and idempotent pipeline patterns to ensure data reliability and repeatability.
- Define and apply data architecture patterns such as layered lakehouse structures, domain-oriented datasets, and semantic models aligned with business goals.
- Engineer physical data schemas including partitioning strategies, partition key selection, clustering, micro-partitioning, and compaction for optimal performance and cost efficiency.
- Develop curated datasets and data marts to facilitate analytics, reporting, and self-service business intelligence.
- Implement data quality checks, observability, lineage tracing, and monitoring to ensure data integrity and SLA adherence.
- Optimize query and system performance on cloud data platforms like Snowflake by leveraging tasks, streams, compute sizing, and query tuning.
- Manage Lakehouse table formats (e.g., Apache Iceberg, Delta Lake) on object storage, including schema evolution, maintenance, and versioning.
- Collaborate with data architects, analytics teams, and business stakeholders to translate requirements into effective data solutions.
- Lead design reviews, mentor junior engineers, and contribute to engineering standards, frameworks, and best practices.
- Automate data pipeline deployment, monitor data lifecycle, and apply DevOps principles such as CI/CD and infrastructure-as-code for continuous improvement.
Qualifications - 7 to 10+ years of experience in data engineering or related software engineering roles with a focus on data systems.
- Strong expertise in designing and maintaining large-scale data pipelines and lakehouse architectures.
- Proficiency with cloud data platforms like Snowflake or similar, including performance tuning and resource management.
- Experience with data lake formats such as Apache Iceberg or Delta Lake, including schema evolution and maintenance.
- Knowledge of data pipeline patterns including CDC, upsert, merge, and incremental loads.
- Familiarity with data quality, observability, lineage, and monitoring tools and practices.
- Ability to work collaboratively with cross-functional teams and translate complex requirements into scalable solutions.
- Proven experience in mentoring junior engineers and leading architecture reviews.
- Robust understanding of DevOps practices related to data pipelines, including automation with CI/CD tools.
- Excellent communication skills and the ability to work effectively in a team environment.
Publishing Pay Range: $92.00 - $95.00 Hourly
This position is based in office and requires employee to work on-site.
About GDH: At GDH, we believe in the power of people and the importance of caring. Our culture statement, "We care about people," isn't just a tagline - it's the core of everything we do. GDH is a premier staffing and talent solutions company dedicated to helping businesses find the best talent and assisting job seekers in finding their dream jobs.
Who We Are: GDH, founded in 2001, has grown into a leader in providing staffing solutions across various industries. We specialize in IT across several sectors, connecting top talent with leading enterprises. As a Best of Staffing firm recognized for excellence in client, employee, talent, and women's services, we pride ourselves on our commitment to quality and service.
GDH Benefits GDH offers a range of employee benefits that are designed to promote well-being and help maintain a healthy work-life balance. These comprehensive benefits cover various aspects of an employee's life and aim to enhance their overall experience with the company. Our health benefits include three medical insurance options with access to KISx Card, Zero Card, and HealthJoy concierge services. Other plan offerings include dental, vision, life, disability, supplemental insurance, and pet insurance plans. Enjoy additional perks like holiday pay, 401(k) plan, direct deposit, an employee referral program, work-life balance benefits, a Wellbeats membership, a discounted gym membership program, and more! For more detailed information on benefits, please go to GDH's website under the tab for candidates.
GDH provides equal employment opportunities (EEO) to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, gender, sex (including pregnancy), sexual orientation, gender identity, national origin, age, disability, genetic information, marital status, ancestry, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable federal, state, and local laws. Applicants with disabilities who require an accommodation or assistance in applying and/or for interviewing, please contact our HR Department.
Please visit our notice of collection for California applicants.