Overview
We're seeking a senior-level data engineer to help design and build a modern AWS-based data lakehouse platform. This role is hands-on and suited for a "builder" who can stand up scalable patterns, work through evolving requirements, and partner closely with engineers, analysts, and data stakeholders.
What You'll Do
-
Design data architecture (AWS lakehouse): Build scalable, reliable lakehouse solutions on AWS using Apache Iceberg and cloud-native services.
-
Develop and operate data pipelines: Create, automate, and maintain ETL/ELT workflows to ingest data from multiple internal and external sources into AWS.
-
Build data access services/APIs: Design and maintain secure, scalable RESTful APIs (and related interfaces) to enable data access for internal applications and teams.
-
Implement AWS data services: Use services such as Amazon S3, EMR (Spark), Lake Formation, Lambda, API Gateway, and related tooling to support processing, storage, and analytics.
-
Manage Iceberg tables on S3: Build and maintain Iceberg tables enabling ACID transactions, time travel, schema evolution, and lakehouse-style governance.
-
Optimize performance: Apply partitioning strategies, compaction, file sizing, and tuning techniques to improve query performance and reliability.
-
Ensure data quality and integrity: Implement validation, reconciliation, and error-handling processes to ensure consistent, trusted datasets.
-
Security & compliance: Enforce strong access controls and governance (e.g., Lake Formation, IAM/Cognito authorization for APIs, encryption, least privilege).
-
Collaborate and document: Partner with cross-functional teams and maintain clear technical documentation for pipelines, processes, and API specs.
-
Support & troubleshooting: Provide technical guidance and issue resolution for pipeline operations and data/API endpoints.
Required Qualifications - Bachelor's degree in Computer Science, IT, or related discipline (or equivalent experience).
- Strong experience in data engineering with significant hands-on work in AWS.
- Hands-on experience implementing Apache Iceberg (design, table maintenance, optimization).
- Proficiency in Python, Java, or Scala.
- Strong SQL skills (querying, modeling, schema design).
- Experience with big data processing using Apache Spark (EMR) and/or Hadoop ecosystem concepts.
- Experience developing and deploying RESTful APIs with attention to performance and security.
- Experience with orchestration tools such as Apache Airflow (or similar).
About GDH: At GDH, we believe in the power of people and the importance of caring. Our culture statement, "We care about people," isn't just a tagline - it's the core of everything we do. GDH is a premier staffing and talent solutions company dedicated to helping businesses find the best talent and assisting job seekers in finding their dream jobs.
Who We Are: GDH, founded in 2001, has grown into a leader in providing staffing solutions across various industries. We specialize in IT across several sectors, connecting top talent with leading enterprises. As a Best of Staffing firm recognized for excellence in client, employee, talent, and women's services, we pride ourselves on our commitment to quality and service.
GDH Benefits GDH offers a range of employee benefits that are designed to promote well-being and help maintain a healthy work-life balance. These comprehensive benefits cover various aspects of an employee's life and aim to enhance their overall experience with the company. Our health benefits include three medical insurance options with access to KISx Card, Zero Card, and HealthJoy concierge services. Other plan offerings include dental, vision, life, disability, supplemental insurance, and pet insurance plans. Enjoy additional perks like holiday pay, 401(k) plan, direct deposit, an employee referral program, work-life balance benefits, a Wellbeats membership, a discounted gym membership program, and more! For more detailed information on benefits, please go to GDH's website under the tab for candidates.
GDH provides equal employment opportunities (EEO) to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, gender, sex (including pregnancy), sexual orientation, gender identity, national origin, age, disability, genetic information, marital status, ancestry, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable federal, state, and local laws. Applicants with disabilities who require an accommodation or assistance in applying and/or for interviewing, please contact our HR Department.
Please visit our notice of collection for California applicants.