Lead Data Engineer

Contract| Remote in United States or Canada
| 4 months ago

101444 Lead Data Engineer

USA

Upper-Intermediate Strong (B2+)

Position Requirements

We are looking for a Lead Big Data Engineer with strong expertise in streaming and modern data platforms to join our team and collaborate with our client, Deloitte.

In this role, you will lead the design and delivery of real-time data solutions, scalable data platforms, and event-driven architectures, working closely with engineering teams, architects, and business stakeholders.

You Are

An experienced Lead Data Engineer / Lead Data Platform Engineer

Strong in:

Streaming data architecture

Event-driven systems

Designing real-time and batch data pipelines

Hands-on with:

Apache Kafka and Confluent Platform / Confluent Cloud

Databricks and lakehouse architectures

Change Data Capture (CDC) patterns

Proficient in:

Python, SQL (Scala is a plus)

Experienced in building solutions using:

Spark (PySpark/Scala), Delta Lake

Knowledgeable in:

Kafka topics, partitions, schema design

Schema Registry, Kafka Connect, ksqlDB

Experienced in:

Cloud platforms (Azure / AWS / GCP)

Data modeling and performance optimization

Skilled in collaboration with:

Architects

Product Owners

Cross-functional engineering teams

A strong leader with ownership mindset and excellent communication skills

You Will

Define and drive data platform architecture and engineering standards

Lead a team of data engineers and support technical decision-making

Design and implement:

End-to-end data ingestion frameworks

Streaming and batch data pipelines

Build and optimize:

Real-time data processing solutions

Event-driven systems based on Kafka ecosystem

Develop and maintain data platforms on Databricks

Implement CDC pipelines to replicate transactional data into analytics platforms

Drive cloud migration and data platform modernization initiatives

Ensure solutions meet requirements for:

Scalability

Reliability

Security and governance

Collaborate with stakeholders to align technical solutions with business needs

Support continuous improvement and data-driven decision-making

Selling Points

Nice to Have

Hands-on experience with:

Debezium

Kafka Connect ecosystem

GoldenGate or SQL-based CDC tools

Experience with:

Airflow or Databricks Workflows

Infrastructure as Code (Terraform)

CI/CD pipelines for data platforms

Exposure to:

Advanced monitoring and observability tools

Multi-cloud data platform strategies

Together We Offer

Opportunity to work with Deloitte, a globally recognized client

Participation in enterprise-scale data engineering and transformation programs

Access to modern streaming, cloud, and data platform technologies

A collaborative and innovation-driven engineering environment

Opportunities for leadership growth and certifications

Flexible work arrangements across the United States