Sr Data Engineer - 12 Month Contract
-
Location
New York
-
Sector:
-
Job type:
-
Salary:
Negotiable
-
Contact:
Alyssa Hank
-
Contact email:
a.hank@ioassociates.com
-
Job ref:
0929AH_1664461128
-
Duration:
12 Months
-
Consultant:
Alyssa Hank
Our Customer, a Software Company in New York, is hiring a Data Engineer for a 12+ month contract on their new InfoSec team.
You Will:
* Work to enrich, stabilize and normalize datasets from an infosec data lake.
* Work within a private cloud environment that includes Java, Scala, Spark, Hadoop, Airflow, etc.
* Support data onboarding and migration.
* Collaborate with senior leadership to understand business needs and design a data ingestion pipeline.
* Support the creation of technical documentation.
Position Requirements:
* 5+ years of experience in software development.
* Experience building out data pipelines from scratch (Java and Scala).
* Experience working with streaming data and tools like Spark, Kafka.
* Experience working with tools like Hadoop in a big data environment (this role entails 15 TB/day).
* Experience with Flink is ideal.
* Ability to be onsite 2 times a week is ideal
