Data Engineer
-
Location
Ashburn
-
Sector:
-
Job type:
-
Salary:
Negotiable
-
Contact:
Alyssa Hank
-
Contact email:
a.hank@ioassociates.com
-
Job ref:
BBBH146417_1726149304
-
Consultant:
Alyssa Hank
We are seeking a skilled Data Engineer, based in the Washington D.C. metro area, to take on contract or contact to hire work within the professional services and consulting space. This role offers the opportunity to work with a variety of clients to design, implement, and maintain scalable data pipelines and architectures. The ideal candidate will have a strong technical background and a passion for solving complex data challenges.
Key Responsibilities:
- Design, develop, and maintain robust data pipelines and architectures to support data integration, transformation, and analysis.
- Implement and optimize cloud-based data solutions using AWS, Snowflake, and Databricks.
- Develop ETL/ELT processes using tools like Logstash for data ingestion and transformation from various sources.
- Collaborate with cross-functional teams to gather requirements, design solutions, and ensure alignment with client goals.
- Optimize data workflows for performance, scalability, and efficiency.
- Manage and ensure data quality, security, and compliance across all systems and processes.
- Perform data modeling, schema design, and database management to support analytics and reporting needs.
- Troubleshoot and resolve issues related to data pipelines, storage, and processing.
- Stay up to date with the latest data engineering technologies and best practices, and apply them to projects as appropriate.
Required Qualifications:
- Bachelor's degree in Computer Science, Data Engineering, or a related field.
- 4+ years of experience as a Data Engineer or in a related role.
- Strong SQL skills and experience with relational and non-relational databases.
- Experience with cloud platforms (AWS preferred), including data storage and compute services.
- Experience with data pipeline and ETL/ELT development.
- Strong programming skills in Python, Scala, or a similar language.
- Familiarity with data warehousing concepts and best practices.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills to work effectively with both technical and non-technical stakeholders.
Preferred Qualifications:
- Experience working in a consulting environment.
- Proficiency in Snowflake, Databricks, AWS, and/or Logstash.
- Experience with additional data tools and frameworks, such as Apache Kafka, Airflow, or Spark.
- Knowledge of data governance and compliance standards (e.g., GDPR, HIPAA).
- Certification in AWS, Snowflake, or Databricks is a plus.