Senior Data Engineer

We are currently looking for a Senior Data Engineer to join us on a contract basis, collaborating with teams within a dynamic technology organization. This role offers a hybrid work setup based at our Customer's office in New York City.

Responsibilities:

• Lead the complete development lifecycle of intricate data projects involving integrations and transformations, including analysis, design, development, and support of complex data pipelines within cloud environments.
• Contribute to the design and setup of data management tools for extracting and manipulating data from diverse sources, encompassing both internal and external databases.

Required Qualifications:

• Bachelor's degree in Computer Science, Information Systems, or a related field; a Master's degree is preferred.
• Over 7 years of experience as a Data Engineer.
• Proficiency in constructing scalable, secure data pipelines that facilitate the ingestion, transformation, and transfer of large volumes of structured and unstructured data from various databases and sources.
• Demonstrated expertise in developing sophisticated database logic and APIs to automate data retrieval and storage in various formats.
• Extensive familiarity with programming languages (e.g., Python), ETL tools, relational and non-relational databases, and their administration.
• Experience in architecting and building reusable modular components to support complex applications.
• Proven track record in implementing data quality, security, and governance standards across multiple cloud environments.
• Skilled in designing and implementing integrations between data management tools.
• Proficiency in designing, developing, and maintaining data solutions across major cloud platforms such as AWS or Google Cloud.
• Strong understanding of data structures, algorithms, software architecture, and the ability to design, test, and document complex systems comprehensively.
• Experience in securely handling PHI, PII, and PCI data, and optimizing application performance and resiliency.
• Ability to collaborate effectively with data analysts, data scientists, and IT operations to develop tools that transform data for use in advanced data and artificial intelligence applications.
• Demonstrated leadership in technical roles, providing guidance and consulting on development projects.
• Strong problem-solving skills, with the ability to innovate solutions for complex business and production challenges.
• Familiarity with modern DevSecOps practices and tools, as well as Agile methodologies and associated tools (e.g., Jira, Scrum, Kanban).

Preferred Qualifications:

• Experience leading teams of data engineers and analysts in developing complex software and data pipelines.
• Familiarity with data governance processes, data classification, and taxonomy tools.