Job Description

Data Engineer

Location: Chicago, IL Remote Duration: 12+ months Rate: DOE U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time.

Job Description:

• 5+ years of experience in a Data Engineer role, with a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.
• Very good knowledge in SQL (7+ out of 10), PySpark, Databricks on Azure (7+ out of 10), SparkSQL (7+ out of 10), Azure/ADLS (7+ out of 10).
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Great numerical and analytical skills.
• Data engineering certifications/Azure is a plus.
• Create and maintain optimal data pipeline architecture.
• Analyze and organize raw data.
• Write pseudo code.
• Combine raw information from different sources.
• Explore ways to enhance data quality and reliability.
• Working with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Build processes supporting data transformation, data structures, metadata, dependency, and workload management.

Job Tags

Similar Jobs