MS or BS in CS, Engineering, Math, Statistics, or a related field or equivalent practical experience in data engineering.
5 years of experience working in data engineering using Python on Cloud platforms like AWS. Proficient in programming in Python. With experience of packages like pandas, numpy, boto, s3fs, flask, fastapi, pyarrorw, pyspark etc.
Expert in SQL programming and experience working with relational databases, as well as working familiarity with a variety of databases (Postgres/Redshift/MySQL).
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Strong analytic skills related to working with unstructured datasets. A successful history of manipulating, processing and extracting value from large, disconnected datasets.
Strong problem-solving skills to understand complex structured and/or unstructured datasets and their relationships to find issues and provide programmatic solutions.
Working experience in data analytics (data wrangling, integration, visualization), and reporting using BI (Business Intelligence) tools
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Strong project management and organizational skills. Strong sense of ownership.
Collaborative personality with experience supporting and working with cross-functional teams in a dynamic environment.
Excellent Problem Solving and Communication Skills