Posted 12 months ago
Chicago, IL
Our ideal candidate will have experience with storing, transforming, and modeling data with an eye for the end-customer and quality, is a natural collaborator.
IN THIS ROLE, YOU WILL
- Develop data ingestion processes using Python, SQL, and Spark.
- Design and build services to improve data acquisition and data analysis.
- Design data models for a wide variety of internal and external datasets.
- Collaborate with data scientists and data providers to understand requirements and onboard data sets.
- Maintain alerting systems to ensure smooth day-to-day operations for datasets.
- Investigate and resolve data pipeline issues.
- Document solutions and best practices.
WHAT YOU’LL BRING
- Bachelors/master’s degree in computer science or a related field.
- Strong analytical, data, and programming skills (Python/SQL/NoSQL).
- 2+ years of experience developing and optimizing pipelines using a technology like Airflow, Luigi, or Oozie.
- 1+ years of experience with cloud technologies (AWS / Azure / Google Cloud).
- Experience with large data sets and techniques to architect them for performance.
- Ability to understand and contribute to our existing data system software.
- Experience with Kubernetes and Docker or Podman is a plus.
- Aptitude for designing infrastructure, data products, and tools for Data Scientists a plus.
- Financial industry experience is a plus.
- Strong oral and written communication skills; most importantly, must be a team player.
Data Engineer