Text copied to clipboard!
Title
Text copied to clipboard!Data Engineer
Description
Text copied to clipboard!
We are looking for a skilled Data Engineer to join our team. The successful candidate will be responsible for developing, testing, and maintaining architectures such as databases and large-scale processing systems. You will be responsible for discovering opportunities for data acquisition, developing data set processes for data modeling, mining, and production. The ideal candidate should be an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. You will support our software developers, data analysts, and data scientists on data initiatives and ensure optimal data delivery architecture is consistent throughout ongoing projects. You must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products.
Responsibilities
Text copied to clipboard!- Develop and maintain scalable data pipelines
- Build high-performance algorithms, prototypes, and conceptual models
- Identify, design, and implement internal process improvements
- Automate manual processes, optimize data delivery, and re-design infrastructure for greater scalability
- Build data processing systems with cloud technology
- Work with data and analytics experts to strive for greater functionality in our data systems
- Create data tools for analytics and data scientist team members
- Ensure data architecture will support the requirements of the business
- Work with stakeholders to assist with data-related technical issues
- Ensure all systems meet business/company requirements as well as industry practices
Requirements
Text copied to clipboard!- Bachelor's degree in Computer Science, Engineering, or related field
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with relational SQL and NoSQL databases
- Experience with data pipeline and workflow management tools
- Experience with AWS cloud services
- Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
- Strong analytic skills related to working with unstructured datasets
- Strong project management and organizational skills
- Experience supporting and working with cross-functional teams in a dynamic environment
- Excellent communication and teamwork skills
Potential interview questions
Text copied to clipboard!- Can you describe your experience with big data tools?
- How have you used SQL in your previous roles?
- Can you explain a situation where you automated a process?
- How do you ensure data quality in your processes?
- Can you describe a time when you had to work with a difficult stakeholder?