Job Description
Devexperts works with respected financial institutions, delivering products and tailor-made solutions for retail and brokerage houses, exchanges, and buy-side firms. The company focuses on trading platforms and brokerage automation, complex software development projects, market data products, and IT consulting services.
Job Description
We are looking for a Senior Data Engineer with a Java / Scala / Python background to join the Research & Development Team.
Our current project is for a Top-5 US retail broker (by the number of users). The project is devoted to trading experience, finance reports, and risk management.
You will join cross-functional team that excels in getting features done from zero to production.
We expect the Senior Data Engineer to:
1. Develop Data Pipeline:
- Design, develop, and maintain robust data pipelines using Java within AWS infrastructure,
- Implement scalable solutions for data analysis and transformation using Apache Spark and PySpark,
- Utilise Airflow for efficient workflow orchestration in complex data processing tasks,
- Ensure fast and interactive querying capabilities through the use of Presto.
2. Manage Infrastructure:
- Containerise applications using Docker for streamlined deployment and scaling,
- Orchestrate and manage containers effectively with Kubernetes in production environments,
- Implement infrastructure as code using Terraform for provisioning and managing AWS resources.
3. Collaborate and Communicate:
- Collaborate with cross-functional teams to understand data requirements and architect scalable solutions aligned with business goals,
- Ensure data quality and reliability through robust testing methodologies and monitoring solutions,
- Stay updated with emerging technologies and industry trends to continuously enhance the data engineering ecosystem.
Qualifications
Must-have skills:
1. Education and Experience:
- Bachelor's degree in Computer Science, Engineering, or related field,
- Minimum 5 years of hands-on experience in Java / Scala / Python development, emphasising object-oriented principles.
2. Technical Proficiency:
- Proficiency in Apache Spark or PySpark for large-scale data processing,
- Experience with Airflow for workflow orchestration in production environments,
- Familiarity with Docker for containerisation and Kubernetes for container orchestration,
- Experience managing AWS services such as S3, EMR, Glue, Athena, and Redshift,
- Strong background in SQL and relational databases.
3. Communication Skills:
- Excellent English language communication skills, both verbal and written,
- Ability to collaborate effectively with technical and non-technical stakeholders.
Nice-to-have skills:
- Experience with streaming platforms such as Kafka for real-time data processing,
- Knowledge of Terraform for infrastructure as code implementation in AWS environments.
Additional Information
Devexperts employees create the art of FinTech in comfortable working spaces located in modern business centers around the world. Join our team in Porto and enjoy:
Work Regime Flexibility benefits:
- Possibility of hybrid/remote work mode
- Flexible working hours
- Work From Anywhere Program
Health and recreation benefits:
- Fully paid additional wellness days (3 unwell days per year)
- Medical insurance for the employees and children
- Reimbursement of fitness
- Meal allowance
- Flexpay system
Facility benefits:
- Modern office with new equipment
- PlayStation, table football, and musical instruments in the office
- Parking spaces/transport reimbursement
- Meals in the office
- Free drinks and snacks
Community benefits:
- Teambuilding activities
- Corporate parties
- Football club
- Music club
- Speakers' club
- Free admission to corporate external events
- Possibility of joining conferences and professional fairs
- Personal branding development support
Professional training benefits:
- English language courses
- Local language courses for foreign employees
- Unlimited access to self-learning platforms
- Certification opportunities
- Mentorship Program
Social benefits:
- Parental bonus
- Pension plan
- Referral bonus
- Blood donation paid leave
