Senior Data Engineer

Отговорности

• Develop and evaluate data structures and schemas, and improve new and existing data sources for the repository
• Ensure data quality, integrity, and consistency across all data streams and storage systems
• Collaborate with data scientists to understand their requirements and assist in feature engineering & data modeling for machine learning models
• Manage and optimize data solutions, including real-time data processing and high-performance analytical databases, with the flexibility to deploy other appropriate data storage options as required
• Implement best practices for data management, security, and compliance
• Monitor and troubleshoot data pipeline performance, identifying and resolving bottlenecks and other issues
• Stay updated with the latest industry trends and technologies to continuously improve our data infrastructure
• Document all processes and code to ensure reproducibility and knowledge sharing within the team

Изисквания

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Technology, or a related field
• Proven skills in SQL and Python. Experience with Java or Scala will be considered as an advantage
• Demonstrated track record in the capacity of a Data Engineer or equivalent position, showcasing expertise in overseeing data streams and databases
• Expertise in working with data streaming platforms such as Kafka or RabbitMQ
• Experience with RDBMS solutions like PostgreSQL, MySQL, etc.
• Solid understanding of data architecture, ETL processes, and data warehousing
• Excellent problem-solving skills and the ability to work in a fast-paced, dynamic environment
• Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams
• Experience with cloud-based data storage and processing solutions such as Amazon Redshift, Google Cloud Big Table, Snowflake Data Cloud, etc.
• Knowledge of machine learning and data science workflows
• Experience in the iGaming industry or a similar high-volume, data-intensive environment