Senior Data Engineer

The Analytics & Optimization team within Atea Information Management helps businesses and organizations to achieve greatness and success through data-driven solutions. We are focused on delivering advanced and innovative analytics and machine learning solutions. We do this by providing high-end consulting services and tailored software solutions.

Our team thrives on being dynamic and innovative, placing great importance on collaboration, creativity, and finding joy in our work. Our customers operate in various business areas, such as financial, manufacturing and HR.

Job Description:

We are seeking a Senior Data Engineer with experience in the Azure environment to join our Analytics and Optimization team. In this role, you will work closely with our data architects, data scientists and BI Professionals to design and implement data engineering solutions that support our advanced analytics and machine learning initiatives. You will be responsible for the development, maintenance, and optimization of our data models, data pipelines, and data storage solutions.

We are seeking a highly skilled Senior Data Engineer to join our team and take a leading role in designing, implementing, and maintaining our data infrastructure and systems. As a Senior Data Engineer, you will be responsible for managing large-scale data pipelines, optimizing data storage and retrieval, and ensuring the reliability and efficiency of our client’s data processing workflows. You will collaborate closely with cross-functional teams, including data scientists, data architects and BI developers, to enable data-driven decision-making and deliver high-quality data solutions.

Responsibilities:

• Design and develop data pipelines: Architect and build robust, scalable, and efficient data pipelines to ingest, process, transform, and load structured and unstructured data from various sources. Ensure data quality, integrity, and security throughout the entire pipeline.
• Data modeling and schema design: Collaborate with data scientists and BI developers to understand their requirements and design data models and schemas that facilitate efficient data analysis and reporting. Optimize data structures for performance and scalability.
• Data integration and ETL: Implement and maintain Extract, Transform, Load (ETL) processes to integrate data from diverse sources into a unified data platform. Develop and optimize data transformation and cleansing routines to ensure consistency and accuracy.
• Data warehousing and storage: Design and manage data warehousing solutions, including data lakes, data marts, and data warehouses. Evaluate and implement appropriate storage technologies to handle large volumes of data efficiently.
• Performance optimization: Identify and address performance bottlenecks in data processing and storage. Optimize queries, indexing, and caching strategies to improve data retrieval and analysis speed.
• Data governance and security: Implement data governance policies and procedures to ensure data privacy, compliance, and security. Establish data access controls and manage data permissions and roles.
• Collaboration and leadership: Work closely with cross-functional teams, including data scientists, BI developers, and software engineers, to understand their requirements and provide data engineering solutions. Mentor junior data engineers and provide technical guidance and support as needed. Stay up-to-date with emerging data engineering technologies and trends, and suggest solutions that could benefit the team.

Requirements:

• Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
• Proven experience as a Data Engineer, preferably in a senior or lead role.
• Programming skills in languages such as Python, Java, or Scala are beneficial.
• In-depth knowledge of data modeling, database design, and SQL.
• Solid understanding and experience with Azure cloud services and technologies, such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics (formerly SQL Data Warehouse), Azure Cosmos DB, and Azure Storage.
• Familiarity with big data technologies and frameworks in the Azure ecosystem, including Azure HDInsight, Azure Data Lake Storage, and Azure Stream Analytics. Experience with data integration techniques and tools in the Azure ecosystem, such as Azure Logic App.
• Proficiency in working with relational databases (e.g., Azure SQL Database) in the Azure environment.
• Knowledge of Azure security and compliance frameworks for data governance and protection.
• Strong analytical and problem-solving skills, with the ability to troubleshoot and optimize data processing workflows in Azure.
• Excellent communication and teamwork abilities.

We offer a competitive salary, health benefits, and opportunities for professional growth and development. Most importantly, we offer a fun and dynamic work environment where everyone's ideas and contributions are valued.

If you're excited about working in a team that values collaboration, creativity, and innovation, and you have a passion for designing and implementing data architectures, we want to hear from you. Please submit your resume and cover letter.

Location: Preferably Turku, Vaasa or Vantaa