Big Data Platform Engineer - Java / Go

Job Description

As a member of our Big Data Engineering team you’ll get the opportunity to work with data at incredible scale that helps us improve the quality of our products. Peak’s Big Data Platform fuels the process of data-driven decisions by utilising the latest big data tech stack to collect and process terabytes of incoming data on a daily basis. Our team of experienced software engineers is building large distributed systems and developing real-time services to complete the data needs.

In this role you’ll equally touch software development, data processing and service operations while working closely with our development teams. We’re looking for a dedicated software engineer to help us process terabytes of data into well-designed, high-quality batch and real-time services that are the foundation of product-related decisions at Peak.

It’s a great time to join our team as we just started working on major changes on the infrastructure, including dockerizing our architecture and other exciting stuff that we’ll find on the way.

Here’s what you’ll do

• Develop and maintain distributed Big Data services, components and tools
• Build real-time systems and tools in Java / Go / Python to support all of our products
• Design and build data processing architecture in AWS
• Build an automated and scalable data pipeline
• Analyze complex distributed production deployments and make recommendations to optimize performance
• Design and build scalable infrastructure and platform to collect and process very large amounts of data, including streaming real-time data

Desired Skills and Experiences

Areas in which you'll continue to grow