Senior Data Engineer

Job description

About Octopus Deploy:

Octopus Deploy sets the standard for Continuous Delivery, empowering software teams to deliver value in an agile way. Over 4,000 organizations globally – including Ubisoft, Xero, Stack Overflow, NASA, and Disney – rely on our Continuous Delivery, GitOps, and release orchestration solutions.

Founded in Australia in 2012, our team of over 300 Octonauts now spans the globe. We combine high growth and big ambitions with a sustainable, balanced working environment. Our revenue has grown consistently between 20–50% every year for the past 9 years, and we’ve been profitable for 10 out of the past 12 years. Octopus now provides the industry's most comprehensive Continuous Delivery solution for organizations operating at scale.

We’ve been remote-first since 2015 and work with an uncommon level of transparency. You can read our public handbook to learn how we work. We have a transparent approach to compensation that ensures people doing the same work with the same skill get paid the same, with well-defined career pathways. We foster a supportive, collaborative, and high-trust environment. We leave our job titles at the door and focus on doing what’s best for our customers and team. Our leaders never shy away from answering the tough questions at our all-hands calls or in 1:1s. We conduct interviews and onboarding virtually as part of being a remote-first company.

Role Summary

Are you a Data Engineer who thrives at the intersection of data and software engineering? Are you excited about the impact of AI and context engineering in the world of data? We want you to shape the future of our Data Platform that serves both our internal organisation and our customers.

We're part of the Platform group at Octopus and are looking for a Data Engineer to join our small, nimble team. If you've always wanted the freedom and autonomy to build the best Data Platform in a DevOps-centred organisation, we'd love to hear from you!

What You'll Be Doing:

• Taking ownership of the end-to-end development lifecycle of new data-platform capabilities - solution architecture and design, instrumentation → ingestion → transformation, security, CI/CD and instrumenting the monitoring of it.

• Redefining how Analytics works in a world of AI, shifting from managing not just data, but building innovative solutions to manage context and AI Agents. Tackling challenges like non-determinism and managing the impact of scale and cost that AI based systems have.

• Collaborating with stakeholders, such as Organisational Leaders, Product Managers, Designers, Customer Engineers to model and deliver data to be used for insights - pair with your colleagues to get the right results.

• Bringing your strong opinions, loosely held for technical discussions and strategies to ensure high-quality solutions and alignment with company goals.

• Managing the operational day-to-day of the platform - ensuring it's reliable, performant and cost effective.

We're looking for someone like you who

• 3+ years and demonstrable experience as a data (or software-engineer), explicitly building Data Platform capabilities, using modern cloud based technology (Azure/AWS, Snowflake, Databricks, Clickhouse etc). You come with a strong understanding of data engineering and principles.

• You have a firm grasp on languages used predominately in the data-engineering landscape, preferably proficiency in SQL and strong Python experience.

• Lived experience working with the latest in data, this might include working with technology like Apache Iceberg, new-age data-stores (DuckDB, Clickhouse) or building pro-active analytics with agents.

• Background in working on real-time and streaming based problems - you have experience in the likes of Kafka, Flink or near-real-time OLAP databases like Clickhouse, RisingWave and Interactive Tables (Snowflake).

• A genuine and enthusiastic interest in the way data-engineering is evolving alongside artificial intelligence systems. This includes a desire to stay abreast of the latest advancements, experiment with AI based solutions, and actively participate in advancing our Data Platform and keeping it at the cutting edge of AI.

• You come with a pragmatic approach to the idea of self-service analytics and data-as-a-product, along with other data-mesh like principles.

• You enjoy working in a "you built it, you run it" culture, where teams take pride in the quality of their work and the availability of their systems.

• You enjoy collaborating with other people to solve problems, challenging each other to discover the best solution for a problem using a balance of passion, pragmatism, and empathy.

• You are a results-oriented person, focused on iteratively delivering valuable things to your customers, willingly changing direction based on clear and transparent business information, and someone who helps others do the same.

Nice to have:

• You've already built or worked on AI based solutions, such as creating agents.

Prepare for the interview

Nothing collected for this employer yet. The Blind 75 is what technical screens draw from; practise it here, with a coach, in Java or Python.