Lead Data Engineer
We’re looking for a smart, self-motivated Lead Data Engineer to join our great team and lead our data engineering effort. This role will be responsible for coordinating the current team of 6 and owning the data development process, setting best practice and standards, interpreting needs of stakeholders along with overall responsibility of programming and maintaining complex data pipeline.
We’re small (20+ people and growing), fast, innovative and varied group, solving big problems in real estate data and analytics. We’re growing at a rapid pace and are seeking enthusiastic, creative, intelligent and fun individuals to join us in helping build the best platform on the market. In return we can offer you a fun and hard working environment where you can instantly see your contribution to the company’s success.
What you’ll be doing:
The hire will be responsible for expanding and optimising our data and data pipeline architecture, as well as optimising data flow and collection. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys leading a small team who are optimising data systems and building them from the ground up. The Lead Data Engineer will support our software developers and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of supporting our next generation of products and data initiatives.
The current data processing and pipelines are written in PSQL, Spark (Python and Scala) using AWS Glue to orchestrate. We work mostly with batch data rather than streams.
Excellent SQL skills are required, and knowledge of window functions, optimising queries, geospatial queries, GIS, and general data wrangling are a must.
We are open to people from a diverse range of backgrounds and would have a preference for people with an understanding of most of the following;
We are looking for someone with proven experience of managing a small data engineering team and working with stakeholders and directly with the CTO and Product Owner. We are still a small team, so you must be comfortable with conversing across all aspects of development and reacting quickly to new information.
If you’d like to apply, please send us your updated CV and a cover letter explaining why you feel that this is the right job for you, to email@example.com
© Treex 2020