We’re looking for a smart, self-motivated Data Engineer to join our team. This role will be responsible for data collection, extraction, maintaining pipelines and actively researching and verifying new data sources.
We’re small (20+ people and growing fast), innovative and varied group, solving big problems in real estate data and analytics. We are seeking enthusiastic, creative, intelligent and fun individuals to join us in helping build the best platform on the market. In return we can offer you a fun and hard-working environment where you can clearly see your contribution to the company’s success.
What you’ll be doing:
The hire will be working with our team who are responsible for optimising data flow and collection, researching and investigating new data sources, and expanding and maintaining our existing data pipelines. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys working in a fast paced and interesting environment. The Data Engineer will support our software developers and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple product verticals. The right candidate will be excited by the prospect of supporting our next generation of products and data initiatives.
The current data collection and extraction processes are written in Go and Python, and our processing and pipelines are written in PSQL, Spark (Python and Scala) using AWS Glue to orchestrate. We work mostly with batch data rather than streams.
Excellent SQL skills are required, and knowledge of window functions, optimising queries, geospatial queries, GIS, and general data wrangling are a must.
We are open to people from a diverse range of backgrounds and would have a preference for people with an understanding of most of the following:
We are looking for someone with proven experience of data collection and data pipelines, and who is comfortable working with stakeholders and directly with the CTO and Product Owner. We are a relatively small team, so you must be comfortable with conversing across all aspects of development and reacting quickly to new information.
© Treex 2020