Data Engineer

Job Description DATA ENGINEER: must also be able to problem solve in a structured way + build scalable and maintainable systems. INTEREST IN WORKING WITH AN EARLY STAGE BIG DATA STARTUP (ON THE CORE FOUNDING TEAM) This position will work under the advisory of a senior data engg advisor. Exp (6months - 3 yrs) with good foundational understanding /experience of data engineering on cloud & relevant Infra & ETL Experience with geospatial data processing is really useful. Experience with using at least one cloud provider or both (AWS preferred) Design and implement the data infrastructure platforms including the data ingestion, data consumption and processing on AWS cloud MUST - Hands on experience of handling large data sets and use of Python or PySpark/SQL/Hive/Impala for data analysis Deploying and scaling ML solutions using open-source frameworks - (MUST HAVE) Experience building ETL/ELT production pipelines from ground-up. Research and assess technology environment and trend for best practises to apply. Must have willingness to learn (demonstrated by work on projects/portfolio or learned any new skills recently) Supporting, Maintaining & Developing new enhancements in Enterprise AWS Developing and maintain IaC (Infrastructure as Code) and CI/CD Pipeline Improving infrastructure operations through better use of monitoring, cloud coding and scripting best practises Must have interest to work for startups rather than large entities Must be a good problem solver (good with structuring problems) Should be able to conceive the design of the cloud infra & pipeline to support MVP development within the time frame You will be responsible for deploying, automating, maintaining and managing cloud based production systems for big data analytics, to ensure the availability, performance, scalability and security of productions as well as delivery systems for initial lean product Must be able to solve processing issues for very large datasets (10GB - 100GB) To apply - reach out to This position is intended to become full time on funding with ESOP grants on offer too.