Data Engineer

Posted 4 hafta ago

Do you want to be a part of an ambitious engineering team and be responsible for expanding and optimizing big data pipeline architecture? Are you passionate about developing products/solutions that will be rolled out in millions of embedded networking devices while being connected to Cloud, and managed/monitored in real-time?
QuantWiFi is looking for exceptionally talented individuals and offer you to become member of a best-in-class team that is based in Istanbul but delivering solutions to all Telecommunications companies throughout the world.

Job Description:
– Build data pipelines that clean, transform, and aggregate data from disparate sources
– Ensure fast, reliable, and secure data ingestion to QuantWiFi data warehouse
– Design stream and batch jobs for ETL processing, perform optimizations
– Build new API integrations to support help extract data enabling powerful data analysis and visualizations for front-end and back-end engineers.
– Work closely with data scientists to help build complex algorithms that provide unique insights into dataset
– Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes
– Use agile software development processes to iteratively make improvements in production system
– Suitable for remote/hybrid/in-office work


Qualifications:
– Bachelor’s degree in computer science, information technology, engineering or equivalent
– 3 or more years of Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
– Working knowledge of message queuing, stream processing.
– Experience using the following software/tools:
o Big data tool such as Spark, working knowledge of PySpark and SparkSQL
o Relational SQL and NoSQL databases,
o Workflow management tools: Volcano, Airflow, Azkaban, etc.
o Object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
– Comfort working in a dynamic, research-oriented team with concurrent projects
– Good understanding of version control systems (git), test automation, agile methodologies
– Ability to work in international teams
– Excellent command of English (written and verbal) and Communication skills, especially explaining technical concepts to non-technical business leaders
– No restriction for international travel

Apply Online

A valid email address is required.
A valid phone number is required.