תיאור תפקיד:
We are looking for experienced big data engineer to our wide & innovative new Big Data & AI program in Haifa The program aim is to produce world-class capabilities for semi & un-structured data & AI lifecycle management that will introduce a new way to empower value from data & AI As big data engineer you will help us to implement at scale our program while dealing with big data challenges, and working with cutting edge technologies Convert ideas and needs from the design and turn that to reality. Understand the needs and requirements, analyze alternatives, and provide solutions Hands-on: Build smart logic data pipelines for processing data, manipulating, and deriving insights from data Collaborate with data stewards to define and build metadata schemes Implement data FAAS and workflows for example: metadata generator, metadata auto-extraction, validation procedures according to schemes and taxonomy, format conversions and more Develop tools for audit, observability, and compliance analytics Serve as domain expert: Be technical leader and mentor to a small group of big data engineers Be the main focal point on the above domains across the company Grow. Explore new technologies, learn new skills, and apply concepts in new ways Collaborate. Work side by side with our Big Data & AI engineers, build & share documentation, and present outcomes to managerial level
דרישות:
Education: B.sc in computer science or equivalent Experience: 6+ years of hands-on experience as lead big data engineer - must 3+ years of hand-on implementation around hybrid Big Data & AI environment (on-prem and cloud) – must. You have developed and deployed Big Data & AI solutions with tools and frameworks such as Apache Nifi, Kafka, Spark, Graph DB, NoSQL DB, Airflow, microservices, S3 object storage – must Coding: Python, Bash – Must You have experience with concepts of managing metadata & taxonomy beside big data objects – advantage Experience with public cloud Big Data & AI services – advantage Familiar with machine learning concepts – advantage About you: A nice person – positive, good-natured, and generally pleasant to be around. Great learner, open-minded and team player Strong verbal and written communication skills
היקף משרה:
Full-time
קוד משרה:
70049617
|