Experience

PayZen

• United States
• Software Development
• 1 - 100 Employee

• Head of Data

  • Jun 2022 - Present

  Tel Aviv, Israel



PayPal

• United States
• Software Development
• 700 & Above Employee

• Data Engineering Tech Lead

  • Jan 2017 - Jun 2022

  Israel Managing various big data projects from requirements gathering and scope preparation to project closure. The workload involved in this position: Coordinate with different stakeholders (business analytics, data scientist, platform engineering), transform into the design plan, develop solutions that will be easy to maintain & configure, conduct testing, deploy into prod. Architect & develop big data ETL pipelines running on the cloud - GCP & on-prem. Extract… Show more Managing various big data projects from requirements gathering and scope preparation to project closure. The workload involved in this position: Coordinate with different stakeholders (business analytics, data scientist, platform engineering), transform into the design plan, develop solutions that will be easy to maintain & configure, conduct testing, deploy into prod. Architect & develop big data ETL pipelines running on the cloud - GCP & on-prem. Extract (structured / semi-structured/ unstructured) --> transform (Spark / Hive / Pig) --> Load data into files / tables / topics. Build a framework for ETL automation using configuration to gain lower TTM and reduce the overall costs and resources utilization, by standard the code & logic layer. Moving development life cycle rapidly through initial prototyping to enterprise-quality testing and final implementation by using Agile methodologies. Mentoring developers Onsite & Offshore people, delivering consistent coaching and constructive feedback. Show less



Lenderly

• Big Data Solution Architect & Backend Automation

  • Apr 2016 - Jan 2017

  Israel I was building the company backend services , focusing on data recommendations. Drive the company data management strategy & architecture on different platforms: AWS RDS - MySql, AWS Elastic cache - Redis, AWS S3. Data modelling ERD schema design, ETL offline tasks. Data scraping & integration from various sources (Google / gmail / Facebook / Microbilt (credit report API)/ Emailage (fraud detection API). Building data flow transformations using Spark 2.0.0+ : PySpark - reading data… Show more I was building the company backend services , focusing on data recommendations. Drive the company data management strategy & architecture on different platforms: AWS RDS - MySql, AWS Elastic cache - Redis, AWS S3. Data modelling ERD schema design, ETL offline tasks. Data scraping & integration from various sources (Google / gmail / Facebook / Microbilt (credit report API)/ Emailage (fraud detection API). Building data flow transformations using Spark 2.0.0+ : PySpark - reading data -> transforming into RDD -> transforming into Data Frames -> dumping into AWS S3 buckets as Json & Parquet formats. Building RESTFULL API solutions with Python 2.7 using Flask. Integrating REST & SOAP API’s using curl & suds library. Design & implement algorithms for transforming the company collected data into a meaningful quantity measures (e.g. ranking & scoring). Implementing develop env on local pc using virtual box - vagrant -> running docker containers. Implementing stage & prod env on AWS EC2 instances deploying docker containers. Conduct various demos and presentations to customers and internal team. Document technical specifications, white papers, and architecture designs. Saving the source code development on git (bitbucket). implementing message broker (AMPQ) using rabbitmq. Create dynamic connections, channels, exchanges, queues. Issue producers and consumers. Show less



Wefi®

• United States
• Telecommunications
• 1 - 100 Employee

• Big Data DBA & ETL Automation

  • Jun 2015 - Apr 2016

  Israel Develop & Admin for company's Big data solutions: -------------------------------------------------------------------------- developing Big Data Technologies, programming many solutions using: python, bash, java. Working on a live 20 nodes Hadoop cluster. Handled importing of data from various data sources, performed transformations using Hive, MapReduce, loaded data into HDFS and extracted the data from MySQL into HDFS using Talend. The Hive tables created as per requirement… Show more Develop & Admin for company's Big data solutions: -------------------------------------------------------------------------- developing Big Data Technologies, programming many solutions using: python, bash, java. Working on a live 20 nodes Hadoop cluster. Handled importing of data from various data sources, performed transformations using Hive, MapReduce, loaded data into HDFS and extracted the data from MySQL into HDFS using Talend. The Hive tables created as per requirement were Internal or External tables defined with appropriate Static and Dynamic partitions, intended for efficiency. Created Python framework to work with Hadoop hive, HDFS, MySql, Google Cloud API (GCE), Google Storage, Google Big Query, Exasol, Linux os. Framework performs data filtering, aggregation, sorting, adjusting, and processing using different custom rules for different clients. Data was output into the database, dumped into files, uploaded into big data platforms (HDFS, Hadoop Hive DB, Google storage, Google Big Query, MySql, Exasol, Elasticsearch) Installing Elasticsearch.Learned to index and search/query large number of documents inside Elasticsearch. Optimizing Elasticsearch queries. Helping development with writing complex queries. Data Analytics with Kibana. Created many reporting / analytics tools: active alerts / data usage / cost control on all data environments using Host monitor & Talend studio. Developed a Central configuration db schema which was integrated into various apps which collect central parameters on every run. Developed a Central monitoring db schema using alerting counters which were reported by various apps and was monitored by host monitor & scheduler reports. Show less



Gilat Satellite Networks

• Satellite Telecommunications
• 700 & Above Employee

• BI & DB projects leader, data analyst, C# applications developer

  • Jun 2012 - Jun 2015

  Israel Managing Corporate BI Applications. Designing and developing several BI DWH Projects simultaneously using wide variety of BI tools: Microsoft - MSSQL, SSAS, SSIS, SSRS , c# (developing out of the box applications) SAP BW - BEX queries, Webi, B.O Design studio, cmc. Accomplished full life cycles of numerous projects from initial conception to completion, systems analysis, design and development, programming, testing to implementation MSSQL 2012/2008/2005/2000 DB developing &… Show more Managing Corporate BI Applications. Designing and developing several BI DWH Projects simultaneously using wide variety of BI tools: Microsoft - MSSQL, SSAS, SSIS, SSRS , c# (developing out of the box applications) SAP BW - BEX queries, Webi, B.O Design studio, cmc. Accomplished full life cycles of numerous projects from initial conception to completion, systems analysis, design and development, programming, testing to implementation MSSQL 2012/2008/2005/2000 DB developing & administration. Specialties: Corporate KPI's, Knowledge Management,BI Analyst, IT Management,IT system specialist, C# Application Developer,Excel Analyst. Show less



Electra Power

• Israel
• Electric Power Generation
• 1 - 100 Employee

• DB & Business Intelligence Specialist

  • Oct 2006 - Jun 2012

  Israel MSSQL 2008/2005/2000 administration. MSSQL DTS & SSIS developer. Oracle 8.17 + 10g developer. Database performance tuning. T-SQL & PL/SQL programming. VB 6.0 (ms-access) programming. BO (Crystal Reports) programming. ERP Design and implementation. Win-CE mobile Design and implementation.