Experience

TechnoGenics SMC PVT LTD

• Pakistan
• Software Development
• 1 - 100 Employee

• Data Curation Engineer

  • Nov 2022 - Present

  Lahore, Punjab, Pakistan I lead the 'Threat Landscape' project, gathering cybersecurity data from various sources and populating our web application. My responsibilities include data scraping, cleaning, and managing the IOCs Extraction Package, a Python package owned by our team. I'm well-versed in the Scrapy Framework and have built data pipelines for cross-team integration. Proficient in ELT/ETL techniques, I've automated data gathering and extraction processes. Python is my primary language, and I utilize… Show more I lead the 'Threat Landscape' project, gathering cybersecurity data from various sources and populating our web application. My responsibilities include data scraping, cleaning, and managing the IOCs Extraction Package, a Python package owned by our team. I'm well-versed in the Scrapy Framework and have built data pipelines for cross-team integration. Proficient in ELT/ETL techniques, I've automated data gathering and extraction processes. Python is my primary language, and I utilize Elasticsearch for backend storage. I monitor crawler logs, implement real-time bug alerts, and leverage my DevOps background to manage OVH infrastructure for Kafka, Elasticsearch, and Kibana services, facilitating cross-team communication and efficiency. Show less



SkipQ

• United States
• Retail
• 1 - 100 Employee

• DevOps Engineer

  • Jun 2022 - Sep 2022

  Lahore, Punjab, Pakistan


EVMTech
• Switzerland
• Information Technology & Services
• 1 - 100 Employee
• Software Engineer Intern

  • Apr 2022 - Jun 2022