Experience

Protocol Labs

• United States
• Software Development
• 200 - 300 Employee

• Technical Lead

  • Oct 2022 - Present

  - Engaged as a long-term contributor at Protocol Labs Engineering and Research, leading the Network Indexer project. This protocol, designed for discovering providers of immutable, content-addressable data, integrates IPFS and Filecoin networks with tools like multiformats, IPLD, IPFS, and libp2p. - Designed and developed protocols for advertising content from Filecoin storage providers and IPFS nodes. These were implemented in Golang and integrated within Lotus, the foremost Filecoin… Show more - Engaged as a long-term contributor at Protocol Labs Engineering and Research, leading the Network Indexer project. This protocol, designed for discovering providers of immutable, content-addressable data, integrates IPFS and Filecoin networks with tools like multiformats, IPLD, IPFS, and libp2p. - Designed and developed protocols for advertising content from Filecoin storage providers and IPFS nodes. These were implemented in Golang and integrated within Lotus, the foremost Filecoin implementation. - Led the data onboarding engineering initiative, introducing a streamlined mechanism for users to upload data at large PiB scale onto Filecoin through user-friendly REST APIs. - Held responsibility for the operation and reliability of cid.contact, a service that processes over 3 billion hashes per day from IPFS and Filecoin network, achieving provider search times of under 10 milliseconds. - Served as the Golang implementor and maintainer for a variety of open-source projects, including Filecoin, IPLD, libp2p and IPFS.

• Software Engineer

  • May 2021 - Oct 2022



Functionland

• Canada
• Technology, Information and Internet
• 1 - 100 Employee

• CTO

  • Sep 2022 - Present

  - Spearheaded the design and development of a decentralized application development platform leveraging a federation of edge computing. - Collaborated with global development teams and organizations to enhance the platform's capabilities. - Orchestrated the platform's integration with the broader web 3.0 ecosystem. - Ensured the incorporation of cryptographic incentives and integration with robust blockchain functionalities.



Infinite Faculty

• Founder

  • May 2021 - Present

  - Established Infinite Faculty Limited to provide expert consultation on large-scale data-intensive applications, applied AI, the decentralized web, and privacy preservation techniques. - Collaborated with global enterprises, delivering top-tier solutions to complex technical challenges.



SolarWinds

• United States
• Software Development
• 700 & Above Employee

• Principal Architect

  • Jul 2018 - Jul 2021

  - Actively contributed to the rapid development and delivery of strategic products, company-wide engineering standards, M&As, and overarching technology decisions. - Led a team of nine engineers spread over three time zones, developing a cloud-native anomaly detection system for time-series data. This system, based on unsupervised online machine learning, permitted real-time algorithm development without hindering the production environment. Built on AWS EKS, it utilized gRPC for… Show more - Actively contributed to the rapid development and delivery of strategic products, company-wide engineering standards, M&As, and overarching technology decisions. - Led a team of nine engineers spread over three time zones, developing a cloud-native anomaly detection system for time-series data. This system, based on unsupervised online machine learning, permitted real-time algorithm development without hindering the production environment. Built on AWS EKS, it utilized gRPC for inter-process communication and was exclusively penned in Golang. - Served as the principal architect for the SolarWinds MSP Data Platform, centralizing over fifty data-centric services spanning four business sectors. - Conceived a cloud-native, event-driven messaging framework, handling over 4 TBs of data daily, which translates to 22+ billion messages across four regions via 12 Kafka clusters. This system offers a unified gRPC API with a reliable backup mechanism, at availability of 99.995%. - Established efficient data pipelines, channeling 500 billion records daily into AWS Redshift and Snowflake databases. These pipelines draw from 11 geographically dispersed MySQL databases, ensuring data accuracy and consistency even when faced with downstream disruptions. Show less



Adobe

• United States
• Software Development
• 700 & Above Employee

• Computer Scientist

  • Jan 2016 - Jun 2018

  - Served as co-architect and lead developer for an Adobe-wide pub-sub system under business platform services. This system, written in Java and operating via HTTP/REST protocol, ensured a resilient, scalable event dissemination with guaranteed at-least-once delivery, sequential message consistency, and emphasized a high-availability of 99.99%. - Successfully delivered the system's core functionality from initial design to full-scale production in a mere three months. Commenced… Show more - Served as co-architect and lead developer for an Adobe-wide pub-sub system under business platform services. This system, written in Java and operating via HTTP/REST protocol, ensured a resilient, scalable event dissemination with guaranteed at-least-once delivery, sequential message consistency, and emphasized a high-availability of 99.99%. - Successfully delivered the system's core functionality from initial design to full-scale production in a mere three months. Commenced operations on CoreOS fleet, later transitioning to a bespoke Kubernetes 1.6 cluster hosted on AWS. - Enhanced Kafka's raw message delivery framework to support near-instantaneous message pushes to webhooks, aiming for delivery within 250 milliseconds of publication. This upgrade incorporated a distributed network overlay ensuring automatic message failover and retry mechanisms. - Crafted a specialized Kafka client tailored for high-throughput, transient consumers. This custom solution, developed in Java with Netty NIO, offers random message access across all Kafka topic replicas. Show less



University of St Andrews

• United Kingdom
• Higher Education
• 700 & Above Employee

• Research Fellow

  • Apr 2015 - Jan 2016

  - Collaborated with the Administrative Data Research Centre for Scotland (ADRC-S), University of Edinburgh, Edinburgh Napier University, and National Records Scotland (NRS). - Contributed to the construction of a linked genealogy of 24 million historical Scottish records since 1855. - Undertook intricate linkage across three databases: birth, death, and marriage records digitized from original paper copies. - Spearheaded the development of an automated classification… Show more - Collaborated with the Administrative Data Research Centre for Scotland (ADRC-S), University of Edinburgh, Edinburgh Napier University, and National Records Scotland (NRS). - Contributed to the construction of a linked genealogy of 24 million historical Scottish records since 1855. - Undertook intricate linkage across three databases: birth, death, and marriage records digitized from original paper copies. - Spearheaded the development of an automated classification system. - Utilized online machine learning techniques to efficiently categorize causes of death and professions.

• Lecturer

  • Jan 2015 - Jun 2015

  - Instructed the "Software Architecture" module for Masters and Senior Honours students. - Presented software architecture as a pivotal tool across various software lifecycle stages. - Delved into an in-depth exploration of both formal and informal architectural methods.

• Research Fellow

  • Nov 2014 - Apr 2015

  - Spearheaded the development and commercialization of Qraqrbox, a pioneering platform delivering content to remote areas with limited connectivity, including nature trails, scenic locales, and mountain peaks, using eco-friendly standalone servers powered by solar and wind energy. - Innovated a robust, delay-tolerant content dissemination protocol. This system capitalized on visitor smartphone movement, opportunistically updating information on standalone servers when users transitioned… Show more - Spearheaded the development and commercialization of Qraqrbox, a pioneering platform delivering content to remote areas with limited connectivity, including nature trails, scenic locales, and mountain peaks, using eco-friendly standalone servers powered by solar and wind energy. - Innovated a robust, delay-tolerant content dissemination protocol. This system capitalized on visitor smartphone movement, opportunistically updating information on standalone servers when users transitioned from well-connected zones to remote server locations. - Engineered an energy-optimized, rapid QR-code decoder, operational entirely within a smartphone's browser even offline.



DH Group

• Senior Software Engineer

  • Nov 2007 - Sep 2010

  - Led the technology division overseeing the reliability and availability of over 50 e-commerce platforms, steering a dedicated team of three engineers. - Conceived and executed a stock control system that manages an inventory of 300K+ products across multiple database instances. The bespoke solution unified stock management, leading to a marked decrease in administrative expenses and enhanced customer service. - Developed middleware solutions tailored for diverse e-commerce… Show more - Led the technology division overseeing the reliability and availability of over 50 e-commerce platforms, steering a dedicated team of three engineers. - Conceived and executed a stock control system that manages an inventory of 300K+ products across multiple database instances. The bespoke solution unified stock management, leading to a marked decrease in administrative expenses and enhanced customer service. - Developed middleware solutions tailored for diverse e-commerce applications, enabling dynamic seasonal pricing adjustments and automated promotion management across all platforms. Show less