Piyush Tyagi
Software Engineer at PromptCloud- Claim this Profile
Click to upgrade to our gold package
for the full feature experience.
Topline Score
Bio
Experience
-
PromptCloud
-
United States
-
Information Services
-
1 - 100 Employee
-
Software Engineer
-
Jun 2023 - Present
-
-
Associate Software Engineer
-
Aug 2022 - May 2023
•Devised and implemented a function utilized for executing API calls acrossmultiple Machine Learnings models.•Played a pivotal role in troubleshooting over 85 websites, covering all phasesfrom logic design to data extraction.•Enhanced the performance of Scraper API sites by 30% through optimizationefforts tailored to each site.•Took charge of bolstering and refining the internal pipeline dedicated to webscraping across diverse websites.•Currently engaged in the "JobsPikr" project, which revolves around a job datadelivery platform extracting information directly from corporate websites.•Conducted thorough tests on various proxies to preemptively address potentialblocking complications.•Designed a Kibana dashboard for visualizing daily volume statistics, segmentedby individual sites.•Formulated a Ruby script for automated data crawling updates in Elasticsearch.•Devised a Python script to identify failures in Machine Learning modelsprocessing. Show less
-
-
Intern
-
Dec 2021 - Aug 2022
•Utilized Chrome's Xpath helper to obtain element xpaths for accurate dataextraction.•Participated in web scraping for multiple websites including Lowes India,Aimbridge Hospital, and Careers Lennar.•Employed both Python and Ruby programming languages for data extractionfrom diverse websites.•Aided in the resolution of a client's concern regarding significant data volumereduction.
-
-
Education
-
Bhagwan mahavir college of engineering and management
Bachelor of Technology - BTech, Computer Science