Job Description

WE ARE HIRING

Asiawise Lanka Pvt Ltd

Type: Full time

Location: Remote

DATA ENGINEER - PYTHON

Description of Services

  • Design, develop, and maintain Python scripts for web scraping and data collection from target websites.
  • Extract relevant product data including title, price, rating, availability, and listing position.
  • Implement scraping solutions using libraries like BeautifulSoup, Scrapy, Selenium, or Playwright.
  • Store and manage extracted data in structured formats (e.g., CSV, JSON, SQL, NoSQL).
  • Create dashboards or reports to visualize product performance and positioning.
  • Monitor and adapt to changes in website structure to ensure scraping continuity.
  • Ensure all scraping activities comply with legal and ethical guidelines.

Qualifications

  • Bachelor’s degree in Computer Science, Engineering, or a related field.
  • 2 years Proven work experience in similar role.
  • Proficiency in Python with a focus on data scraping and automation.
  • Strong experience with web scraping frameworks (e.g., Scrapy, BeautifulSoup, Selenium).
  • Experience working with APIs and handling authentication (e.g., OAuth, tokens).
  • Hands-on experience designing and implementing AI agents or autonomous systems using Python and related frameworks.
  • Knowledge of data storage systems like MySQL, PostgreSQL / MongoDB.
  • Ability to write clean, scalable, and well-documented code.
  • Basic understanding of SEO and product ranking mechanisms is a plus.

Preferred Qualifications

  • Experience with e-commerce platforms like Amazon, eBay, or Shopify.

Competitive salary, negotiable based on experience and qualifications.

CVs should be submitted to [email protected], with the applied position mentioned in the subject line.