Job Description
PYTHON - DATA ENGINEER
Location : Sri Lanka | Remote
KEY RESPONSIBILITIES:
- Design, develop, and maintain Python scripts for web scraping and data collection from target websites.
- Extract relevant product data including title, price, rating, availability, and listing position.
- Implement scraping solutions using libraries like BeautifulSoup, Scrapy, Selenium, or Playwright.
- Store and manage extracted data in structured formats (e.g., CSV, JSON, SQL, NoSQL).
- Create dashboards or reports to visualize product performance and positioning.
- Monitor and adapt to changes in website structure to ensure scraping continuity.
- Ensure all scraping activities comply with legal and ethical guidelines.
Requirements:
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 2 years Proven work experience in a similar role.
- Proficiency in Python with a focus on data scraping and automation.
- Strong experience with web scraping frameworks (e.g., Scrapy, BeautifulSoup, Selenium).
- Experience working with APIs and handling authentication (e.g., OAuth, tokens).
- Knowledge of data storage systems like MySQL, PostgreSQL / MongoDB.
- Ability to write clean, scalable, and well-documented code.
- Basic understanding of SEO and product ranking mechanisms is a plus.
Nice to Have:
- Experience with e-commerce platforms like Amazon, eBay, or Shopify.
Salary -
negotiable
Apply: [email protected]
