22/11/2024
We are hiring Python(web scraping).
Company: AgileKode
Location: Model Town, Lahore
Experience: Minimum 2 years in Python (web scraping)
Timings: 10:00 AM - 7:00 PM
Responsibilities:
- Develop and maintain efficient web scraping tools and scripts to collect structured and unstructured data from websites.
- Identify and resolve challenges such as CAPTCHAs, Cloudflare, dynamic content, and IP blocking using advanced techniques.
- Ability to overcome scraping challenges, including CAPTCHAs, Cloudflare and rate limits.
- Analyze and understand website structures to implement effective data extraction strategies.
- Handle large-scale scraping projects, ensuring scalability, speed, and accuracy.
- Identify and resolve challenges such as CAPTCHAs, dynamic content, and IP blocking using advanced techniques.
- Clean, transform, and store scraped data in structured formats or databases as required.
- Monitor and troubleshoot scraping scripts to ensure optimal performance.
- Stay updated on the latest web scraping technologies, tools, and trends.
Qualifications:
- Bachelor’s degree in Computer Science, IT, or related fields (or equivalent experience).
- Strong proficiency in Python and experience with web scraping libraries such as Scrapy, BeautifulSoup, and Selenium.
- Knowledge of HTML, CSS, and JavaScript for interacting with web content.
- Familiarity with handling APIs and data formats like JSON, XML, and CSV.
- Experience with database systems (SQL/NoSQL) for storing and managing scraped data.
- Ability to overcome scraping challenges, including CAPTCHAs and rate limits.
- Experience with headless browsers (e.g., Puppeteer, Playwright).
Why Join AgileKode?
- Work in a dynamic and collaborative environment with a focus on innovation.
- Competitive salary and career growth opportunities.
Send your resume at mail to: [email protected]