Partnier

Data Engineer with Web Scraping Expertise

FULL TIME

November 3, 2024

We are a leading platform in the gaming industry, connecting game developers with influencers to drive impactful content and engagement. We’re looking for a Data Engineer with expertise in web scraping and database management to help us gather, process, and store large datasets that power our analytics and insights.
What You’ll Do
  • Build and Maintain Scrapers: Develop and maintain web scraping workflows, utilizing tools like Apify or similar libraries to gather data from various platforms.
  • Database Management: Work with large databases (primarily Postgre SQL), optimizing for efficient data storage, retrieval, and aggregation.
  • Data Pipeline Development: Create and automate ETL processes to move scraped data into structured databases, ensuring data consistency and reliability.
  • Optimize Data Storage: Use AWS S3, Glacier, and other storage solutions for long-term data storage and archival.
  • Ensure Data Quality: Implement checks and validation processes to maintain high data quality and handle any site changes effectively.
What You’ll Bring
  • 1+ Years of Web Scraping Experience: Familiarity with Apify, Scrapy, or similar tools, and understanding of web protocols, bot detection, and anti-scraping techniques.
  • Database Skills: Knowledge of SQL and experience working with databases like Postgre SQL; ability to design schemas and optimize queries.
  • Python Basics: Basic to intermediate Python skills for building scrapers, managing data workflows, and simple automation.
  • Problem-Solving Mindset: Resourceful and adaptable, with a focus on troubleshooting data extraction issues.
  • Collaborative Team Player: Strong communication skills and ability to work effectively with a remote, multi-disciplinary team.
Benefits
  • Competitive Package: Healthcare, 28 days of paid holiday, and paid sick leave.
  • Growth & Development: Opportunities for continuous learning in data engineering, web scraping, and new data technologies.
  • Flexible Remote Work: Collaborate with global teams in the UK, Philippines, and Brazil, with flexibility in hours once you’re established.
If you have a passion for data, an interest in web scraping, and are ready to work with a fast-growing company, we’d love to hear from you!
Job Types: Full-time, Permanent
Pay: Php35,000.00 - Php65,000.00 per month
Benefits:
  • Health insurance
  • Pay raise
  • Work from home
Schedule:
  • 8 hour shift
  • Evening shift
  • Monday to Friday
Experience:
  • Web Scraping: 1 year (Required)
  • SQL: 2 years (Required)
Language:
  • Fluent English (Required)
Application Deadline: 11/15/2024
Expected Start Date: 11/16/2024

New Job Alerts
Tahj/NSDMM Management

Administrative Assistant in Operation_ Santa Rosa Laguna, Nuvali_ URGENT HIRING!!!

Santa Rosa

FULL TIME

November 19, 2024

View Job Description
Lancesoft philippines

Senior SAP Fico Consultant

Manila

CONTRACT

November 19, 2024

View Job Description
GH Specialist Philippines Incorporated

IT/Graphics Designers for Fresh Grad - Makati Area

Makati City

FULL TIME

November 19, 2024

View Job Description
Simpletrade Solutions Inc.

Finance Supervisor

Quezon City

FULL TIME

November 19, 2024

View Job Description
PM Consulting

Call Center Agent - Insurance Claims (HYBRID in Taguig, NIGHT SHIFT)

Taguig

FULL TIME

November 19, 2024

View Job Description
Looking for similar job?
Ista Personnel Solutions

Database Administrator | SQL, Azure, Google Cloud | WFH

Makati City

FULL TIME

October 8, 2024

View Job Description
Lancesoft philippines

Data Analyst

Manila

CONTRACT

October 8, 2024

View Job Description
transcomos Asia Philippines, Inc.

Urgent Hiring | AI Product Specialist with 12k Signing Bonus| Data Analyst experience is a plus!

Pasig City

FULL TIME

October 8, 2024

View Job Description
Octal Philippines Inc.

BI/Data Management Jr Developer

Quezon City

FULL TIME

October 8, 2024

View Job Description
Unisys Philippines

Data Encoder/Civil Registry Associate - PSA Maguindanao

Cotabato

FULL TIME & CONTRACT

October 7, 2024

View Job Description
Centrics Networks Philippines Inc.

Cybersecurity Data Analyst Developer

FULL TIME

October 7, 2024

View Job Description
See What’s New: Partnier Job Opportunities
Partnier

Data Engineer with Web Scraping Expertise

FULL TIME

November 3, 2024

View Job Description
Partnier

AngularJS Developer (+Node, MySQL, Mongo)

FULL TIME

October 11, 2024

View Job Description
View More Jobs by Partnier
New Job Alerts
Tahj/NSDMM Management

Administrative Assistant in Operation_ Santa Rosa Laguna, Nuvali_ URGENT HIRING!!!

Santa Rosa

FULL TIME

November 19, 2024

View Job Description
Lancesoft philippines

Senior SAP Fico Consultant

Manila

CONTRACT

November 19, 2024

View Job Description
GH Specialist Philippines Incorporated

IT/Graphics Designers for Fresh Grad - Makati Area

Makati City

FULL TIME

November 19, 2024

View Job Description
Simpletrade Solutions Inc.

Finance Supervisor

Quezon City

FULL TIME

November 19, 2024

View Job Description
PM Consulting

Call Center Agent - Insurance Claims (HYBRID in Taguig, NIGHT SHIFT)

Taguig

FULL TIME

November 19, 2024

View Job Description