Meeting 11/04/2020 – Amran – Scraping web
Overview : Scraping detail page Challenges : Struktur page tiap halaman berbeda-beda Baca-baca artikel tentang teknik penanganan struktur yang berbeda dengna tag yang sama Feedback : https://gitlab.com/lovia/jobsid-crawler/-/issues/2 Next Steps : Insert or update MongoDB jobPosting collection from JobPosting object Wrap crawler into Zeebe worker using zeebe-grpc (Python) Store HiringOrganization Logo Image to S3+MongoDB Run Workflow…