Senior Software Engineer - Crawler
Jornada completa, Jornada temporal
ZoomInfo
Responsibilities
- Design and implement scalable, fault-tolerant web crawling and extraction pipeline components.
- Write clean, production-grade Java and Python code.
- Build and operate large-scale ETL/ELT pipelines for data extraction and transformation.
- Work with GCP and AWS cloud infrastructure, primarily on GKE.
- Improve observability, reliability, and operational excellence across contributed systems.
- Partner with product and data science teams to deliver solutions.
- Contribute to code reviews, documentation, and knowledge sharing.
- Keep current with web technologies, anti-crawling mechanisms, and AI-powered extraction approaches.
Requirements
- At least 5 years of professional software engineering experience building production systems.
- Strong knowledge of algorithms, data structures, concurrency, and distributed systems.
- Proficiency in Java and/or Python.
- Experience owning features end-to-end from design through deployment and operation.
- Experience making component-level architectural decisions.
- Hands-on experience with cloud data warehouses such as BigQuery or Snowflake.
- Experience designing and operating large-scale ETL/ELT pipelines.
- Experience with orchestration tools such as Apache Airflow.
- Experience with streaming or event-driven systems such as Apache Kafka.
- Production experience on GCP or AWS, with GCP preferred.
- Hands-on experience with Kubernetes, including GKE or EKS, for distributed workloads.
- Familiarity with infrastructure-as-code tools such as Terraform.
- Strong communication, pragmatic problem-solving, adaptability, and self-direction.
- Web crawling at scale, Scrapy, proxy infrastructure, anti-bot evasion, SERP extraction, AI/LLM-based extraction, or B2B data-company experience is preferred.
Benefits
- Remote work arrangement is indicated by the LI-REMOTE designation.
- Comprehensive benefits are offered, along with holistic mind, body, and lifestyle well-being programs.
Vacante publicada el 8 horas atrás
Empleos similares que podrían interesarleBasado en la vacante Senior Software Engineer - Crawler en Teletrabajo
- ...India) creates quality solutions for its customers by combining software, back office, and knowledge processing operations to fulfill... ...Summary We are seeking a highly motivated and skilled Software Engineer with 5–8 years of professional experience in designing,...SeniorTiempo completo
- ...excellence matter every day. We're looking for a hands-on Senior Corporate IT Engineer to own and scale the technology that supports our workforce... ...About the Role House Rx is hiring a Senior Security Software Engineer to help us build, review, and harden security-sensitive...SeniorTiempo completoRemotoHorario flexible
- ...across PC and IoT technologies. Our teams partner with specialist engineers from major silicon companies to integrate next-generation... ...integration for the latest IoT and server-class hardware platforms and software stacks Work with partners to deliver a delightful,...SeniorPrácticaTiempo completoRemoto
- ...for task authoring, expert annotation, review, quality control, and structured data collection. Collaborate with researchers and engineers to ensure evaluation data and published outputs are accurate, consistent, and integrated. Requirements ~4+ years of...SugeridoTiempo completoRemotoTrabajo híbrido
- ...with customers and subject-matter experts, and take ownership of product outcomes. Requirements Four or more years of software engineering experience, most of it in frontend work, at companies with strong engineering practices. Strong frontend capability in either...SugeridoPrácticaTiempo completoPatrocinio de visaTrabajar en la oficinaRemotoVisa de trabajo
- ...distinguish model limitations from infrastructure, harness, or environment failures. Requirements ~3–5+ years of professional software engineering experience, particularly in backend, infrastructure, platform, SRE, or distributed systems engineering. ~ Strong...Tiempo completoRemoto
- ...Canonical is a leading provider of open source software and operating systems to the global... ...such as public cloud, data science, AI, engineering innovation and IoT. Our customers... ...software, provide robust upgrade paths and engineer the future of Ubuntu. Ubuntu is not just...FreelanceTiempo completoTrabajar en la oficinaRemoto
- ...30%+ at ~$2B ARR is that we need great engineers everywhere, and we have the room to shape... ...NYSE: IOT) sits at the center of hardware, software, AI, and the physical world. The... ...is broad and flexible: we're hiring from Senior through Principal, across platform and product...SeniorPrácticaTiempo completoRemotoTrabajo híbridoHorario flexible
- ...Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform... ...initiatives such as public cloud, data science, AI, engineering innovation, and IoT. Our customers include the world's leading...Tiempo completoTrabajar en la oficinaDesde casaRemoto
- ...Responsibilities Own delivery of high-quality software projects and coordinate with teammates and stakeholders to meet agreed timelines... ...ambiguity, and drive projects forward. Participate in engineering recruiting through interviewing, problem specification, and role...Tiempo completoTrabajar en la oficina
- ...Canonical is a leading provider of open source software and operating systems to the global... ...such as public cloud, data science, AI, engineering innovation and IoT. Our customers... ...software, provide robust upgrade paths and engineer the future of Ubuntu. Ubuntu is not just...FreelanceTrabajar en la oficinaRemoto
- ...Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform... ...initiatives such as public cloud, data science, AI, engineering innovation, and IoT. Our customers include the world's leading...Tiempo completoTrabajar en la oficinaDesde casaRemoto
- ...Canonical is a leading provider of open source software and operating systems to the global... ...such as public cloud, data science, AI, engineering innovation, and IoT. Our customers... ...and growing. We are hiring a Software Engineer for Distributed Systems Testing with a...Tiempo completoTrabajar en la oficinaDesde casa
- ...Canonical is a leading provider of open source software and operating systems to the global... ...such as public cloud, data science, AI, engineering innovation and IoT. Our customers... ...private infrastructure. As a software engineer on the team, you'll collaborate on end-to...TemporalTiempo completoDesde casaRemoto
- ...focused on two new major product lines coming to market in the next few months. Join us!! The Role We're hiring a Staff/Senior Security Engineer to lead our signing and treasury security program across wallets and custodian accounts. This is a high-impact, mission-...SeniorContratoRemotoHorario flexible
- ...wrong and it takes an hour of digging to prove it isn't. Most engineers want to build the shiny new thing and hand off the boring maintenance... ...it better than anyone, and keep it running. We need an engineer to take over day-to-day support, the recurring calls, the...SeniorTiempo completoRemoto
- ...provider of open source software and operating systems... ..., data science, AI, engineering innovation, and IoT. Our... ...of all levels of seniority, for all relevant teams... ...exceptional software engineer who prefers to work in... ...alternative path For more senior roles, experience...SeniorTiempo completoTrabajar en la oficinaDesde casaRemoto
- ...tldr; We build software for Airbnbs to rent themselves, with a state-of-the-art product and user experience. We have crafted an Applicant... ...-distributed team is looking for a Core & Connectivity Product Engineer to maintain momentum and stability. "Working at Hospitable is...ContratistaTemporalTiempo completoRemoto
- ...Canonical is a leading provider of open source software and operating systems to the global... ...such as public cloud, data science, AI, engineering innovation, and IoT. Our customers... ...globally distributed team Learn from senior mentors to demystify the inner workings...SeniorPrácticaTiempo completoTrabajar en la oficinaDesde casaRemoto
- ...general track for applications to any team at Canonical that works with the Linux kernel, across all seniority levels. Apply here if you are an exceptional software engineer who wants to work on both stable and cutting edge Linux kernels for Ubuntu and its wider ecosystem...Tiempo completoTrabajar en la oficinaDesde casaRemoto
- ...the entire internet. The role of Security Engineering Manager directly impacts the safety and... ...of engineers, ranging from graduate to senior Provide technical guidance on vulnerability... ..., and community Solid background in software development, including expertise in...SeniorTiempo completoRemoto
- ...provider of open-source software and operating systems... ..., data science, AI, engineering innovation and IoT. Our... ...engineers of all levels of seniority, for all relevant... ...exceptional software engineer who prefers to work in... ...system level For more senior roles, experience...SeniorTiempo completoTrabajar en la oficinaDesde casaRemoto
- ...chance to be a part of that as a Community Engineer at Canonical . We are building... ...multiple positions available, at different seniority levels. All applications and candidates... ...who is passionate about open source software, Linux, and sustainable community building...Tiempo completoDesde casaRemoto
- ...The Python Software Foundation (PSF) is hiring a contract Sustainability Engineer, PyPI reporting to the PSF's Director of Engineering. The mission of the Python Software Foundation is to promote, protect, and advance the Python programming language, and to support and...Tiempo completoContratoRemoto
- 1936 DevOps Engineer - Cloud We are collaborating with a leading provider of clean energy solutions, focused on delivering innovative... ...to contribute to a greener future. Role Overview As a Senior DevOps Engineer focused on Cloud, you will lead the migration...SeniorTrabajo remotoTiempo completo
- ...Canonical is a leading provider of open source software and operating systems to the global... ...such as public cloud, data science, AI, engineering innovation and IoT. Our customers... ...exceptional Go, Rust, or C/C++ software engineer and want to work on next-generation open...Trabajar en la oficinaRemoto
- ...Job Title Python Engineer – (DevOps/Internal Tools) FULLLY REMOTE Job Description As a software engineer, you'll join a team tackling complex challenges in automating, streamlining, and scaling engineering and support workflows through the development of critical...FreelanceTiempo completoRemoto
- ...for individuals with a strong flair for software development at the hardware level and a... ...to prove a strong aptitude for software engineering at the hardware level. While direct experience... ...of years under their belt up through senior industry veterans. What your day will...SeniorTiempo completoDesde casaRemoto
- ...Canonical is a leading provider of open source software and operating systems to the global... ...such as public cloud, data science, AI, engineering innovation and IoT. Our customers... .... We are hiring an Ubuntu Pro Sales Engineer to help global companies embrace the latest...Tiempo completoDesde casaRemoto
- ...Canonical is a leading provider of open source software and operating systems to the global... ...such as public cloud, data science, AI, engineering innovation and IoT. Our customers... ...We are hiring an Embedded Linux Field Engineer for Devices/IoT to expand our reach in...Tiempo completoTrabajar en la oficinaRemoto
¿Desea recibir más vacantes?
Suscríbase y reciba vacantes similares a Senior Software Engineer - Crawler. ¡Sea el primero en aplicar!
