CrewBloom Logo

CrewBloom

Social Media Data Crawler

Posted 5 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in India
Mid level
Remote
Hiring Remotely in India
Mid level
Design, build, and maintain automated tools and scripts to extract social media data, ensure platform compliance, monitor crawlers, analyze trends, and deliver datasets to marketing and data teams.
The summary above was generated by AI

We are looking for a detail-oriented and technically proficient Social Media Data Crawler to design and manage tools that automate data extraction from social media platforms such as LinkedIn, Facebook, X (formerly Twitter), Instagram, and others. The ideal candidate will have strong skills in web scraping, data analysis, and working with social media APIs. This role is vital for providing valuable data insights to support our marketing, research, and analytics teams.

  • Develop and maintain automated scripts and tools for extracting data from social media platforms, including LinkedIn, Facebook, X, Instagram, and more.
  • Ensure compliance with the terms of service and privacy policies of each platform.
  • Continuously monitor and troubleshoot crawling systems to ensure consistent, accurate data collection.
  • Analyze collected data to identify key trends, insights, and patterns aligned with business goals.
  • Work closely with data scientists, marketing, and research teams to deliver relevant data for their initiatives.
  • Optimize crawling systems for performance, scalability, and adaptability to platform changes.
  • Stay up-to-date with changes in social media platforms and APIs to adjust crawling strategies as needed.

Requirements
    • Bachelor’s degree in Computer Science, Information Technology, or a related field.
    • Proven experience in web crawling, scraping, or data extraction from social media.
    • Proficiency in programming languages such as Python, Java, or similar.
    • Familiarity with social media APIs (e.g., LinkedIn API, Facebook Graph API, Twitter API, Instagram API).
    • Strong understanding of HTML, CSS, and JavaScript.
    • Knowledge of data privacy laws and ethical considerations related to data scraping.
    • Excellent problem-solving skills with keen attention to detail.
    • Ability to work independently and collaboratively within a team.

Preferred Skills:

    • Experience with big data technologies such as Hadoop or Spark.
    • Familiarity with data visualization and reporting tools.
    • Understanding of natural language processing (NLP) techniques.

Minimum Technical and Work Environment Requirements:

  • Internet Connection:
    • Primary internet connection with a minimum speed of 15 Mbps.
    • Backup internet connection with at least 10 Mbps.
    • Backup connection must be capable of supporting work during a power outage.
  • Primary Device:
    • Desktop or laptop equipped with at least:
      • Intel Core i5 (8th generation or newer), Intel Core i3 (10th generation or newer), AMD Ryzen 5, or an equivalent processor.
      • A minimum of 8 GB RAM.
  • Backup Device:
    • Must meet or exceed the performance of an Intel Core i3 processor.
    • Must be functional during power interruptions.
  • Peripherals and Workspace:
    • A functioning webcam.
    • A noise-canceling USB headset.
    • A quiet, dedicated home office space.
    • A smartphone for communication and verification purposes.

Benefits

Join Our Dynamic Team: Experience our fun, inclusive, innovative culture that values your unique contributions and supports your professional growth.

Embrace the Opportunities: Seize daily chances to learn, innovate, and excel. Make a real impact in your field.

Limitless Career Growth: Unlock a world of possibilities and resources to propel your career forward.

Fast-Paced Thrills: Thrive in a high-energy, engaging atmosphere. Embrace challenges and reap stimulating rewards.

Flexibility, Your Way: Embrace the freedom to work from home or any location of your choice. Create your ideal work environment.

Work-Life Balance at Its Best: Say goodbye to stressful commutes and hello to quality time with loved ones. Achieve a healthy work-life integration to perform at your best.

Similar Jobs

51 Minutes Ago
Easy Apply
Remote
India
Easy Apply
Mid level
Mid level
Artificial Intelligence • Edtech • Mobile • Natural Language Processing • Productivity • Software
Support design, deployment, and maintenance of multiregion, multicloud infrastructure on GCP. Build and operate Kubernetes clusters, GitOps deployments with ArgoCD, GitLab CI pipelines, Terraform automation, monitoring, on-call incident response, and documentation to improve reliability and developer productivity for ML and data-intensive workloads.
Top Skills: AnsibleArgocdBashCloud StorageCloudFormationCompute EngineElkGcp Cloud LoggingGcp Cloud MonitoringGitlab CiGitopsGkeGoGoogle Cloud Platform (Gcp)GrafanaIamKubernetesLlmsPrometheusPythonTerraformVpc
2 Hours Ago
Remote
Gujarat, IND
Expert/Leader
Expert/Leader
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Responsible for managing electrical projects for semiconductor facilities, ensuring scope execution, safety, and effective communication among teams, and leading system design and coordination.
Top Skills: Electrical EngineeringMedium Voltage Electrical Distribution SystemsSemiconductor Systems
2 Hours Ago
In-Office or Remote
Gujarat, IND
Entry level
Entry level
Artificial Intelligence • Hardware • Information Technology • Machine Learning
The Inventory Management Engineer will analyze and improve inventory processes, conduct system reconciliations, and coordinate inventory audits while reporting statistics to management.
Top Skills: DatabasesE2OpenMamSAP

What you need to know about the Delhi Tech Scene

Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account