The Data Engineer will collaborate with various teams to implement data management and security solutions, improve telemetry services, manage data architecture, perform threat analysis, ensure compliance, conduct risk assessments, and train stakeholders. This role requires strong data engineering skills and expertise in cloud environments.
- Work collaboratively with application development, data protection, information security, and risk management teams to understand and implement data security and management solutions.
- Continuously improve security & observability telemetry services based on input from a diverse network of internal and external stakeholders, and technology teams as well as the IT industry at large.
- Data Management: Define and manage data models, schemas, metadata, and security rules. Design, create, deploy, and manage databases and data structures on premise and in the cloud to fulfill business requirements.
- Threat Analysis: Identify and mitigate potential security risks in the organization's data architecture.
- Compliance: Ensure compliance with data privacy laws and regulations.
- Risk Management: Conduct risk assessments and take appropriate actions to mitigate the risks associated with data security.
- Training and Development: Train and educate stakeholders about our data
- Collaboration: Collaborate with other IT team members, stakeholders, and executives to ensure the security of data architectures.
- Minimum 6+ years of Data Ingestion, Integration, ETL, or security engineering experience with large scale implementations distributed globally
- Extensive knowledge of a globally distributed environment across multiple platforms such as AWS, Azure and GCP
- Data-driven mindset
- Strong understanding of Data Management or Data Engineering
- Strong grounding in data analysis and related processes
- Experienced in Agile methods, experience in Atlassian stack (i.e., JIRA) or related tools
- Ability to Develop roadmaps and the underlying strategies for the data centric products and services
- Experience with standard monitoring frameworks and observability products
- Experience with hybrid environment data sources, data collectors and instrumentation
- Expertise in the use SIEM solutions for basic and advanced detection methods, including cloud-based data sources
- Experience with security monitoring & observability solutions such as Splunk, Sumo, Datadog, New Relic, AppDynamics
- Experience of working with cloud and data security in a DevSecOps/IRE and agile working environments.
- Expertise in at least one scripting language (PowerShell, Python, Bash)
- Experience in container/container orchestration technologies - Docker and Kubernetes
- Experience w/systems configuration orchestration tools - Ansible or Terraform
- Understanding of infrastructure as a code and concepts
- Related security certifications (e.g. CISSP, CCSP, SABSA, ITIL etc.).
- Familiarity and experience with the Splunk SPL query language.
- 3+ years familiarity and experience with Linux / Ubuntu / Mac systems
- Experience in creating dashboards, queries, alerts in Splunk, Data Dog, Sumo
- Experience in troubleshooting issues with Splunk connectivity including, networking, server (windows and Linux), and application tiers.
Top Skills
Bash
Powershell
Python
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Data Engineer at Capco will be responsible for upgrading to the latest golden source image and installing golden source on Google infrastructure, contributing to the transformation of the financial services industry.
Top Skills:
Golden Source
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Sr. Data Engineer will work on projects involving PySpark and Scala with a focus on data analysis and debugging. They will utilize their skills in Spark, GIT, and familiar CICD tools to manage the Big Data Application Life Cycle while ensuring efficient incident management using Control-M and Service Now.
Top Skills:
PysparkScalaSpark
Financial Services
As a Data Engineer III, you will design and deliver technology solutions, create data pipelines, manage ETL jobs, and ensure code quality within an agile team. Your role involves developing secure, scalable data products that enhance understanding of customer data and improve business strategies.
Top Skills:
JavaPythonScala
What you need to know about the Delhi Tech Scene
Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.
