Data Engineer

Data Engineer

Experience : 9+ Years

Responsibilities:

  1. Design, construct, install, test, and maintain highly scalable data management systems.
  1. Develop and implement databases, data collection systems, data analytics, and other strategies that optimize statistical efficiency and quality.
  1. Acquire data from primary or secondary sources and maintain databases/data systems.
  1. Identify, analyze, and interpret trends or patterns in complex datasets.
  1. Filter and “clean” data by reviewing computer reports, printouts, and performance indicators to locate and correct code problems.
  1. Work closely with stakeholders including management, software engineers, and data scientists to assist with data-related technical issues and support their data infrastructure needs.
  1. Create custom software components (e.g., specialized scripts, stored procedures) and analytics applications.
  1. Evaluate and improve existing data collection and data handling procedures.
  1. Develop and implement data security and data backup procedures to safeguard data against security breaches and loss.
  1. Ensure compliance with regulatory requirements regarding data storage, data processing, and data access.
  1. Proficiency in implementing DevOps principles and utilizing Docker containers for optimizing and deployment processes
  1. Utilize DevOps practices to automate data deployment, monitoring, and management.

 Must require skills :

Core python, SQL, shell scripting, rest API, Pandas, NumPy, power BI, docker, AWS, GCP.

Add new comment