Data Engineer Job at Gandiva Insights, Texas

dm5KWEdXUFJMdGdHS1Rpcm9HK0o4WENIbmc9PQ==
  • Gandiva Insights
  • Texas

Job Description

Job Title: Data Engineer

Remote Position

Job Summary:

We are seeking a skilled Data Engineer to design, implement, and manage robust data pipelines and architecture. The ideal candidate will work closely with data scientists, analysts, and business stakeholders to ensure data is available, clean, and well-structured for analytics and decision-making. You will manage both structured and unstructured data and integrate various data sources into a cohesive, reliable system.

Key Responsibilities:
  • Design, develop, and maintain scalable data pipelines and ETL processes to support data integration and analytics needs.
  • Collaborate with data scientists, analysts, and stakeholders to understand data requirements and ensure data accuracy and availability.
  • Manage and optimize databases (SQL, NoSQL) for data storage, retrieval, and analysis.
  • Build and maintain batch and real-time data processing systems.
  • Ensure data quality and governance through monitoring and validation tools.
  • Develop and maintain data warehousing solutions (e.g., AWS Redshift, Snowflake).
  • Implement data security and privacy policies in compliance with industry regulations.
  • Optimize data workflows for scalability, performance, and cost efficiency.
  • Continuously evaluate and improve the data architecture to meet the evolving needs of the business.
Required Skills and Qualifications:
  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • 2+ years of experience in a Data Engineering role or equivalent.
  • Strong proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL).
  • Experience with big data technologies such as Hadoop, Spark, Kafka, and Hive.
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Experience with cloud-based data platforms (e.g., AWS, GCP, Azure).
  • Hands-on experience with ETL tools (e.g., Apache Airflow, Talend, Informatica).
  • Familiarity with data warehousing concepts and tools (e.g., Snowflake, Redshift).
  • Strong understanding of data modeling, data structures, and database design.
  • Knowledge of data governance, security, and privacy best practices.
Preferred Qualifications:
  • Experience with machine learning pipelines and tools.
  • Knowledge of DevOps and CI/CD practices in data engineering.
  • Familiarity with stream processing frameworks like Apache Flink or Apache Storm.
  • Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).

Job Tags

Full time, Part time, Seasonal work, Remote job,

Similar Jobs

Treehouse Orthodontics

Orthodontic Assistant Job at Treehouse Orthodontics

 ...Assistant to join our awesome team of doctors and staff for either a part-time or full-time position. Experience is preferred but on the job training is available. This unique opportunity allows you to work closely with our owner doctors who have years of experience and... 

See Rock City Inc

Clumpies Ice Cream Team Leader (Part-Time) Job at See Rock City Inc

 ...customers in line with the organization's mission, culture, and values. Models appropriate guest and partner interaction at all times, displaying the values of the culture of excellence and leading in a manner that serves as an organizational model for the values.... 

Feyer&Associates

Virtual Travel Assistant (REMOTE) (C) Job at Feyer&Associates

 ...Work remotely from home booking itineraries, destinations and activities. This is an opportunity to work from home booking air, car,...  ...collaborative and supportive team environment, receiving guidance and assistance whenever needed. Work remotely from the comfort of your... 

Georgetown Visitation Preparatory School

Maintenance Technician Job at Georgetown Visitation Preparatory School

The school seeks a Maintenance Technician who is warm and welcoming while providing maintenance and repair services for all of the campus buildings.Key Responsibilities:~Performs general maintenance and repairs, including carpentry, locksmithing, and painting.~Maintains... 

Post Ranch Inn

Houseperson Job at Post Ranch Inn

 ...prestigious Preferred Boutique Hotel group, and hotel amenities include the Sierra Mar restaurant. This Wine Spectator Grand-Award...  ...throughout the property and Guest Experience Stays.Post Ranch Inn is also proud to offer onsite employee housing ( based on availability ).