Vaga de Engenheiro de Dados em São Paulo - SP - Projeto Maior

Veja a descrição da vaga e candidate-se!

Engenheiro de Dados

Postada em 5 de janeiro de 2022
Localização
Contrato
CLT (Efetivo)
Remuneração
de R$0,01 até R$0,01
Benefícios
a combinar
Descrição
FUNDADA EM 2003, COM A VOCAÇÃO DE APOIAR EMPRESAS QUE SE UTILIZAM DE OUTSOURCING EM TI, DISPONIBILIZANDO INTELIGÊNCIA & TECNOLOGIA. COM 18 ANOS DE ATUAÇÃO EM UM MERCADO DINÂMICO E INOVADOR, SOMOS RECONHECIDOS POR NOSSOS CLIENTES E COLABORADORES PELA QUALIDADE E CONFIABILIDADE DE NOSSOS SERVIÇOS. ESSE RECONHECIMENTO É REFLEXO DE VALORES QUE CULTIVAMOS, COMO RESPONSABILIDADE, PROFISSIONALISMO, FLEXIBILIDADE E TRANSPARÊNCIA. ESTAMOS ALTAMENTE CAPACITADOS A ATENDER TODAS AS DEMANDAS DO CLIENTE EM RELAÇÃO A SOFTWARE, HARDWARE E CONECTIVIDADE, COM A PREOCUPAÇÃO DE ADEQUAR AS MELHORES SOLUÇÕES TECNOLÓGICAS PARA NOSSOSPARCEIROS. DESCRIÇÃO DA VAGA Company is building solutions usingdata lakes and business analysis in international companies, using the AWSstack, and other technologies including Tableau, PowerBI and top data analyticstechnologies, and we are now hiring a full-time dedicated data engineer to joinour team. This professional will build and maintain ELT data processes in thedata lake, taking customer requirements and analysis to develop new processes,and ensure data security and data modelling with all market best practices. RESPONSABILIDADES EATRIBUIÇÕES * Build and maintain data, reporting and analytics processes for an AWS data lake * Manage AWS solutions and infrastructure for data, supporting developments * Act as an advisor to senior management on technical questions and research * Develop auxiliary routines to monitor the environments (jobs, applications, queries) * Help on architect decisions and in the data pipeline construction * Develop and deploy ETL/ELT jobs, consuming data from different types of data sources * Develop, run and maintain load tests * Bugs and data fixes, addressing root cause analysis for continuous improvement * Evolution of data schemas and documentation to delivery business value REQUISITOS E QUALIFICAÇÕES * Apache NiFi for data ingestion and data flow automation. * 2+ years of working experience using AWS Cloud, configuration and monitoring knowledge (EC2, Security, * CloudFormation), and specially for Big Data Services SQS, S3, RDS, EC2, Athena, Glue, EMR; * 2+ years of working experience in Datalake or DW projects * Experience with cloud computing, as well scalability and performance problems * Experience with Unix/Linux environments, data pipelines and database modelling * Working experience with BigData, open standards and open source technologies * Expert in SQL and RDBMS including performance optimizations, preferable PostgreSQL * Knowledge on NoSQL databases like MongoDB or AWS DocumentDB. * Practical knowledge of functional programming. * Practical knowledge of Data Lake, S3 or Hadoop. * Practical knowledge of Unstructured and Structured Data formats. * Good knowledge of programming in Python. * Distributed data processing using Apache Spark on AWS EMR.
Compartilhe essa vaga: