Data Engineer - GCP

EPAM NEORIS is a Digital accelerator that helps companies enter the future, having 20 years of experience as Digital Partners of some of the largest companies in the world. We have more than 4,000 professionals in 11 countries, with our multicultural startup culture where we cultivate innovation, continuous learning to create high-value solutions for our clients.

We are looking for a Data Engineer - GCP

• Data Ingestion
• + 3 years SQL (ETL, Complex Database Scripting)
• Data Extraction from various sources (Files, Plans, Excel, MS SQL / Oracle / Snowflake / Hana / SAP ECC / ERPs) (Structured Data / Unstructured Data) (At least 3 different types)
• Desirable: Spark (ETLS, Distributed Systems for High Data Volumes)

• + 3 years Python (ETLs, Pipelines) for Machine Learning
• Experience in data preparation for Data Science teams, from the review of Sources, their Cleaning, Integration and Data Transformation.
• Tagging Data Sets (Data Annotation Toolset) GCP
• Experience in Transformations for Model Types (Supervised (Labels delivered) / Unsupervised (model finds patterns))
• Experience creating data ingestion processes to models, to generate predictions.
• 2 years Data Cleansing
• Data Wrangling
• Data Cleansing
• Data Quality

• · + 2 years GCP
• · API Management, Azure Pipelines, Log Analytics, Azure Functions, Databricks, Storage – SQL Azure / CosmosDB / Table Storage / Blob Storage)
• GIT: GitHub, BitBucket.
• CI/CD, Jenkins, Azure Pipelines, Airflow.

• Spark, Hadoop, among others
• NoSQL (Mongo, Cosmos)