Custom Software Engineer

Project Role : Custom Software Engineer
Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work.
Must have skills : PySpark
Good to have skills : NA
Minimum 3 year(s) of experience is required
Educational Qualification : 15 years full time education

Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to effectively migrate and deploy data across various systems, contributing to the overall efficiency and reliability of data management within the organization. Roles & Responsibilities: -Develop and maintain ETL pipelines using PySpark for data ingestion, transformation, and aggregation. -Write optimized and reusable PySpark code to process large-scale datasets. -Work with structured and unstructured data sources (CSV, JSON, Parquet, Avro, relational DBs, etc.). -Optimize Spark jobs for scalability, reliability, and performance. -Collaborate with data engineers, analysts, and business stakeholders to deliver clean and reliable datasets. -Implement data quality checks, monitoring, and logging for pipelines. -Work with cloud storage and big data frameworks (HDFS, Hive, Delta Lake, S3, ADLS, BigQuery). -Apply best practices for code versioning (Git), testing, and CI/CD deployment. -Document design, workflows, and technical solutions. Professional & Technical Skills: - Must To Have Skills: Proficiency in PySpark. - Strong understanding of data modeling and database design principles. - Work with cloud storage and big data frameworks (HDFS, Hive, Delta Lake, S3, ADLS, BigQuery). - Experience with ETL tools and processes. - Familiarity with cloud platforms such as AWS or Azure. - Knowledge of data warehousing concepts and technologies. Additional Information: - The candidate should have minimum 5 years of experience in PySpark. - This position is based at our Bengaluru office. - A 15 years full time education is required.

15 years full time education

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.

Visit us at www.accenture.com