At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years, our innovative drive has kept us a step ahead of our customers' evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection.

Job Description
The Software Engineer Consultant II implements applications following 12-factor principles to build out the product and iterative enhancements. They partner on full stack of software products; developing and implementing frontends (web or mobile), and backend services. They leverage test driven development and continuous integration to ensure agility and quality of products. They actively participate in the decision-making process of the team ensuring that the simplest appropriate technology and design is chosen to meet user needs.

We are seeking a highly motivated Data Engineer with expertise in Apache Spark (Scala), Python, SQL, MongoDB, and Java to design, develop, and maintain scalable data processing solutions. The ideal candidate will contribute to building robust data pipelines, optimizing data platforms, and enabling analytics and business intelligence capabilities.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Apache Spark and Scala.

• Build and optimize ETL/ELT processes for large-scale structured and unstructured datasets.

• Develop data processing and automation solutions using Python and Java.

• Design and implement data models, data transformation logic, and data integration workflows.

• Work with MongoDB, relational databases, and data warehouses to manage and access data efficiently.

• Write complex and optimized SQL queries, stored procedures, and performance tuning solutions.

• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.

• Participate in daily standups, sprint planning, retrospectives, and other Agile ceremonies.

• Contribute to solution architecture, technical design discussions, and technology decisions.

• Implement data quality, validation, monitoring, and governance controls.

• Troubleshoot and resolve data pipeline failures and performance bottlenecks.

• Build and maintain CI/CD pipelines and deployment processes for data engineering solutions.

• Ensure adherence to coding standards, security policies, and best practices.

• Mentor junior engineers and share knowledge across the team.

• Support production systems and provide timely resolution to operational issues.

Primary Skills
Software Development

Shift Time

Recruiter Info
Shriya Kumari

skuow@allstate.com

About Allstate

Joining our team isn't just a job - it's an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. One where you can shape the future of protection while supporting causes that mean the most to you. Joining our team means being part of something bigger - a winning team making a meaningful impact.

The Allstate Corporation is one of the largest publicly held insurance providers in the United States. Ranked No. 84 in the 2023 Fortune 500 list of the largest United States corporations by total revenue, The Allstate Corporation owns and operates 18 companies in the United States, Canada, Northern Ireland, and India. Allstate India Private Limited, also known as Allstate India, is a subsidiary of The Allstate Corporation. The India talent center was set up in 2012 and operates under the corporation's Good Hands promise. As it innovates operations and technology, Allstate India has evolved beyond its technology functions to be the critical strategic business services arm of the corporation. With offices in Bengaluru and Pune, the company offers expertise to the parent organization's business areas including technology and innovation, accounting and imaging services, policy administration, transformation solution design and support services, transformation of property liability service design, global operations and integration, and training and transition.

Learn more about Allstate India here.