230 matching jobs for “Pyspark Engineer”

How results work

Exact titles rank first, then title variations and keywords in descriptions. These labels aren't qualification scores. Without keywords, recently added jobs appear first.

Amgen

Sr Associate IS Engineer, Commercialization Technology

India - Hyderabad

Full time
Regular

The Sr Associate IS Engineer will be focused on data foundations and emerging AI technologies by assisting in designing, developing, and …

Added Oct 15, 2026

Save job

Amgen

Sr. Associate Full Stack Software Engineer

India - Hyderabad

Full time
Regular

… us and transform the lives of patients while transforming your career. Senior Associate Full Stack Software Engineer What you will do Let’s do this. Let’s change the world. In this vital role you will be responsible for …

Added Oct 15, 2026

Save job

Nvidia

Data Application Engineer, Enterprise Data Management

Santa Clara, California, United States

We are inviting a highly motivated and experienced Enterprise Data Management – Data Application Engineer (Supply Chain) to join our Business Applications group. This function plays a vital role in our mission to …

Added Oct 27, 2026

Save job

Bristol-Myers Squibb

Data Solutions Engineer II , Enabling Functions Data

Hyderabad - TS - IN

Full time
Regular

… managing scalable data pipelines. Strong experience in Databricks development and optimization , including PySpark/SQL, cluster and job configuration, performance tuning, and implementing production-grade data pipelines. …

Added Oct 15, 2026

Save job

State Street

Offensive AI Engineer – Frontier AI Security & Testing, VP

North Quincy, Massachusetts +6 locations

Full time

Pay posted by employer$120,000–$202,500

Offensive AI Engineer – Frontier AI Security & Testing Who we are looking for State Street Global Cybersecurity (GCS) is looking …

Added Oct 27, 2026

Save job

Block

Security Engineer - Network Edge Security

Bay Area, CA, United States of America

Remote
Regular

… monitoring, Be flexible with respect to computer languages as we use Java, Kotlin, Python, TypeScript, PySpark and others as needed or appropriate Evaluate and build integrations with vendor systems that may be used in …

Added Oct 16, 2026

Save job

RTX

Sr Engineer, Applied Machine Learning (Onsite)

Troy, Ohio, United States

… Collins Landing Systems is looking for an experienced, highly motivated Senior Applied Machine Learning Engineer to join our Data and Analytics Team focused on supporting our Wheels and Brakes product line. Relying on a …

Added Oct 30, 2026

Save job

Bristol-Myers Squibb

Senior Manager, Data Engineer, Clinical Operations

Princeton - NJ - US

Full time
Regular

Pay posted by employer$153,770–$186,327

As a Senior Manager, Data Engineer, you will play a vital role in supporting the broader Data Engineering community to deliver cutting-edge …

Added Oct 15, 2026

Save job

State Street

Lead Software Engineer – Investment Analytics, VP - State Street Investment Management

Boston, Massachusetts, United States +1 location

Full time

Pay posted by employer$110,000–$188,750

… Will Be Responsible For Design, build, and optimize scalable applications and data pipelines using Python, PySpark, and SQL on Databricks (AWS). Partner with business stakeholders to understand financial data, analytics …

Added Oct 27, 2026

Save job

General Motors

2027 Summer Intern, AI/ML Engineer, Mapping

Warren, Michigan, United States

Hybrid
Full time
Internship

… as Azure Databricks and Google Cloud Platform. Develop scripts to manage data workflows using Python or PySpark Analyze large datasets to discover trends and patterns Present complex information using data visualization …

Added Oct 12, 2026

Save job

Workday

Senior Full Stack Software Engineer - Agent Platform

Atlanta, Georgia, United States +1 location

Flex
Full time

As a Full Stack Engineer in the PCC team, you’ll help build the user-facing and platform experiences that increase trust AI agents …

Added Oct 27, 2026

Save job

Databricks

Sr. Forward Deployed Engineer (FDE) - Public Sector/National Security

Washington, District of Columbia, United States

Remote
Senior

Pay posted by employer$182,000–$250,208 USD

As a Sr. Forward Deployed Engineer (FDE), you will work with federal government customers to build and productionize solutions to their data & …

Added Oct 4, 2026

Save job

General Motors

2027 Summer Intern, AI/ML Engineer, Mapping (Masters)

Warren, Michigan, United States

Hybrid
Full time
Internship

Added Oct 16, 2026

Save job

Marsh & McLennan

Oliver Wyman - Lead Data Engineer - Data and Analytics (DNA) - Gurugram, India

Gurugram - Horizon

and Responsibilities We have open positions ranging from Data Engineer to Lead Data Engineer, providing talented and motivated professionals with excellent career and growth …

Added Oct 27, 2026

Save job

State Street

Analytics Engineer, Assistant Vice President, State Street Investment Management

Kraków, Poland

Full time

… building and maintaining ETL pipelines in platforms such as Databricks with proficiency in Python, SQL and PySpark and a solid understanding of data modelling best practices Experience owning production reliability, …

Added Oct 27, 2026

Save job

RTX

Principal Engineer, Data Analytics and Machine Learning (Hybrid - Aguadilla, PR)

US-PR-AGUADILLA-110 ~ Rd 110 N Km 28.8 ~ RD110

… The Global Engineering & Technology Center in Puerto Rico (GETC-PR) is seeking a seasoned Principal Engineer with advanced skills in Data Analytics and Machine Learning and a strong background in mechanical systems …

Added Oct 27, 2026

Save job

Bristol-Myers Squibb

PD Senior Engineer – Model Lifecycle, Sustainability and MLOps, Pharmaceutical Product Development

Hyderabad - TS - IN

Full time
Regular

… Kubernetes, GitHub Actions, Azure DevOps, Lakehouse Monitoring, Evidently AI Strong expertise in Python, PySpark and knowledge of Machine Learning – skLearn, PyTorch Practical hands-on expertise in data drift and model …

Added Oct 15, 2026

Save job

State Street

Senior Software Engineer, VP – Cloud, Data & Integration, Collateral Management

Quincy, Massachusetts, United States

Full time

Pay posted by employer$120,000–$202,500

… degradation. Modernize legacy Spark/Scala/Hadoop workloads by transitioning data processing workflows to PySpark on Azure Databricks. Architect and implement event driven integration solutions and near-real-time data …

Added Oct 27, 2026

Save job

RTX

Principal Engineer, Integrated Product Analytics Innovation Lead (Remote)

US-CT-REMOTE

… of experience Experience in performing data analysis using Python, including libraries such as Pandas or PySpark Experience in performing statistical analysis to evaluate data completeness and validity Experience …

Added Oct 29, 2026

Save job

Travelers

Data Engineer I - Cloud Data Modernization - AWS, Databricks, DBT, SQL, AI

Hartford, Connecticut, United States +1 location

Hybrid
Full time
Regular

Pay posted by employer$112,000–$184,800

… constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer, you will play a key role in growing and transforming our analytics landscape. In addition to your strong …

Added Oct 27, 2026

Save job

Amgen

Sr Associate IS Engineer, Commercialization Technology

India - Hyderabad

Full time
Regular

View job

Save job

Basic Qualifications · employer excerpt

Master’s / Bachelor's degree and 5 to 8 years of Computer Science, IT or related field experience OR

About this opportunity

Original employer description

Career Category

Engineering

Job Description

The Sr Associate IS Engineer will be focused on data foundations and emerging AI technologies by assisting in designing, developing, and maintaining foundational data engineering solutions that meet business needs and ensuring the availability and performance of critical systems.

You will be part of a team specifically focused on Amgen’s Commercialization business. Amgen is using fully integrated and best-in-class technologies, having various enterprise platforms such as AWS, Databricks, Salesforce, Planisware and Anaplan; enterprise collaboration platforms such as O365, SharePoint Online and MS Teams, as well as vertical-specific platforms in R&D, Operations, Process Development and Commercial/Marketing areas.

The candidate should also have experience with large, diverse and globally dispersed teams within a matrixed organization. Extensive collaboration with global cross functional teams is required to ensure seamless integration and operational excellence. The ideal candidate will have a strong background in the end-to-end software development lifecycle, strong experience with data integration, and be a Scaled Agile practitioner.

Roles & Responsibilities:

Design, develop, and maintain data solutions for data generation, collection, and processing
Be a key team member that assists in design and development of the data pipeline
Create data pipelines and ensure data quality by implementing ETL processes to migrate and deploy data across systems
Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions
Work with the team to troubleshoot and resolve technical issues. Identify and fix bugs and defects
Develop and optimize data models, ETL processes, and workflows across structured and unstructured data sources.
Take ownership of data pipeline projects from inception to deployment, manage scope, timelines, and risks
Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency
Implement data security and privacy measures to protect sensitive data
Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions
Collaborate and communicate effectively with product teams
Collaborate with Architects, Business SMEs, and Data Scientists to design and develop end-to-end data pipelines to meet fast paced business needs across geographic regions
Identify and resolve complex data-related challenges
Adhere to best practices for coding, testing, and designing reusable code/component
Explore new tools and technologies that will help to improve ETL platform performance
Participate in sprint planning meetings and provide estimations on technical implementation
Ensure data security, compliance, and role-based access control across data environments.

Basic Qualifications:

Master’s / Bachelor's degree and 5 to 8 years of Computer Science, IT or related field experience OR

Must have Skills:

Hands-on experience with data technologies and platforms, such as Databricks, Apache Spark (PySpark, SparkSQL), workflow orchestration, performance tuning

Proficiency in data analysis tools (eg. SQL)

Solid understanding of data modeling, schema design and data pipeline orchestration.

Experience with ETL tools such as Apache Spark, and various Python packages related to data processing, machine learning model development

Strong understanding of data modeling, data warehousing, and data integration concepts
Demonstrated ability to design, build, and test automation workflows
Strong understanding of web services, databases, and ETL concepts

Eagerness to learn and grow in an engineering environment
Ability to work well within a team and communicate effectively
Working experience in Agile or Scrum methodologies

Good-to-Have Skills:

Experience with Software engineering best-practices, including but not limited to version control, infrastructure-as-code, CI/CD, and automated testing
Understanding of data governance frameworks, tools, and best practices.
Knowledge of data protection regulations and compliance requirements (e.g., GDPR)
Familiarity with vector databases for semantic search and embeddings-based retrieval.
Exposure to knowledge graph technologies (e.g., Neo4j, AWS Neptune, RDF/SPARQL, graph data modeling).
Experience working with Large Language Models (LLMs) or Generative AI systems, particularly in retrieval-augmented generation (RAG) or data augmentation contexts.
Understanding of MLOps or DataOps principles, including CI/CD for data workflows.
Ability to collaborate in cross-functional teams and communicate complex technical concepts clearly
Certifications related to Agile or any software or cloud platform are advantageous
Experience with automation tools or platforms (e.g. Microsoft Power Automate, UiPath, PowerShell, or similar)

Soft Skills:

Excellent analytical and troubleshooting skills
Comfortable to work effectively with global, virtual teams
High degree of initiative and self-motivation

Why this result? · Employer labels

Keywords also found in description

Full time
IS
Regular

Location reference: GeoNames (CC BY 4.0), normalized by Referizz.