230 matching jobs for “Pyspark Engineer”

How results work

Exact titles rank first, then title variations and keywords in descriptions. These labels aren't qualification scores. Without keywords, recently added jobs appear first.

Block

Software Engineer, Reconciliation & Reporting

Bay Area, CA, United States of America

Remote
Regular

… with cloud data warehouses (e.g., BigQuery, Snowflake) or distributed data systems and tools such as Spark/PySpark, Delta Lake, Kafka, and Hadoop. Exposure to cloud platforms (AWS, Kubernetes) and infrastructure-as-code …

Added Oct 4, 2026

Save job

RTX

Data Engineer (Puerto Rico)

US-PR-SANTA ISABEL-B1 ~ Felicia Industrial Park - St B1 ~ BLDG 1 +1 location

… data such as file shares, SharePoint repositories, images, documents, logs, and engineering artifacts. Engineer data solutions that can logically and physically segment data domains based on business rules, regulatory …

Added Oct 27, 2026

Save job

Fannie Mae

Senior Associate – Palantir Forward Deployed Engineer

Reston, Virginia, United States

Flex
Full time
Regular

Pay posted by employer$123,000–$161,000 per year

THE IMPACT YOU WILL MAKE The Senior Associate - Palantir Forward Deployed Engineer (FDE) , partners with business stakeholders, engineers, and data teams to design, develop, and deploy …

Added Oct 15, 2026

Save job

USAA

AI/ML Engineer II

Phoenix Campus (Main)

… in job offered or in a related occupation. Position requires: Programming Languages: Pandas, NumPy, PySpark, Snowflake SQL, BigQuery, HTML and CSS; Machine Learning & NLP Frameworks: Scikit-learn, XGBoost, …

Added Oct 27, 2026

Save job

Booz Allen Hamilton

Databricks Data Engineer and Scientist

Bethesda, Maryland, United States +1 location

Pay posted by employer$77,600–$176,000

Databricks Data Engineer and Scientist The Opportunity: As a Databricks Data Engineer and Scientist, you will design, build, and …

Added Oct 27, 2026

Save job

Hewlett Packard Enterprise

AI/ML Data Engineer

Bengaluru, Karnataka, India

… data (Text, all kinds of simple/complex table structures, images, video and audio data) Python, Pyspark, SQL, RDBMS Data Transformation (ETL/ELT) activities SQL Data warehouse (e.g. Snowflake) working / …

Added Nov 3, 2026

Save job

The Home Depot

Online Sr Data Engineer (SEO) - Onsite

STORE SUPPORT CENTER, ATLANTA - 9090

In person
Full time
Regular

… in Python, Google BigQuery to stitch and enrich the raw data from multiple sources Proven ability to use PySpark, AirFlow, and DataProc to engineer and automate data flows pipelines Ability to optimize the pipelines run …

Added Oct 16, 2026

Save job

Stryker

Engineer, Automations (AI/ML),Technical support

Bengaluru, Karnataka, India

… as Jira, BitBucket, and Confluence/Atlassian Wiki Experience with ETL frameworks such as Apache Airflow, PySpark, ElasticSearch Knowledge of frontend frameworks such as React, AngularJS Knowledge of infrastructure …

Added Oct 27, 2026

Save job

Palo Alto Networks

Senior Staff Data Engineer (Data & AI solutions)

Office - Israel - Petach Tikva

IDIRA by Palo Alto Networks seeks an experienced Senior Staff Data Engineer to join our AI and Data Solutions unit and champion an AI-first strategy. You will spearhead the …

Added Oct 27, 2026

Save job

Amgen

Sr. Data Engineer – Clinical Data Foundation

India - Hyderabad

Full time
Regular

… and human genetic data to push beyond what’s known today. ABOUT THE ROLE Role Description: The Sr. Data Engineer is responsible for designing, building, maintaining, analyzing, and interpreting data to provide actionable …

Added Oct 15, 2026

Save job

Tyson Foods

Lead IT Data Engineer -Onsite

Tyson Emma - Springdale, Arkansas

Full time

… Storage, Dataproc, Pub/Sub, Composer/Airflow, Dataflow, or related tools. • Experience with dbt, Python, PySpark, Spark, Terraform, CI/CD, or other modern data engineering technologies. • Experience with Power BI, …

Added Oct 27, 2026

Save job

S&P Global

Director, Distinguished Engineer - Data Platforms

Hyderabad, Telangana, India

Full time

… to support common data engineering activities such as: Code generation Code refactoring SQL optimization PySpark optimization, etc. Develop and implement context engineering practices that provide AI tools with the …

Added Oct 27, 2026

Save job

Data Engineer - Enterprise Data Lakehouse & Data Products

Bengaluru, Karnataka, India

In person

… where you can collaborate with other curious, creative 3Mers. The Impact You’ll Make in this Role As a Data Engineer, you will have the opportunity to tap into your curiosity and collaborate with some of the most innovative …

Added Oct 28, 2026

Save job

Marsh & McLennan

Oliver Wyman - Data Engineer / Senior Data Engineer - Data and Analytics (DNA) - Gurugram, India

Gurugram - Horizon

and Responsibilities We have open positions ranging from Data Engineer to Lead Data Engineer, providing talented and motivated professionals with excellent career and growth …

Added Oct 27, 2026

Save job

Amgen

Sr. Data Engineer – Clinical Data Hub

India - Hyderabad

Full time
Regular

… Skills: Hands on experience with big data technologies and platforms, such as Databricks, Apache Spark (PySpark, SparkSQL), workflow orchestration, performance tuning on big data processing Hands on experience with …

Added Oct 15, 2026

Save job

S&P Global

Azure Infrastructure & Data Engineer

Penang-Jalan, MYS

Hybrid
Full time

… Hybrid connectivity (on‑prem to Azure) Fabric end‑to‑end experience (OneLake, Lakehouse, Warehouse) Spark / PySpark experience Integration with AI/ML workloads Data governance tooling (Purview) #L1-RS2 What’s In It For You? …

Added Oct 27, 2026

Save job

Procter & Gamble

Senior Data Engineer (TOP Organization)

HYDERABAD OFFICE APAC PSC GDOP

… promoting agility and work/life balance. P&G's corporate function IT organization is seeking a Senior Data Engineer , located at the Hyderabad IT Hub. Specifically, this position works within a Data & AI group that supports …

Added Oct 27, 2026

Save job

Procter & Gamble

Data Engineer - North America Fabric Care

CINCINNATI GENERAL OFFICES

Pay posted by employer$92,000–$116,500 per year

… innovation thrives and where your technical expertise is recognized and rewarded. The Opportunity As a Data Engineer, you'll design, develop, and implement cloud-based data and analytics platforms (DAP) and pipelines that …

Added Oct 27, 2026

Save job

Databricks

Senior Specialist Solutions Engineer (Infrastructure & Platform)

London, England, United Kingdom

Senior

… would be GCP experience Recruiter: Dina Hussain As an Infrastructure & Platform Specialist Solutions Engineer, you will serve as a trusted technical advisor, helping enterprise customers with the architecture, …

Added Oct 4, 2026

Save job

Mastercard

Senior AI Engineer, Big Data & AI Solutions

Vancouver, British Columbia, Canada

Pay posted by employer$111,000–$160,000 CAD

… that help people, businesses and governments realize their greatest potential. Title and Summary Senior AI Engineer, Big Data & AI Solutions Who is Mastercard? Mastercard is a global technology company in the payments …

Added Oct 28, 2026

Save job

Block

Software Engineer, Reconciliation & Reporting

Bay Area, CA, United States of America

Remote
Regular

View job

Save job

About this opportunity

Original employer description

Since we opened our doors in 2009, the world of commerce has evolved immensely, and so has Square. After enabling anyone to take payments and never miss a sale, we saw sellers stymied by disparate, outmoded products and tools that wouldn’t work together.

So we expanded into software and started building integrated, omnichannel solutions – to help sellers sell online, manage inventory, offer buy now, pay later functionality, book appointments, engage loyal buyers, and hire and pay staff. Across it all, we’ve embedded financial services tools at the point of sale, so merchants can access a business loan and manage their cash flow in one place. Afterpay furthers our goal to provide omnichannel tools that unlock meaningful value and growth, enabling sellers to capture the next generation shopper, increase order sizes, and compete at a larger scale.

Today, we are a partner to sellers of all sizes – large, enterprise-scale businesses with complex operations, sellers just starting, as well as merchants who began selling with Square and have grown larger over time. As our sellers grow, so do our solutions. There is a massive opportunity in front of us. We’re building a significant, meaningful, and lasting business, and we are helping sellers worldwide do the same.

The Role

You will join the Recon and Reporting team, which owns our post-transaction systems: the platform responsible for reconciling money, tracing the end-to-end flow of funds, and meeting our tax and regulatory reporting obligations to merchants, customers, and authorities worldwide. Reconciliation and financial reporting are essential to running a payments business, and given our transaction volume, the projects you own will have direct, measurable impact on financial accuracy and trust.

You will help build and operate the systems that ingest and integrate global card-network settlement and report files (Visa, Mastercard, and equivalents), along with data from acquirers, processors, and banks, and reconcile them against internal payment data to power settlement, dispute, cost, tax, and regulatory reporting. You will own well-scoped projects within this platform end-to-end, with guidance from more experienced engineers. Our vision is to make reconciliation and reporting accurate, automated, and near real-time.

You Will

Own small, well-bounded projects end-to-end with guidance available: clarify requirements, design, build, test, ship, and follow up.
Build and maintain features within the ingestion and reconciliation pipelines that match card-network and partner reports against internal transaction data.
Contribute to tooling that provides end-to-end traceability of money throughout the system.
Develop features for reporting and reconciliation products that are accurate, reliable, timely, scalable, and user-friendly for both internal finance teams and external merchants.
Produce standardized journals and summaries that feed downstream accounting, audit, and analysis.
Contribute to our large-scale tax and regulatory reporting systems, including US IRS information returns (the 1099 family, issued at the scale of tens of millions of forms annually to merchants and customers) and international regimes such as EU-wide CESOP and country-specific reporting for Australia, Ireland, and Spain.
Support broader regulatory and compliance obligations (AML, KYC, and similar), with careful handling of sensitive and PII data, including TIN validation and secure form generation and filing.
Validate your work before calling it done, using code review, tests, small experiments, or usage signals, including for AI-assisted changes.
Take agency in debugging and escalating production issues across services, giving the team clear context on what changed, when it changed, how it changed, and what risk remains.
Collaborate with engineers, product managers, data analysts, and finance, tax, and compliance partners, contributing to technical design and product decisions that shape feature outcomes.
Review peers' work, apply their feedback to your own, and document learnings, including AI workflows the team can reuse.
Opportunistically improve the systems you touch when it fits your project scope, replacing manual and redundant work with automation, and route larger issues to the right owner.

You Have

3+ years of professional software or data engineering experience.
A Bachelor's degree in a technical field (Computer Science, Engineering, Mathematics, or similar) or equivalent technical experience.
Experience building or maintaining batch- or event-driven data pipelines, with exposure to workflow-orchestration technologies (e.g., Airflow, Temporal, Spark, or equivalent) and a working understanding of distributed systems.
Proficiency in at least one major programming language (e.g., Java, Python, Go) and solid SQL.
Experience delivering well-scoped projects or features end-to-end (design, build, test, ship, operate), with guidance from more experienced engineers.
Strong communication skills: you surface concerns alongside a concrete proposal, and you give teammates clear context when debugging and escalating.
Care for engineering quality, including maintainable and testable code, code review, CI/CD, and observability, appropriate for a complex, high-stakes financial environment.
Proficiency in using AI tools throughout the software development lifecycle, with the judgment to recognize where they accelerate work and where output needs additional validation.

Nice to Have

Exposure to financial, tax, regulatory, or payments reporting and reconciliation products.
Familiarity with the payments ecosystem (merchants, acquirers, card networks, and issuers/processors), including authorization, clearing, and settlement, card-network settlement file formats, or ISO-8583.
Understanding of accounting principles, double-entry bookkeeping, and financial reconciliation processes.
Experience with cloud data warehouses (e.g., BigQuery, Snowflake) or distributed data systems and tools such as Spark/PySpark, Delta Lake, Kafka, and Hadoop.
Exposure to cloud platforms (AWS, Kubernetes) and infrastructure-as-code (Terraform).
Interest in financial products and markets.

EEOC

We’re working to build a more inclusive economy where our customers have equal access to opportunity, and we strive to live by these same values in building our workplace. Block is an equal opportunity employer evaluating all employees and job applicants without regard to identity or any legally protected class. We will consider qualified applicants with arrest or conviction records for employment in accordance with state and local laws and “fair chance” ordinances.

We believe in being fair, and are committed to an inclusive interview experience, including providing reasonable accommodations to disabled applicants throughout the recruitment process. We encourage applicants to share any needed accommodations with their recruiter, who will treat these requests as confidentially as possible. Want to learn more about what we’re doing to build a workplace that is fair and square? Check out our I+D page.

While there is no specific deadline to apply for this role, U.S. roles are typically open for an average of 55 days before being filled by a successful candidate. Please refer to the date listed at the top of this job page for when this role was first posted.

Block takes a market-based approach to pay, and pay may vary depending on your location. U.S. locations are categorized into one of four zones based on a cost of labor index for that geographic area. The successful candidate’s starting pay will be determined based on job-related skills, experience, qualifications, work location, and market conditions. These ranges may be modified in the future.

To find a location’s zone designation, please refer to this resource. If a location of interest is not listed, please speak with a recruiter for additional information.

Zone A:

$142,000—$213,000 USD

Zone B:

$134,900—$202,300 USD

Zone C:

$127,800—$191,600 USD

Zone D:

$120,700—$181,100 USD

Application Guidelines

Candidates may submit up to 9 active applications within a 60-day period. Reapplications to the same role are accepted 90 days after a previous application has been reviewed.

Use of AI in Our Hiring Process

We may use automated AI tools to evaluate job applications for efficiency and consistency. These tools comply with local regulations, including bias audits, and we handle all personal data in accordance with state and local privacy laws.

Every benefit we offer is designed with one goal: empowering you to do the best work of your career while building the life you want. Remote work, medical insurance, flexible time off, retirement savings plans, and modern family planning are just some of our offering. Check out our other benefits at Block.

Block, Inc. (NYSE: XYZ) builds technology to increase access to the global economy. Each of our brands unlocks different aspects of the economy for more people. Square makes commerce and financial services accessible to sellers. Cash App is the easy way to spend, send, and store money. Afterpay is transforming the way customers manage their spending over time. TIDAL is a music platform that empowers artists to thrive as entrepreneurs. Bitkey is a simple self-custody wallet built for bitcoin. Proto is a suite of bitcoin mining products and services. Together, we’re helping build a financial system that is open to everyone.

Why this result? · Employer labels

Keywords also found in description

Position open to remote: Yes
Regular
Software Engineering

Location reference: GeoNames (CC BY 4.0), normalized by Referizz.