Last updated: 2025-06-06

60 Ai Performance Engineering jobs in New York City.

Hiring now: Zk Proof Engineer @ Axiom, Research Engineer @ Charactera, Software Engineer @ Quantitati, Software Engineer @ Jane Stree, Machine Learning Engineer @ Physicsx, Software Engineer Systems Ml Hpc Special @ Meta, Sr C Software Engineer @ Celonis, Sr Software Engineer @ Datadog, Software Engineer @ Captions, Principal Performance Engineer @ Writer. Explore more at at jobswithgpt.com

🔥 Skills

machine learning (14) C++ (13) performance optimization (11) Python (10) distributed systems (9) Kubernetes (8) Rust (7) CUDA (7) PyTorch (6) software engineering (6)

📍 Locations

New York City (49) Jersey City (1) Kearny (1)

Axiom

Axiom is using zero knowledge proofs to scale smart contract applications in a new way.

ZK Proof Engineer

New York City

  • Skills: zero knowledge proofs, ZK Proof Engineer, cryptographic code, Rust, C++, LLVM, performance optimization, low-level computer systems, database backends, secure systems
  • Experience: Strong background in math/cryptography or strong problem-solving skills
  • Type: Full-time
  • Salary: competitive

Character.AI

Character.AI empowers people to connect, learn and tell stories through interactive entertainment. Over 20 million people visit Character.AI every month, using…

Research Engineer

New York City

  • Skills: Machine Learning, GPU Clusters, Model Development, Triton Kernels, Distributed Systems, Reinforcement Learning, PyTorch, LLM Inference, CUDA, Kubernetes
  • Experience: PhD (or equivalent) research experience

Quantitative Trading Startup

A lean and technical startup focused on developing scalable trading applications and infrastructure for financial markets.

Software Engineer

New York City

  • Skills: quantitative trading, scalable trading applications, infrastructure development, performance optimization, multi-core communications, lock-free algorithms, run-time behavior, serialization delays, TCP/multicast handling, financial markets
  • Experience: Experience with trading systems and performance optimization
  • Type: Full-time
  • Salary: Base salary plus discretionary performance bonus and possible long-term incentives

Jane Street

A finance company that utilizes advanced technology and quantitative analysis for financial modeling and risk management.

Software Engineer

New York City

  • Skills: Software Engineer, language compilers, runtimes, performance analysis, optimization, dynamic graph systems, parallel runtimes, computation graphs, resource usage, scheduling
  • Experience: Strong experience in performance analysis and optimization
  • Type: Full-time

PhysicsX

PhysicsX is a deep-tech company of scientists and engineers, developing machine learning applications to massively accelerate physics simulations and enable a …

Machine Learning Engineer

New York City

  • Skills: machine learning, physics simulations, optimization, design engineering, numerical physics, product performance, medical devices, electric vehicles, aerospace, renewables
  • Type: Full-time

Meta

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Ap…

Software Engineer, Systems ML - HPC Specialist

New York City

  • Skills: AI, machine learning, HPC, parallel computing, CUDA, GPU programming, cuBLAS, cuDNN, AI algorithms, distributed systems
  • Experience: 2+ years of experience in HPC and parallel computing
  • Type: Full Time
  • Salary: $70.67/hour to $208,000/year + bonus + equity + benefits

Celonis

Celonis helps some of the world’s largest and most esteemed brands make processes work for people, companies and the planet. With over 5,000 enterprise custome…

Senior C++ Software Engineer

New York City

  • Skills: C++, big data, query optimization, transaction management, distributed data, performance, scalability, data processing, algorithms, database internals
  • Experience: 5+ years of hands-on software engineering experience
  • Type: Full-time
  • Salary: $192,000 - $234,000 USD

Datadog

Datadog (NASDAQ: DDOG) is a global SaaS business, delivering a rare combination of growth and profitability. We are on a mission to break down silos and solve …

Senior Software Engineer

New York City

  • Skills: scaling bottleneck, feature flags, production issue, architecture, high scale, code simplicity, data pipelines, statistics, Go, Python
  • Experience: 6+ years of experience
  • Salary: $130,000 — $300,000 USD

Captions

Captions is the leading video AI company, building the future of video creation. Over 10 million creators and businesses have used Captions to create videos fo…

Software Engineer

New York City

  • Skills: video processing, video encoding, H.264, HEVC, VP9, AV1, FFmpeg, GStreamer, Python, C++
  • Experience: Demonstrated expertise in video encoding technologies
  • Type: Full-time

Writer

Writer is seeking a highly skilled and motivated Principal Performance Engineer to lead the performance optimization of our cutting-edge Generative AI technolo…

Principal Performance Engineer

New York City

  • Skills: performance engineering, Generative AI, large-scale distributed systems, LLMs, RAG systems, performance testing, AI/ML technologies, cloud computing, NLP architectures, performance analysis tools
  • Experience: 10+ years of experience in performance engineering, with a focus on large-scale distributed systems; 2+ years of experience working with AI/ML technologies
  • Type: Full-time

DRW

DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets aro…

Research Engineer

New York City

  • Skills: software development, C++, Python, quantitative finance, algorithms, distributed computation, data acquisition, data visualization, user interfaces, multi-threaded applications
  • Salary: $175,000 to $225,000

PDT Partners

PDT Partners has a stellar 30+ year track record and a reputation for excellence. Our goal is to be the best quantitative investment manager in the world. PDT’…

Research Engineer

New York City

  • Skills: machine learning, deep learning, infrastructure, high-performance computing, scientific research, research workflows, model optimization, quantitative, signal construction, portfolio construction
  • Type: Hybrid

SCM

SCM is committed to a workplace that values and promotes diversity, inclusion and equal employment opportunity by ensuring that all employees are valued, heard…

Production-Oriented Developer

Jersey City

  • Skills: C++, Linux, multi-threaded applications, performance optimization, global trade execution, network programming, systems programming, data analysis, problem solving, shell scripts
  • Experience: A minimum of three years professional-level C++ programming experience in a Linux environment.
  • Type: Full-time
  • Salary: $100,000 - $250,000

Voleon

Voleon is a technology company that applies state-of-the-art machine-learning techniques to real-world problems in finance. For more than a decade, we have led…

Senior HPC Infrastructure Engineer

New York City

  • Skills: HPC clusters, storage, high-performance computing, Linux environments, scripting, automation, troubleshooting, system uptime, security best practices, performance optimization

Adaptive ML

Adaptive ML is building a reinforcement learning platform to tune, evaluate, and serve specialized language models. We are pioneering the development of task-s…

Member of Technical Staff

New York City

  • Skills: reinforcement learning, language models, software engineering, Python, Rust, CUDA, GPU, data pipelines, high-performance, empirical research
  • Experience: M.Sc./Ph.D. in computer science or demonstrated experience in software engineering, preferably with a focus on machine learning.
  • Type: Full time

Anthropic

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. They focus on making AI safe and beneficial for users and society.

Software Engineer

New York City

  • Skills: software engineering, machine learning, Kubernetes, Pytorch, Reinforcement learning, large-scale ML systems, GPU, security best practices, systems design, ETL
  • Experience: Significant software engineering experience
  • Type: Full-time
  • Salary: $280,000 - $485,000 USD

Cohere

Cohere is on a mission to scale intelligence to serve humanity by training and deploying frontier models for developers and enterprises who build AI systems fo…

Member of Technical Staff, Agent Infrastructure Engineer

New York City

  • Skills: software engineering, HPC environment, auto-scaling, container orchestration, distributed training, autoregressive models, Transformers, research, experimentation, AI systems
  • Type: Full time

Ellipsis Labs

Ellipsis Labs is a profitable, venture-backed New York-based startup building differentiated products and infrastructure in decentralized finance. The company …

Senior Performance Engineer

New York City

  • Skills: performance engineering, low-level systems, high-performance computing, decentralized finance, blockchain, optimization, monitoring, benchmarking, performance bottlenecks, team-first attitude
  • Experience: 3+ years
  • Type: Full time
  • Salary: $170K – $250K

FluidStack

Fluidstack is the AI Cloud Platform. We build GPU supercomputers for top AI labs, governments, and enterprises. Our customers include Mistral, Poolside, Black …

Head of Infrastructure

New York City

  • Skills: GPU clusters, infrastructure, deployment, data centers, OEMS, networking, Kubernetes, PyTorch, scalability, engineering
  • Experience: 3+ years of related experience deploying GPU clusters; 5+ years deploying infrastructure at global scale.
  • Type: Full time

Hedra

Hedra is a pioneering generative media company backed by top investors at Index, A16Z, and Abstract Ventures. We're building Hedra Studio, a multimodal creatio…

Machine Learning Engineer (CUDA)

New York City

  • Skills: CUDA, GPU, machine learning, 3DVAE, video diffusion, high-performance computing, C++, deep learning frameworks, model optimization, generative models
  • Type: Full time

Vatic Labs

Vatic Labs combines AI research, quant trading, and software engineering to build state-of-the-art algorithmic trading systems. The company is committed to hir…

Quantitative Developer

New York City

  • Skills: algorithmic trading, C++, Python, Linux, low latency, distributed computing, machine learning, statistical learning, deep learning, performance tuning
  • Experience: 2+ years
  • Type: Full-time
  • Salary: $150,000 - $350,000

Reflection AI

Technical Staff, Infrastructure

New York City

  • Skills: AI, infrastructure, GPU, scalable, high-performance, Reinforcement Learning, C++, Rust, distributed systems, production-ready
  • Experience: Extensive experience building large-scale, high-performance solutions in the AI or software engineering domain.
  • Type: Full time

Sesame

Sesame believes in a future where computers are lifelike - with the ability to see, hear, and collaborate with us in ways that feel natural and human. Our team…

ML Model Serving Engineer

New York City

  • Skills: machine learning, real-time, scalable, model serving, Kubernetes, GCP, NVIDIA H100, infrastructure, performance analysis, CI/CD
  • Experience: Deep experience in deploying and managing scalable machine learning models using modern model-serving approaches.
  • Type: Full time
  • Salary: $175K – $280K

Anti Capital

Join Our World-Class Engineering Team at Anti Capital. We cultivate a dynamic, high-energy, and entrepreneurial work culture where innovation and collaboration…

Research Infrastructure Engineer

New York City

  • Skills: Research Infrastructure, Simulation Engine, Performance Optimization, Market Data Integration, Low-latency systems, C++, Rust, Python, Distributed computing, Financial markets
  • Experience: Minimum of 4 years of experience in low-latency systems, C++/Rust/Python, and distributed computing.
  • Type: Full-time
  • Salary: $150,000 - $200,000 a year

Epic Games

Epic Games spans across 25 countries with 46 studios and 4,500+ employees globally. For over 25 years, we've been making award-winning games and engine technol…

Desktop Platform Programmer

New York City

  • Skills: C++, multi-threaded programming, performance optimization, debugging, Windows APIs, stability programming, PC hardware, graphics APIs, live-service, collaboration
  • Type: Full-time
  • Salary: $215,921 - $316,683 USD (NYC), $190,010 - $278,682 USD (CA), $172,736 - $253,347 USD (WA)

Evolutionary Scale

EvolutionaryScale’s mission is to develop artificial intelligence to understand biology for the benefit of human health and society, through open, safe, and re…

Software Engineering, Backend

New York City

  • Skills: AI model API, biologists, ML inference service, integration tests, open source, performance optimization, API design, SDK design, model inference pipelines, startup experience
  • Experience: 6+ years in software teams, 2+ years with Python
  • Salary: $150,000 to $350,000 per year

PhysicsX

PhysicsX is a deep-tech company with roots in numerical physics and Formula One, dedicated to accelerating hardware innovation at the speed of software. We are…

Senior Software Engineer

New York City

  • Skills: AI-driven, simulation, software stack, engineering, manufacturing, high-fidelity, multi-physics, Data Scientists, Machine Learning Engineers, observability

Anthropic

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a who…

Software Engineer, ML Performance and Scaling

New York City

  • Skills: machine learning, performance, scaling, supercomputing, distributed systems, GPU programming, ML frameworks, OS internals, language modeling, collaboration
  • Experience: Significant software engineering or machine learning experience, particularly at supercomputing scale
  • Type: Full-time
  • Salary: $315,000 - $560,000 USD

Hugging Face

Hugging Face is building the fastest growing platform for AI builders with over 5 million users & 100k organizations who collectively shared over 1M models, 30…

Web Machine Learning Engineer

New York City

  • Skills: Open source, machine learning, JavaScript, TypeScript, Web technologies, ONNX, quantization, WebGPU, WASM, community management
  • Type: Full-time

Ripple

At Ripple, we’re building a world where value moves like information does today. It’s big, it’s bold, and we’re already doing it. Through our crypto solutions …

Senior Engineer - Performance Engineering

New York City

  • Skills: performance testing, P2P networking, root cause analysis, cloud platforms, Linux/Unix, system metrics, collaborative environments, decentralized protocols, observability stacks, load generators
  • Experience: 8+ years of experience in software performance engineering for complex distributed systems
  • Salary: $180,000 - $202,500 USD

Aquatic Capital Management

Research Engineer

New York City

  • Skills: machine learning, software engineering, quantitative research, neural network training, distributed model training, GPU acceleration, PyTorch, JAX, numerical computing, research infrastructure
  • Experience: BS/MS/PhD in Computer Science, Applied Math, Engineering, or related field
  • Type: Full-time
  • Salary: $150,000 - $300,000

Thea Energy

Thea Energy is leveraging recent breakthroughs in stellarator physics and engineering to create a faster and simpler approach to commercializing fusion energy.…

Stellarator Coil Optimization Specialist

Kearny

  • Skills: stellarator, coil optimization, fusion energy, plasma physics, nonlinear optimization, magnetic confinement, stellarator systems, simulation, optimization techniques, fusion devices
  • Type: Full-time

Cerebrium

Cerebrium is a serverless infrastructure platform that makes it easy for companies to build and scale data/AI workloads. It is backed by world-class investors …

ML/AI Developer Advocate

New York City

  • Skills: ML, AI, developer community, scaling, CPU, GPU, documentation, tutorials, community engagement, distributed systems
  • Experience: 3+ years
  • Type: Full-time
  • Salary: $60 - $130 / 0.10% - 0.20%

Arena AI

Arena AI is redefining the future of hardware engineering with autonomous AI solutions, building the world's first AI industrial engineer called Atlas.

Software Engineer

New York City

  • Skills: AI, hardware, distributed systems, scalable architecture, multimodal data, large models, performance optimization, cloud platforms, hardware testing, engineering workflows
  • Experience: 5+ years in software development, distributed systems, platform engineering, or related fields
  • Salary: $150,000 - $225,000 per year

Cloudflare

Cloudflare is a large-scale technology company dedicated to building a better Internet by providing network services that improve performance and security for …

Distributed Systems Engineer - Workers AI Platform

New York City

  • Skills: distributed systems, load balancing, scheduling, resource sharing, cloudflare, AI inference, Rust, Typescript, container platform, scaling
  • Experience: Strong systems-level programming skills, experience building large-scale distributed systems, expertise in languages like Rust, Go, or modern C++
  • Type: Full-time

Hebbia

The user interface for universal knowledge capture. We want every atom of information that our users need to be at their fingertips.

Platform Engineer, Staff

New York City

  • Skills: backend engineering, distributed systems, performance optimization, cloud platforms, scalable system design, data structures, algorithms, Python, Java, Go
  • Type: full_time
  • Salary: {'min': 190000.0, 'max': 250000.0, 'period': 'annual', 'currency': 'USD'}

Assembled

Assembled builds the infrastructure that underpins exceptional customer support, empowering companies like CashApp, Etsy, and Robinhood to deliver faster, bett…

AI Agent Software Engineer - Agent Performance Engineering

New York City

  • Skills: AI evaluation systems, data pipelines, AI model optimization, evaluation infrastructure, knowledge automation, retrieval systems, prompt optimization, automated benchmarking, evaluation frameworks, vector databases
  • Type: full_time
  • Salary: {'min': 150000.0, 'max': 300000.0, 'period': 'annual', 'currency': 'USD'}

Captions

Captions is the leading video AI company, building the future of video creation. Over 10 million creators and businesses have used Captions to create videos fo…

Principal Engineer

New York City

  • Skills: distributed systems, cloud infrastructures, Kubernetes, Python, C++, Java, Rust, scalability, performance, fault tolerance
  • Type: full_time
  • Salary: {'min': None, 'max': None, 'period': '', 'currency': ''}

Anti Capital

We are a leading full-stack, high-frequency proprietary trading firm strategically located in New York, Taipei, and Singapore. Our company is equipped with a p…

Algo Developer (C++)

New York City

  • Skills: C++, algorithmic trading, latency-sensitive, high-frequency trading, performance optimization, backtesting, simulation, multithreading, statistical modeling, real-time systems
  • Type: full_time
  • Salary: {'min': 100000.0, 'max': 150000.0, 'period': 'annual', 'currency': 'USD'}

Aptos

Aptos is a people-first blockchain on a mission to help billions of people achieve universal and fair access to decentralized assets in a safe and scalable way.

Software Engineer

New York City

  • Skills: blockchain, Move language, virtual machine, performance optimization, security measures, programming languages, Rust, C++, systems programming, code reviews
  • Type: full_time
  • Salary: {'min': 180000.0, 'max': 300000.0, 'period': 'annual', 'currency': 'USD'}