Last updated: 2025-06-06
60 Ai Performance Engineering jobs in New York City.
Hiring now: Zk Proof Engineer @ Axiom, Research Engineer @ Charactera, Software Engineer @ Quantitati, Software Engineer @ Jane Stree, Machine Learning Engineer @ Physicsx, Software Engineer Systems Ml Hpc Special @ Meta, Sr C Software Engineer @ Celonis, Sr Software Engineer @ Datadog, Software Engineer @ Captions, Principal Performance Engineer @ Writer. Explore more at at jobswithgpt.com
🔥 Skills
machine learning (14)
C++ (13)
performance optimization (11)
Python (10)
distributed systems (9)
Kubernetes (8)
Rust (7)
CUDA (7)
PyTorch (6)
software engineering (6)
📍 Locations
New York City (49)
Jersey City (1)
Kearny (1)
Axiom
Axiom is using zero knowledge proofs to scale smart contract applications in a new way.
ZK Proof Engineer
New York City
- Skills: zero knowledge proofs, ZK Proof Engineer, cryptographic code, Rust, C++, LLVM, performance optimization, low-level computer systems, database backends, secure systems
- Experience: Strong background in math/cryptography or strong problem-solving skills
- Type: Full-time
- Salary: competitive
Character.AI
Character.AI empowers people to connect, learn and tell stories through interactive entertainment. Over 20 million people visit Character.AI every month, using…
Research Engineer
New York City
- Skills: Machine Learning, GPU Clusters, Model Development, Triton Kernels, Distributed Systems, Reinforcement Learning, PyTorch, LLM Inference, CUDA, Kubernetes
- Experience: PhD (or equivalent) research experience
Quantitative Trading Startup
A lean and technical startup focused on developing scalable trading applications and infrastructure for financial markets.
Software Engineer
New York City
- Skills: quantitative trading, scalable trading applications, infrastructure development, performance optimization, multi-core communications, lock-free algorithms, run-time behavior, serialization delays, TCP/multicast handling, financial markets
- Experience: Experience with trading systems and performance optimization
- Type: Full-time
- Salary: Base salary plus discretionary performance bonus and possible long-term incentives
Jane Street
A finance company that utilizes advanced technology and quantitative analysis for financial modeling and risk management.
Software Engineer
New York City
- Skills: Software Engineer, language compilers, runtimes, performance analysis, optimization, dynamic graph systems, parallel runtimes, computation graphs, resource usage, scheduling
- Experience: Strong experience in performance analysis and optimization
- Type: Full-time
PhysicsX
PhysicsX is a deep-tech company of scientists and engineers, developing machine learning applications to massively accelerate physics simulations and enable a …
Machine Learning Engineer
New York City
- Skills: machine learning, physics simulations, optimization, design engineering, numerical physics, product performance, medical devices, electric vehicles, aerospace, renewables
- Type: Full-time
Meta
Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Ap…
Software Engineer, Systems ML - HPC Specialist
New York City
- Skills: AI, machine learning, HPC, parallel computing, CUDA, GPU programming, cuBLAS, cuDNN, AI algorithms, distributed systems
- Experience: 2+ years of experience in HPC and parallel computing
- Type: Full Time
- Salary: $70.67/hour to $208,000/year + bonus + equity + benefits
Celonis
Celonis helps some of the world’s largest and most esteemed brands make processes work for people, companies and the planet. With over 5,000 enterprise custome…
Senior C++ Software Engineer
New York City
- Skills: C++, big data, query optimization, transaction management, distributed data, performance, scalability, data processing, algorithms, database internals
- Experience: 5+ years of hands-on software engineering experience
- Type: Full-time
- Salary: $192,000 - $234,000 USD
Datadog
Datadog (NASDAQ: DDOG) is a global SaaS business, delivering a rare combination of growth and profitability. We are on a mission to break down silos and solve …
Senior Software Engineer
New York City
- Skills: scaling bottleneck, feature flags, production issue, architecture, high scale, code simplicity, data pipelines, statistics, Go, Python
- Experience: 6+ years of experience
- Salary: $130,000 — $300,000 USD
Captions
Captions is the leading video AI company, building the future of video creation. Over 10 million creators and businesses have used Captions to create videos fo…
Software Engineer
New York City
- Skills: video processing, video encoding, H.264, HEVC, VP9, AV1, FFmpeg, GStreamer, Python, C++
- Experience: Demonstrated expertise in video encoding technologies
- Type: Full-time
Writer
Writer is seeking a highly skilled and motivated Principal Performance Engineer to lead the performance optimization of our cutting-edge Generative AI technolo…
Principal Performance Engineer
New York City
- Skills: performance engineering, Generative AI, large-scale distributed systems, LLMs, RAG systems, performance testing, AI/ML technologies, cloud computing, NLP architectures, performance analysis tools
- Experience: 10+ years of experience in performance engineering, with a focus on large-scale distributed systems; 2+ years of experience working with AI/ML technologies
- Type: Full-time
DRW
DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets aro…
Research Engineer
New York City
- Skills: software development, C++, Python, quantitative finance, algorithms, distributed computation, data acquisition, data visualization, user interfaces, multi-threaded applications
- Salary: $175,000 to $225,000
PDT Partners
PDT Partners has a stellar 30+ year track record and a reputation for excellence. Our goal is to be the best quantitative investment manager in the world. PDT’…
Research Engineer
New York City
- Skills: machine learning, deep learning, infrastructure, high-performance computing, scientific research, research workflows, model optimization, quantitative, signal construction, portfolio construction
- Type: Hybrid
SCM
SCM is committed to a workplace that values and promotes diversity, inclusion and equal employment opportunity by ensuring that all employees are valued, heard…
Production-Oriented Developer
Jersey City
- Skills: C++, Linux, multi-threaded applications, performance optimization, global trade execution, network programming, systems programming, data analysis, problem solving, shell scripts
- Experience: A minimum of three years professional-level C++ programming experience in a Linux environment.
- Type: Full-time
- Salary: $100,000 - $250,000
Voleon
Voleon is a technology company that applies state-of-the-art machine-learning techniques to real-world problems in finance. For more than a decade, we have led…
Senior HPC Infrastructure Engineer
New York City
- Skills: HPC clusters, storage, high-performance computing, Linux environments, scripting, automation, troubleshooting, system uptime, security best practices, performance optimization
Adaptive ML
Adaptive ML is building a reinforcement learning platform to tune, evaluate, and serve specialized language models. We are pioneering the development of task-s…
Member of Technical Staff
New York City
- Skills: reinforcement learning, language models, software engineering, Python, Rust, CUDA, GPU, data pipelines, high-performance, empirical research
- Experience: M.Sc./Ph.D. in computer science or demonstrated experience in software engineering, preferably with a focus on machine learning.
- Type: Full time
Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. They focus on making AI safe and beneficial for users and society.
Software Engineer
New York City
- Skills: software engineering, machine learning, Kubernetes, Pytorch, Reinforcement learning, large-scale ML systems, GPU, security best practices, systems design, ETL
- Experience: Significant software engineering experience
- Type: Full-time
- Salary: $280,000 - $485,000 USD
Cohere
Cohere is on a mission to scale intelligence to serve humanity by training and deploying frontier models for developers and enterprises who build AI systems fo…
Member of Technical Staff, Agent Infrastructure Engineer
New York City
- Skills: software engineering, HPC environment, auto-scaling, container orchestration, distributed training, autoregressive models, Transformers, research, experimentation, AI systems
- Type: Full time
Ellipsis Labs
Ellipsis Labs is a profitable, venture-backed New York-based startup building differentiated products and infrastructure in decentralized finance. The company …
Senior Performance Engineer
New York City
- Skills: performance engineering, low-level systems, high-performance computing, decentralized finance, blockchain, optimization, monitoring, benchmarking, performance bottlenecks, team-first attitude
- Experience: 3+ years
- Type: Full time
- Salary: $170K – $250K
FluidStack
Fluidstack is the AI Cloud Platform. We build GPU supercomputers for top AI labs, governments, and enterprises. Our customers include Mistral, Poolside, Black …
Head of Infrastructure
New York City
- Skills: GPU clusters, infrastructure, deployment, data centers, OEMS, networking, Kubernetes, PyTorch, scalability, engineering
- Experience: 3+ years of related experience deploying GPU clusters; 5+ years deploying infrastructure at global scale.
- Type: Full time
Hedra
Hedra is a pioneering generative media company backed by top investors at Index, A16Z, and Abstract Ventures. We're building Hedra Studio, a multimodal creatio…
Machine Learning Engineer (CUDA)
New York City
- Skills: CUDA, GPU, machine learning, 3DVAE, video diffusion, high-performance computing, C++, deep learning frameworks, model optimization, generative models
- Type: Full time
Vatic Labs
Vatic Labs combines AI research, quant trading, and software engineering to build state-of-the-art algorithmic trading systems. The company is committed to hir…
Quantitative Developer
New York City
- Skills: algorithmic trading, C++, Python, Linux, low latency, distributed computing, machine learning, statistical learning, deep learning, performance tuning
- Experience: 2+ years
- Type: Full-time
- Salary: $150,000 - $350,000
Reflection AI
Technical Staff, Infrastructure
New York City
- Skills: AI, infrastructure, GPU, scalable, high-performance, Reinforcement Learning, C++, Rust, distributed systems, production-ready
- Experience: Extensive experience building large-scale, high-performance solutions in the AI or software engineering domain.
- Type: Full time
Sesame
Sesame believes in a future where computers are lifelike - with the ability to see, hear, and collaborate with us in ways that feel natural and human. Our team…
ML Model Serving Engineer
New York City
- Skills: machine learning, real-time, scalable, model serving, Kubernetes, GCP, NVIDIA H100, infrastructure, performance analysis, CI/CD
- Experience: Deep experience in deploying and managing scalable machine learning models using modern model-serving approaches.
- Type: Full time
- Salary: $175K – $280K
Anti Capital
Join Our World-Class Engineering Team at Anti Capital. We cultivate a dynamic, high-energy, and entrepreneurial work culture where innovation and collaboration…
Research Infrastructure Engineer
New York City
- Skills: Research Infrastructure, Simulation Engine, Performance Optimization, Market Data Integration, Low-latency systems, C++, Rust, Python, Distributed computing, Financial markets
- Experience: Minimum of 4 years of experience in low-latency systems, C++/Rust/Python, and distributed computing.
- Type: Full-time
- Salary: $150,000 - $200,000 a year
Epic Games
Epic Games spans across 25 countries with 46 studios and 4,500+ employees globally. For over 25 years, we've been making award-winning games and engine technol…
Desktop Platform Programmer
New York City
- Skills: C++, multi-threaded programming, performance optimization, debugging, Windows APIs, stability programming, PC hardware, graphics APIs, live-service, collaboration
- Type: Full-time
- Salary: $215,921 - $316,683 USD (NYC), $190,010 - $278,682 USD (CA), $172,736 - $253,347 USD (WA)
Evolutionary Scale
EvolutionaryScale’s mission is to develop artificial intelligence to understand biology for the benefit of human health and society, through open, safe, and re…
Software Engineering, Backend
New York City
- Skills: AI model API, biologists, ML inference service, integration tests, open source, performance optimization, API design, SDK design, model inference pipelines, startup experience
- Experience: 6+ years in software teams, 2+ years with Python
- Salary: $150,000 to $350,000 per year
PhysicsX
PhysicsX is a deep-tech company with roots in numerical physics and Formula One, dedicated to accelerating hardware innovation at the speed of software. We are…
Senior Software Engineer
New York City
- Skills: AI-driven, simulation, software stack, engineering, manufacturing, high-fidelity, multi-physics, Data Scientists, Machine Learning Engineers, observability
Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a who…
Software Engineer, ML Performance and Scaling
New York City
- Skills: machine learning, performance, scaling, supercomputing, distributed systems, GPU programming, ML frameworks, OS internals, language modeling, collaboration
- Experience: Significant software engineering or machine learning experience, particularly at supercomputing scale
- Type: Full-time
- Salary: $315,000 - $560,000 USD
Hugging Face
Hugging Face is building the fastest growing platform for AI builders with over 5 million users & 100k organizations who collectively shared over 1M models, 30…
Web Machine Learning Engineer
New York City
- Skills: Open source, machine learning, JavaScript, TypeScript, Web technologies, ONNX, quantization, WebGPU, WASM, community management
- Type: Full-time
Ripple
At Ripple, we’re building a world where value moves like information does today. It’s big, it’s bold, and we’re already doing it. Through our crypto solutions …
Senior Engineer - Performance Engineering
New York City
- Skills: performance testing, P2P networking, root cause analysis, cloud platforms, Linux/Unix, system metrics, collaborative environments, decentralized protocols, observability stacks, load generators
- Experience: 8+ years of experience in software performance engineering for complex distributed systems
- Salary: $180,000 - $202,500 USD
Aquatic Capital Management
Research Engineer
New York City
- Skills: machine learning, software engineering, quantitative research, neural network training, distributed model training, GPU acceleration, PyTorch, JAX, numerical computing, research infrastructure
- Experience: BS/MS/PhD in Computer Science, Applied Math, Engineering, or related field
- Type: Full-time
- Salary: $150,000 - $300,000
Thea Energy
Thea Energy is leveraging recent breakthroughs in stellarator physics and engineering to create a faster and simpler approach to commercializing fusion energy.…
Stellarator Coil Optimization Specialist
Kearny
- Skills: stellarator, coil optimization, fusion energy, plasma physics, nonlinear optimization, magnetic confinement, stellarator systems, simulation, optimization techniques, fusion devices
- Type: Full-time
Cerebrium
Cerebrium is a serverless infrastructure platform that makes it easy for companies to build and scale data/AI workloads. It is backed by world-class investors …
ML/AI Developer Advocate
New York City
- Skills: ML, AI, developer community, scaling, CPU, GPU, documentation, tutorials, community engagement, distributed systems
- Experience: 3+ years
- Type: Full-time
- Salary: $60 - $130 / 0.10% - 0.20%
Arena AI
Arena AI is redefining the future of hardware engineering with autonomous AI solutions, building the world's first AI industrial engineer called Atlas.
Software Engineer
New York City
- Skills: AI, hardware, distributed systems, scalable architecture, multimodal data, large models, performance optimization, cloud platforms, hardware testing, engineering workflows
- Experience: 5+ years in software development, distributed systems, platform engineering, or related fields
- Salary: $150,000 - $225,000 per year
Cloudflare
Cloudflare is a large-scale technology company dedicated to building a better Internet by providing network services that improve performance and security for …
Distributed Systems Engineer - Workers AI Platform
New York City
- Skills: distributed systems, load balancing, scheduling, resource sharing, cloudflare, AI inference, Rust, Typescript, container platform, scaling
- Experience: Strong systems-level programming skills, experience building large-scale distributed systems, expertise in languages like Rust, Go, or modern C++
- Type: Full-time
Hebbia
The user interface for universal knowledge capture. We want every atom of information that our users need to be at their fingertips.
Platform Engineer, Staff
New York City
- Skills: backend engineering, distributed systems, performance optimization, cloud platforms, scalable system design, data structures, algorithms, Python, Java, Go
- Type: full_time
- Salary: {'min': 190000.0, 'max': 250000.0, 'period': 'annual', 'currency': 'USD'}
Assembled
Assembled builds the infrastructure that underpins exceptional customer support, empowering companies like CashApp, Etsy, and Robinhood to deliver faster, bett…
AI Agent Software Engineer - Agent Performance Engineering
New York City
- Skills: AI evaluation systems, data pipelines, AI model optimization, evaluation infrastructure, knowledge automation, retrieval systems, prompt optimization, automated benchmarking, evaluation frameworks, vector databases
- Type: full_time
- Salary: {'min': 150000.0, 'max': 300000.0, 'period': 'annual', 'currency': 'USD'}
Captions
Captions is the leading video AI company, building the future of video creation. Over 10 million creators and businesses have used Captions to create videos fo…
Principal Engineer
New York City
- Skills: distributed systems, cloud infrastructures, Kubernetes, Python, C++, Java, Rust, scalability, performance, fault tolerance
- Type: full_time
- Salary: {'min': None, 'max': None, 'period': '', 'currency': ''}
Anti Capital
We are a leading full-stack, high-frequency proprietary trading firm strategically located in New York, Taipei, and Singapore. Our company is equipped with a p…
Algo Developer (C++)
New York City
- Skills: C++, algorithmic trading, latency-sensitive, high-frequency trading, performance optimization, backtesting, simulation, multithreading, statistical modeling, real-time systems
- Type: full_time
- Salary: {'min': 100000.0, 'max': 150000.0, 'period': 'annual', 'currency': 'USD'}
Aptos
Aptos is a people-first blockchain on a mission to help billions of people achieve universal and fair access to decentralized assets in a safe and scalable way.
Software Engineer
New York City
- Skills: blockchain, Move language, virtual machine, performance optimization, security measures, programming languages, Rust, C++, systems programming, code reviews
- Type: full_time
- Salary: {'min': 180000.0, 'max': 300000.0, 'period': 'annual', 'currency': 'USD'}