About Groq
Inference is the engine that powers AI, and Groq was built from the silicon up to deliver the world's fastest inference at scale. We pioneered the LPU—the first processor designed specifically for AI inference—and are transforming that innovation into a global cloud platform powering production AI workloads.
With the capital, infrastructure, and team to execute, we're uniquely positioned to define the next era of AI infrastructure. The opportunity is massive, and it's still wide open. Now let's go build it!
Mission:
Help shape the future of AI inference by building the platform capabilities that enable developers and enterprises to bring AI applications to life at scale. As a Sr. Staff Product Manager, you'll own product strategy and execution for critical areas of Groq's AI Inference Platform, turning complex infrastructure challenges into scalable, reliable, and intuitive product experiences.
You'll work at the intersection of AI infrastructure, cloud technology, and distributed systems, partnering closely with Engineering and cross-functional teams to define what we build and drive it from concept to delivery. This is an opportunity to influence product direction across the platform, and take hands-on ownership of products that make high-performance AI inference more accessible to customers.
Location: This role will be based in one of our three hiring hubs: the Dallas, San Francisco, or New York City area. The person hired for this role must be based in one of these three areas. You’ll have the flexibility to work remotely while we establish our local Groq office, with the expectation that this role will transition to onsite once the office opens.
Responsibilities & opportunities in this role:
- Drive hands-on product definition and delivery, translating customer needs, technical constraints, and business priorities into detailed specifications, feature requirements, success metrics, and execution plans from concept through launch and continuous improvement.
- Bring deep AI infrastructure and cloud platform expertise to complex platform initiatives, contributing to technical specifications, architecture discussions, and roadmap priorities across multiple product workstreams.
- Partner closely with Platform Engineering, Distributed Systems, Cloud Infrastructure, Reliability Engineering, Hardware Engineering, and customer-facing teams to deliver scalable, reliable, and customer-centric platform capabilities.
- Partner with engineering leadership to navigate technical tradeoffs and balance customer impact, technical investments, platform scalability, and long-term architectural evolution.
- Shape customer-facing cloud capabilities, including inference APIs, developer workflows, and platform experiences, that turn complex infrastructure into services that are easy to adopt, deploy, and scale.
- Define and prioritize internal platform investments across cloud infrastructure, resource management, observability, and platform optimization to improve scalability, reliability, operational efficiency, and infrastructure utilization.
- Lead customer discovery with enterprise AI customers and developers to understand inference workloads, deployment workflows, performance expectations, operational challenges, and emerging infrastructure needs.
- Measure product adoption, customer experience, and platform performance using customer feedback, telemetry, and operational metrics to continuously improve customer outcomes.
- Collaborate with Sales, Solutions Engineering, Customer Success, and Marketing to support product launches, customer adoption, and go-to-market initiatives.
- Monitor the evolving AI inference and cloud infrastructure landscape to identify emerging technologies, customer needs, and opportunities for product differentiation.
- Communicate product strategy, roadmap, priorities, risks, and progress to executive leadership and cross-functional stakeholders.
Ideal candidates have/are:
- 10+ years of Product Management experience, including at least 5 years leading highly technical platform, infrastructure, or cloud products.
- Deep domain expertise and demonstrated ownership of technically complex products in AI inference, cloud infrastructure, or related environments such as inference engines, LLM serving platforms, neoclouds, or AI cloud services.
- Strong understanding of distributed systems, cloud infrastructure, APIs, Kubernetes, observability, platform reliability, capacity planning, and multi-region architectures.
- Proven ability to independently define and deliver complex technical products, including developing specifications, prioritizing features, and driving execution with engineering teams.
- Strong technical judgment and a track record of partnering with senior engineering leaders to translate customer needs into product strategy, influence architectural decisions, and deliver scalable infrastructure capabilities.
- Highly self-directed and comfortable navigating ambiguity, making decisions, and driving progress with minimal oversight.
- Strong analytical and problem-solving skills with a data-driven approach to prioritization and decision-making.
- Excellent written and verbal communication skills, with the ability to influence engineering teams, cross-functional stakeholders, and executive leadership.
- Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
Preferred experience includes:
- Familiarity with infrastructure utilization, fleet scheduling, capacity forecasting, cloud economics, and platform operations.
- Experience with consumption-based cloud services for enterprise customers, AI accelerators, or hardware and system bring-up.
Why Join Us
- Purposeful Hiring: You’re not here by accident, and neither is anyone else. Every teammate is handpicked with intention because who we build with matters.
- Builders Wanted: You’re not just riding the rocket ship, you’re building it. Your work directly shapes the trajectory of our company.
- Mission-Driven Work: We’re here to make a real impact. Our mission fuels everything we do.
- Tackling Hard Problems: If easy isn’t your thing, you’re in the right place. We solve some of the most complex and exciting challenges in our space.
- Excellence Is The Standard: High performance isn’t just encouraged, it’s the baseline. And it’s contagious.
If this sounds like you, we’d love to hear from you!
Compensation
Groq is committed to providing competitive compensation through our Total Cash philosophy, which incorporates potential bonus value directly into base pay. The total cash salary range for this position, which is inclusive of the potential bonus value, is $310,400 - $365200, with individual placement determined by your geographic location, experience, skills, and alignment with internal compensation standards. This range is specific to candidates located in the United States. Compensation for international candidates will vary based on local market dynamics. Beyond cash compensation, Groq also offers a Long-Term Incentive (LTI) Program and a robust suite of employee benefits.
#LI-MS1
US Job Posting
This position may require access to technology and/or information subject to U.S. export control laws and regulations, including the Export Administration Regulations (EAR). To comply with these requirements, candidates for this role must meet certain citizenship or residency criteria. Specifically, they must qualify as U.S. Persons for export control purposes (i.e., U.S. citizen, U.S. lawful permanent resident (Green Card holder), or a protected individual under 8 U.S.C. § 1324b(a)(3) such as a refugee or asylee), or otherwise be eligible for an applicable export license.
Non-US Job Postings
This position may require access to technology and/or information subject to U.S. export control laws and regulations, as well as applicable local laws and regulations, including the Export Administration Regulations (EAR). To comply with these requirements, candidates for this role must meet all relevant export control eligibility criteria.
Groq is an Equal Opportunity Employer. We are committed to creating an inclusive environment for all employees and applicants. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex (including gender identity, sexual orientation, and pregnancy), age, disability, genetic information, protected veteran status, or any other characteristic protected by applicable law.
Groq complies with all applicable federal, state, and local laws governing nondiscrimination in employment. We do not tolerate discrimination or harassment based on any protected characteristic.
Groq is committed to working with and providing reasonable accommodations to qualified individuals with physical or mental disabilities. If you require a reasonable accommodation to complete an application or to participate in the hiring process, please contact us at talent@groq.com. This contact is for accommodation requests only, which will be considered on a case-by-case basis.
All offers of employment are contingent upon verification of the applicant’s identity and employment authorization in accordance with federal law.
Groq encourages people with criminal record histories to apply for employment, and values diverse experiences, including prior contact with the criminal legal system. To that end, Groq welcomes such applicants in accordance with the California Fair Chance Act, Los Angeles City Fair Chance Act Ordinance, Los Angeles County Fair Chance Act Ordinance, and San Francisco Fair Chance Act Ordinance. Philadelphia applicants can review information pertaining to Philadelphia’s Fair Criminal Record Screening Standards Ordinance here: https://www.phila.gov/documents/fair-chance-hiring-law-poster.
As part of our hiring process, Groq may use artificial intelligence (“AI”) tools or automated systems to assist with activities such as reviewing applications, evaluating qualifications, scheduling interviews, analyzing assessment responses, or supporting recruiting operations. These tools are designed to assist—not replace—human decision-making, and hiring decisions are subject to human review. We may process information you provide during the application process, including resumes, application materials, interview responses, assessments, and, where applicable, audio, video, or transcript data. If legally required, we will request consent before using technologies that analyze biometric or video interview data. Candidates may request reasonable accommodations, an alternative evaluation process, additional information regarding the use of AI in the hiring process, or review of certain automated decisions by contacting ta-operations@groq.com.
