LLM Researcher - Pointfive

Design & develop SLM for endpoint devices [laptops] Design & develop a model router using endpoint state Design rigorous evaluation methodologies for API-based coding agents, with and without access to external tools. Build statistically sound benchmarks that measure cost, latency, accuracy, reliability, and developer productivity. Develop novel techniques for optimizing agent context, retrieval, memory, and tool interactions while preserving correctness. Design and analyze large-scale experimental campaigns using production APIs across multiple foundation models. Build reusable research infrastructure, datasets, simulators, and evaluation frameworks for agentic systems. Publish technical reports and contribute research findings that influence both product direction and the broader AI community. Collaborate closely with engineering teams to translate research into production-ready optimization systems. Stay at the forefront of advances in LLMs, agent architectures, retrieval systems, and AI evaluation methodologies. PhD or equivalent research experience in Computer Science, Machine Learning, Mathematics, Statistics, or a related quantitative field. Strong background in experimental design, statistical analysis, and empirical evaluation. Excellent programming skills in Python and/or Go, with experience building research infrastructure. Demonstrated ability to conduct independent research and communicate findings through publications, technical reports, or open-source projects. Deep understanding of modern LLMs, retrieval systems, or AI agents. Experience working with API-based foundation models such as Claude, GPT, Gemini, or similar systems. Publications in machine learning, systems, information retrieval, software engineering, or AI evaluation. Experience designing benchmarks, datasets, or evaluation frameworks. Familiarity with developer tools, coding assistants, or software engineering workflows. Experience with distributed experimentation and large-scale data analysis. Founders with a track recordBuilt and sold IntSights to Rapid7. Backed by top-tier investors with deep conviction in this category. Category-defining productBuilding AI systems that reduce engineering waste and improve the efficiency of software development through measurable optimization. Research with real-world impactYour work will be validated on production-scale workloads, influence shipping products, and shape how next-generation coding agents are evaluated. Opportunity to define a new research fieldHelp establish the benchmarks, methodologies, and scientific standards for evaluating and optimizing API-based coding agents—an area that is only beginning to emerge.

Design & develop SLM for endpoint devices [laptops] Design & develop a model router using endpoint state Design rigorous evaluation methodologies for API-based coding agents, with and without access to external tools. Build statistically sound benchmarks that measure cost, latency, accuracy, reliability, and developer productivity. Develop novel techniques for optimizing agent context, retrieval, memory, and tool interactions while preserving correctness. Design and analyze large-scale experimental campaigns using production APIs across multiple foundation models. Build reusable research infrastructure, datasets, simulators, and evaluation frameworks for agentic systems. Publish technical reports and contribute research findings that influence both product direction and the broader AI community. Collaborate closely with engineering teams to translate research into production-ready optimization systems. Stay at the forefront of advances in LLMs, agent architectures, retrieval systems, and AI evaluation methodologies. PhD or equivalent research experience in Computer Science, Machine Learning, Mathematics, Statistics, or a related quantitative field. Strong background in experimental design, statistical analysis, and empirical evaluation. Excellent programming skills in Python and/or Go, with experience building research infrastructure. Demonstrated ability to conduct independent research and communicate findings through publications, technical reports, or open-source projects. Deep understanding of modern LLMs, retrieval systems, or AI agents. Experience working with API-based foundation models such as Claude, GPT, Gemini, or similar systems. Publications in machine learning, systems, information retrieval, software engineering, or AI evaluation. Experience designing benchmarks, datasets, or evaluation frameworks. Familiarity with developer tools, coding assistants, or software engineering workflows. Experience with distributed experimentation and large-scale data analysis. Founders with a track recordBuilt and sold IntSights to Rapid7. Backed by top-tier investors with deep conviction in this category. Category-defining productBuilding AI systems that reduce engineering waste and improve the efficiency of software development through measurable optimization. Research with real-world impactYour work will be validated on production-scale workloads, influence shipping products, and shape how next-generation coding agents are evaluated. Opportunity to define a new research fieldHelp establish the benchmarks, methodologies, and scientific standards for evaluating and optimizing API-based coding agents—an area that is only beginning to emerge.

Design & develop SLM for endpoint devices [laptops] Design & develop a model router using endpoint state Design rigorous evaluation methodologies for API-based coding agents, with and without access to external tools. Build statistically sound benchmarks that measure cost, latency, accuracy, reliability, and developer productivity. Develop novel techniques for optimizing agent context, retrieval, memory, and tool interactions while preserving correctness. Design and analyze large-scale experimental campaigns using production APIs across multiple foundation models. Build reusable research infrastructure, datasets, simulators, and evaluation frameworks for agentic systems. Publish technical reports and contribute research findings that influence both product direction and the broader AI community. Collaborate closely with engineering teams to translate research into production-ready optimization systems. Stay at the forefront of advances in LLMs, agent architectures, retrieval systems, and AI evaluation methodologies. PhD or equivalent research experience in Computer Science, Machine Learning, Mathematics, Statistics, or a related quantitative field. Strong background in experimental design, statistical analysis, and empirical evaluation. Excellent programming skills in Python and/or Go, with experience building research infrastructure. Demonstrated ability to conduct independent research and communicate findings through publications, technical reports, or open-source projects. Deep understanding of modern LLMs, retrieval systems, or AI agents. Experience working with API-based foundation models such as Claude, GPT, Gemini, or similar systems. Publications in machine learning, systems, information retrieval, software engineering, or AI evaluation. Experience designing benchmarks, datasets, or evaluation frameworks. Familiarity with developer tools, coding assistants, or software engineering workflows. Experience with distributed experimentation and large-scale data analysis. Founders with a track recordBuilt and sold IntSights to Rapid7. Backed by top-tier investors with deep conviction in this category. Category-defining productBuilding AI systems that reduce engineering waste and improve the efficiency of software development through measurable optimization. Research with real-world impactYour work will be validated on production-scale workloads, influence shipping products, and shape how next-generation coding agents are evaluated. Opportunity to define a new research fieldHelp establish the benchmarks, methodologies, and scientific standards for evaluating and optimizing API-based coding agents—an area that is only beginning to emerge.