Software Engineer - AI Tooling

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Software Engineer - AI Tooling based in Italy. As a Software Engineer on the AI Tooling team, you will help shape the next generation of AI-powered developer experiences and tools. You will design, build, and maintain intelligent agents, Model Context Protocol (MCP) servers, agent skills, and AI-powered assistants. Your work will make development platforms and products more accessible to AI agents, enabling developers to build smarter applications and workflows. You will champion an evaluation-first engineering approach, ensuring that every tool is measured against clear quality, reliability, and performance benchmarks. Working closely with Documentation, CLI, Frontend, SDK, and Infrastructure teams, you will contribute to a consistent and scalable developer experience. You will also explore emerging AI technologies, experiment with new approaches, and turn promising innovations into production-ready solutions. This is an opportunity to make a significant impact in a fast-moving, open-source-oriented environment alongside a globally distributed engineering team. Accountabilities - Design, develop, and continuously improve AI-powered developer tools, including MCP servers, intelligent agents, agent skills, and dashboard assistants. - Ensure new products and features are accessible to AI agents from launch by developing the necessary tools, skills, integrations, and evaluation frameworks. - Explore emerging AI technologies and agent architectures, rapidly prototype new solutions, assess their effectiveness, and collaborate with the team to determine which innovations are suitable for production. - Establish and promote an evaluation-first engineering culture by developing evaluation frameworks, instrumentation, and feedback loops to measure AI tool quality and effectiveness.

- Benchmark AI-powered tools against no-tool baselines, monitor performance, and define quality indicators and release criteria to prevent regressions. - Analyse how developers and AI agents interact with existing tools and translate usage insights into improvements to interfaces, documentation, and overall functionality. - Design and optimise how technical documentation and product knowledge are structured and exposed to AI agents, measuring their effectiveness and accessibility. - Develop reusable patterns and tools that enable customers to integrate AI capabilities into their own applications, including MCP integrations with Edge Functions, vector embeddings, and AI agents running on Edge Functions. - Enable cross-functional engineering teams to contribute to AI capabilities by providing clear contribution guidelines, templates, documentation, and review processes. - Centralise shared AI logic and reusable components to encourage consistency and reduce duplicated development efforts across teams. - Ensure production readiness through comprehensive testing, benchmarking, stress testing, and continuous reliability improvements. - Collaborate with AI Tooling Infrastructure engineers on service hosting, authentication, scalability, and operational reliability. - Work closely with Documentation, CLI, Frontend, SDK, and other engineering teams to deliver a seamless and consistent developer experience. - Stay informed about developments in the AI ecosystem and identify opportunities to incorporate relevant technologies and practices into the platform. Requirements: - At least 5 years of professional software engineering experience. - Strong proficiency in TypeScript and extensive knowledge of the JavaScript ecosystem, including npm, ES modules, bundlers, and compatibility considerations. - Deep familiarity with the AI ecosystem, including current tools, agent architectures, development patterns, and their practical trade-offs.