DevOps Engineer - AI Model Evaluator
400 $/meseMercor
- Lavoro da remoto
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving cloud platforms , Kubernetes , CI/CD systems , observability , and infrastructure automation .
- Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models to assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional DevOps , SRE , or Cloud Engineering experience.
- Experience with AWS , Azure , GCP , Kubernetes , Terraform , CI/CD pipelines , or observability tooling.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
Preferred
- Experience supporting production-scale systems.
Compensation & Legal
- $400 per accepted task
- Compensation tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Mostrare email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
- .... The Mission The Site Reliability Engineering team is the backbone of Kong’s cloud services... ...Inc., a leading developer of API and AI connectivity technologies, is building the... ...the flow of intelligence across APIs and AI models. For more information, visit...Consigliato
50.000 € - 70.000 €
...are looking for an experienced Platform Engineer to join our growing team in Milan and help... ...Colosseum, one of Europe’s most powerful AI supercomputers, currently in development.... ...Designed to run our proprietary AI models at scale, it forms the compute backbone behind...ConsigliatoSmart workingLavoro da casa36.000 €
...with Power Query and business intelligence tools (e.g., Power BI or equivalent) Familiarity with data analysis and modeling tools, and potential AI applications to improve efficiency and accuracy Why join our team: The opportunity to make an impact by building...ConsigliatoSmart workingTempo pienoImpiego permanenteLavoro ibridoRemotoOrario flessibile48.000 € - 68.000 €
...results. As we evolve, we embrace AI as a catalyst for sharper... .... Moneyfarm’s Partners Engineering team builds and operates the... ...productivity multiplier and know how to evaluate its output critically. ~ A... ...API design, database modelling, and messaging patterns ~ Strong...ConsigliatoOrario flessibile- ...sell more sustainably. We’ve built a unique AI-powered, product-centric platform that... ...understand the business needs and the business model. Collaborate cross-functionally with... ...in early-stage startups or small engineering teams Familiarity with Docker, CDK, and...ConsigliatoTempo pienoStage/Tirocinio
40.000 € - 100.000 €
...firms and companies with a world-class AI product that saves time, boosts productivity... ...of core product features: from data modelling to deployment. Optimize database performance... ..., reliable API contracts. Uphold engineering standards through code reviews, testing,...Lavoro ibridoRemotoOrario flessibile30.000 € - 45.000 €
...e gestione di progetti, in ambito IT ed Engineering. Autorizzata a tempo indeterminato per la... ...soluzioni digitali, ricerchiamo: DEVOPS ENGINEER La persona lavorerà... ...efficace in team supportati da strumenti di AI Utilizzo consapevole di strumenti di...Smart workingTempo pienoImpiego permanenteSomministrazioneLavoro ibridoOrario flessibile- ...azienda di Servizi IT con sede a Roma e Milano, operante su tutto il territorio nazionale, ricerca per importante cliente un/una AI DevOps Engineer Sede: Milano ( 2 giorni in sede e 3 giorni in remoto) Requisiti : Almeno 4 anni di esperienza nel ruolo in ambito...Tempo pienoContratto con partita IVARemoto
- ...Job Title: Senior System, DevOps & Software Engineer Location: Milano Employment Type: Permanent, Full‑Time Role Summary Are you... ...across 60 countries. We deliver industry-leading capabilities in AI, digital, engineering, cloud, and software services. Our...Tempo pienoImpiego permanente
45.000 € - 50.000 €
...accelerate and we need you! We are looking for a hands-on DevOps / Site Reliability Engineer to join our CloudOps team and own the operational... ...growth of all employees. This role operates in a hybrid work model, combining on-site presence and remote work....Lavoro ibridoRemoto65.000 € - 75.000 €
...Chi stiamo cercando: Stiamo cercando un/una Senior Platform Engineer che voglia avere un impatto diretto e visibile sulla piattaforma... ...tracing e metriche custom. Contribuirai allo sviluppo di strumenti AI-powered per gli sviluppatori: code review automation,...Stage/TirocinioRemotoLavoro da casaTurno di pomeridianoOrario flessibile- ...realizzare workflow automatizzati e contribuire all'adozione di soluzioni AI a supporto delle Operations, del team di Finance e della Supply... ...e applicazioni interfacciate con AI - Large Language Models (OpenAI, Anthropic, Gemini) e/o framework come LangChain Progettare...Tempo pienoStage/Tirocinio
- ...Gamma Innovation è alla ricerca di un Software Engineer Cloud-native | AI & DevOps Modalità di lavoro: Full Remote Durata progetto: Settembre 2026 – Settembre 2027 Contratto: Tempo determinato (non sono previste collaborazioni freelance) Per un importante...Libero professionistaRemoto
40.000 €
...Esperienza nella gestione di database cloud-native, serverless e servizi AI/ML Conoscenza delle best practice di sicurezza cloud (IAM,... ...AWS Certified Solutions Architect Esperienza con DevOps e CI/CD pipelines Familiarità con Edge Computing e Hybrid Cloud...Lavoro ibrido36.000 €
...struttura di A.I. Delivery Center, nell'ufficio A.I. & GENAI Technology Platform, entrerai in un team che sviluppa e governa la piattaforma AI del Gruppo. Ti occuperai di supportare l'implementazione e l'evoluzione di componenti della piattaforma su Databricks, contribuendo...Orario flessibile34.000 € - 40.000 €
...We are looking for a passionate Platform Engineer to join our Team in Milan and help us... ...cloud platforms. Required Skills DevOps mindset. You are passionate about improving... ...to backend services when needed. AI-assisted Engineering. You are familiar...Remoto- ...solving problems, building market-leading products or exploring how AI can make work smarter, you'll have the freedom to create and the... ...reliable software delivery. Join us as a Senior Platform Engineer within the Build team , where you’ll be at the forefront of...Tempo pieno
- ...artificiale, si ricerca una risorsa da inserire come Sistemista – DevOps. Cosa farai: Entrerai a far parte del nostro team tech... ...Possibilità di lavorare con team altamente specializzati su temi di AI, machine learning, NLP e automazione dei processi, con effetti di...Smart workingImpiego permanenteTempo determinatoLavoro ibridoRemoto
50.000 € - 60.000 €
...architetture containerizzate ➕ Esperienza in ambito Data Platform, AI o Modern Applications ➕ Familiarità con framework di... ...Architect Expert Costituiscono un plus: • AWS Certified DevOps Engineer – Professional • AWS Certified Security – Specialty • Windows...Impiego permanenteLavoro ibridoRemoto32.000 € - 45.000 €
...Siamo una realtà leader nel settore della consulenza Data & AI. Supportiamo le principali aziende enterprise nel loro percorso... ...di un nuovo e sfidante progetto in ambito Enterprise (settore Engineering/Manufacturing), stiamo potenziando il nostro team e siamo alla...Smart workingImpiego permanenteLavoro ibridoOrario flessibile75.000 €
...automotive manufacturers, and we're evolving that foundation into an AI-native platform. Our products help dealer groups and... ...Deep knowledge of at least one cloud provider, ideally AWS SRE/DevOps instincts baked in, not bolted on Infrastructure as Code fluency...Lavoro ibridoOrario flessibile250 €/giorno
...nazionale ed internazionale, per ampliamento del team cerca un* CLOUD DEVOPS da inserire nel nostro team Infrastructure. La risorsa ideale... ...Requisiti • Esperienza di 3-5 anni in ruoli DevOps/Cloud Engineer • Esperienza con almeno una piattaforma cloud tra AWS, GCP e...Tempo pienoLibero professionistaLavoro ibridoRemoto- ....g., Tableau, Looker, or PowerBI) and advanced Excel/Google Sheets skills (Pivot tables, VLOOKUPs, data modeling) to audit partner performance and attribution models. Commercial Grit: Demonstrated ability to negotiate and structure diverse commercial deals, including...Lavoro da casaTurno di mattina
34.000 € - 40.000 €
...Randstad Digital è alla ricerca di una risorsa in ambito AI & Data Integration per un importante cliente internazionale. Se possiedi solide competenze in ambito data visualization e intelligenza artificiale, questa è l’opportunità ideale per far evolvere la tua carriera...Tempo pienoSomministrazioneLavoro ibrido35.057 € - 57.465 €
...Architect (.NET e Microservices) In Capgemini Engineering, leader mondiale nei servizi di... ...e processi di automazione tramite Azure DevOps e Infrastructure as Code. Monitorare performance... ...aziende, che sfrutta la potenza dell’AI per offrire valore ai propri clienti....Impiego permanenteRemotoOrario flessibile30000 $ - 80000 $
...around the globe work on Speechify in a 100% distributed setting – Speechify has no office. These include frontend and backend engineers, AI research scientists, and others from Amazon, Microsoft, and Google, leading PhD programs like Stanford, high growth startups like...38.000 € - 48.000 €
...quo, and turn bold ideas into results. As we evolve, we embrace AI as a catalyst for sharper thinking, smarter decisions, and even... ...please upload your CV in English In this role you will be Scala engineer in a cross-functional development team. Likely technical...Tempo pienoOrario flessibile- ...boundaries and robust, predictable APIs. This is what enables AI agents and automations to work reliably across the stack. You... ...that values mentorship, thoughtful code reviews, and blameless engineering. If you’re early in your career, curious about backend systems...Lavoro ibrido
30.814,29 € - 45.300 €
...assistenza, e-commerce, progettazione, prodotti digitali, dati e AI per creare una crescita centrata sul cliente. Entra a far parte... ...in team multidisciplinari, seguendo metodologie Agile e DevOps La retribuzione prevista in Accenture viene definita sulla base...39.000 € - 54.000 €
...artificial intelligence (AI), exploring its... ...functional teams (frontend, DevOps, QA); Participate in... ...degree in computer science, Engineering, or a related field;... ...- is the engine that drives us to excel... ...: we work in a hybrid model, with autonomy over when...Tempo pienoLavoro ibridoTurno di pomeridianoOrario flessibile
