DevOps Engineer - AI Model Evaluator
400 $/meseMercor
Milano
- Lavoro da remoto
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving cloud platforms , Kubernetes , CI/CD systems , observability , and infrastructure automation .
- Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models to assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional DevOps , SRE , or Cloud Engineering experience.
- Experience with AWS , Azure , GCP , Kubernetes , Terraform , CI/CD pipelines , or observability tooling.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
Preferred
- Experience supporting production-scale systems.
Compensation & Legal
- $400 per accepted task
- Compensation tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Mostrare email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Offerta di lavoro pubblicata 24 giorni fa
Offerte di lavoro simili
35.000 € - 40.000 €
...seeking an MLOps & Platform Engineer to join its Industrial... ...’s application and AI platform, supporting... ...relevant experience in DevOps, cloud infrastructure,... ...systems, LLM and embedding model serving, vector... ...DNS); Support offline evaluation and testing activities...ConsigliatoImpiego permanenteLavoro ibrido- ...technical talent with leading AI research labs. Headquartered in... .... Position: Frontend Engineer Type: Contract... ...visual fidelity in detail: box model and spacing, typography (family... ..., preference-labeling, model-evaluation, or structured code-review work...ConsigliatoLavoro da remoto
Mercor
Milano6 giorni fa - ...e rischi. Impostare DevOps: IaC (Terraform/Bicep),... ...Vector DB e RAG: Azure AI Search, pgvector, Cosmos... ...integrations; Evaluate and introduce cloud technologies... ...in Computer Science, Engineering, or an equivalent field... ...: TOGAF; C4 Model; Architecture Decision...ConsigliatoLavoro ibrido
50.000 € - 70.000 €
...We are looking for an experienced Platform Engineer to join our growing team in Milan and help... ...Colosseum, one of Europe’s most powerful AI supercomputers, currently in development. Designed to run our proprietary AI models at scale, it forms the compute backbone behind...ConsigliatoSmart workingLavoro da casa58.000 € - 78.000 €
...community innovations into secure, sovereign and AI-ready solutions, SUSE empowers customers... ...-critical resilience at Platform Engineer, AI Job Description About the Role... ...Grafana or equivalent) API/AI gateway and model serving – production deployment of an API...ConsigliatoOrario flessibile36.000 €
...with Power Query and business intelligence tools (e.g., Power BI or equivalent) Familiarity with data analysis and modeling tools, and potential AI applications to improve efficiency and accuracy Why join our team: The opportunity to make an impact by building...Smart workingTempo pienoImpiego permanenteLavoro ibridoRemotoOrario flessibile48.000 € - 68.000 €
...results. As we evolve, we embrace AI as a catalyst for sharper... .... Moneyfarm’s Partners Engineering team builds and operates the... ...productivity multiplier and know how to evaluate its output critically. ~ A... ...API design, database modelling, and messaging patterns ~ Strong...Orario flessibile- ...innovative projects ranging from data platforms to AI/LLM integrations, directly contributing to... ...) Experience integrating Large Language Models (LLMs) Familiarity with data pipelines... ...What’s In It For You Hybrid working model. A supportive multicultural team...Lavoro ibrido
30000 $ - 80000 $
...– Speechify has no office. These include frontend and backend engineers, AI research scientists, and others from Amazon, Microsoft, and Google... ...responsible for all aspects of data collection to support our model training operations. We are able to build high-quality...Turni30.000 € - 45.000 €
...e gestione di progetti, in ambito IT ed Engineering. Autorizzata a tempo indeterminato per la... ...soluzioni digitali, ricerchiamo: DEVOPS ENGINEER La persona lavorerà... ...efficace in team supportati da strumenti di AI Utilizzo consapevole di strumenti di...Smart workingTempo pienoImpiego permanenteSomministrazioneLavoro ibridoOrario flessibile- ...free hiring process because the best teams are built on merit. AI at Qonto: AI is deeply embedded in how we work ( here ) -... ...it, and when to question it. Join us as a Site Reliability Engineer on our S torage team to keep the databases Qonto runs on resilient...Remoto
- ...azienda di Servizi IT con sede a Roma e Milano, operante su tutto il territorio nazionale, ricerca per importante cliente un/una AI DevOps Engineer Sede: Milano ( 2 giorni in sede e 3 giorni in remoto) Requisiti : Almeno 4 anni di esperienza nel ruolo in ambito...Tempo pienoContratto con partita IVARemoto
45.000 € - 50.000 €
...accelerate and we need you! We are looking for a hands-on DevOps / Site Reliability Engineer to join our CloudOps team and own the operational... ...growth of all employees. This role operates in a hybrid work model, combining on-site presence and remote work....Lavoro ibridoRemoto- ...Job Title: Senior System, DevOps & Software Engineer Location: Milano Employment Type: Permanent, Full‑Time Role Summary Are you... ...across 60 countries. We deliver industry-leading capabilities in AI, digital, engineering, cloud, and software services. Our...Tempo pienoImpiego permanente
- ...a far parte del nostro team in qualità di Infrastructure & AI Platform Engineer , lavorando sia sulle nostre infrastrutture sia su ForgeDoc... ...un sistema CI/CD (Jenkins, GitHub Actions, GitLab CI o Azure DevOps: i concetti sono gli stessi). Must have: hai già avuto...Part-timeImpiego permanenteLavoro ibrido
65.000 € - 75.000 €
...Chi stiamo cercando: Stiamo cercando un/una Senior Platform Engineer che voglia avere un impatto diretto e visibile sulla piattaforma... ...tracing e metriche custom. Contribuirai allo sviluppo di strumenti AI-powered per gli sviluppatori: code review automation,...Stage/TirocinioRemotoLavoro da casaTurno di pomeridianoOrario flessibile- ...realizzare workflow automatizzati e contribuire all'adozione di soluzioni AI a supporto delle Operations, del team di Finance e della Supply... ...e applicazioni interfacciate con AI - Large Language Models (OpenAI, Anthropic, Gemini) e/o framework come LangChain Progettare...Tempo pienoStage/Tirocinio
35.057 € - 57.475 €
...In Capgemini Engineering , leader mondiale nei servizi di ingegneria,... ...Progettare soluzioni di Generative AI e Machine Learning utilizzando Vertex AI, Large Language Models e servizi Google Cloud, con... ...Kubernetes, Google Kubernetes Engine, container e microservizi;...Impiego permanenteLavoro ibridoRemotoOrario flessibile- ..., trasformazione digitale, cloud adoption o platform operating model. • Conoscenza dei principali modelli di cloud governance e hybrid... ...economica. • Conoscenza dei principi di platform engineering e platform operating model, anche senza ruolo tecnico hands-on....Tempo pienoImpiego permanenteTempo determinatoLavoro ibridoRemoto
45.000 € - 55.000 €
...in Microsoft Office suite (Excel, Word, PowerPoint) Preferred: Skills in Cybersecurity Managed Services Preferred: Knowledge of AI platforms Preferred: Recognized industry certifications in Cloud Architecture, Enterprise Solutions or Security Management....Lavoro ibridoRemoto- ...artificiale, si ricerca una risorsa da inserire come Sistemista – DevOps. Cosa farai: Entrerai a far parte del nostro team tech... ...Possibilità di lavorare con team altamente specializzati su temi di AI, machine learning, NLP e automazione dei processi, con effetti di...Smart workingImpiego permanenteTempo determinatoLavoro ibridoRemoto
240 - 290 €/giorno
...di personale ICT, ricerca per proprio cliente un/una Platform AI Engineer. Full Remote La risorsa sarà focalizzata sullo sviluppo, manutenzione... ...della sicurezza dell'informazione. Esperienza con pratiche DevOps e CI/CD. Capacità di analisi, troubleshooting e problem...Tempo pienoContratto con partita IVARemoto36.000 €
...struttura di A.I. Delivery Center, nell'ufficio A.I. & GENAI Technology Platform, entrerai in un team che sviluppa e governa la piattaforma AI del Gruppo. Ti occuperai di supportare l'implementazione e l'evoluzione di componenti della piattaforma su Databricks, contribuendo...Orario flessibile- ...solving problems, building market-leading products or exploring how AI can make work smarter, you’ll have the freedom to create and the... ...reliable software delivery. Join us as a Senior Platform Engineer within the Build team , where you’ll be at the forefront of...
40.000 €
...business, normativi e metodologici in specifiche funzionali strutturate e non ambigue, utilizzabili sia dagli sviluppatori sia dagli agenti AI, garantendo allineamento tra business, Risk Management e soluzioni applicative. Quali saranno le tue attività Analizzare...Orario flessibile- ...Role: Senior System / Platform Engineer Location: Italy Experience: 5+ Years About... ...Observability and monitoring platforms DevOps and Site Reliability Engineering (SRE) practices CI/CD pipeline exposure AI-powered operations, anomaly detection, predictive...Stage/TirocinioLavoro ibrido
32.000 € - 45.000 €
...Siamo una realtà leader nel settore della consulenza Data & AI. Supportiamo le principali aziende enterprise nel loro percorso... ...di un nuovo e sfidante progetto in ambito Enterprise (settore Engineering/Manufacturing), stiamo potenziando il nostro team e siamo alla...Smart workingImpiego permanenteLavoro ibridoOrario flessibile41.000 € - 52.000 €
...digital payments. In Data, AI & Analytics Dept., we are dedicated... ...in the field of AI platform engineering. In a fast-paced... ...ENTREPRENEURSHIP - is the engine that drives us to excel, innovate... ...Flexibility: we work in a hybrid model, with autonomy over when to come...Tempo pienoLavoro ibridoTurno di pomeridianoOrario flessibile- ...Il tuo ruolo La risorsa sarà inserita all’interno del team DevOps e System Management del Cliente finale, operando su piattaforme IT... ...trasversali e metodologiche - Professional & Cognitive Skills for AI Era Capacità di analisi critica e supporto alle decisioni tecniche...Lavoro ibridoOrario flessibile
27.000 €
...oltre 6.000 professionisti impegnati nello sviluppo di soluzioni innovative per aziende e istituzioni. In Lutech tecnologia, dati e AI diventano strumenti concreti per trasformare processi, servizi ed esperienze. Attraverso competenze tecnologiche avanzate, ecosistemi...Tempo determinato
